2024-09-21T10:20:00.581 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T10:20:00.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T10:20:00.705 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803 branch: wip-guits-main-2024-09-21-0813 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7913803' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-21-0813 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-21-0813 sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3041 sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-21-0813 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLLT50vdBQT8/JvT7tVfyv4CExx5PBDRTB/4acTGTOKQ2xJr4lLa3cGhKVvH0WvCObgRx6kt3al/xEIj/7vKNMA= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIG6H0oB6CqKc8trZBktersx679X4JRf4W/uqUmS8FAnHX+omY8n4ERonMN2JrF2kMgRF4+vq8qt9/aUZuiYxuk= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/gabrioux/src/git.ceph.com_ceph-c_wip-guits-main-2024-09-21-0813/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_10:07:29 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-21T10:20:00.705 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa; will attempt to use it 2024-09-21T10:20:00.705 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks 2024-09-21T10:20:00.706 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T10:20:00.707 INFO:teuthology.task.internal:Checking packages... 2024-09-21T10:20:00.727 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5c1cdc3c470dae78e91a0ed2bcf13509a046d301' 2024-09-21T10:20:00.727 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:20:00.727 INFO:teuthology.packaging:ref: None 2024-09-21T10:20:00.727 INFO:teuthology.packaging:tag: None 2024-09-21T10:20:00.727 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-21-0813 2024-09-21T10:20:00.728 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:20:00.728 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-21-0813 2024-09-21T10:20:00.874 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5103.g5c1cdc3c 2024-09-21T10:20:00.875 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T10:20:00.884 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T10:20:00.884 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T10:20:00.920 INFO:teuthology.task.internal:Saving configuration 2024-09-21T10:20:00.938 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T10:20:00.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T10:20:00.975 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 10:15:16.612574', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLLT50vdBQT8/JvT7tVfyv4CExx5PBDRTB/4acTGTOKQ2xJr4lLa3cGhKVvH0WvCObgRx6kt3al/xEIj/7vKNMA='} 2024-09-21T10:20:00.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 10:15:16.613781', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIG6H0oB6CqKc8trZBktersx679X4JRf4W/uqUmS8FAnHX+omY8n4ERonMN2JrF2kMgRF4+vq8qt9/aUZuiYxuk='} 2024-09-21T10:20:00.996 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T10:20:01.006 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-21T10:20:01.006 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-21T10:20:01.007 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T10:20:01.068 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0f7f1c280>, signals=[15]) 2024-09-21T10:20:01.068 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T10:20:01.079 INFO:teuthology.task.internal:Opening connections... 2024-09-21T10:20:01.079 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:20:01.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:20:01.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T10:20:01.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:20:01.233 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T10:20:01.244 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-21T10:20:01.262 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-21T10:20:01.262 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-21T10:20:01.319 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-21T10:20:01.319 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-21T10:20:01.319 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-21T10:20:01.319 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-21T10:20:01.319 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T10:20:01.320 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T10:20:01.321 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-21T10:20:01.342 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-21T10:20:01.360 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-21T10:20:01.360 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-21T10:20:01.416 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T10:20:01.417 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T10:20:01.418 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-21T10:20:01.434 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T10:20:01.445 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T10:20:01.457 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T10:20:01.458 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-21T10:20:01.460 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-21T10:20:01.476 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T10:20:01.487 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T10:20:01.487 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-21T10:20:01.518 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-21T10:20:01.540 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T10:20:01.599 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T10:20:01.624 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T10:20:01.624 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T10:20:01.624 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T10:20:01.625 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T10:20:01.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:20:01.641 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-21T10:20:01.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:20:01.641 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-21T10:20:01.697 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-503.el9.x86_64 2024-09-21T10:20:01.698 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.14.0-503.el9.x86_64 2024-09-21T10:20:01.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-09-21T10:20:01.699 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-21T10:20:01.700 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-21T10:20:01.700 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-21T10:20:04.546 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.3 MB 00:01 2024-09-21T10:20:06.498 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.3 MB 00:03 2024-09-21T10:20:08.458 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T10:20:10.613 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-21T10:20:13.317 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 6.5 MB 00:00 2024-09-21T10:20:14.859 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-21T10:20:15.613 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T10:20:16.880 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-21T10:20:18.781 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-21T10:20:19.551 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T10:20:21.778 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 3.3 kB/s | 1.7 kB 00:00 2024-09-21T10:20:23.776 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T10:20:23.776 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T10:20:23.869 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:20:23.883 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:20:23.883 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-21T10:20:23.884 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:20:23.885 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-21T10:20:23.885 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-21T10:20:23.885 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:20:24.220 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 463 kB/s | 36 kB 00:00 2024-09-21T10:20:24.804 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-21T10:20:24.957 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T10:20:25.246 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 31 MB/s | 35 MB 00:01 2024-09-21T10:20:25.680 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-21T10:20:25.680 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:20:25.680 INFO:teuthology.orchestra.run.smithi060.stdout:Total 44 MB/s | 79 MB 00:01 2024-09-21T10:20:26.392 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:20:26.781 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:20:26.781 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:20:26.839 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T10:20:26.839 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T10:20:26.942 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:20:26.951 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:20:26.952 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:20:26.952 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-21T10:20:26.952 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:20:26.952 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 79 M 2024-09-21T10:20:26.952 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 126 M 2024-09-21T10:20:26.952 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:20:27.192 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 314 kB/s | 36 kB 00:00 2024-09-21T10:20:27.795 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:20:27.795 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:20:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:20:30.426 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-09-21T10:20:31.053 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T10:20:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T10:20:33.886 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T10:20:34.010 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T10:20:39.141 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T10:20:39.186 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:20:39.517 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.3 MB/s | 29 MB 00:12 2024-09-21T10:20:43.375 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-21T10:20:43.375 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:20:43.375 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-21T10:20:44.057 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:20:44.333 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:20:44.401 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:20:44.401 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:20:45.390 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:20:45.391 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:20:47.893 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:20:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T10:20:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T10:20:51.385 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T10:20:51.513 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T10:20:56.352 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T10:20:56.388 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:01.209 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:23.303 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:23.345 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:23.634 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:23.634 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T10:21:23.634 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T10:21:23.634 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T10:21:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:21:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:21:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T10:21:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T10:21:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T10:21:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T10:21:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:21:24.522 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:21:24.867 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T10:21:24.960 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T10:21:24.961 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T10:21:24.961 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T10:21:24.961 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T10:21:24.961 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T10:21:24.961 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-21T10:21:24.962 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T10:21:24.962 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T10:21:25.020 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T10:21:25.020 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T10:21:25.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-21T10:21:25.052 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-21T10:21:25.052 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-21T10:21:25.052 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-21T10:21:25.052 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-21T10:21:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:21:25.054 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T10:21:25.054 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T10:21:25.054 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T10:21:25.054 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-21T10:21:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:21:25.054 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T10:21:25.055 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T10:21:25.055 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-508.el9.x86_64 2024-09-21T10:21:25.055 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T10:21:25.695 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-21T10:21:27.041 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T10:21:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-21T10:21:27.072 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-21T10:21:27.086 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.1nlpNIahuU 2024-09-21T10:21:27.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1nlpNIahuU 2024-09-21T10:21:27.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.1nlpNIahuU 2024-09-21T10:21:27.291 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.1nlpNIahuU is 6KB 2024-09-21T10:21:27.339 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.1nlpNIahuU 2024-09-21T10:21:27.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T10:21:27.417 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T10:21:27.417 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T10:21:27.417 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T10:21:27.417 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T10:21:27.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T10:21:27.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-21T10:21:39.014 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:39.053 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T10:21:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T10:21:39.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T10:21:40.251 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T10:21:40.251 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:21:40.251 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:21:40.251 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T10:21:40.252 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T10:21:40.252 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T10:21:40.252 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T10:21:40.252 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:21:40.252 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:21:40.591 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T10:21:40.673 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T10:21:40.673 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T10:21:40.673 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T10:21:40.673 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T10:21:40.673 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T10:21:40.673 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-21T10:21:40.673 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T10:21:40.673 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T10:21:40.732 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T10:21:40.732 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T10:21:40.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 82.el9 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8274670 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-09-21T10:21:40.771 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:21:40.772 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T10:21:40.773 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T10:21:40.773 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 5.14.0-508.el9.x86_64 2024-09-21T10:21:40.773 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T10:21:41.430 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-21T10:21:42.796 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T10:21:42.822 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-21T10:21:42.824 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-21T10:21:42.839 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.dm0IErFjli 2024-09-21T10:21:42.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dm0IErFjli 2024-09-21T10:21:42.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.dm0IErFjli 2024-09-21T10:21:43.045 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.dm0IErFjli is 6KB 2024-09-21T10:21:43.065 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.dm0IErFjli 2024-09-21T10:21:43.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T10:21:43.142 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T10:21:43.142 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T10:21:43.142 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T10:21:43.142 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T10:21:43.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T10:21:43.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-21T10:21:57.593 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-21T10:21:57.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T10:21:57.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:22:13.318 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-21T10:22:13.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T10:22:13.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:22:16.047 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-09-21T10:22:25.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T10:22:25.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:22:31.667 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-21T10:22:40.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T10:22:40.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:22:43.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-21T10:22:55.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T10:22:55.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:23:25.071 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T10:23:27.563 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-21T10:23:27.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T10:23:27.894 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T10:23:27.894 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-21T10:23:27.909 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-508.el9.x86_64 2024-09-21T10:23:27.909 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T10:23:27.909 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T10:23:27.909 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T10:23:28.911 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-21T10:23:28.911 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T10:23:28.967 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-21T10:23:28.987 DEBUG:teuthology.parallel:result is None 2024-09-21T10:23:37.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T10:23:37.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:23:37.413 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-21T10:23:37.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T10:23:37.784 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T10:23:37.785 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-21T10:23:37.803 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-508.el9.x86_64 2024-09-21T10:23:37.803 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T10:23:37.803 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T10:23:37.803 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T10:23:38.804 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-21T10:23:38.804 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T10:23:38.875 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-09-21T10:23:38.898 DEBUG:teuthology.parallel:result is None 2024-09-21T10:23:38.898 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T10:23:38.905 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T10:23:38.905 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T10:23:38.907 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T10:23:38.926 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T10:23:38.932 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T10:23:38.943 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T10:23:38.943 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T10:23:38.966 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T10:23:39.002 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T10:23:39.009 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T10:23:39.009 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T10:23:39.028 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T10:23:39.069 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T10:23:39.074 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T10:23:39.081 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T10:23:39.086 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T10:23:39.088 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T10:23:39.095 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T10:23:39.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T10:23:39.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T10:23:39.156 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T10:23:39.165 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T10:23:39.165 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T10:23:39.195 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T10:23:39.214 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T10:23:39.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T10:23:39.351 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T10:23:39.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T10:23:39.483 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:23:39.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T10:23:39.554 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T10:23:39.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T10:23:39.655 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T10:23:39.740 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T10:23:39.783 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:23:39.783 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T10:23:39.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-21T10:23:39.853 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-21T10:23:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T10:23:39.942 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T10:23:40.451 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T10:23:40.460 INFO:teuthology.task.internal:Starting timer... 2024-09-21T10:23:40.460 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T10:23:40.482 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T10:23:40.490 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T10:23:40.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-21T10:23:40.560 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-21T10:23:40.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-21T10:23:40.630 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-21T10:23:40.632 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T10:23:40.632 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-21T10:23:40.660 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-21T10:23:40.661 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-21T10:23:40.687 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-21T10:23:40.688 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2024-09-21T10:23:40.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T10:23:40.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:23:40.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T10:23:40.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:23:40.761 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T10:23:40.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-21T10:23:40.808 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-21T10:23:40.840 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T10:23:40.855 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T10:23:40.857 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T10:23:40.957 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T10:23:40.967 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T10:23:40.967 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T10:27:32.514 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-09-21T10:27:32.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T10:27:32.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:27:32.595 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-21T10:27:32.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T10:27:32.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T10:27:32.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T10:27:32.750 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-21T10:27:32.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-21T10:27:32.831 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T10:27:32.845 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T10:27:32.845 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T10:27:32.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T10:27:32.848 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T10:27:32.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T10:27:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T10:27:32.895 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T10:27:32.901 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T10:27:32.916 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T10:27:32.922 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-21T10:27:32.934 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-21T10:27:32.941 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-21T10:27:32.949 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T10:27:32.952 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-21T10:27:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T10:27:32.966 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T10:27:32.981 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T10:27:33.024 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-21T10:27:33.028 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T10:27:33.028 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-21T10:27:33.028 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.028 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.028 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.028 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.048 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-21T10:27:33.052 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T10:27:33.053 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-21T10:27:33.053 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.053 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.053 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.053 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:27:33.053 INFO:teuthology.run_tasks:Running task install... 2024-09-21T10:27:33.061 DEBUG:teuthology.task.install:project ceph 2024-09-21T10:27:33.061 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'}} 2024-09-21T10:27:33.061 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'} 2024-09-21T10:27:33.061 INFO:teuthology.task.install:Using flavor: default 2024-09-21T10:27:33.067 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T10:27:33.067 INFO:teuthology.task.install:extra packages: [] 2024-09-21T10:27:33.067 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'tag': None, 'wait_for_package': False} 2024-09-21T10:27:33.068 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:27:33.068 INFO:teuthology.packaging:ref: None 2024-09-21T10:27:33.068 INFO:teuthology.packaging:tag: None 2024-09-21T10:27:33.068 INFO:teuthology.packaging:branch: reef 2024-09-21T10:27:33.068 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:27:33.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-21T10:27:33.070 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'tag': None, 'wait_for_package': False} 2024-09-21T10:27:33.070 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:27:33.070 INFO:teuthology.packaging:ref: None 2024-09-21T10:27:33.070 INFO:teuthology.packaging:tag: None 2024-09-21T10:27:33.070 INFO:teuthology.packaging:branch: reef 2024-09-21T10:27:33.070 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:27:33.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-21T10:27:33.307 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/ 2024-09-21T10:27:33.308 INFO:teuthology.task.install.rpm:Package version is 18.2.4-871.g6a1bdf85 2024-09-21T10:27:33.362 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/ 2024-09-21T10:27:33.363 INFO:teuthology.task.install.rpm:Package version is 18.2.4-871.g6a1bdf85 2024-09-21T10:27:33.428 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T10:27:33.428 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:27:33.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T10:27:33.456 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T10:27:33.456 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:27:33.456 INFO:teuthology.packaging:ref: None 2024-09-21T10:27:33.456 INFO:teuthology.packaging:tag: None 2024-09-21T10:27:33.456 INFO:teuthology.packaging:branch: reef 2024-09-21T10:27:33.456 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:27:33.456 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T10:27:33.468 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T10:27:33.468 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:27:33.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T10:27:33.495 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T10:27:33.495 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:27:33.496 INFO:teuthology.packaging:ref: None 2024-09-21T10:27:33.496 INFO:teuthology.packaging:tag: None 2024-09-21T10:27:33.496 INFO:teuthology.packaging:branch: reef 2024-09-21T10:27:33.496 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:27:33.496 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T10:27:33.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T10:27:33.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T10:27:33.602 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T10:27:33.637 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T10:27:33.668 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-21T10:27:33.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-21T10:27:33.701 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-21T10:27:33.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-21T10:27:33.910 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-21T10:27:33.930 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-21T10:27:33.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw 2024-09-21T10:27:33.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw 2024-09-21T10:27:34.502 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 294 kB/s | 77 kB 00:00 2024-09-21T10:27:34.516 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 277 kB/s | 77 kB 00:00 2024-09-21T10:27:34.786 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-21T10:27:34.808 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-21T10:27:35.062 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T10:27:35.084 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T10:27:35.571 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T10:27:35.700 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T10:27:37.764 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-21T10:27:38.035 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-21T10:27:42.040 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T10:27:42.695 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-21T10:27:43.825 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-21T10:27:44.254 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-21T10:27:44.578 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T10:27:45.399 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T10:27:50.026 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-21T10:27:50.989 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-21T10:27:52.263 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:27:52.275 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:27:52.275 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:27:52.275 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 7.7 M 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 3.3 M 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 3.0 M 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T10:27:52.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 5.1 M 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 18 M 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 25 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 711 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 477 k 2024-09-21T10:27:52.277 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 4.5 M 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 45 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 129 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 161 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 320 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 300 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 99 k 2024-09-21T10:27:52.278 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Install 28 Packages 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 2 Packages 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 53 M 2024-09-21T10:27:52.279 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:27:52.963 INFO:teuthology.orchestra.run.smithi112.stdout:(1/30): ceph-base-18.2.4-871.g6a1bdf85.el9.x86_ 8.0 MB/s | 5.1 MB 00:00 2024-09-21T10:27:53.063 INFO:teuthology.orchestra.run.smithi112.stdout:(2/30): ceph-radosgw-18.2.4-871.g6a1bdf85.el9.x 11 MB/s | 7.7 MB 00:00 2024-09-21T10:27:53.088 INFO:teuthology.orchestra.run.smithi112.stdout:(3/30): ceph-selinux-18.2.4-871.g6a1bdf85.el9.x 201 kB/s | 25 kB 00:00 2024-09-21T10:27:53.130 INFO:teuthology.orchestra.run.smithi112.stdout:(4/30): libcephfs2-18.2.4-871.g6a1bdf85.el9.x86 10 MB/s | 711 kB 00:00 2024-09-21T10:27:53.155 INFO:teuthology.orchestra.run.smithi112.stdout:(5/30): libradosstriper1-18.2.4-871.g6a1bdf85.e 7.0 MB/s | 477 kB 00:00 2024-09-21T10:27:53.205 INFO:teuthology.orchestra.run.smithi112.stdout:(6/30): python3-ceph-argparse-18.2.4-871.g6a1bd 900 kB/s | 45 kB 00:00 2024-09-21T10:27:53.281 INFO:teuthology.orchestra.run.smithi112.stdout:(7/30): python3-ceph-common-18.2.4-871.g6a1bdf8 1.7 MB/s | 129 kB 00:00 2024-09-21T10:27:53.326 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:27:53.334 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:27:53.334 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:27:53.334 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:27:53.334 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:27:53.334 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 7.7 M 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 3.3 M 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 3.0 M 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 5.1 M 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 18 M 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 25 k 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T10:27:53.335 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 711 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 477 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 4.5 M 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 45 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 129 k 2024-09-21T10:27:53.336 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 161 k 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 320 k 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 300 k 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 99 k 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout:Install 28 Packages 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2024-09-21T10:27:53.337 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:27:53.338 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 53 M 2024-09-21T10:27:53.338 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:27:53.364 INFO:teuthology.orchestra.run.smithi112.stdout:(8/30): librgw2-18.2.4-871.g6a1bdf85.el9.x86_64 19 MB/s | 4.5 MB 00:00 2024-09-21T10:27:53.390 INFO:teuthology.orchestra.run.smithi112.stdout:(9/30): python3-cephfs-18.2.4-871.g6a1bdf85.el9 1.5 MB/s | 161 kB 00:00 2024-09-21T10:27:53.415 INFO:teuthology.orchestra.run.smithi112.stdout:(10/30): python3-rados-18.2.4-871.g6a1bdf85.el9 6.2 MB/s | 320 kB 00:00 2024-09-21T10:27:53.599 INFO:teuthology.orchestra.run.smithi112.stdout:(11/30): ceph-common-18.2.4-871.g6a1bdf85.el9.x 14 MB/s | 18 MB 00:01 2024-09-21T10:27:53.632 INFO:teuthology.orchestra.run.smithi112.stdout:(12/30): python3-rbd-18.2.4-871.g6a1bdf85.el9.x 1.2 MB/s | 300 kB 00:00 2024-09-21T10:27:53.657 INFO:teuthology.orchestra.run.smithi112.stdout:(13/30): python3-rgw-18.2.4-871.g6a1bdf85.el9.x 411 kB/s | 99 kB 00:00 2024-09-21T10:27:53.733 INFO:teuthology.orchestra.run.smithi112.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 799 kB/s | 107 kB 00:00 2024-09-21T10:27:53.758 INFO:teuthology.orchestra.run.smithi112.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-09-21T10:27:53.783 INFO:teuthology.orchestra.run.smithi112.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T10:27:53.825 INFO:teuthology.orchestra.run.smithi112.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-21T10:27:53.850 INFO:teuthology.orchestra.run.smithi112.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T10:27:53.876 INFO:teuthology.orchestra.run.smithi112.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-21T10:27:53.926 INFO:teuthology.orchestra.run.smithi112.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-21T10:27:53.951 INFO:teuthology.orchestra.run.smithi112.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-21T10:27:53.977 INFO:teuthology.orchestra.run.smithi112.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T10:27:54.024 INFO:teuthology.orchestra.run.smithi060.stdout:(1/30): ceph-base-18.2.4-871.g6a1bdf85.el9.x86_ 8.1 MB/s | 5.1 MB 00:00 2024-09-21T10:27:54.027 INFO:teuthology.orchestra.run.smithi112.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.7 MB/s | 308 kB 00:00 2024-09-21T10:27:54.052 INFO:teuthology.orchestra.run.smithi112.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2024-09-21T10:27:54.086 INFO:teuthology.orchestra.run.smithi112.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T10:27:54.124 INFO:teuthology.orchestra.run.smithi060.stdout:(2/30): ceph-radosgw-18.2.4-871.g6a1bdf85.el9.x 11 MB/s | 7.7 MB 00:00 2024-09-21T10:27:54.128 INFO:teuthology.orchestra.run.smithi112.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-21T10:27:54.158 INFO:teuthology.orchestra.run.smithi060.stdout:(3/30): ceph-selinux-18.2.4-871.g6a1bdf85.el9.x 188 kB/s | 25 kB 00:00 2024-09-21T10:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T10:27:54.199 INFO:teuthology.orchestra.run.smithi060.stdout:(4/30): libcephfs2-18.2.4-871.g6a1bdf85.el9.x86 9.2 MB/s | 711 kB 00:00 2024-09-21T10:27:54.225 INFO:teuthology.orchestra.run.smithi060.stdout:(5/30): libradosstriper1-18.2.4-871.g6a1bdf85.e 7.0 MB/s | 477 kB 00:00 2024-09-21T10:27:54.262 INFO:teuthology.orchestra.run.smithi112.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T10:27:54.275 INFO:teuthology.orchestra.run.smithi060.stdout:(6/30): python3-ceph-argparse-18.2.4-871.g6a1bd 899 kB/s | 45 kB 00:00 2024-09-21T10:27:54.367 INFO:teuthology.orchestra.run.smithi060.stdout:(7/30): python3-ceph-common-18.2.4-871.g6a1bdf8 1.4 MB/s | 129 kB 00:00 2024-09-21T10:27:54.495 INFO:teuthology.orchestra.run.smithi112.stdout:(29/30): librbd1-18.2.4-871.g6a1bdf85.el9.x86_6 9.5 MB/s | 3.0 MB 00:00 2024-09-21T10:27:54.562 INFO:teuthology.orchestra.run.smithi112.stdout:(30/30): librados2-18.2.4-871.g6a1bdf85.el9.x86 7.6 MB/s | 3.3 MB 00:00 2024-09-21T10:27:54.569 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:27:54.569 INFO:teuthology.orchestra.run.smithi112.stdout:Total 23 MB/s | 53 MB 00:02 2024-09-21T10:27:54.576 INFO:teuthology.orchestra.run.smithi060.stdout:(8/30): ceph-common-18.2.4-871.g6a1bdf85.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T10:27:54.601 INFO:teuthology.orchestra.run.smithi060.stdout:(9/30): python3-cephfs-18.2.4-871.g6a1bdf85.el9 691 kB/s | 161 kB 00:00 2024-09-21T10:27:54.626 INFO:teuthology.orchestra.run.smithi060.stdout:(10/30): python3-rados-18.2.4-871.g6a1bdf85.el9 6.3 MB/s | 320 kB 00:00 2024-09-21T10:27:54.635 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:27:54.651 INFO:teuthology.orchestra.run.smithi060.stdout:(11/30): python3-rbd-18.2.4-871.g6a1bdf85.el9.x 5.8 MB/s | 300 kB 00:00 2024-09-21T10:27:54.669 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:27:54.670 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:27:54.677 INFO:teuthology.orchestra.run.smithi060.stdout:(12/30): python3-rgw-18.2.4-871.g6a1bdf85.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T10:27:54.744 INFO:teuthology.orchestra.run.smithi060.stdout:(13/30): librgw2-18.2.4-871.g6a1bdf85.el9.x86_6 8.2 MB/s | 4.5 MB 00:00 2024-09-21T10:27:54.836 INFO:teuthology.orchestra.run.smithi060.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 581 kB/s | 107 kB 00:00 2024-09-21T10:27:54.861 INFO:teuthology.orchestra.run.smithi060.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-21T10:27:54.886 INFO:teuthology.orchestra.run.smithi060.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 766 kB/s | 160 kB 00:00 2024-09-21T10:27:54.928 INFO:teuthology.orchestra.run.smithi060.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-21T10:27:54.962 INFO:teuthology.orchestra.run.smithi060.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T10:27:54.995 INFO:teuthology.orchestra.run.smithi060.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-21T10:27:55.037 INFO:teuthology.orchestra.run.smithi060.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-21T10:27:55.063 INFO:teuthology.orchestra.run.smithi060.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-21T10:27:55.088 INFO:teuthology.orchestra.run.smithi060.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T10:27:55.113 INFO:teuthology.orchestra.run.smithi060.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-21T10:27:55.138 INFO:teuthology.orchestra.run.smithi060.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T10:27:55.180 INFO:teuthology.orchestra.run.smithi060.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T10:27:55.222 INFO:teuthology.orchestra.run.smithi060.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-21T10:27:55.306 INFO:teuthology.orchestra.run.smithi060.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T10:27:55.314 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:27:55.314 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:27:55.381 INFO:teuthology.orchestra.run.smithi060.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T10:27:55.473 INFO:teuthology.orchestra.run.smithi060.stdout:(29/30): librados2-18.2.4-871.g6a1bdf85.el9.x86 13 MB/s | 3.3 MB 00:00 2024-09-21T10:27:55.557 INFO:teuthology.orchestra.run.smithi060.stdout:(30/30): librbd1-18.2.4-871.g6a1bdf85.el9.x86_6 12 MB/s | 3.0 MB 00:00 2024-09-21T10:27:55.561 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:27:55.562 INFO:teuthology.orchestra.run.smithi060.stdout:Total 24 MB/s | 53 MB 00:02 2024-09-21T10:27:55.638 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:27:55.679 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:27:55.679 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:27:56.321 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:27:56.321 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:27:56.684 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:27:56.763 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-21T10:27:56.792 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-21T10:27:56.841 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-21T10:27:57.207 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-21T10:27:57.274 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/32 2024-09-21T10:27:57.372 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/32 2024-09-21T10:27:57.459 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 6/32 2024-09-21T10:27:57.484 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 7/32 2024-09-21T10:27:57.547 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 7/32 2024-09-21T10:27:57.575 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-21T10:27:57.627 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:18.2.4-871.g6a1bdf85.el9.x 9/32 2024-09-21T10:27:57.701 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 10/32 2024-09-21T10:27:57.725 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:27:57.752 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 11/32 2024-09-21T10:27:57.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-21T10:27:57.827 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 11/32 2024-09-21T10:27:57.837 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-21T10:27:57.896 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-21T10:27:57.932 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-21T10:27:57.960 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-21T10:27:58.020 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-21T10:27:58.050 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-21T10:27:58.077 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-21T10:27:58.113 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-21T10:27:58.146 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-21T10:27:58.285 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-21T10:27:58.336 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/32 2024-09-21T10:27:58.438 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/32 2024-09-21T10:27:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-21T10:27:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 20/32 2024-09-21T10:27:58.532 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 6/32 2024-09-21T10:27:58.562 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 7/32 2024-09-21T10:27:58.607 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 20/32 2024-09-21T10:27:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 7/32 2024-09-21T10:27:58.638 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 21/32 2024-09-21T10:27:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-21T10:27:58.673 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-21T10:27:58.706 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:18.2.4-871.g6a1bdf85.el9.x 9/32 2024-09-21T10:27:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 10/32 2024-09-21T10:27:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 11/32 2024-09-21T10:27:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 11/32 2024-09-21T10:27:58.991 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-21T10:27:59.039 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-21T10:27:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-21T10:27:59.088 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-21T10:27:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 24/32 2024-09-21T10:27:59.129 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-21T10:27:59.155 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-21T10:27:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 24/32 2024-09-21T10:27:59.192 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-21T10:27:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-21T10:27:59.251 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 25/32 2024-09-21T10:27:59.280 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86 26/32 2024-09-21T10:27:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-21T10:27:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 20/32 2024-09-21T10:27:59.704 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 20/32 2024-09-21T10:27:59.734 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 21/32 2024-09-21T10:27:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-21T10:28:00.202 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-21T10:28:00.231 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 24/32 2024-09-21T10:28:00.308 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 24/32 2024-09-21T10:28:00.383 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 25/32 2024-09-21T10:28:00.417 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86 26/32 2024-09-21T10:28:01.665 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 27/32 2024-09-21T10:28:01.701 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 27/32 2024-09-21T10:28:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 27/32 2024-09-21T10:28:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 28/32 2024-09-21T10:28:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 28/32 2024-09-21T10:28:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T10:28:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T10:28:02.379 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:02.414 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/32 2024-09-21T10:28:02.623 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 27/32 2024-09-21T10:28:02.664 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 27/32 2024-09-21T10:28:03.234 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 27/32 2024-09-21T10:28:03.275 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 28/32 2024-09-21T10:28:03.372 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 28/32 2024-09-21T10:28:03.372 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T10:28:03.372 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T10:28:03.372 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:03.402 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/32 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/32 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-21T10:28:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:13.136 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/32 2024-09-21T10:28:13.161 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/32 2024-09-21T10:28:13.162 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:13.162 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T10:28:13.162 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T10:28:13.162 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T10:28:13.162 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:13.164 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-21T10:28:13.248 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-21T10:28:13.248 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-21T10:28:14.078 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/32 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-21T10:28:14.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 6/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 7/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:18.2.4-871.g6a1bdf85.el9.x 8/32 2024-09-21T10:28:14.415 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86 9/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 10/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 11/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 12/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 13/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-21T10:28:14.416 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-21T10:28:14.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-21T10:28:14.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-21T10:28:14.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-21T10:28:14.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-21T10:28:14.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/32 2024-09-21T10:28:14.417 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-21T10:28:14.418 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 31/32 2024-09-21T10:28:14.850 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/32 2024-09-21T10:28:14.877 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/32 2024-09-21T10:28:14.877 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:14.877 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T10:28:14.877 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T10:28:14.877 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T10:28:14.877 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:14.879 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-21T10:28:14.970 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-21T10:28:14.970 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.247 INFO:teuthology.orchestra.run.smithi112.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T10:28:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:15.249 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:15.626 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-test 2024-09-21T10:28:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 6/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 7/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:18.2.4-871.g6a1bdf85.el9.x 8/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86 9/32 2024-09-21T10:28:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 10/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 11/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 12/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 13/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-21T10:28:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-21T10:28:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 31/32 2024-09-21T10:28:16.209 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:26 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:16.349 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 40 M 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:28:16.350 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 166 k 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-21T10:28:16.351 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:16.352 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 40 M 2024-09-21T10:28:16.352 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 164 M 2024-09-21T10:28:16.352 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:28:16.686 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-21T10:28:16.711 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): libcephsqlite-18.2.4-871.g6a1bdf85.el9.x 706 kB/s | 166 kB 00:00 2024-09-21T10:28:16.736 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.173 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T10:28:17.174 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:17.175 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:17.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-test 2024-09-21T10:28:17.770 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): ceph-test-18.2.4-871.g6a1bdf85.el9.x86_6 31 MB/s | 40 MB 00:01 2024-09-21T10:28:17.773 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:17.773 INFO:teuthology.orchestra.run.smithi112.stdout:Total 28 MB/s | 40 MB 00:01 2024-09-21T10:28:17.800 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:28:17.820 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:28:17.820 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:28:18.137 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:28:18.137 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:28:18.144 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:18.288 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:18.289 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:28:18.289 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 40 M 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 166 k 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-21T10:28:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:18.291 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 40 M 2024-09-21T10:28:18.291 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 164 M 2024-09-21T10:28:18.291 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:28:18.477 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-21T10:28:18.519 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T10:28:18.561 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): libcephsqlite-18.2.4-871.g6a1bdf85.el9.x 744 kB/s | 166 kB 00:00 2024-09-21T10:28:18.619 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:28:18.702 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T10:28:18.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T10:28:18.772 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/4 2024-09-21T10:28:19.645 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): ceph-test-18.2.4-871.g6a1bdf85.el9.x86_6 30 MB/s | 40 MB 00:01 2024-09-21T10:28:19.647 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:19.647 INFO:teuthology.orchestra.run.smithi060.stdout:Total 30 MB/s | 40 MB 00:01 2024-09-21T10:28:19.675 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:28:19.697 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:28:19.697 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:28:20.031 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:28:20.032 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:28:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:28:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T10:28:20.653 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T10:28:20.680 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/4 2024-09-21T10:28:22.471 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/4 2024-09-21T10:28:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/4 2024-09-21T10:28:24.491 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/4 2024-09-21T10:28:24.491 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/4 2024-09-21T10:28:24.491 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/4 2024-09-21T10:28:24.492 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T10:28:24.603 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/4 2024-09-21T10:28:24.689 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/4 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T10:28:24.819 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T10:28:24.820 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:24.820 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:25.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph 2024-09-21T10:28:25.740 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:35 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:25.885 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:25.887 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:25.887 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 6.5 k 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 2.1 M 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 1.5 M 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 246 k 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 4.7 M 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 17 M 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T10:28:25.888 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T10:28:25.889 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T10:28:25.890 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:Install 33 Packages 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 29 M 2024-09-21T10:28:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 104 M 2024-09-21T10:28:25.892 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:28:26.253 INFO:teuthology.orchestra.run.smithi112.stdout:(1/33): ceph-18.2.4-871.g6a1bdf85.el9.x86_64.rp 49 kB/s | 6.5 kB 00:00 2024-09-21T10:28:26.429 INFO:teuthology.orchestra.run.smithi112.stdout:(2/33): ceph-mds-18.2.4-871.g6a1bdf85.el9.x86_6 6.8 MB/s | 2.1 MB 00:00 2024-09-21T10:28:26.470 INFO:teuthology.orchestra.run.smithi112.stdout:(3/33): ceph-mgr-18.2.4-871.g6a1bdf85.el9.x86_6 4.2 MB/s | 1.5 MB 00:00 2024-09-21T10:28:26.554 INFO:teuthology.orchestra.run.smithi112.stdout:(4/33): ceph-mgr-modules-core-18.2.4-871.g6a1bd 2.9 MB/s | 246 kB 00:00 2024-09-21T10:28:26.638 INFO:teuthology.orchestra.run.smithi112.stdout:(5/33): ceph-mon-18.2.4-871.g6a1bdf85.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-21T10:28:26.794 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/4 2024-09-21T10:28:26.794 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/4 2024-09-21T10:28:26.795 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/4 2024-09-21T10:28:26.795 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T10:28:26.805 INFO:teuthology.orchestra.run.smithi112.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-21T10:28:26.972 INFO:teuthology.orchestra.run.smithi112.stdout:(7/33): ceph-osd-18.2.4-871.g6a1bdf85.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-21T10:28:26.997 INFO:teuthology.orchestra.run.smithi112.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 556 kB/s | 106 kB 00:00 2024-09-21T10:28:27.047 INFO:teuthology.orchestra.run.smithi112.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-21T10:28:27.095 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:27.096 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:27.122 INFO:teuthology.orchestra.run.smithi112.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-21T10:28:27.156 INFO:teuthology.orchestra.run.smithi112.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 735 kB/s | 135 kB 00:00 2024-09-21T10:28:27.181 INFO:teuthology.orchestra.run.smithi112.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.6 MB/s | 215 kB 00:00 2024-09-21T10:28:27.206 INFO:teuthology.orchestra.run.smithi112.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T10:28:27.232 INFO:teuthology.orchestra.run.smithi112.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 460 kB/s | 35 kB 00:00 2024-09-21T10:28:27.257 INFO:teuthology.orchestra.run.smithi112.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-21T10:28:27.282 INFO:teuthology.orchestra.run.smithi112.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-21T10:28:27.333 INFO:teuthology.orchestra.run.smithi112.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-21T10:28:27.358 INFO:teuthology.orchestra.run.smithi112.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 463 kB/s | 11 kB 00:00 2024-09-21T10:28:27.383 INFO:teuthology.orchestra.run.smithi112.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 711 kB/s | 18 kB 00:00 2024-09-21T10:28:27.417 INFO:teuthology.orchestra.run.smithi112.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T10:28:27.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph 2024-09-21T10:28:27.442 INFO:teuthology.orchestra.run.smithi112.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 395 kB/s | 23 kB 00:00 2024-09-21T10:28:27.467 INFO:teuthology.orchestra.run.smithi112.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-21T10:28:27.493 INFO:teuthology.orchestra.run.smithi112.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-21T10:28:27.518 INFO:teuthology.orchestra.run.smithi112.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-21T10:28:27.543 INFO:teuthology.orchestra.run.smithi112.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T10:28:27.568 INFO:teuthology.orchestra.run.smithi112.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T10:28:27.616 INFO:teuthology.orchestra.run.smithi112.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 227 kB/s | 16 kB 00:00 2024-09-21T10:28:27.644 INFO:teuthology.orchestra.run.smithi112.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-21T10:28:27.669 INFO:teuthology.orchestra.run.smithi112.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 673 kB/s | 36 kB 00:00 2024-09-21T10:28:27.694 INFO:teuthology.orchestra.run.smithi112.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-21T10:28:27.728 INFO:teuthology.orchestra.run.smithi112.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T10:28:27.753 INFO:teuthology.orchestra.run.smithi112.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 340 kB/s | 20 kB 00:00 2024-09-21T10:28:27.779 INFO:teuthology.orchestra.run.smithi112.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-21T10:28:27.783 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:27.783 INFO:teuthology.orchestra.run.smithi112.stdout:Total 15 MB/s | 29 MB 00:01 2024-09-21T10:28:27.902 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:28:27.940 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:28:27.940 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:28:28.034 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:38 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:28.174 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 6.5 k 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 2.1 M 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 1.5 M 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 246 k 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 4.7 M 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 17 M 2024-09-21T10:28:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T10:28:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:28.179 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout:Install 33 Packages 2024-09-21T10:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 29 M 2024-09-21T10:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 104 M 2024-09-21T10:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:28:28.803 INFO:teuthology.orchestra.run.smithi060.stdout:(1/33): ceph-18.2.4-871.g6a1bdf85.el9.x86_64.rp 57 kB/s | 6.5 kB 00:00 2024-09-21T10:28:29.021 INFO:teuthology.orchestra.run.smithi060.stdout:(2/33): ceph-mds-18.2.4-871.g6a1bdf85.el9.x86_6 6.3 MB/s | 2.1 MB 00:00 2024-09-21T10:28:29.062 INFO:teuthology.orchestra.run.smithi060.stdout:(3/33): ceph-mgr-18.2.4-871.g6a1bdf85.el9.x86_6 3.9 MB/s | 1.5 MB 00:00 2024-09-21T10:28:29.163 INFO:teuthology.orchestra.run.smithi060.stdout:(4/33): ceph-mon-18.2.4-871.g6a1bdf85.el9.x86_6 13 MB/s | 4.7 MB 00:00 2024-09-21T10:28:29.188 INFO:teuthology.orchestra.run.smithi060.stdout:(5/33): ceph-mgr-modules-core-18.2.4-871.g6a1bd 1.9 MB/s | 246 kB 00:00 2024-09-21T10:28:29.355 INFO:teuthology.orchestra.run.smithi060.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-21T10:28:29.405 INFO:teuthology.orchestra.run.smithi060.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T10:28:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:(8/33): ceph-osd-18.2.4-871.g6a1bdf85.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-21T10:28:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:28:29.614 INFO:teuthology.orchestra.run.smithi060.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 648 kB/s | 135 kB 00:00 2024-09-21T10:28:29.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-21T10:28:29.697 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-21T10:28:29.697 INFO:teuthology.orchestra.run.smithi060.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-21T10:28:29.723 INFO:teuthology.orchestra.run.smithi060.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 879 kB/s | 125 kB 00:00 2024-09-21T10:28:29.738 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-21T10:28:29.831 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-21T10:28:29.848 INFO:teuthology.orchestra.run.smithi060.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 1.9 MB/s | 1.2 MB 00:00 2024-09-21T10:28:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-21T10:28:29.923 INFO:teuthology.orchestra.run.smithi060.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 173 kB/s | 35 kB 00:00 2024-09-21T10:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-21T10:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-21T10:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-21T10:28:30.041 INFO:teuthology.orchestra.run.smithi060.stdout:(14/33): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-21T10:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-21T10:28:30.066 INFO:teuthology.orchestra.run.smithi060.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 234 kB/s | 51 kB 00:00 2024-09-21T10:28:30.091 INFO:teuthology.orchestra.run.smithi060.stdout:(16/33): python3-mako-1.1.4-6.el9.noarch.rpm 438 kB/s | 172 kB 00:00 2024-09-21T10:28:30.093 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-21T10:28:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-21T10:28:30.141 INFO:teuthology.orchestra.run.smithi060.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-21T10:28:30.166 INFO:teuthology.orchestra.run.smithi060.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 468 kB/s | 11 kB 00:00 2024-09-21T10:28:30.177 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-21T10:28:30.192 INFO:teuthology.orchestra.run.smithi060.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-09-21T10:28:30.211 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-21T10:28:30.217 INFO:teuthology.orchestra.run.smithi060.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T10:28:30.242 INFO:teuthology.orchestra.run.smithi060.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-21T10:28:30.267 INFO:teuthology.orchestra.run.smithi060.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-21T10:28:30.268 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-21T10:28:30.293 INFO:teuthology.orchestra.run.smithi060.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-21T10:28:30.318 INFO:teuthology.orchestra.run.smithi060.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-21T10:28:30.344 INFO:teuthology.orchestra.run.smithi060.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T10:28:30.358 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-21T10:28:30.372 INFO:teuthology.orchestra.run.smithi060.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T10:28:30.389 INFO:teuthology.orchestra.run.smithi060.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 364 kB/s | 16 kB 00:00 2024-09-21T10:28:30.406 INFO:teuthology.orchestra.run.smithi060.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-21T10:28:30.431 INFO:teuthology.orchestra.run.smithi060.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-21T10:28:30.457 INFO:teuthology.orchestra.run.smithi060.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-21T10:28:30.482 INFO:teuthology.orchestra.run.smithi060.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-21T10:28:30.506 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-21T10:28:30.507 INFO:teuthology.orchestra.run.smithi060.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T10:28:30.532 INFO:teuthology.orchestra.run.smithi060.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T10:28:30.536 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:30.537 INFO:teuthology.orchestra.run.smithi060.stdout:Total 12 MB/s | 29 MB 00:02 2024-09-21T10:28:30.583 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-21T10:28:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-21T10:28:30.661 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:28:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-21T10:28:30.704 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:28:30.704 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:28:30.732 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-21T10:28:30.796 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-21T10:28:30.984 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-21T10:28:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-21T10:28:31.107 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-21T10:28:31.150 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:28:31.150 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:28:31.212 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-21T10:28:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-21T10:28:31.370 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-21T10:28:31.544 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-871.g6a1bdf85.el9.n 28/33 2024-09-21T10:28:31.571 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/33 2024-09-21T10:28:31.596 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/33 2024-09-21T10:28:31.597 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:31.597 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T10:28:31.597 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T10:28:31.597 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T10:28:31.597 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:32.552 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:28:32.628 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-21T10:28:32.660 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-21T10:28:32.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-21T10:28:32.789 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-21T10:28:32.993 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-21T10:28:33.038 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-21T10:28:33.063 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/33 2024-09-21T10:28:33.072 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-21T10:28:33.094 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/33 2024-09-21T10:28:33.094 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:33.094 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T10:28:33.094 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T10:28:33.094 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T10:28:33.094 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:33.102 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-21T10:28:33.137 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-21T10:28:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-21T10:28:33.210 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-21T10:28:33.254 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-21T10:28:33.288 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-21T10:28:33.326 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-21T10:28:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-21T10:28:33.554 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-21T10:28:33.556 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 31/33 2024-09-21T10:28:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 31/33 2024-09-21T10:28:33.580 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:33.580 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T10:28:33.580 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T10:28:33.580 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T10:28:33.580 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:33.637 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-21T10:28:33.697 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-21T10:28:33.734 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-21T10:28:33.781 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 32/33 2024-09-21T10:28:33.792 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-21T10:28:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 32/33 2024-09-21T10:28:33.808 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:33.808 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T10:28:33.808 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T10:28:33.808 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T10:28:33.808 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:33.856 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-21T10:28:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 33/33 2024-09-21T10:28:34.051 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-21T10:28:34.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-21T10:28:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-21T10:28:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-21T10:28:34.329 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-21T10:28:34.451 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-21T10:28:34.618 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-871.g6a1bdf85.el9.n 28/33 2024-09-21T10:28:34.648 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/33 2024-09-21T10:28:34.676 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 29/33 2024-09-21T10:28:34.676 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:34.676 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T10:28:34.676 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T10:28:34.676 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T10:28:34.676 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:35.620 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 33/33 2024-09-21T10:28:35.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/33 2024-09-21T10:28:35.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/33 2024-09-21T10:28:35.620 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-871.g6a1bdf85.el9.n 6/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-21T10:28:35.621 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-21T10:28:35.622 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-21T10:28:35.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-21T10:28:35.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-21T10:28:35.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-21T10:28:35.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-21T10:28:35.623 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-21T10:28:36.165 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/33 2024-09-21T10:28:36.194 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 30/33 2024-09-21T10:28:36.194 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:36.194 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T10:28:36.194 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T10:28:36.194 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T10:28:36.194 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-21T10:28:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:36.557 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:28:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T10:28:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T10:28:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:36.560 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 31/33 2024-09-21T10:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 31/33 2024-09-21T10:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T10:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T10:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T10:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:36.900 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 32/33 2024-09-21T10:28:36.925 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 32/33 2024-09-21T10:28:36.925 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:36.925 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T10:28:36.925 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T10:28:36.925 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T10:28:36.925 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:36.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-base 2024-09-21T10:28:37.000 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 33/33 2024-09-21T10:28:37.523 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:47 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:37.612 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:28:37.653 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:37.654 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:28:37.654 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:37.724 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install cephadm 2024-09-21T10:28:38.297 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:48 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:38.426 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:38.427 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:38.427 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:28:38.427 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:38.427 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 226 k 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 226 k 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 217 k 2024-09-21T10:28:38.428 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:28:38.671 INFO:teuthology.orchestra.run.smithi112.stdout:cephadm-18.2.4-871.g6a1bdf85.el9.noarch.rpm 931 kB/s | 226 kB 00:00 2024-09-21T10:28:38.672 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:38.672 INFO:teuthology.orchestra.run.smithi112.stdout:Total 925 kB/s | 226 kB 00:00 2024-09-21T10:28:38.672 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:28:38.677 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:28:38.677 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:28:38.680 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:28:38.680 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:28:38.752 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 33/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 3/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 4/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 5/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-871.g6a1bdf85.el9.n 6/33 2024-09-21T10:28:38.854 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-21T10:28:38.855 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-21T10:28:38.856 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-21T10:28:38.856 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-21T10:28:38.856 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-21T10:28:38.856 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-21T10:28:38.857 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-21T10:28:39.192 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:39.282 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:39.651 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-21T10:28:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:39.795 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:28:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T10:28:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T10:28:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T10:28:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T10:28:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:39.798 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:39.907 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:28:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:39.907 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:39.907 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:40.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T10:28:40.175 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-base 2024-09-21T10:28:40.698 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:50 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:40.779 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:50 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:40.833 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:40.833 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 142 k 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 142 k 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 395 k 2024-09-21T10:28:40.834 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:28:40.871 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-base-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:28:40.915 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:40.916 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:28:40.916 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:40.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install cephadm 2024-09-21T10:28:41.043 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-immutable-object-cache-18.2.4-871.g6a1bdf8 685 kB/s | 142 kB 00:00 2024-09-21T10:28:41.043 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:41.044 INFO:teuthology.orchestra.run.smithi112.stdout:Total 679 kB/s | 142 kB 00:00 2024-09-21T10:28:41.044 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:28:41.051 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:28:41.051 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:28:41.108 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:28:41.109 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:28:41.250 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:28:41.335 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.e 1/1 2024-09-21T10:28:41.361 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.e 1/1 2024-09-21T10:28:41.361 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:41.361 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T10:28:41.361 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:41.603 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:51 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:41.739 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 226 k 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:41.740 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:28:41.741 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:41.741 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 226 k 2024-09-21T10:28:41.741 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 217 k 2024-09-21T10:28:41.741 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:28:41.950 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm-18.2.4-871.g6a1bdf85.el9.noarch.rpm 1.1 MB/s | 226 kB 00:00 2024-09-21T10:28:41.951 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:41.951 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.0 MB/s | 226 kB 00:00 2024-09-21T10:28:41.951 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:28:41.957 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:28:41.957 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:28:41.960 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:28:41.960 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:28:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:28:42.291 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.e 1/1 2024-09-21T10:28:42.291 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:42.291 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:28:42.291 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:42.291 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:42.291 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:42.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr 2024-09-21T10:28:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:43.113 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/1 2024-09-21T10:28:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:43.188 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:28:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:43.189 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:43.208 INFO:teuthology.orchestra.run.smithi112.stdout:Package ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:28:43.253 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:43.254 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:28:43.254 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:43.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T10:28:43.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T10:28:43.903 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:44.034 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:44.034 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 3.5 M 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 24 k 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 16 k 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:44.035 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:28:44.036 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:28:44.036 INFO:teuthology.orchestra.run.smithi112.stdout:Install 5 Packages 2024-09-21T10:28:44.036 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:44.036 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 3.8 M 2024-09-21T10:28:44.036 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 87 M 2024-09-21T10:28:44.036 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:28:44.057 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:44.197 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:44.197 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:44.197 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 142 k 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:28:44.198 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:44.199 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 142 k 2024-09-21T10:28:44.199 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 395 k 2024-09-21T10:28:44.199 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:28:44.407 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-immutable-object-cache-18.2.4-871.g6a1bdf8 684 kB/s | 142 kB 00:00 2024-09-21T10:28:44.408 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:44.408 INFO:teuthology.orchestra.run.smithi060.stdout:Total 680 kB/s | 142 kB 00:00 2024-09-21T10:28:44.408 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:28:44.416 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:28:44.416 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:28:44.478 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:28:44.478 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:28:44.554 INFO:teuthology.orchestra.run.smithi112.stdout:(1/5): ceph-grafana-dashboards-18.2.4-871.g6a1b 163 kB/s | 24 kB 00:00 2024-09-21T10:28:44.581 INFO:teuthology.orchestra.run.smithi112.stdout:(2/5): ceph-prometheus-alerts-18.2.4-871.g6a1bd 93 kB/s | 16 kB 00:00 2024-09-21T10:28:44.623 INFO:teuthology.orchestra.run.smithi112.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 446 kB/s | 31 kB 00:00 2024-09-21T10:28:44.628 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:28:44.648 INFO:teuthology.orchestra.run.smithi112.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-21T10:28:44.691 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.e 1/1 2024-09-21T10:28:44.718 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.e 1/1 2024-09-21T10:28:44.718 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:28:44.718 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T10:28:44.718 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:44.815 INFO:teuthology.orchestra.run.smithi112.stdout:(5/5): ceph-mgr-dashboard-18.2.4-871.g6a1bdf85. 8.6 MB/s | 3.5 MB 00:00 2024-09-21T10:28:44.819 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:44.819 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.8 MB/s | 3.8 MB 00:00 2024-09-21T10:28:44.819 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:28:44.826 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:28:44.826 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:28:44.907 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:28:44.908 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:28:45.152 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:28:45.246 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-21T10:28:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-21T10:28:45.315 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-871.g6a1bdf85.el9.no 3/5 2024-09-21T10:28:45.635 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.e 1/1 2024-09-21T10:28:45.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:45.635 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:28:45.635 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:28:45.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:45.636 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:45.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr 2024-09-21T10:28:46.372 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-871.g6a1bdf85.el9.n 4/5 2024-09-21T10:28:46.419 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 5/5 2024-09-21T10:28:46.491 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:46.584 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-mgr-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:28:46.627 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:46.629 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:28:46.629 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:46.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T10:28:47.311 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:47.447 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:47.447 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 3.5 M 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 24 k 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 16 k 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:28:47.448 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:28:47.449 INFO:teuthology.orchestra.run.smithi060.stdout:Install 5 Packages 2024-09-21T10:28:47.449 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:47.449 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 3.8 M 2024-09-21T10:28:47.449 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 87 M 2024-09-21T10:28:47.449 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:28:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 5/5 2024-09-21T10:28:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-871.g6a1bdf85.el9.n 1/5 2024-09-21T10:28:47.552 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 2/5 2024-09-21T10:28:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-871.g6a1bdf85.el9.no 3/5 2024-09-21T10:28:47.553 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-21T10:28:47.787 INFO:teuthology.orchestra.run.smithi060.stdout:(1/5): ceph-prometheus-alerts-18.2.4-871.g6a1bd 104 kB/s | 16 kB 00:00 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:47.807 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:28:47.812 INFO:teuthology.orchestra.run.smithi060.stdout:(2/5): ceph-grafana-dashboards-18.2.4-871.g6a1b 133 kB/s | 24 kB 00:00 2024-09-21T10:28:47.854 INFO:teuthology.orchestra.run.smithi060.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 461 kB/s | 31 kB 00:00 2024-09-21T10:28:47.887 INFO:teuthology.orchestra.run.smithi060.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T10:28:47.996 INFO:teuthology.orchestra.run.smithi060.stdout:(5/5): ceph-mgr-dashboard-18.2.4-871.g6a1bdf85. 9.6 MB/s | 3.5 MB 00:00 2024-09-21T10:28:48.000 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:48.000 INFO:teuthology.orchestra.run.smithi060.stdout:Total 6.9 MB/s | 3.8 MB 00:00 2024-09-21T10:28:48.000 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:28:48.007 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:28:48.008 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:28:48.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T10:28:48.093 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:28:48.093 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:28:48.346 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:28:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-21T10:28:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-21T10:28:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-871.g6a1bdf85.el9.no 3/5 2024-09-21T10:28:48.611 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:48.742 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 7.4 M 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T10:28:48.744 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout:Install 12 Packages 2024-09-21T10:28:48.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:28:48.746 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 38 M 2024-09-21T10:28:48.746 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 212 M 2024-09-21T10:28:48.746 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:28:49.355 INFO:teuthology.orchestra.run.smithi112.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.4-87 16 MB/s | 7.4 MB 00:00 2024-09-21T10:28:49.472 INFO:teuthology.orchestra.run.smithi112.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-21T10:28:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-871.g6a1bdf85.el9.n 4/5 2024-09-21T10:28:49.641 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 5/5 2024-09-21T10:28:49.764 INFO:teuthology.orchestra.run.smithi112.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 219 kB/s | 191 kB 00:00 2024-09-21T10:28:49.873 INFO:teuthology.orchestra.run.smithi112.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-09-21T10:28:49.948 INFO:teuthology.orchestra.run.smithi112.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 759 kB/s | 801 kB 00:01 2024-09-21T10:28:49.973 INFO:teuthology.orchestra.run.smithi112.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-21T10:28:50.115 INFO:teuthology.orchestra.run.smithi112.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T10:28:50.491 INFO:teuthology.orchestra.run.smithi112.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-09-21T10:28:50.599 INFO:teuthology.orchestra.run.smithi112.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 250 kB 00:00 2024-09-21T10:28:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 5/5 2024-09-21T10:28:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-871.g6a1bdf85.el9.n 1/5 2024-09-21T10:28:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 2/5 2024-09-21T10:28:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-871.g6a1bdf85.el9.no 3/5 2024-09-21T10:28:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-21T10:28:51.067 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:51.068 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:28:51.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T10:28:51.824 INFO:teuthology.orchestra.run.smithi112.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.6 MB/s | 4.9 MB 00:01 2024-09-21T10:28:51.918 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:01 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:28:52.058 INFO:teuthology.orchestra.run.smithi112.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-09-21T10:28:52.059 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 7.4 M 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:28:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-21T10:28:52.061 INFO:teuthology.orchestra.run.smithi060.stdout:Install 12 Packages 2024-09-21T10:28:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:28:52.062 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 38 M 2024-09-21T10:28:52.062 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 212 M 2024-09-21T10:28:52.062 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:28:52.545 INFO:teuthology.orchestra.run.smithi060.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 944 kB/s | 191 kB 00:00 2024-09-21T10:28:52.612 INFO:teuthology.orchestra.run.smithi060.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-21T10:28:52.787 INFO:teuthology.orchestra.run.smithi060.stdout:(3/12): ceph-mgr-diskprediction-local-18.2.4-87 17 MB/s | 7.4 MB 00:00 2024-09-21T10:28:52.812 INFO:teuthology.orchestra.run.smithi060.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-21T10:28:52.879 INFO:teuthology.orchestra.run.smithi060.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-09-21T10:28:52.905 INFO:teuthology.orchestra.run.smithi060.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 155 kB/s | 18 kB 00:00 2024-09-21T10:28:52.955 INFO:teuthology.orchestra.run.smithi060.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 270 kB/s | 38 kB 00:00 2024-09-21T10:28:53.030 INFO:teuthology.orchestra.run.smithi060.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 33 MB/s | 4.9 MB 00:00 2024-09-21T10:28:53.072 INFO:teuthology.orchestra.run.smithi060.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-09-21T10:28:53.097 INFO:teuthology.orchestra.run.smithi060.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T10:28:53.447 INFO:teuthology.orchestra.run.smithi060.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-09-21T10:28:53.523 INFO:teuthology.orchestra.run.smithi060.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.0 MB/s | 5.1 MB 00:00 2024-09-21T10:28:53.524 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:53.524 INFO:teuthology.orchestra.run.smithi060.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-21T10:28:53.890 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:28:53.917 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:28:53.917 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:28:53.991 INFO:teuthology.orchestra.run.smithi112.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.8 MB/s | 16 MB 00:03 2024-09-21T10:28:53.992 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:28:53.992 INFO:teuthology.orchestra.run.smithi112.stdout:Total 7.3 MB/s | 38 MB 00:05 2024-09-21T10:28:54.346 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:28:54.373 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:28:54.373 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:28:54.460 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:28:54.461 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:28:54.894 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:28:54.894 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:28:55.249 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:28:55.328 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T10:28:55.371 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T10:28:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T10:28:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T10:28:55.652 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:28:55.710 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T10:28:55.714 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T10:28:55.746 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T10:28:55.747 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T10:28:55.829 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T10:28:55.847 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T10:28:55.915 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T10:28:56.100 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T10:28:56.131 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T10:28:56.207 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T10:28:56.541 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T10:28:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T10:28:56.877 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T10:28:57.002 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T10:28:58.016 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T10:28:58.260 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T10:28:59.116 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T10:28:59.145 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf 12/12 2024-09-21T10:28:59.303 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T10:28:59.337 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf 12/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf 12/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf 1/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T10:29:01.696 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T10:29:01.697 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T10:29:01.697 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T10:29:01.697 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T10:29:01.697 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T10:29:02.088 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T10:29:02.089 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T10:29:02.089 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T10:29:02.089 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T10:29:02.089 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:02.089 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf 12/12 2024-09-21T10:29:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf 1/12 2024-09-21T10:29:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T10:29:02.125 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T10:29:02.126 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T10:29:02.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-rook 2024-09-21T10:29:02.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T10:29:02.532 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:02.532 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:02.532 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:29:02.532 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:02.533 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:02.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-rook 2024-09-21T10:29:03.111 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:13 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:03.251 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 49 k 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:29:03.252 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T10:29:03.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T10:29:03.254 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T10:29:03.254 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:03.254 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:03.254 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:03.254 INFO:teuthology.orchestra.run.smithi060.stdout:Install 13 Packages 2024-09-21T10:29:03.254 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:03.255 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 2.2 M 2024-09-21T10:29:03.255 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 26 M 2024-09-21T10:29:03.255 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:03.505 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:13 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:03.521 INFO:teuthology.orchestra.run.smithi060.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 227 kB/s | 19 kB 00:00 2024-09-21T10:29:03.546 INFO:teuthology.orchestra.run.smithi060.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 234 kB/s | 26 kB 00:00 2024-09-21T10:29:03.613 INFO:teuthology.orchestra.run.smithi060.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T10:29:03.638 INFO:teuthology.orchestra.run.smithi060.stdout:(4/13): ceph-mgr-rook-18.2.4-871.g6a1bdf85.el9. 244 kB/s | 49 kB 00:00 2024-09-21T10:29:03.646 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:29:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:03.647 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 49 k 2024-09-21T10:29:03.647 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T10:29:03.648 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:03.649 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:03.649 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:03.649 INFO:teuthology.orchestra.run.smithi112.stdout:Install 13 Packages 2024-09-21T10:29:03.649 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:03.649 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 2.2 M 2024-09-21T10:29:03.650 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 26 M 2024-09-21T10:29:03.650 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:03.663 INFO:teuthology.orchestra.run.smithi060.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-21T10:29:03.706 INFO:teuthology.orchestra.run.smithi060.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.3 MB/s | 54 kB 00:00 2024-09-21T10:29:03.739 INFO:teuthology.orchestra.run.smithi060.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-09-21T10:29:03.773 INFO:teuthology.orchestra.run.smithi060.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 296 kB/s | 32 kB 00:00 2024-09-21T10:29:03.815 INFO:teuthology.orchestra.run.smithi060.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 134 kB/s | 14 kB 00:00 2024-09-21T10:29:03.840 INFO:teuthology.orchestra.run.smithi060.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2024-09-21T10:29:03.882 INFO:teuthology.orchestra.run.smithi060.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-09-21T10:29:03.915 INFO:teuthology.orchestra.run.smithi060.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.3 MB/s | 220 kB 00:00 2024-09-21T10:29:03.930 INFO:teuthology.orchestra.run.smithi112.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 232 kB/s | 19 kB 00:00 2024-09-21T10:29:03.955 INFO:teuthology.orchestra.run.smithi112.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 237 kB/s | 26 kB 00:00 2024-09-21T10:29:03.957 INFO:teuthology.orchestra.run.smithi060.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-21T10:29:03.961 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:03.961 INFO:teuthology.orchestra.run.smithi060.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-21T10:29:04.014 INFO:teuthology.orchestra.run.smithi112.stdout:(3/13): ceph-mgr-rook-18.2.4-871.g6a1bdf85.el9. 296 kB/s | 49 kB 00:00 2024-09-21T10:29:04.033 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:04.049 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:04.049 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:04.064 INFO:teuthology.orchestra.run.smithi112.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-21T10:29:04.089 INFO:teuthology.orchestra.run.smithi112.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-21T10:29:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 916 kB/s | 54 kB 00:00 2024-09-21T10:29:04.146 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:04.146 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:04.156 INFO:teuthology.orchestra.run.smithi112.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-21T10:29:04.182 INFO:teuthology.orchestra.run.smithi112.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 248 kB/s | 14 kB 00:00 2024-09-21T10:29:04.207 INFO:teuthology.orchestra.run.smithi112.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-21T10:29:04.232 INFO:teuthology.orchestra.run.smithi112.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T10:29:04.266 INFO:teuthology.orchestra.run.smithi112.stdout:(11/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-21T10:29:04.291 INFO:teuthology.orchestra.run.smithi112.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-21T10:29:04.325 INFO:teuthology.orchestra.run.smithi112.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-21T10:29:04.327 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:04.327 INFO:teuthology.orchestra.run.smithi112.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-21T10:29:04.392 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:04.408 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:04.496 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:04.498 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:04.846 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T10:29:04.919 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T10:29:04.974 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T10:29:05.006 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:05.010 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T10:29:05.052 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T10:29:05.157 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T10:29:05.173 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T10:29:05.226 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T10:29:05.277 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T10:29:05.281 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T10:29:05.319 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T10:29:05.337 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T10:29:05.360 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T10:29:05.464 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T10:29:05.573 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T10:29:05.628 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T10:29:06.099 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T10:29:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T10:29:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T10:29:06.242 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T10:29:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 13/13 2024-09-21T10:29:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T10:29:06.400 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T10:29:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T10:29:06.490 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T10:29:06.528 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 13/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 13/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 1/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T10:29:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T10:29:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T10:29:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T10:29:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T10:29:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T10:29:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T10:29:07.335 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 13/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 1/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T10:29:07.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T10:29:07.483 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T10:29:07.484 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T10:29:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T10:29:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T10:29:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T10:29:07.680 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:07.681 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:07.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T10:29:07.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T10:29:08.376 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:18 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:08.501 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:18 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:08.515 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:08.515 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:08.515 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 139 k 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:08.516 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:08.517 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2024-09-21T10:29:08.517 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:08.517 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 7.0 M 2024-09-21T10:29:08.517 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 33 M 2024-09-21T10:29:08.518 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:08.632 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:08.633 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:08.633 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:29:08.633 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:08.633 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:08.633 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:18.2.4-871.g6a1bdf85.el9 ceph-noarch 139 k 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout:Install 6 Packages 2024-09-21T10:29:08.634 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:08.635 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 7.0 M 2024-09-21T10:29:08.635 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 33 M 2024-09-21T10:29:08.635 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:09.034 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-21T10:29:09.068 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): ceph-mgr-cephadm-18.2.4-871.g6a1bdf85.el 542 kB/s | 139 kB 00:00 2024-09-21T10:29:09.119 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-21T10:29:09.144 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 767 kB/s | 58 kB 00:00 2024-09-21T10:29:09.180 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-21T10:29:09.226 INFO:teuthology.orchestra.run.smithi112.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-21T10:29:09.251 INFO:teuthology.orchestra.run.smithi112.stdout:(2/6): ceph-mgr-cephadm-18.2.4-871.g6a1bdf85.el 612 kB/s | 139 kB 00:00 2024-09-21T10:29:09.310 INFO:teuthology.orchestra.run.smithi112.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-21T10:29:09.335 INFO:teuthology.orchestra.run.smithi112.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 689 kB/s | 58 kB 00:00 2024-09-21T10:29:09.361 INFO:teuthology.orchestra.run.smithi112.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-21T10:29:10.369 INFO:teuthology.orchestra.run.smithi112.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-21T10:29:10.372 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:10.372 INFO:teuthology.orchestra.run.smithi112.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-21T10:29:10.443 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:10.454 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:10.454 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:10.553 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:10.554 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:10.868 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:11.051 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T10:29:11.104 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T10:29:11.228 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-09-21T10:29:11.231 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:11.231 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.6 MB/s | 7.0 MB 00:02 2024-09-21T10:29:11.307 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:11.320 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:11.320 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:11.425 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:11.426 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:11.622 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T10:29:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T10:29:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T10:29:11.776 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 6/6 2024-09-21T10:29:11.961 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T10:29:12.005 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T10:29:12.572 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T10:29:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 6/6 2024-09-21T10:29:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/6 2024-09-21T10:29:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T10:29:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T10:29:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T10:29:12.628 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T10:29:12.660 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T10:29:12.730 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T10:29:12.758 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 6/6 2024-09-21T10:29:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T10:29:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:12.913 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:12.914 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:13.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-fuse 2024-09-21T10:29:13.523 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 6/6 2024-09-21T10:29:13.524 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 1/6 2024-09-21T10:29:13.524 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T10:29:13.524 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T10:29:13.524 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T10:29:13.524 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T10:29:13.747 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:23 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:13.798 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T10:29:13.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:13.798 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:18.2.4-871.g6a1bdf85.el9.noarch 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:13.799 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:13.879 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:13.880 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:13.880 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-21T10:29:13.880 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:13.880 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 853 k 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:Install 2 Packages 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 932 k 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 2.7 M 2024-09-21T10:29:13.881 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:14.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-fuse 2024-09-21T10:29:14.129 INFO:teuthology.orchestra.run.smithi112.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 542 kB/s | 80 kB 00:00 2024-09-21T10:29:14.262 INFO:teuthology.orchestra.run.smithi112.stdout:(2/2): ceph-fuse-18.2.4-871.g6a1bdf85.el9.x86_6 3.0 MB/s | 853 kB 00:00 2024-09-21T10:29:14.263 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:14.263 INFO:teuthology.orchestra.run.smithi112.stdout:Total 2.4 MB/s | 932 kB 00:00 2024-09-21T10:29:14.274 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:14.296 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:14.296 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:14.377 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:14.377 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:14.580 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:14.666 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:24 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:14.719 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T10:29:14.786 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/2 2024-09-21T10:29:14.805 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 853 k 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout:Install 2 Packages 2024-09-21T10:29:14.806 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:14.807 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 932 k 2024-09-21T10:29:14.807 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 2.7 M 2024-09-21T10:29:14.807 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:15.138 INFO:teuthology.orchestra.run.smithi060.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 385 kB/s | 80 kB 00:00 2024-09-21T10:29:15.196 INFO:teuthology.orchestra.run.smithi060.stdout:(2/2): ceph-fuse-18.2.4-871.g6a1bdf85.el9.x86_6 3.1 MB/s | 853 kB 00:00 2024-09-21T10:29:15.197 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:15.197 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.3 MB/s | 932 kB 00:00 2024-09-21T10:29:15.209 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:15.233 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:15.233 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:15.430 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/2 2024-09-21T10:29:15.430 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/2 2024-09-21T10:29:15.510 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:15.660 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T10:29:15.729 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T10:29:15.729 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:15.729 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:15.729 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T10:29:15.729 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:15.730 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/2 2024-09-21T10:29:16.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados-devel 2024-09-21T10:29:16.466 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2/2 2024-09-21T10:29:16.466 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/2 2024-09-21T10:29:16.608 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:26 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:16.744 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 126 k 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 126 k 2024-09-21T10:29:16.745 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 456 k 2024-09-21T10:29:16.746 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:16.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T10:29:16.757 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:16.757 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:16.757 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T10:29:16.757 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:16.757 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:16.933 INFO:teuthology.orchestra.run.smithi112.stdout:librados-devel-18.2.4-871.g6a1bdf85.el9.x86_64. 674 kB/s | 126 kB 00:00 2024-09-21T10:29:16.934 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:Total 668 kB/s | 126 kB 00:00 2024-09-21T10:29:16.935 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:16.940 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:16.940 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:17.002 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:17.003 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:17.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados-devel 2024-09-21T10:29:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:17.280 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:17.664 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:17.669 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:17.807 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 126 k 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:29:17.808 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:17.809 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 126 k 2024-09-21T10:29:17.809 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 456 k 2024-09-21T10:29:17.809 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:17.947 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:17.947 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:18.018 INFO:teuthology.orchestra.run.smithi060.stdout:librados-devel-18.2.4-871.g6a1bdf85.el9.x86_64. 607 kB/s | 126 kB 00:00 2024-09-21T10:29:18.019 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:18.019 INFO:teuthology.orchestra.run.smithi060.stdout:Total 602 kB/s | 126 kB 00:00 2024-09-21T10:29:18.019 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:18.025 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:18.025 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:18.092 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:18.092 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:18.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs2 2024-09-21T10:29:18.248 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:18.351 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:18.762 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:18.790 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:18.881 INFO:teuthology.orchestra.run.smithi112.stdout:Package libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:18.926 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:18.927 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:18.927 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:18.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install libcephfs-devel 2024-09-21T10:29:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:19.006 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:19.006 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:19.006 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:19.295 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs2 2024-09-21T10:29:19.576 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:29 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:19.708 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 31 k 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 31 k 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 139 k 2024-09-21T10:29:19.709 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:19.862 INFO:teuthology.orchestra.run.smithi112.stdout:libcephfs-devel-18.2.4-871.g6a1bdf85.el9.x86_64 204 kB/s | 31 kB 00:00 2024-09-21T10:29:19.862 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:19.863 INFO:teuthology.orchestra.run.smithi112.stdout:Total 202 kB/s | 31 kB 00:00 2024-09-21T10:29:19.863 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:19.866 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:19.866 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:19.884 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:19.884 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:19.904 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:29 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:19.996 INFO:teuthology.orchestra.run.smithi060.stdout:Package libcephfs2-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:20.001 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:20.042 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:20.043 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:20.043 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:20.100 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:20.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs-devel 2024-09-21T10:29:20.479 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:20.727 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:20.727 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:20.735 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:20.873 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 31 k 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:20.874 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:29:20.875 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 31 k 2024-09-21T10:29:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 139 k 2024-09-21T10:29:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:20.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librados2 2024-09-21T10:29:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:libcephfs-devel-18.2.4-871.g6a1bdf85.el9.x86_64 225 kB/s | 31 kB 00:00 2024-09-21T10:29:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:Total 223 kB/s | 31 kB 00:00 2024-09-21T10:29:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:21.018 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:21.028 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:21.029 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:21.117 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:21.237 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:21.483 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:21.572 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:21.615 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:21.616 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:21.616 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:21.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install librbd1 2024-09-21T10:29:21.830 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:21.830 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:21.830 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:21.830 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:21.831 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:21.831 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:22.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados2 2024-09-21T10:29:22.263 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:22.353 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:22.396 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:22.398 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:22.398 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:22.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rados 2024-09-21T10:29:22.654 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:22.747 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:22.792 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:22.793 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:22.793 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:22.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librbd1 2024-09-21T10:29:23.050 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:23.138 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:23.181 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:23.182 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:23.182 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:23.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rgw 2024-09-21T10:29:23.491 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:23.584 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:23.630 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:23.631 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:23.631 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:23.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rados 2024-09-21T10:29:23.823 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:23.913 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:23.953 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:23.954 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:23.955 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:24.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-cephfs 2024-09-21T10:29:24.317 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:24.410 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rados-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:24.456 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:24.457 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:24.457 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:24.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rgw 2024-09-21T10:29:24.609 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:24.700 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:24.742 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:24.743 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:24.743 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:24.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install python3-rbd 2024-09-21T10:29:25.146 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:25.236 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rgw-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:25.281 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:25.282 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:25.282 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:25.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-cephfs 2024-09-21T10:29:25.384 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:25.473 INFO:teuthology.orchestra.run.smithi112.stdout:Package python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:25.516 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:25.517 INFO:teuthology.orchestra.run.smithi112.stdout:Nothing to do. 2024-09-21T10:29:25.517 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:25.582 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-fuse 2024-09-21T10:29:25.971 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:26.062 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-cephfs-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:26.108 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:26.109 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:26.109 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:26.159 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:26.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rbd 2024-09-21T10:29:26.291 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 87 k 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:29:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:26.293 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 87 k 2024-09-21T10:29:26.293 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 227 k 2024-09-21T10:29:26.293 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:26.490 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-fuse-18.2.4-871.g6a1bdf85.el9.x86_64.rpm 443 kB/s | 87 kB 00:00 2024-09-21T10:29:26.491 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:26.491 INFO:teuthology.orchestra.run.smithi112.stdout:Total 440 kB/s | 87 kB 00:00 2024-09-21T10:29:26.491 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:26.498 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:26.498 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:26.703 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:26.788 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:26.881 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 is already installed. 2024-09-21T10:29:26.928 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:26.929 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-21T10:29:26.929 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:27.008 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-fuse 2024-09-21T10:29:27.169 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:27.460 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:27.460 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:27.460 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:27.460 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:27.460 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:27.460 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:27.620 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:27.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-mirror 2024-09-21T10:29:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-21T10:29:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 87 k 2024-09-21T10:29:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:27.760 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:29:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:27.761 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 87 k 2024-09-21T10:29:27.761 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 227 k 2024-09-21T10:29:27.761 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:27.982 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-fuse-18.2.4-871.g6a1bdf85.el9.x86_64.rpm 394 kB/s | 87 kB 00:00 2024-09-21T10:29:27.983 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:27.983 INFO:teuthology.orchestra.run.smithi060.stdout:Total 391 kB/s | 87 kB 00:00 2024-09-21T10:29:27.984 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:28.057 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:28.057 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:28.307 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:28.318 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:28.452 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repo Size 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 3.0 M 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:29:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:28.454 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 3.0 M 2024-09-21T10:29:28.454 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 12 M 2024-09-21T10:29:28.454 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:28.667 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:28.784 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-mirror-18.2.4-871.g6a1bdf85.el9.x86_64.rpm 9.1 MB/s | 3.0 MB 00:00 2024-09-21T10:29:28.785 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:28.786 INFO:teuthology.orchestra.run.smithi112.stdout:Total 9.0 MB/s | 3.0 MB 00:00 2024-09-21T10:29:28.786 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:28.795 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:28.795 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:28.874 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:28.874 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:28.927 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:28.927 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:28.927 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:29.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-mirror 2024-09-21T10:29:29.292 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:29.352 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:29.377 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:29:29.377 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T10:29:29.377 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T10:29:29.377 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T10:29:29.377 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:29.807 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:29.945 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:29.945 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 3.0 M 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:29:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:29.947 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 3.0 M 2024-09-21T10:29:29.947 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 12 M 2024-09-21T10:29:29.947 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:30.286 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-mirror-18.2.4-871.g6a1bdf85.el9.x86_64.rpm 8.8 MB/s | 3.0 MB 00:00 2024-09-21T10:29:30.286 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:30.287 INFO:teuthology.orchestra.run.smithi060.stdout:Total 8.8 MB/s | 3.0 MB 00:00 2024-09-21T10:29:30.287 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:30.296 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:30.297 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:30.380 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:30.381 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:30.452 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:30.453 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:30.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:30.453 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:30.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install rbd-nbd 2024-09-21T10:29:30.822 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:30.878 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:30.905 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T10:29:30.905 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T10:29:30.905 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T10:29:30.905 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T10:29:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:31.327 INFO:teuthology.orchestra.run.smithi112.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:31.462 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-21T10:29:31.463 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 172 k 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:Install 1 Package 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 172 k 2024-09-21T10:29:31.464 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 494 k 2024-09-21T10:29:31.465 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-21T10:29:31.688 INFO:teuthology.orchestra.run.smithi112.stdout:rbd-nbd-18.2.4-871.g6a1bdf85.el9.x86_64.rpm 768 kB/s | 172 kB 00:00 2024-09-21T10:29:31.689 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:31.689 INFO:teuthology.orchestra.run.smithi112.stdout:Total 763 kB/s | 172 kB 00:00 2024-09-21T10:29:31.689 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-21T10:29:31.697 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-21T10:29:31.697 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-21T10:29:31.759 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-21T10:29:31.760 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-21T10:29:31.930 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-21T10:29:32.021 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:32.021 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:32.021 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:32.022 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:32.022 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:32.022 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:32.026 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:32.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-nbd 2024-09-21T10:29:32.451 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:32.710 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-21T10:29:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:29:32.710 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-21T10:29:32.918 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 10:27:50 AM UTC. 2024-09-21T10:29:33.007 DEBUG:teuthology.parallel:result is None 2024-09-21T10:29:33.057 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:18.2.4-871.g6a1bdf85.el9 ceph 172 k 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:33.058 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T10:29:33.059 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T10:29:33.059 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-21T10:29:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:33.059 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 172 k 2024-09-21T10:29:33.059 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 494 k 2024-09-21T10:29:33.060 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T10:29:33.272 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-nbd-18.2.4-871.g6a1bdf85.el9.x86_64.rpm 806 kB/s | 172 kB 00:00 2024-09-21T10:29:33.273 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:29:33.273 INFO:teuthology.orchestra.run.smithi060.stdout:Total 801 kB/s | 172 kB 00:00 2024-09-21T10:29:33.274 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T10:29:33.282 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T10:29:33.282 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T10:29:33.350 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T10:29:33.350 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T10:29:33.513 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T10:29:33.614 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:34.396 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 1/1 2024-09-21T10:29:34.396 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:34.396 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T10:29:34.396 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:18.2.4-871.g6a1bdf85.el9.x86_64 2024-09-21T10:29:34.396 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:29:34.396 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T10:29:34.720 DEBUG:teuthology.parallel:result is None 2024-09-21T10:29:34.721 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:29:34.721 INFO:teuthology.packaging:ref: None 2024-09-21T10:29:34.721 INFO:teuthology.packaging:tag: None 2024-09-21T10:29:34.721 INFO:teuthology.packaging:branch: reef 2024-09-21T10:29:34.721 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:29:34.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-21T10:29:34.998 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T10:29:35.020 INFO:teuthology.orchestra.run.smithi060.stdout:18.2.4-871.g6a1bdf85.el9 2024-09-21T10:29:35.020 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-871.g6a1bdf85.el9 2024-09-21T10:29:35.021 INFO:teuthology.task.install:The correct ceph version 18.2.4-871.g6a1bdf85 is installed. 2024-09-21T10:29:35.022 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T10:29:35.022 INFO:teuthology.packaging:ref: None 2024-09-21T10:29:35.022 INFO:teuthology.packaging:tag: None 2024-09-21T10:29:35.022 INFO:teuthology.packaging:branch: reef 2024-09-21T10:29:35.022 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:29:35.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-21T10:29:35.297 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T10:29:35.320 INFO:teuthology.orchestra.run.smithi112.stdout:18.2.4-871.g6a1bdf85.el9 2024-09-21T10:29:35.320 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-871.g6a1bdf85.el9 2024-09-21T10:29:35.320 INFO:teuthology.task.install:The correct ceph version 18.2.4-871.g6a1bdf85 is installed. 2024-09-21T10:29:35.322 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T10:29:35.322 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:29:35.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T10:29:35.351 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:29:35.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T10:29:35.386 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T10:29:35.386 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:29:35.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T10:29:35.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T10:29:35.497 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:29:35.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T10:29:35.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T10:29:35.586 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T10:29:35.586 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:29:35.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T10:29:35.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T10:29:35.678 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:29:35.678 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T10:29:35.703 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T10:29:35.767 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T10:29:35.767 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:29:35.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T10:29:35.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T10:29:35.858 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:29:35.858 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T10:29:35.882 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T10:29:35.947 INFO:teuthology.run_tasks:Running task print... 2024-09-21T10:29:35.955 INFO:teuthology.task.print:**** done install task... 2024-09-21T10:29:35.955 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T10:29:36.045 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'} 2024-09-21T10:29:36.045 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-21T10:29:36.046 INFO:tasks.cephadm:Cluster fsid is 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:29:36.046 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T10:29:36.046 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-21T10:29:36.046 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi060': '172.21.15.60', 'mon.smithi112': '172.21.15.112'} 2024-09-21T10:29:36.046 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T10:29:36.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-09-21T10:29:36.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-09-21T10:29:36.097 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-21T10:29:36.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:29:36.244 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83200/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5103-g5c1cdc3c', 'node_name': '172.21.2.5+braggi05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5103.g5c1cdc3c'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0813/5c1cdc3c470dae78e91a0ed2bcf13509a046d301/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 10:00:04.055809', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-21-0813', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-21-0813/5c1cdc3c470dae78e91a0ed2bcf13509a046d301/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-21T10:29:36.517 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 6a1bdf854bb5803efd58957907442aa01f41a8fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-21T10:29:36.518 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/x86_64/flavors/default/cephadm 2024-09-21T10:29:36.518 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/x86_64/flavors/default/cephadm 2024-09-21T10:29:36.519 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T10:29:36.992 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 21 10:29 /home/ubuntu/cephtest/cephadm 2024-09-21T10:29:36.992 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/6a1bdf854bb5803efd58957907442aa01f41a8fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T10:29:37.467 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 21 10:29 /home/ubuntu/cephtest/cephadm 2024-09-21T10:29:37.467 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T10:29:37.488 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T10:29:37.517 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-21T10:29:37.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-21T10:29:37.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-21T10:29:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-21T10:29:39.208 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)", 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "0adab276c97e6f3143ffbca5eeff37fcd7dc3b5c0f339a9f747381d9993602de", 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6" 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-21T10:30:23.241 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)", 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "0adab276c97e6f3143ffbca5eeff37fcd7dc3b5c0f339a9f747381d9993602de", 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6" 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T10:30:23.975 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:30:23.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-09-21T10:30:24.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-09-21T10:30:24.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-09-21T10:30:24.228 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-09-21T10:30:24.260 INFO:tasks.cephadm:Writing seed config... 2024-09-21T10:30:24.261 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-21T10:30:24.261 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T10:30:24.262 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T10:30:24.263 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T10:30:24.264 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:30:24.264 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T10:30:24.286 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6621b92e-7804-11ef-baf6-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T10:30:24.286 DEBUG:teuthology.orchestra.run.smithi060:mon.smithi060> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service 2024-09-21T10:30:24.328 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T10:30:24.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid 6621b92e-7804-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.60 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:30:24.489 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T10:30:24.490 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.60', '--skip-admin-label'] 2024-09-21T10:30:24.513 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-21T10:30:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T10:30:24.514 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying podman|docker is present... 2024-09-21T10:30:24.537 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-21T10:30:24.537 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying lvm2 is present... 2024-09-21T10:30:24.537 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying time synchronization is in place... 2024-09-21T10:30:24.545 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T10:30:24.545 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T10:30:24.551 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T10:30:24.551 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T10:30:24.558 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-09-21T10:30:24.565 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-09-21T10:30:24.565 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-09-21T10:30:24.565 INFO:teuthology.orchestra.run.smithi060.stdout:Repeating the final host check... 2024-09-21T10:30:24.587 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-21T10:30:24.587 INFO:teuthology.orchestra.run.smithi060.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T10:30:24.588 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl is present 2024-09-21T10:30:24.588 INFO:teuthology.orchestra.run.smithi060.stdout:lvcreate is present 2024-09-21T10:30:24.594 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T10:30:24.594 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T10:30:24.601 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T10:30:24.601 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T10:30:24.607 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-09-21T10:30:24.614 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-09-21T10:30:24.614 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-09-21T10:30:24.614 INFO:teuthology.orchestra.run.smithi060.stdout:Host looks OK 2024-09-21T10:30:24.614 INFO:teuthology.orchestra.run.smithi060.stdout:Cluster fsid: 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:24.614 INFO:teuthology.orchestra.run.smithi060.stdout:Acquiring lock 140010401686864 on /run/cephadm/6621b92e-7804-11ef-baf6-efdc52797490.lock 2024-09-21T10:30:24.615 INFO:teuthology.orchestra.run.smithi060.stdout:Lock 140010401686864 acquired on /run/cephadm/6621b92e-7804-11ef-baf6-efdc52797490.lock 2024-09-21T10:30:24.615 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 3300 ... 2024-09-21T10:30:24.615 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 6789 ... 2024-09-21T10:30:24.616 INFO:teuthology.orchestra.run.smithi060.stdout:Base mon IP(s) is [172.21.15.60:3300, 172.21.15.60:6789], mon addrv is [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-21T10:30:24.619 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.60 metric 100 2024-09-21T10:30:24.619 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.60 metric 100 2024-09-21T10:30:24.621 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T10:30:24.621 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T10:30:24.622 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-21T10:30:24.624 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T10:30:24.624 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T10:30:24.624 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T10:30:24.624 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T10:30:24.624 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-21T10:30:24.624 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T10:30:24.625 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-09-21T10:30:24.625 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-09-21T10:30:24.625 INFO:teuthology.orchestra.run.smithi060.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T10:30:24.626 INFO:teuthology.orchestra.run.smithi060.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T10:30:24.626 INFO:teuthology.orchestra.run.smithi060.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 0adab276c97e6f3143ffbca5eeff37fcd7dc3b5c0f339a9f747381d9993602de 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:b51f6d1e10fe8de9e06c08c0a23ce0010d2bef42d30a6f89f3ac07fd857715ba 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying config sha256:0adab276c97e6f3143ffbca5eeff37fcd7dc3b5c0f339a9f747381d9993602de 2024-09-21T10:30:25.135 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T10:30:26.074 INFO:teuthology.orchestra.run.smithi060.stdout:ceph: stdout ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable) 2024-09-21T10:30:26.074 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph version: ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable) 2024-09-21T10:30:26.074 INFO:teuthology.orchestra.run.smithi060.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T10:30:26.963 INFO:teuthology.orchestra.run.smithi060.stdout:stat: stdout 167 167 2024-09-21T10:30:26.964 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial keys... 2024-09-21T10:30:28.002 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQBDoO5m62yVGBAAySbq39GAeMIGr9hc6vX8sA== 2024-09-21T10:30:28.874 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQBEoO5mwFbzEhAAvrtQsXaKjTxWqSQkW5s2cA== 2024-09-21T10:30:29.772 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQBFoO5mTgbQCRAArcONgaxgPtSecV+0UFXsog== 2024-09-21T10:30:29.773 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial monmap... 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool for smithi060 [v2:172.21.15.60:3300,v1:172.21.15.60:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = pacific 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: set fsid to 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:30:30.754 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mon... 2024-09-21T10:30:31.676 INFO:teuthology.orchestra.run.smithi060.stdout:create mon.smithi060 on 2024-09-21T10:30:31.889 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T10:30:32.042 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T10:30:32.334 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6621b92e-7804-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-6621b92e-7804-11ef-baf6-efdc52797490.target. 2024-09-21T10:30:32.334 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6621b92e-7804-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-6621b92e-7804-11ef-baf6-efdc52797490.target. 2024-09-21T10:30:32.584 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060 2024-09-21T10:30:32.584 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service: Unit ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service not loaded. 2024-09-21T10:30:32.766 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6621b92e-7804-11ef-baf6-efdc52797490.target.wants/ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service → /etc/systemd/system/ceph-6621b92e-7804-11ef-baf6-efdc52797490@.service. 2024-09-21T10:30:33.444 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T10:30:33.444 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T10:30:33.451 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T10:30:33.451 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T10:30:33.452 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T10:30:33.452 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T10:30:33.453 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon to start... 2024-09-21T10:30:33.453 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon... 2024-09-21T10:30:33.578 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:33 smithi060 systemd[1]: Started Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:30:34.632 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:34 smithi060 ceph-mon[27848]: mon.smithi060 is new leader, mons smithi060 in quorum (ranks 0) 2024-09-21T10:30:34.632 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:34 smithi060 ceph-mon[27848]: monmap e1: 1 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T10:30:34.632 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:34 smithi060 ceph-mon[27848]: fsmap 2024-09-21T10:30:34.632 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:34 smithi060 ceph-mon[27848]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T10:30:34.632 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:34 smithi060 ceph-mon[27848]: mgrmap e1: no daemons active 2024-09-21T10:30:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:36 smithi060 ceph-mon[27848]: from='client.? 172.21.15.60:0/2984757134' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T10:30:42.662 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T10:30:42.663 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout id: 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:42.663 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout services: 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi060 (age 3s) 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout data: 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:mon is available 2024-09-21T10:30:42.664 INFO:teuthology.orchestra.run.smithi060.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T10:30:43.820 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:43 smithi060 ceph-mon[27848]: from='client.? 172.21.15.60:0/1617019734' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T10:30:43.820 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:43 smithi060 ceph-mon[27848]: from='client.? 172.21.15.60:0/1617019734' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T10:30:44.084 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T10:30:44.085 INFO:teuthology.orchestra.run.smithi060.stdout:Generating new minimal ceph.conf... 2024-09-21T10:30:44.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:44 smithi060 ceph-mon[27848]: from='client.? 172.21.15.60:0/2252324684' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:30:45.164 INFO:teuthology.orchestra.run.smithi060.stdout:Restarting the monitor... 2024-09-21T10:30:45.440 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:45 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:30:45.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:45 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[27844]: 2024-09-21T10:30:45.437+0000 7f125d559640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:30:45.695 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:45 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[27844]: 2024-09-21T10:30:45.437+0000 7f125d559640 -1 mon.smithi060@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T10:30:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:45 smithi060 podman[28090]: 2024-09-21 10:30:45.693819045 +0000 UTC m=+0.358121617 container died caf385f11fbbb24c825393b6fc0e8f0793ad389076987613a568439d781fdb5c (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:30:46.423 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 podman[28090]: 2024-09-21 10:30:46.045684824 +0000 UTC m=+0.709987393 container cleanup caf385f11fbbb24c825393b6fc0e8f0793ad389076987613a568439d781fdb5c (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T10:30:46.423 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 bash[28090]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060 2024-09-21T10:30:46.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 podman[28103]: 2024-09-21 10:30:46.421661177 +0000 UTC m=+0.719077570 container remove caf385f11fbbb24c825393b6fc0e8f0793ad389076987613a568439d781fdb5c (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T10:30:46.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service: Deactivated successfully. 2024-09-21T10:30:46.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 systemd[1]: Stopped Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:30:46.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 systemd[1]: Starting Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:30:47.093 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 podman[28196]: 2024-09-21 10:30:46.82242721 +0000 UTC m=+0.103343951 container create 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-6a1bdf8, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:46 smithi060 podman[28196]: 2024-09-21 10:30:46.73542251 +0000 UTC m=+0.016339261 image pull 0adab276c97e6f3143ffbca5eeff37fcd7dc3b5c0f339a9f747381d9993602de quay.ceph.io/ceph-ci/ceph:reef 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 podman[28196]: 2024-09-21 10:30:47.025027681 +0000 UTC m=+0.305944430 container init 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 podman[28196]: 2024-09-21 10:30:47.028116585 +0000 UTC m=+0.309033326 container start 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable), process ceph-mon, pid 2 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: pidfile_write: ignore empty --pid-file 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: load: jerasure load: lrc 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: RocksDB version: 7.9.2 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Git sha 0 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Compile date 2024-09-20 20:34:00 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: DB SUMMARY 2024-09-21T10:30:47.094 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: DB Session ID: IWZAS5BL2PVVLO49SMJP 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: CURRENT file: CURRENT 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi060/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi060/store.db: 000009.log size: 91397 ; 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.error_if_exists: 0 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.create_if_missing: 0 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.paranoid_checks: 1 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.env: 0x55a3497cdbc0 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T10:30:47.095 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.info_log: 0x55a34bca4dc0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.statistics: (nil) 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.use_fsync: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_log_file_size: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.allow_fallocate: 1 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.use_direct_reads: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T10:30:47.096 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.db_log_dir: 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.wal_dir: 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.write_buffer_manager: 0x55a34bcb2320 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T10:30:47.097 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T10:30:47.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T10:30:47.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T10:30:47.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T10:30:47.098 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.unordered_write: 0 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.row_cache: None 2024-09-21T10:30:47.099 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.wal_filter: None 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.two_write_queues: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.wal_compression: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.atomic_flush: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.log_readahead_size: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T10:30:47.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_background_jobs: 2 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_background_compactions: -1 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_subcompactions: 1 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T10:30:47.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_open_files: -1 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_background_flushes: -1 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Compression algorithms supported: 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kZSTD supported: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kXpressCompression supported: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kBZip2Compression supported: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kLZ4Compression supported: 1 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kZlibCompression supported: 1 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T10:30:47.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: kSnappyCompression supported: 1 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000010 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.merge_operator: 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_filter: None 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a34bca4a20) 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T10:30:47.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_type: 0 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_index_type: 0 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_shortening: 1 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: checksum: 4 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: no_block_cache: 0 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache: 0x55a34bc99350 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_options: 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: capacity : 536870912 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_shard_bits : 4 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: strict_capacity_limit : 0 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_compressed: (nil) 2024-09-21T10:30:47.104 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: persistent_cache: (nil) 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size: 4096 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size_deviation: 10 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_restart_interval: 16 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_block_restart_interval: 1 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: metadata_block_size: 4096 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: partition_filters: 0 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: use_delta_encoding: 1 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: filter_policy: bloomfilter 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: whole_key_filtering: 1 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: verify_compression: 0 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: format_version: 5 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_index_compression: 1 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_align: 0 2024-09-21T10:30:47.105 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_auto_readahead_size: 262144 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: prepopulate_block_cache: 0 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: initial_auto_readahead_size: 8192 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression: NoCompression 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.num_levels: 7 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T10:30:47.106 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:30:47.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T10:30:47.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T10:30:47.109 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.inplace_update_support: 0 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T10:30:47.110 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.bloom_locality: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.max_successive_merges: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.ttl: 2592000 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.enable_blob_files: false 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.min_blob_size: 0 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T10:30:47.111 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 46823b86-3b59-4f7c-84a5-24ee1f3016c3 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726914647054965, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726914647056453, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 87285, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 85339, "index_size": 266, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11768, "raw_average_key_size": 48, "raw_value_size": 78783, "raw_average_value_size": 324, "num_data_blocks": 11, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726914647, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "46823b86-3b59-4f7c-84a5-24ee1f3016c3", "db_session_id": "IWZAS5BL2PVVLO49SMJP", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726914647056600, "job": 1, "event": "recovery_finished"} 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi060/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a34bcc4e00 2024-09-21T10:30:47.112 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: DB pointer 0x55a34bdb8000 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** DB Stats ** 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L0 2/0 87.14 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:30:47.113 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Sum 2/0 87.14 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 89.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T10:30:47.114 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative compaction: 0.00 GB write, 17.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval compaction: 0.00 GB write, 17.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Block cache BinnedLRUCache@0x55a34bc99350#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: starting mon.smithi060 rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi060 fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???) e1 preinit fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).mds e1 new map 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).mds e1 print_map 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: e1 2024-09-21T10:30:47.115 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: legacy client fscid: -1 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: No filesystems configured 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T10:30:47.116 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 bash[28196]: 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d 2024-09-21T10:30:47.116 INFO:teuthology.orchestra.run.smithi060.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T10:30:47.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 systemd[1]: Started Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:30:47.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mon.smithi060 is new leader, mons smithi060 in quorum (ranks 0) 2024-09-21T10:30:47.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: monmap e1: 1 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T10:30:47.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: fsmap 2024-09-21T10:30:47.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T10:30:47.352 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:47 smithi060 ceph-mon[28215]: mgrmap e1: no daemons active 2024-09-21T10:30:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:48 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2641247140' entity='client.admin' 2024-09-21T10:30:50.144 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T10:30:50.165 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:30:50.165 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mgr... 2024-09-21T10:30:50.165 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T10:30:50.166 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T10:30:50.166 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-21T10:30:50.426 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6621b92e-7804-11ef-baf6-efdc52797490@mgr.smithi060.mulzpr 2024-09-21T10:30:50.426 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6621b92e-7804-11ef-baf6-efdc52797490@mgr.smithi060.mulzpr.service: Unit ceph-6621b92e-7804-11ef-baf6-efdc52797490@mgr.smithi060.mulzpr.service not loaded. 2024-09-21T10:30:50.575 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6621b92e-7804-11ef-baf6-efdc52797490.target.wants/ceph-6621b92e-7804-11ef-baf6-efdc52797490@mgr.smithi060.mulzpr.service → /etc/systemd/system/ceph-6621b92e-7804-11ef-baf6-efdc52797490@.service. 2024-09-21T10:30:51.051 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T10:30:51.051 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T10:30:51.059 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T10:30:51.059 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T10:30:51.059 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T10:30:51.059 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T10:30:51.068 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T10:30:51.068 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T10:30:51.075 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T10:30:51.075 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T10:30:51.076 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T10:30:51.076 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-21T10:30:51.076 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr to start... 2024-09-21T10:30:51.076 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr... 2024-09-21T10:30:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:51 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3941836700' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T10:30:52.190 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:52.190 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:30:52.190 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "6621b92e-7804-11ef-baf6-efdc52797490", 2024-09-21T10:30:52.190 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T10:30:52.190 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T10:30:52.190 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T10:30:52.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T10:30:52.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:52.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T10:30:52.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T10:30:52.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T10:30:52.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T10:30:52.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T10:30:52.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T10:30:52.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T10:30:52.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T10:30:33.360251+0000", 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:52.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T10:30:52.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:30:52.198 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (1/15)... 2024-09-21T10:30:54.786 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:54 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1582865015' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T10:30:55.331 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "6621b92e-7804-11ef-baf6-efdc52797490", 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T10:30:55.332 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T10:30:55.333 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T10:30:55.334 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T10:30:55.337 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T10:30:55.337 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T10:30:55.337 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T10:30:55.337 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T10:30:55.338 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T10:30:33.360251+0000", 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:30:55.339 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (2/15)... 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: mgrmap e2: smithi060.mulzpr(active, starting, since 0.00301918s) 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:30:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' 2024-09-21T10:30:56.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"}]: dispatch 2024-09-21T10:30:56.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' 2024-09-21T10:30:56.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:55 smithi060 ceph-mon[28215]: from='mgr.14100 172.21.15.60:0/625080428' entity='mgr.smithi060.mulzpr' 2024-09-21T10:30:58.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:57 smithi060 ceph-mon[28215]: mgrmap e3: smithi060.mulzpr(active, since 1.00706s) 2024-09-21T10:30:58.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:58.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:30:58.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "6621b92e-7804-11ef-baf6-efdc52797490", 2024-09-21T10:30:58.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T10:30:58.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "smithi060" 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-21T10:30:58.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T10:30:58.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T10:30:58.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:58.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T10:30:58.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T10:30:58.514 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T10:30:58.517 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T10:30:58.517 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T10:30:58.517 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T10:30:58.517 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.517 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T10:30:58.517 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T10:30:58.518 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T10:30:33.360251+0000", 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T10:30:58.519 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:30:58.520 INFO:teuthology.orchestra.run.smithi060.stdout:mgr is available 2024-09-21T10:30:59.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:58 smithi060 ceph-mon[28215]: mgrmap e4: smithi060.mulzpr(active, since 2s) 2024-09-21T10:30:59.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:58 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/4271386018' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T10:30:59.618 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:59.618 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T10:30:59.619 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T10:30:59.620 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling cephadm module... 2024-09-21T10:31:00.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:30:59 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3459897736' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T10:31:01.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:00 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3965688519' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T10:31:02.075 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:01 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3965688519' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T10:31:02.075 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:01 smithi060 ceph-mon[28215]: mgrmap e5: smithi060.mulzpr(active, since 5s) 2024-09-21T10:31:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:31:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T10:31:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T10:31:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "smithi060.mulzpr", 2024-09-21T10:31:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T10:31:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:31:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-09-21T10:31:02.717 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 5... 2024-09-21T10:31:03.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:02 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2911124174' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T10:31:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: Active manager daemon smithi060.mulzpr restarted 2024-09-21T10:31:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:31:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T10:31:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: mgrmap e6: smithi060.mulzpr(active, starting, since 0.00315267s) 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:31:06.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:31:06.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:05 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"}]: dispatch 2024-09-21T10:31:07.235 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:06 smithi060 ceph-mon[28215]: Found migration_current of "None". Setting to last migration. 2024-09-21T10:31:07.235 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:06 smithi060 ceph-mon[28215]: mgrmap e7: smithi060.mulzpr(active, since 1.0053s) 2024-09-21T10:31:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:31:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T10:31:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T10:31:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:31:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 5 is available 2024-09-21T10:31:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:Setting orchestrator backend to cephadm... 2024-09-21T10:31:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:07 smithi060 ceph-mon[28215]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T10:31:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:07 smithi060 ceph-mon[28215]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T10:31:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:07 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:07 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: mgrmap e8: smithi060.mulzpr(active, since 2s) 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:08] ENGINE Bus STARTING 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:08] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:08] ENGINE Error in HTTPServer.serve 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Traceback (most recent call last): 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:31:09.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._run(expiration_interval) 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self.do_handshake() 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:31:09.189 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:09 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:31:09.877 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T10:31:09.877 INFO:teuthology.orchestra.run.smithi060.stdout:Generating ssh key... 2024-09-21T10:31:10.252 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:10 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:09] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:31:10.252 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:10 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:09] ENGINE Bus STARTED 2024-09-21T10:31:10.252 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:10 smithi060 ceph-mon[28215]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:11.900 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:11 smithi060 ceph-mon[28215]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:11.901 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:11 smithi060 ceph-mon[28215]: Generating ssh key... 2024-09-21T10:31:11.901 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:11 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:11.901 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:11 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:12.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/8skYeDaMCxQByWvJmL6SZiOY6TSwXvuPecsNVOaPf1cWnqegsBQiSkE1b9XLJ6TBqNlB5xRdEPQ3C15hLHfDLsbcgNrEBe7GuZaApPliiCgzPu9tJRFmyg2qwWVAsb7D8wlUg+zI0bsFHcwXOFywfUDSD+2BIsVOZw6CnlTXujUkm9tYlHiI35Vv8pTP1MZCDtbQjzdI27TRn5ioAaqW7hUy3yKGdAUrtqv7wLSaEKeBg3zzyCk/tXUxLjuo67QUMjvllgpOoXCc3eAb7HEtXHL+xd+pH9ibl8/UhXBsIhwFWVIZdz2Hdk++szNKetQKbZIrHGMg24EFqb/VqfmNJ9UzWjMVho+s0amC4I22rmEy4cecGE16DzGc9QGXiQUkheSSEXFaON73Z87H098ezCUiHpMTjhCKdZP7Y76krkt2nGFpaoOEer+cAGvS7Lxwv4SVXiBcZ+FrByOT0YyhHPYicnnBXyHq/M+wy3sFmKJPe/9D/a1+oVIwZiVtkk= ceph-6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:31:12.441 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T10:31:12.441 INFO:teuthology.orchestra.run.smithi060.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T10:31:12.448 INFO:teuthology.orchestra.run.smithi060.stdout:Adding host smithi060... 2024-09-21T10:31:13.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:12 smithi060 ceph-mon[28215]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:14.414 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:14 smithi060 ceph-mon[28215]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:15.356 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:15 smithi060 ceph-mon[28215]: Deploying cephadm binary to smithi060 2024-09-21T10:31:17.100 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Added host 'smithi060' with addr '172.21.15.60' 2024-09-21T10:31:17.100 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying mon service with default placement... 2024-09-21T10:31:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:17 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:17 smithi060 ceph-mon[28215]: Added host smithi060 2024-09-21T10:31:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:17 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:31:19.133 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:18 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:19.133 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:18 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:19.133 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:18 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:19.799 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T10:31:19.799 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying mgr service with default placement... 2024-09-21T10:31:20.141 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:19 smithi060 ceph-mon[28215]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:20.141 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:19 smithi060 ceph-mon[28215]: Saving service mon spec with placement count:5 2024-09-21T10:31:20.141 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:19 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T10:31:20.923 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying crash service with default placement... 2024-09-21T10:31:21.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:21 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:21.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:21 smithi060 ceph-mon[28215]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:21.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:21 smithi060 ceph-mon[28215]: Saving service mgr spec with placement count:2 2024-09-21T10:31:21.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:21 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:22.270 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-21T10:31:22.270 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying ceph-exporter service with default placement... 2024-09-21T10:31:22.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:22 smithi060 ceph-mon[28215]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:22.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:22 smithi060 ceph-mon[28215]: Saving service crash spec with placement * 2024-09-21T10:31:22.889 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:22 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:24.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-21T10:31:24.053 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying prometheus service with default placement... 2024-09-21T10:31:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:24 smithi060 ceph-mon[28215]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:24 smithi060 ceph-mon[28215]: Saving service ceph-exporter spec with placement * 2024-09-21T10:31:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:24 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:25.250 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-21T10:31:25.250 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying grafana service with default placement... 2024-09-21T10:31:25.795 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:25 smithi060 ceph-mon[28215]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:25.795 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:25 smithi060 ceph-mon[28215]: Saving service prometheus spec with placement count:1 2024-09-21T10:31:25.795 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:25 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:26.331 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-21T10:31:26.332 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying node-exporter service with default placement... 2024-09-21T10:31:27.176 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:26 smithi060 ceph-mon[28215]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:27.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:26 smithi060 ceph-mon[28215]: Saving service grafana spec with placement count:1 2024-09-21T10:31:27.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:26 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:27.177 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:26 smithi060 ceph-mon[28215]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:31:27.430 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-21T10:31:27.430 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying alertmanager service with default placement... 2024-09-21T10:31:28.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:27 smithi060 ceph-mon[28215]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:28.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:27 smithi060 ceph-mon[28215]: Saving service node-exporter spec with placement * 2024-09-21T10:31:28.035 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:27 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:28.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-21T10:31:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:28 smithi060 ceph-mon[28215]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:31:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:28 smithi060 ceph-mon[28215]: from='mgr.14118 172.21.15.60:0/878483708' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:30.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:29 smithi060 ceph-mon[28215]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:29 smithi060 ceph-mon[28215]: Saving service alertmanager spec with placement count:1 2024-09-21T10:31:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:29 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/591132719' entity='client.admin' 2024-09-21T10:31:30.792 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling the dashboard module... 2024-09-21T10:31:31.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:30 smithi060 ceph-mon[28215]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:31:31.108 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:30 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/4071974773' entity='client.admin' 2024-09-21T10:31:32.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:31 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3569997241' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T10:31:33.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:32 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3569997241' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T10:31:33.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:32 smithi060 ceph-mon[28215]: mgrmap e9: smithi060.mulzpr(active, since 25s) 2024-09-21T10:31:33.806 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:31:33.806 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T10:31:33.806 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T10:31:33.806 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "smithi060.mulzpr", 2024-09-21T10:31:33.806 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T10:31:33.807 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:31:33.807 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-09-21T10:31:33.807 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 9... 2024-09-21T10:31:34.147 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:33 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1996279807' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: Active manager daemon smithi060.mulzpr restarted 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: mgrmap e10: smithi060.mulzpr(active, starting, since 0.00320728s) 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:31:37.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:31:37.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:31:37.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:31:37.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:31:37.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:31:37.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:31:37.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:36 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"}]: dispatch 2024-09-21T10:31:38.749 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T10:31:38.749 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T10:31:38.749 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T10:31:38.749 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T10:31:38.749 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 9 is available 2024-09-21T10:31:38.750 INFO:teuthology.orchestra.run.smithi060.stdout:Generating a dashboard self-signed certificate... 2024-09-21T10:31:39.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:38 smithi060 ceph-mon[28215]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T10:31:39.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:38 smithi060 ceph-mon[28215]: mgrmap e11: smithi060.mulzpr(active, since 1.00552s) 2024-09-21T10:31:39.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:38 smithi060 ceph-mon[28215]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T10:31:39.002 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:38 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:39.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:39 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:38] ENGINE Bus STARTING 2024-09-21T10:31:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:39 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:39 smithi060 ceph-mon[28215]: mgrmap e12: smithi060.mulzpr(active, since 2s) 2024-09-21T10:31:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:39 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:39 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:40.452 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T10:31:40.452 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial admin user... 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:40 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:39] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:40 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:39] ENGINE Error in HTTPServer.serve 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Traceback (most recent call last): 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._run(expiration_interval) 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:31:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self.do_handshake() 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:40 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:39] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:40 smithi060 ceph-mon[28215]: [21/Sep/2024:10:31:39] ENGINE Bus STARTED 2024-09-21T10:31:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:40 smithi060 ceph-mon[28215]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:41.978 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$GJRin7mGLEZ.E6k6pd55luhcC0r.NebQZ0vnvIRVgDxu8RBq6TS16", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726914701, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T10:31:41.979 INFO:teuthology.orchestra.run.smithi060.stdout:Fetching dashboard port number... 2024-09-21T10:31:42.412 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:42 smithi060 ceph-mon[28215]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:42.412 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:42 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:43.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T10:31:43.155 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T10:31:43.155 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T10:31:43.164 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T10:31:43.164 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T10:31:43.164 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T10:31:43.164 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T10:31:43.166 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph Dashboard is now available at: 2024-09-21T10:31:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: URL: https://smithi060.front.sepia.ceph.com:8443/ 2024-09-21T10:31:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: User: admin 2024-09-21T10:31:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: Password: x24e8dhnvr 2024-09-21T10:31:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:43.167 INFO:teuthology.orchestra.run.smithi060.stdout:Saving cluster configuration to /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config directory 2024-09-21T10:31:43.167 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling autotune for osd_memory_target 2024-09-21T10:31:43.405 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:43 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/536947851' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T10:31:44.547 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:44 smithi060 ceph-mon[28215]: mgrmap e13: smithi060.mulzpr(active, since 6s) 2024-09-21T10:31:45.548 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T10:31:45.548 INFO:teuthology.orchestra.run.smithi060.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: ceph telemetry on 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout:For more information see: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.549 INFO:teuthology.orchestra.run.smithi060.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T10:31:45.550 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:31:45.550 INFO:teuthology.orchestra.run.smithi060.stdout:Bootstrap complete. 2024-09-21T10:31:45.583 INFO:tasks.cephadm:Fetching config... 2024-09-21T10:31:45.583 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:31:45.583 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T10:31:45.600 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T10:31:45.601 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:31:45.601 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T10:31:45.657 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T10:31:45.657 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:31:45.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/keyring of=/dev/stdout 2024-09-21T10:31:45.722 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T10:31:45.722 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:31:45.722 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T10:31:45.778 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T10:31:45.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/8skYeDaMCxQByWvJmL6SZiOY6TSwXvuPecsNVOaPf1cWnqegsBQiSkE1b9XLJ6TBqNlB5xRdEPQ3C15hLHfDLsbcgNrEBe7GuZaApPliiCgzPu9tJRFmyg2qwWVAsb7D8wlUg+zI0bsFHcwXOFywfUDSD+2BIsVOZw6CnlTXujUkm9tYlHiI35Vv8pTP1MZCDtbQjzdI27TRn5ioAaqW7hUy3yKGdAUrtqv7wLSaEKeBg3zzyCk/tXUxLjuo67QUMjvllgpOoXCc3eAb7HEtXHL+xd+pH9ibl8/UhXBsIhwFWVIZdz2Hdk++szNKetQKbZIrHGMg24EFqb/VqfmNJ9UzWjMVho+s0amC4I22rmEy4cecGE16DzGc9QGXiQUkheSSEXFaON73Z87H098ezCUiHpMTjhCKdZP7Y76krkt2nGFpaoOEer+cAGvS7Lxwv4SVXiBcZ+FrByOT0YyhHPYicnnBXyHq/M+wy3sFmKJPe/9D/a1+oVIwZiVtkk= ceph-6621b92e-7804-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T10:31:45.853 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/8skYeDaMCxQByWvJmL6SZiOY6TSwXvuPecsNVOaPf1cWnqegsBQiSkE1b9XLJ6TBqNlB5xRdEPQ3C15hLHfDLsbcgNrEBe7GuZaApPliiCgzPu9tJRFmyg2qwWVAsb7D8wlUg+zI0bsFHcwXOFywfUDSD+2BIsVOZw6CnlTXujUkm9tYlHiI35Vv8pTP1MZCDtbQjzdI27TRn5ioAaqW7hUy3yKGdAUrtqv7wLSaEKeBg3zzyCk/tXUxLjuo67QUMjvllgpOoXCc3eAb7HEtXHL+xd+pH9ibl8/UhXBsIhwFWVIZdz2Hdk++szNKetQKbZIrHGMg24EFqb/VqfmNJ9UzWjMVho+s0amC4I22rmEy4cecGE16DzGc9QGXiQUkheSSEXFaON73Z87H098ezCUiHpMTjhCKdZP7Y76krkt2nGFpaoOEer+cAGvS7Lxwv4SVXiBcZ+FrByOT0YyhHPYicnnBXyHq/M+wy3sFmKJPe/9D/a1+oVIwZiVtkk= ceph-6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:31:45.864 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/8skYeDaMCxQByWvJmL6SZiOY6TSwXvuPecsNVOaPf1cWnqegsBQiSkE1b9XLJ6TBqNlB5xRdEPQ3C15hLHfDLsbcgNrEBe7GuZaApPliiCgzPu9tJRFmyg2qwWVAsb7D8wlUg+zI0bsFHcwXOFywfUDSD+2BIsVOZw6CnlTXujUkm9tYlHiI35Vv8pTP1MZCDtbQjzdI27TRn5ioAaqW7hUy3yKGdAUrtqv7wLSaEKeBg3zzyCk/tXUxLjuo67QUMjvllgpOoXCc3eAb7HEtXHL+xd+pH9ibl8/UhXBsIhwFWVIZdz2Hdk++szNKetQKbZIrHGMg24EFqb/VqfmNJ9UzWjMVho+s0amC4I22rmEy4cecGE16DzGc9QGXiQUkheSSEXFaON73Z87H098ezCUiHpMTjhCKdZP7Y76krkt2nGFpaoOEer+cAGvS7Lxwv4SVXiBcZ+FrByOT0YyhHPYicnnBXyHq/M+wy3sFmKJPe/9D/a1+oVIwZiVtkk= ceph-6621b92e-7804-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T10:31:45.917 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/8skYeDaMCxQByWvJmL6SZiOY6TSwXvuPecsNVOaPf1cWnqegsBQiSkE1b9XLJ6TBqNlB5xRdEPQ3C15hLHfDLsbcgNrEBe7GuZaApPliiCgzPu9tJRFmyg2qwWVAsb7D8wlUg+zI0bsFHcwXOFywfUDSD+2BIsVOZw6CnlTXujUkm9tYlHiI35Vv8pTP1MZCDtbQjzdI27TRn5ioAaqW7hUy3yKGdAUrtqv7wLSaEKeBg3zzyCk/tXUxLjuo67QUMjvllgpOoXCc3eAb7HEtXHL+xd+pH9ibl8/UhXBsIhwFWVIZdz2Hdk++szNKetQKbZIrHGMg24EFqb/VqfmNJ9UzWjMVho+s0amC4I22rmEy4cecGE16DzGc9QGXiQUkheSSEXFaON73Z87H098ezCUiHpMTjhCKdZP7Y76krkt2nGFpaoOEer+cAGvS7Lxwv4SVXiBcZ+FrByOT0YyhHPYicnnBXyHq/M+wy3sFmKJPe/9D/a1+oVIwZiVtkk= ceph-6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:31:45.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T10:31:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:31:46.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:45 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/4114064' entity='client.admin' 2024-09-21T10:31:50.156 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T10:31:50.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1903621574' entity='client.admin' 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:31:50.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:49 smithi060 ceph-mon[28215]: Deploying daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:31:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:31:53.720 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2024-09-21T10:31:53.720 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:31:53.720 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2024-09-21T10:31:53.739 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:31:53.739 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:31:53.797 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2024-09-21T10:31:53.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch host add smithi112 2024-09-21T10:31:54.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:54.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:54.102 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:54.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:54.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:54.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:54.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T10:31:54.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T10:31:54.103 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:53 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:31:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:31:55.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:54 smithi060 ceph-mon[28215]: Deploying daemon crash.smithi060 on smithi060 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: Deploying daemon node-exporter.smithi060 on smithi060 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:31:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:57 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:00.308 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:59 smithi060 ceph-mon[28215]: Deploying cephadm binary to smithi112 2024-09-21T10:32:00.309 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:31:59 smithi060 ceph-mon[28215]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:00.309 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi112' with addr '172.21.15.112' 2024-09-21T10:32:00.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T10:32:01.056 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: Deploying daemon alertmanager.smithi060 on smithi060 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: Added host smithi112 2024-09-21T10:32:01.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:01 smithi060 ceph-mon[28215]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:03.187 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:32:03.187 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2024-09-21T10:32:03.187 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:02 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:04.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:03 smithi060 ceph-mon[28215]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:04.245 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T10:32:04.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T10:32:04.849 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:32:05.351 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:04 smithi060 ceph-mon[28215]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T10:32:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:05 smithi060 ceph-mon[28215]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:08.230 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:07 smithi060 ceph-mon[28215]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-09-21T10:32:09.163 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:08 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3860743060' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T10:32:09.744 INFO:tasks.cephadm:Adding mon.smithi060 on smithi060 2024-09-21T10:32:09.744 INFO:tasks.cephadm:Adding mon.smithi112 on smithi112 2024-09-21T10:32:09.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch apply mon '2;smithi060:172.21.15.60=smithi060;smithi112:172.21.15.112=smithi112' 2024-09-21T10:32:10.030 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:10.073 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:10.117 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:09 smithi060 ceph-mon[28215]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:10.117 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:09 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3860743060' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T10:32:10.117 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:09 smithi060 ceph-mon[28215]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T10:32:11.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T10:32:11.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:11.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: Deploying daemon grafana.smithi060 on smithi060 2024-09-21T10:32:11.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:11 smithi060 ceph-mon[28215]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:12.018 INFO:teuthology.orchestra.run.smithi112.stdout:Scheduled mon update... 2024-09-21T10:32:12.549 DEBUG:teuthology.orchestra.run.smithi112:mon.smithi112> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112.service 2024-09-21T10:32:12.551 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:12.551 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:12.769 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:12.812 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:13.273 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:12 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:13.273 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:12 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:14.419 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:14.420 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:14.420 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:14.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:13 smithi060 ceph-mon[28215]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi060:172.21.15.60=smithi060;smithi112:172.21.15.112=smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:32:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:13 smithi060 ceph-mon[28215]: Saving service mon spec with placement smithi060:172.21.15.60=smithi060;smithi112:172.21.15.112=smithi112;count:2 2024-09-21T10:32:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:13 smithi060 ceph-mon[28215]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:15.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:14 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/3196432355' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:15.969 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:15.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:16.163 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:16.207 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:16.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:15 smithi060 ceph-mon[28215]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:17.878 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:17.878 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:17.878 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:17 smithi060 ceph-mon[28215]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:17 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/205360212' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:19.477 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:19.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:19.677 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:19.719 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:20.240 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:19 smithi060 ceph-mon[28215]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:21.398 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:21.398 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:21.398 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.336 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.337 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:22.337 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/3995513216' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:22.337 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:21 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:23.063 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:23.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:23.188 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:22 smithi060 ceph-mon[28215]: Deploying daemon prometheus.smithi060 on smithi060 2024-09-21T10:32:23.258 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:23.301 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:24.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:23 smithi060 ceph-mon[28215]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:24.976 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:24.976 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:24.976 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:25 smithi060 ceph-mon[28215]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:25 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/1623484651' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:26.568 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:26.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:26.760 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:26.803 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:28.260 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:27 smithi060 ceph-mon[28215]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:28.406 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:28.406 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:29.264 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:28 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/3272880479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:30.004 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:30.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:30.199 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:29 smithi060 ceph-mon[28215]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:30.242 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:31.850 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:31.850 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:31.850 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/272078734' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:31 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:33.494 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:33.494 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:33.682 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:33.725 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:33.783 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:33 smithi060 ceph-mon[28215]: from='mgr.14162 172.21.15.60:0/3900977471' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T10:32:33.783 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:33 smithi060 ceph-mon[28215]: mgrmap e14: smithi060.mulzpr(active, since 55s) 2024-09-21T10:32:35.338 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:35.338 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:35.338 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:35.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:35 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/1873135738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:36.904 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:36.904 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:37.098 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:37.142 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:37.839 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: Active manager daemon smithi060.mulzpr restarted 2024-09-21T10:32:37.839 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:32:37.839 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: mgrmap e15: smithi060.mulzpr(active, starting, since 0.00301165s) 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:37.840 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:32:38.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:32:38.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"}]: dispatch 2024-09-21T10:32:38.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:38.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:38 smithi060 ceph-mon[28215]: mgrmap e16: smithi060.mulzpr(active, since 1.00546s) 2024-09-21T10:32:38.754 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:38.755 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:38.755 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2633425034' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: [21/Sep/2024:10:32:39] ENGINE Bus STARTING 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: [21/Sep/2024:10:32:39] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: [21/Sep/2024:10:32:39] ENGINE Error in HTTPServer.serve 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Traceback (most recent call last): 2024-09-21T10:32:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._run(expiration_interval) 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T10:32:39.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self.do_handshake() 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: [21/Sep/2024:10:32:39] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: [21/Sep/2024:10:32:39] ENGINE Bus STARTED 2024-09-21T10:32:39.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:40.342 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:40.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:40.638 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:41.032 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:41.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:41 smithi060 ceph-mon[28215]: mgrmap e17: smithi060.mulzpr(active, since 2s) 2024-09-21T10:32:43.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:43.313 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:43.313 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:32:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:44 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2740257887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:44.868 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:44.868 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:45.063 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:45.108 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:46.742 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:46.742 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:46.743 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:47.058 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:46 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/3859008789' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:48.348 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:48.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:48.540 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:48.585 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:32:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:48 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:32:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:50.461 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:50.462 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:32:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:32:50.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:50 smithi060 ceph-mon[28215]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:32:51.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:51 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/1820062225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:52.048 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:52.048 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:52.292 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:32:52.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:32:54.077 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:54.077 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:54.077 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:54 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/22608238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:55.646 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:55.646 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T10:32:56.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T10:32:56.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:32:56.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:55 smithi060 ceph-mon[28215]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T10:32:56.276 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:32:58.061 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:32:58.061 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:32:58.061 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/1369635305' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:32:59.844 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:32:59.844 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:32:59.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:32:59 smithi060 ceph-mon[28215]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T10:33:00.042 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:00.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:00 smithi060 ceph-mon[28215]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:02.580 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:33:02.580 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:33:02.581 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:33:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:02 smithi060 ceph-mon[28215]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2705884778' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:33:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:03.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:33:03.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T10:33:03.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:33:03.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:04.263 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:33:04.263 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:33:04.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:04 smithi060 ceph-mon[28215]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:04.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:04 smithi060 ceph-mon[28215]: Deploying daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:33:05.032 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:33:06.885 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":1,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:30:30.135352Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T10:33:06.885 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 1 2024-09-21T10:33:06.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:06 smithi060 ceph-mon[28215]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:07.763 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:07 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/553744798' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:33:07.764 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:08.506 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T10:33:08.507 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:33:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:08.814 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:09 smithi060 ceph-mon[28215]: Deploying daemon mon.smithi112 on smithi112 2024-09-21T10:33:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:10 smithi060 ceph-mon[28215]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:11.720 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:11 smithi112 podman[35065]: 2024-09-21 10:33:11.694102666 +0000 UTC m=+0.393404625 container create e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=reef-6a1bdf8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T10:33:12.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 podman[35065]: 2024-09-21 10:33:12.114712113 +0000 UTC m=+0.814014078 container init e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-21T10:33:12.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 podman[35065]: 2024-09-21 10:33:12.119083618 +0000 UTC m=+0.818385584 container start e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=reef-6a1bdf8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T10:33:12.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T10:33:12.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable), process ceph-mon, pid 2 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: pidfile_write: ignore empty --pid-file 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: load: jerasure load: lrc 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: RocksDB version: 7.9.2 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Git sha 0 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Compile date 2024-09-20 20:34:00 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: DB SUMMARY 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: DB Session ID: UUNBZ8KT7TMIJDXF6YJC 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: CURRENT file: CURRENT 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 0, files: 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000004.log size: 511 ; 2024-09-21T10:33:12.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.error_if_exists: 0 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.create_if_missing: 0 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.paranoid_checks: 1 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.env: 0x564dedb56bc0 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.info_log: 0x564def71adc0 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T10:33:12.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.statistics: (nil) 2024-09-21T10:33:12.454 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.use_fsync: 0 2024-09-21T10:33:12.454 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_log_file_size: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.allow_fallocate: 1 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.use_direct_reads: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.db_log_dir: 2024-09-21T10:33:12.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.wal_dir: 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.write_buffer_manager: 0x564def728320 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T10:33:12.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.unordered_write: 0 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.row_cache: None 2024-09-21T10:33:12.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.wal_filter: None 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.two_write_queues: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.wal_compression: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.atomic_flush: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.log_readahead_size: 0 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T10:33:12.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_background_jobs: 2 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_background_compactions: -1 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_subcompactions: 1 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T10:33:12.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_open_files: -1 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_background_flushes: -1 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Compression algorithms supported: 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kZSTD supported: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kXpressCompression supported: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kBZip2Compression supported: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T10:33:12.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kLZ4Compression supported: 1 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kZlibCompression supported: 1 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: kSnappyCompression supported: 1 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000005 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.merge_operator: 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_filter: None 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T10:33:12.461 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564def71aa20) 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 4 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x564def70f350 2024-09-21T10:33:12.462 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-09-21T10:33:12.463 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: bloomfilter 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 5 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_auto_readahead_size: 262144 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: prepopulate_block_cache: 0 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: initial_auto_readahead_size: 8192 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression: NoCompression 2024-09-21T10:33:12.464 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.num_levels: 7 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T10:33:12.465 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T10:33:12.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T10:33:12.467 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T10:33:12.468 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T10:33:12.468 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T10:33:12.468 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T10:33:12.469 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T10:33:12.469 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T10:33:12.470 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T10:33:12.471 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T10:33:12.472 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.inplace_update_support: 0 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.bloom_locality: 0 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.max_successive_merges: 0 2024-09-21T10:33:12.473 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.ttl: 2592000 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.enable_blob_files: false 2024-09-21T10:33:12.474 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.min_blob_size: 0 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 19a2467d-981e-4207-9db2-d743c1d538fc 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726914792145894, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T10:33:12.475 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726914792146309, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726914792, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "19a2467d-981e-4207-9db2-d743c1d538fc", "db_session_id": "UUNBZ8KT7TMIJDXF6YJC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726914792146404, "job": 1, "event": "recovery_finished"} 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564def73ae00 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: DB pointer 0x564def82e000 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:33:12.476 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T10:33:12.477 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache BinnedLRUCache@0x564def70f350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T10:33:12.478 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112 does not exist in monmap, will attempt to join an existing cluster 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: using public_addr v2:172.21.15.112:0/0 -> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: starting mon.smithi112 rank -1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(???) e0 preinit fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).mds e1 new map 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).mds e1 print_map 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e1 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: -1 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: No filesystems configured 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T10:33:12.479 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 ceph-mon[35117]: mon.smithi112@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 bash[35065]: e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 2024-09-21T10:33:12.480 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:12 smithi112 systemd[1]: Started Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:33:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:33:17.190 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":2,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","modified":"2024-09-21T10:33:12.176395Z","created":"2024-09-21T10:30:30.135352Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi060","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi112","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T10:33:17.190 INFO:teuthology.orchestra.run.smithi112.stderr:dumped monmap epoch 2 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: mon.smithi060 calling monitor election 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/2181946775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: mon.smithi112 calling monitor election 2024-09-21T10:33:17.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: mon.smithi060 is new leader, mons smithi060,smithi112 in quorum (ranks 0,1) 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: monmap e2: 2 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: fsmap 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: mgrmap e17: smithi060.mulzpr(active, since 39s) 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: overall HEALTH_OK 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:33:17.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:33:17.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:17 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:33:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: mon.smithi060 calling monitor election 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2181946775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: mon.smithi112 calling monitor election 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: mon.smithi060 is new leader, mons smithi060,smithi112 in quorum (ranks 0,1) 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: monmap e2: 2 mons at {smithi060=[v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0],smithi112=[v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: fsmap 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: mgrmap e17: smithi060.mulzpr(active, since 39s) 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: overall HEALTH_OK 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1621719055' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:33:17.701 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.702 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:17 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:17.891 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T10:33:17.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T10:33:18.109 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:18.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:18 smithi060 ceph-mon[28215]: mgrmap e18: smithi060.mulzpr(active, since 39s), standbys: smithi112.gkunly 2024-09-21T10:33:18.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"}]: dispatch 2024-09-21T10:33:18.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:33:18.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:18 smithi060 ceph-mon[28215]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:18.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:18.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:18 smithi112 ceph-mon[35117]: mgrmap e18: smithi060.mulzpr(active, since 39s), standbys: smithi112.gkunly 2024-09-21T10:33:18.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"}]: dispatch 2024-09-21T10:33:18.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:33:18.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:18 smithi112 ceph-mon[35117]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:18.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:33:19.951 INFO:teuthology.orchestra.run.smithi060.stdout:# minimal ceph.conf for 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:33:19.951 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-09-21T10:33:19.951 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:33:19.951 INFO:teuthology.orchestra.run.smithi060.stdout: mon_host = [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-09-21T10:33:20.597 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.597 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.597 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:20.597 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3970092777' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T10:33:20.598 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:20.619 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T10:33:20.619 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:33:20.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T10:33:20.647 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:33:20.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:33:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3970092777' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T10:33:20.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:20.713 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:33:20.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T10:33:20.742 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:33:20.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:33:20.807 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T10:33:20.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T10:33:20.810 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T10:33:20.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T10:33:20.853 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T10:33:20.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T10:33:20.896 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T10:33:20.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T10:33:20.939 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T10:33:20.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T10:33:20.982 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T10:33:20.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T10:33:21.027 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T10:33:21.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T10:33:21.070 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T10:33:21.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T10:33:21.113 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T10:33:21.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T10:33:21.157 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T10:33:21.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T10:33:21.200 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T10:33:21.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T10:33:21.243 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T10:33:21.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T10:33:21.286 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T10:33:21.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T10:33:21.329 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T10:33:21.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T10:33:21.383 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T10:33:21.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T10:33:21.428 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T10:33:21.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T10:33:21.472 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-21T10:33:21.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-21T10:33:21.515 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T10:33:21.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T10:33:21.558 DEBUG:tasks.cephadm:set 18 configs 2024-09-21T10:33:21.558 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi060') 2024-09-21T10:33:21.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:21 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:21.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:21 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:21.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:21 smithi060 ceph-mon[28215]: Reconfiguring mon.smithi060 (unknown last config time)... 2024-09-21T10:33:21.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:21 smithi060 ceph-mon[28215]: Reconfiguring daemon mon.smithi060 on smithi060 2024-09-21T10:33:21.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:21 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:21.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:21 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:33:21.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:21 smithi112 ceph-mon[35117]: Reconfiguring mon.smithi060 (unknown last config time)... 2024-09-21T10:33:21.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:21 smithi112 ceph-mon[35117]: Reconfiguring daemon mon.smithi060 on smithi060 2024-09-21T10:33:21.921 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.312 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:33:22.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:33:22.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:22.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:22.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:22.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:22.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:22.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:33:22.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:33:22.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:22.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:22.783 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:22.821 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:23.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:23 smithi060 ceph-mon[28215]: Reconfiguring mgr.smithi060.mulzpr (unknown last config time)... 2024-09-21T10:33:23.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:23 smithi060 ceph-mon[28215]: Reconfiguring daemon mgr.smithi060.mulzpr on smithi060 2024-09-21T10:33:23.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:23 smithi112 ceph-mon[35117]: Reconfiguring mgr.smithi060.mulzpr (unknown last config time)... 2024-09-21T10:33:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:23 smithi112 ceph-mon[35117]: Reconfiguring daemon mgr.smithi060.mulzpr on smithi060 2024-09-21T10:33:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:24.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:24 smithi060 ceph-mon[28215]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:24.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:24 smithi112 ceph-mon[35117]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:26.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:26 smithi060 ceph-mon[28215]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:26.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:26 smithi112 ceph-mon[35117]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:28 smithi060 ceph-mon[28215]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:28 smithi112 ceph-mon[35117]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:30.594 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:30 smithi060 ceph-mon[28215]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:30 smithi112 ceph-mon[35117]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:31 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2715822400' entity='client.admin' 2024-09-21T10:33:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:31 smithi060 ceph-mon[28215]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:31 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2715822400' entity='client.admin' 2024-09-21T10:33:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:31 smithi112 ceph-mon[35117]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:32.284 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:34.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:34 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2322910805' entity='client.admin' 2024-09-21T10:33:34.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:34 smithi060 ceph-mon[28215]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:34.872 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:34 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2322910805' entity='client.admin' 2024-09-21T10:33:34.872 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:34 smithi112 ceph-mon[35117]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:36.290 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:36 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1166829739' entity='client.admin' 2024-09-21T10:33:36.291 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:36 smithi060 ceph-mon[28215]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:36.291 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:36 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2526998223' entity='client.admin' 2024-09-21T10:33:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:36 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1166829739' entity='client.admin' 2024-09-21T10:33:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:36 smithi112 ceph-mon[35117]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:36 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2526998223' entity='client.admin' 2024-09-21T10:33:37.600 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:37 smithi060 ceph-mon[28215]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:37.600 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:37 smithi112 ceph-mon[35117]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:38.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:38 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/789149476' entity='client.admin' 2024-09-21T10:33:38.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:38 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/999071433' entity='client.admin' 2024-09-21T10:33:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:39.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:38 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/789149476' entity='client.admin' 2024-09-21T10:33:39.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:38 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/999071433' entity='client.admin' 2024-09-21T10:33:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: Reconfiguring ceph-exporter.smithi060 (monmap changed)... 2024-09-21T10:33:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:33:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: Reconfiguring daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:33:40.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3816767137' entity='client.admin' 2024-09-21T10:33:40.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:39 smithi060 ceph-mon[28215]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: Reconfiguring ceph-exporter.smithi060 (monmap changed)... 2024-09-21T10:33:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:33:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: Reconfiguring daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:33:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3816767137' entity='client.admin' 2024-09-21T10:33:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:39 smithi112 ceph-mon[35117]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:41.130 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:41.130 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:41.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:41 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/358462134' entity='client.admin' 2024-09-21T10:33:41.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:41 smithi060 ceph-mon[28215]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:41 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/358462134' entity='client.admin' 2024-09-21T10:33:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:41 smithi112 ceph-mon[35117]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:44.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:44 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2356589454' entity='client.admin' 2024-09-21T10:33:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:44 smithi060 ceph-mon[28215]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:44 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2356589454' entity='client.admin' 2024-09-21T10:33:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:44 smithi112 ceph-mon[35117]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:45.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:45.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:45.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: Reconfiguring crash.smithi060 (monmap changed)... 2024-09-21T10:33:45.545 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T10:33:45.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:45.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: Reconfiguring daemon crash.smithi060 on smithi060 2024-09-21T10:33:45.546 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:45 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2351309960' entity='client.admin' 2024-09-21T10:33:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: Reconfiguring crash.smithi060 (monmap changed)... 2024-09-21T10:33:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T10:33:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:33:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: Reconfiguring daemon crash.smithi060 on smithi060 2024-09-21T10:33:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:45 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2351309960' entity='client.admin' 2024-09-21T10:33:46.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:46 smithi060 ceph-mon[28215]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:46.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:46 smithi112 ceph-mon[35117]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:46.901 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi060') 2024-09-21T10:33:48.860 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:48 smithi060 ceph-mon[28215]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:48 smithi112 ceph-mon[35117]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:33:50.763 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:50 smithi060 ceph-mon[28215]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:50.764 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:50 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/631822236' entity='client.admin' 2024-09-21T10:33:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:50 smithi112 ceph-mon[35117]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:50 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/631822236' entity='client.admin' 2024-09-21T10:33:52.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:51 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1431707992' entity='client.admin' 2024-09-21T10:33:52.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:51 smithi060 ceph-mon[28215]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:52.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:51 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1431707992' entity='client.admin' 2024-09-21T10:33:52.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:51 smithi112 ceph-mon[35117]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.860+0000 7f1f29ffb640 1 -- 172.21.15.60:0/3644895636 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1f180400b0 con 0x7f1f2c0fee10 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.862+0000 7f1f32d89640 1 -- 172.21.15.60:0/3644895636 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1f1c06cbd0 msgr2=0x7f1f1c06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 --2- 172.21.15.60:0/3644895636 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1f1c06cbd0 0x7f1f1c06f090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000a8b0 tx=0x7f1f20007040 comp rx=0 tx=0).stop 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 -- 172.21.15.60:0/3644895636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f2c0fee10 msgr2=0x7f1f2c104590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 --2- 172.21.15.60:0/3644895636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f2c0fee10 0x7f1f2c104590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f18000c00 tx=0x7f1f18005000 comp rx=0 tx=0).stop 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 -- 172.21.15.60:0/3644895636 shutdown_connections 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 --2- 172.21.15.60:0/3644895636 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1f1c06cbd0 0x7f1f1c06f090 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 --2- 172.21.15.60:0/3644895636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f2c0fee10 0x7f1f2c104590 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 --2- 172.21.15.60:0/3644895636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f2c0fe4d0 0x7f1f2c104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:52.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 -- 172.21.15.60:0/3644895636 >> 172.21.15.60:0/3644895636 conn(0x7f1f2c0fa280 msgr2=0x7f1f2c106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 -- 172.21.15.60:0/3644895636 shutdown_connections 2024-09-21T10:33:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:51.863+0000 7f1f32d89640 1 -- 172.21.15.60:0/3644895636 wait complete. 2024-09-21T10:33:53.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:52 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3644895636' entity='client.admin' 2024-09-21T10:33:53.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:53.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:52 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3644895636' entity='client.admin' 2024-09-21T10:33:53.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:33:54.049 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:53 smithi060 ceph-mon[28215]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:54.072 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi060') 2024-09-21T10:33:54.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:53 smithi112 ceph-mon[35117]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:56.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:56.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:56.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:55 smithi060 ceph-mon[28215]: Reconfiguring alertmanager.smithi060 (dependencies changed)... 2024-09-21T10:33:56.137 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:55 smithi060 ceph-mon[28215]: Reconfiguring daemon alertmanager.smithi060 on smithi060 2024-09-21T10:33:56.137 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:55 smithi060 ceph-mon[28215]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:55 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:55 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:33:56.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:55 smithi112 ceph-mon[35117]: Reconfiguring alertmanager.smithi060 (dependencies changed)... 2024-09-21T10:33:56.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:55 smithi112 ceph-mon[35117]: Reconfiguring daemon alertmanager.smithi060 on smithi060 2024-09-21T10:33:56.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:55 smithi112 ceph-mon[35117]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:56.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/1872408886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4103070 msgr2=0x7f4eb4105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:56.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/1872408886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4103070 0x7f4eb4105460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009880 tx=0x7f4ea402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/1872408886 shutdown_connections 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/1872408886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4103070 0x7f4eb4105460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/1872408886 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb4100740 0x7f4eb4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/1872408886 >> 172.21.15.60:0/1872408886 conn(0x7f4eb40fa280 msgr2=0x7f4eb40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/1872408886 shutdown_connections 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/1872408886 wait complete. 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.526+0000 7f4ebc3fb640 1 Processor -- start 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4ebc3fb640 1 -- start start 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4ebc3fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 0x7f4eb41955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4ebc3fb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb4103070 0x7f4eb4195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4ebc3fb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb41960f0 con 0x7f4eb4100740 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4ebc3fb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4196260 con 0x7f4eb4103070 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 0x7f4eb41955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 0x7f4eb41955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40556/0 (socket says 172.21.15.60:40556) 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 -- 172.21.15.60:0/3836319207 learned_addr learned my addr 172.21.15.60:0/3836319207 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eb9996640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb4103070 0x7f4eb4195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 -- 172.21.15.60:0/3836319207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb4103070 msgr2=0x7f4eb4195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb4103070 0x7f4eb4195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 -- 172.21.15.60:0/3836319207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea4009560 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.527+0000 7f4eba197640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 0x7f4eb41955e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000cc90 tx=0x7f4eb000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.528+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb0004b20 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.528+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f4eb0004c80 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.528+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb419ad00 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.528+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb000f680 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.528+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb419b1c0 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.529+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb4100b20 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.529+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f4eb0005020 con 0x7f4eb4100740 2024-09-21T10:33:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.530+0000 7f4eab7fe640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ea006cbd0 0x7f4ea006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.530+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4eb008b230 con 0x7f4eb4100740 2024-09-21T10:33:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.530+0000 7f4eb9996640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ea006cbd0 0x7f4ea006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.530+0000 7f4eb9996640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ea006cbd0 0x7f4ea006f090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4000c00 tx=0x7f4ea40043a0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:33:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.534+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4eb0056760 con 0x7f4eb4100740 2024-09-21T10:33:56.656 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T10:33:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.707+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f4eb41086c0 con 0x7f4eb4100740 2024-09-21T10:33:56.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.711+0000 7f4eab7fe640 1 -- 172.21.15.60:0/3836319207 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) v1 ==== 108+0+0 (secure 0 0 0) 0x7f4eb001d070 con 0x7f4eb4100740 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ea006cbd0 msgr2=0x7f4ea006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ea006cbd0 0x7f4ea006f090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4000c00 tx=0x7f4ea40043a0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 msgr2=0x7f4eb41955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 0x7f4eb41955e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000cc90 tx=0x7f4eb000a620 comp rx=0 tx=0).stop 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 shutdown_connections 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ea006cbd0 0x7f4ea006f090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4eb4103070 0x7f4eb4195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 --2- 172.21.15.60:0/3836319207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eb4100740 0x7f4eb41955e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:56.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 >> 172.21.15.60:0/3836319207 conn(0x7f4eb40fa280 msgr2=0x7f4eb40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:56.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 shutdown_connections 2024-09-21T10:33:56.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.714+0000 7f4ebc3fb640 1 -- 172.21.15.60:0/3836319207 wait complete. 2024-09-21T10:33:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:57 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2523361900' entity='client.admin' 2024-09-21T10:33:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:57 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3836319207' entity='client.admin' 2024-09-21T10:33:57.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 -- 172.21.15.60:0/1252874158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250102f60 msgr2=0x7f5250105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 --2- 172.21.15.60:0/1252874158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250102f60 0x7f5250105350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52440098b0 tx=0x7f524402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 -- 172.21.15.60:0/1252874158 shutdown_connections 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 --2- 172.21.15.60:0/1252874158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250102f60 0x7f5250105350 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 --2- 172.21.15.60:0/1252874158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250100630 0x7f5250102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 -- 172.21.15.60:0/1252874158 >> 172.21.15.60:0/1252874158 conn(0x7f52500fa250 msgr2=0x7f52500fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 -- 172.21.15.60:0/1252874158 shutdown_connections 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.661+0000 7f52568e3640 1 -- 172.21.15.60:0/1252874158 wait complete. 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f52568e3640 1 Processor -- start 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f52568e3640 1 -- start start 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f52568e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 0x7f52501955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f52568e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250102f60 0x7f5250195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f52568e3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250196100 con 0x7f5250100630 2024-09-21T10:33:57.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f52568e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250196270 con 0x7f5250102f60 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 0x7f52501955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 0x7f52501955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40578/0 (socket says 172.21.15.60:40578) 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524ffff640 1 -- 172.21.15.60:0/3298929414 learned_addr learned my addr 172.21.15.60:0/3298929414 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524f7fe640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250102f60 0x7f5250195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524ffff640 1 -- 172.21.15.60:0/3298929414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250102f60 msgr2=0x7f5250195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524ffff640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250102f60 0x7f5250195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524ffff640 1 -- 172.21.15.60:0/3298929414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244009560 con 0x7f5250100630 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.662+0000 7f524f7fe640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250102f60 0x7f5250195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.663+0000 7f524ffff640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 0x7f52501955f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f524000b450 tx=0x7f524000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.663+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5240011860 con 0x7f5250100630 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.663+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f5240011e60 con 0x7f5250100630 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.663+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525019ad10 con 0x7f5250100630 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.663+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f524000f340 con 0x7f5250100630 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.663+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525019b250 con 0x7f5250100630 2024-09-21T10:33:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.664+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5250100a10 con 0x7f5250100630 2024-09-21T10:33:57.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.664+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f52400103e0 con 0x7f5250100630 2024-09-21T10:33:57.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.665+0000 7f524d7fa640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f523806cbd0 0x7f523806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:57.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.665+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f524008b0b0 con 0x7f5250100630 2024-09-21T10:33:57.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.665+0000 7f524f7fe640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f523806cbd0 0x7f523806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:57.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.665+0000 7f524f7fe640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f523806cbd0 0x7f523806f090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5244006010 tx=0x7f5244004420 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:33:57.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.669+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f52400564c0 con 0x7f5250100630 2024-09-21T10:33:57.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:57 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2523361900' entity='client.admin' 2024-09-21T10:33:57.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:57 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3836319207' entity='client.admin' 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 -- 172.21.15.60:0/2000181570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 msgr2=0x7f9f94105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2000181570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94105350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f880098b0 tx=0x7f9f8802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 -- 172.21.15.60:0/2000181570 shutdown_connections 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2000181570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94105350 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2000181570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f94100630 0x7f9f94102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 -- 172.21.15.60:0/2000181570 >> 172.21.15.60:0/2000181570 conn(0x7f9f940fa250 msgr2=0x7f9f940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 -- 172.21.15.60:0/2000181570 shutdown_connections 2024-09-21T10:33:57.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.133+0000 7f9f99c08640 1 -- 172.21.15.60:0/2000181570 wait complete. 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f99c08640 1 Processor -- start 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f99c08640 1 -- start start 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f99c08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f94100630 0x7f9f941954d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f99c08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f99c08640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94195fe0 con 0x7f9f94102f60 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f99c08640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94196150 con 0x7f9f94100630 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.134+0000 7f9f92ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f92ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40542/0 (socket says 172.21.15.60:40542) 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f92ffd640 1 -- 172.21.15.60:0/2523361900 learned_addr learned my addr 172.21.15.60:0/2523361900 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f937fe640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f94100630 0x7f9f941954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:57.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f92ffd640 1 -- 172.21.15.60:0/2523361900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f94100630 msgr2=0x7f9f941954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f92ffd640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f94100630 0x7f9f941954d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f92ffd640 1 -- 172.21.15.60:0/2523361900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009560 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f92ffd640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94195a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f88004d00 tx=0x7f9f88004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f880054e0 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9f88005640 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9419ab90 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f88031a00 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.135+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9419b100 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.136+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f94100a10 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.137+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f9f88031c40 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.137+0000 7f9f90ff9640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9f7c06cbd0 0x7f9f7c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.137+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9f880ac3f0 con 0x7f9f94102f60 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.137+0000 7f9f937fe640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9f7c06cbd0 0x7f9f7c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.138+0000 7f9f937fe640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9f7c06cbd0 0x7f9f7c06f090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f840058c0 tx=0x7f9f8400a250 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:33:57.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.142+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9f88077950 con 0x7f9f94102f60 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.315+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f9f94108530 con 0x7f9f94102f60 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.319+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 7 ==== config(26 keys) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f9f88077950 con 0x7f9f94102f60 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.319+0000 7f9f90ff9640 1 -- 172.21.15.60:0/2523361900 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9f880abbb0 con 0x7f9f94102f60 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9f7c06cbd0 msgr2=0x7f9f7c06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9f7c06cbd0 0x7f9f7c06f090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f840058c0 tx=0x7f9f8400a250 comp rx=0 tx=0).stop 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 msgr2=0x7f9f94195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94195a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f88004d00 tx=0x7f9f88004d30 comp rx=0 tx=0).stop 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 shutdown_connections 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9f7c06cbd0 0x7f9f7c06f090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f94102f60 0x7f9f94195a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 --2- 172.21.15.60:0/2523361900 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f94100630 0x7f9f941954d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 >> 172.21.15.60:0/2523361900 conn(0x7f9f940fa250 msgr2=0x7f9f940fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:57.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 shutdown_connections 2024-09-21T10:33:57.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:56.321+0000 7f9f99c08640 1 -- 172.21.15.60:0/2523361900 wait complete. 2024-09-21T10:33:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.844+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f52501086d0 con 0x7f5250100630 2024-09-21T10:33:57.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.848+0000 7f524d7fa640 1 -- 172.21.15.60:0/3298929414 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) v1 ==== 106+0+0 (secure 0 0 0) 0x7f5240059ae0 con 0x7f5250100630 2024-09-21T10:33:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f523806cbd0 msgr2=0x7f523806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f523806cbd0 0x7f523806f090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5244006010 tx=0x7f5244004420 comp rx=0 tx=0).stop 2024-09-21T10:33:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 msgr2=0x7f52501955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:33:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 0x7f52501955f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f524000b450 tx=0x7f524000b910 comp rx=0 tx=0).stop 2024-09-21T10:33:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 shutdown_connections 2024-09-21T10:33:57.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f523806cbd0 0x7f523806f090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5250102f60 0x7f5250195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 --2- 172.21.15.60:0/3298929414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5250100630 0x7f52501955f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:33:57.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 >> 172.21.15.60:0/3298929414 conn(0x7f52500fa250 msgr2=0x7f52500fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:33:57.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 shutdown_connections 2024-09-21T10:33:57.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:33:57.850+0000 7f52568e3640 1 -- 172.21.15.60:0/3298929414 wait complete. 2024-09-21T10:33:58.565 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:58 smithi060 ceph-mon[28215]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:58.565 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:33:58 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3298929414' entity='client.admin' 2024-09-21T10:33:58.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:58 smithi112 ceph-mon[35117]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:33:58.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:33:58 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3298929414' entity='client.admin' 2024-09-21T10:34:00.844 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:00 smithi060 ceph-mon[28215]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:00 smithi112 ceph-mon[35117]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 -- 172.21.15.60:0/1433112673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb948100d90 msgr2=0x7fb948101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 --2- 172.21.15.60:0/1433112673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb948100d90 0x7fb948101210 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009880 tx=0x7fb93c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 -- 172.21.15.60:0/1433112673 shutdown_connections 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 --2- 172.21.15.60:0/1433112673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb948100d90 0x7fb948101210 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 --2- 172.21.15.60:0/1433112673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9480ffb90 0x7fb9480fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 -- 172.21.15.60:0/1433112673 >> 172.21.15.60:0/1433112673 conn(0x7fb9480fb320 msgr2=0x7fb9480fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 -- 172.21.15.60:0/1433112673 shutdown_connections 2024-09-21T10:34:01.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.896+0000 7fb94cf62640 1 -- 172.21.15.60:0/1433112673 wait complete. 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.897+0000 7fb94cf62640 1 Processor -- start 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.897+0000 7fb94cf62640 1 -- start start 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94cf62640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 0x7fb948195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94cf62640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb948100d90 0x7fb948195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94cf62640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948196060 con 0x7fb9480ffb90 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94cf62640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481961d0 con 0x7fb948100d90 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 0x7fb948195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 0x7fb948195550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40582/0 (socket says 172.21.15.60:40582) 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 -- 172.21.15.60:0/4220253718 learned_addr learned my addr 172.21.15.60:0/4220253718 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:34:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb945d9b640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb948100d90 0x7fb948195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 -- 172.21.15.60:0/4220253718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb948100d90 msgr2=0x7fb948195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb948100d90 0x7fb948195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 -- 172.21.15.60:0/4220253718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c009560 con 0x7fb9480ffb90 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94659c640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 0x7fb948195550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb93800d900 tx=0x7fb93800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb938009c00 con 0x7fb9480ffb90 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fb938009d60 con 0x7fb9480ffb90 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.898+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94819ac00 con 0x7fb9480ffb90 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.899+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800f5f0 con 0x7fb9480ffb90 2024-09-21T10:34:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.899+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94819b150 con 0x7fb9480ffb90 2024-09-21T10:34:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.900+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9480fff90 con 0x7fb9480ffb90 2024-09-21T10:34:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.900+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fb938010460 con 0x7fb9480ffb90 2024-09-21T10:34:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.901+0000 7fb9377fe640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb93006cbd0 0x7fb93006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.901+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb93808af80 con 0x7fb9480ffb90 2024-09-21T10:34:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.901+0000 7fb945d9b640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb93006cbd0 0x7fb93006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.901+0000 7fb945d9b640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb93006cbd0 0x7fb93006f090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb948196a00 tx=0x7fb93c031400 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:01.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:01.905+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9380bee20 con 0x7fb9480ffb90 2024-09-21T10:34:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.077+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fb94818f5f0 con 0x7fb9480ffb90 2024-09-21T10:34:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.081+0000 7fb9377fe640 1 -- 172.21.15.60:0/4220253718 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v27)=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb9380210c0 con 0x7fb9480ffb90 2024-09-21T10:34:02.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb93006cbd0 msgr2=0x7fb93006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:02.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb93006cbd0 0x7fb93006f090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb948196a00 tx=0x7fb93c031400 comp rx=0 tx=0).stop 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 msgr2=0x7fb948195550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 0x7fb948195550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb93800d900 tx=0x7fb93800ddc0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 shutdown_connections 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb93006cbd0 0x7fb93006f090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb948100d90 0x7fb948195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 --2- 172.21.15.60:0/4220253718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9480ffb90 0x7fb948195550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 >> 172.21.15.60:0/4220253718 conn(0x7fb9480fb320 msgr2=0x7fb9481044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 shutdown_connections 2024-09-21T10:34:02.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.083+0000 7fb94cf62640 1 -- 172.21.15.60:0/4220253718 wait complete. 2024-09-21T10:34:02.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 -- 172.21.15.60:0/943758920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 msgr2=0x7f15d00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:02.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 --2- 172.21.15.60:0/943758920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d00fee80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009880 tx=0x7f15c002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 -- 172.21.15.60:0/943758920 shutdown_connections 2024-09-21T10:34:02.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 --2- 172.21.15.60:0/943758920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15d00ffc80 0x7f15d0100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 --2- 172.21.15.60:0/943758920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d00fee80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 -- 172.21.15.60:0/943758920 >> 172.21.15.60:0/943758920 conn(0x7f15d00fa230 msgr2=0x7f15d00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:02.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 -- 172.21.15.60:0/943758920 shutdown_connections 2024-09-21T10:34:02.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.099+0000 7f15d5563640 1 -- 172.21.15.60:0/943758920 wait complete. 2024-09-21T10:34:02.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15d5563640 1 Processor -- start 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15d5563640 1 -- start start 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15d5563640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d0197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15d5563640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15d00ffc80 0x7f15d0197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15d5563640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d01981a0 con 0x7f15d00fea80 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15d5563640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0198310 con 0x7f15d00ffc80 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d0197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d0197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40610/0 (socket says 172.21.15.60:40610) 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.100+0000 7f15ceffd640 1 -- 172.21.15.60:0/617196802 learned_addr learned my addr 172.21.15.60:0/617196802 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15ce7fc640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15d00ffc80 0x7f15d0197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15ceffd640 1 -- 172.21.15.60:0/617196802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15d00ffc80 msgr2=0x7f15d0197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15ceffd640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15d00ffc80 0x7f15d0197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15ceffd640 1 -- 172.21.15.60:0/617196802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0009560 con 0x7f15d00fea80 2024-09-21T10:34:02.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15ceffd640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d0197720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009230 tx=0x7f15c0004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c00054e0 con 0x7f15d00fea80 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d019cd90 con 0x7f15d00fea80 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f15c0005640 con 0x7f15d00fea80 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15c0031b10 con 0x7f15d00fea80 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.101+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d019d1d0 con 0x7f15d00fea80 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.102+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d00fee80 con 0x7f15d00fea80 2024-09-21T10:34:02.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.103+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f15c0031c70 con 0x7f15d00fea80 2024-09-21T10:34:02.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.104+0000 7f15b7fff640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f15b806cbd0 0x7f15b806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:02.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.104+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f15c00ac230 con 0x7f15d00fea80 2024-09-21T10:34:02.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.104+0000 7f15ce7fc640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f15b806cbd0 0x7f15b806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:02.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.104+0000 7f15ce7fc640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f15b806cbd0 0x7f15b806f090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15d0198c40 tx=0x7f15c400a2d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:02.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.108+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f15c0077760 con 0x7f15d00fea80 2024-09-21T10:34:02.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.283+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f15d0107530 con 0x7f15d00fea80 2024-09-21T10:34:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.287+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 7 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15c0077760 con 0x7f15d00fea80 2024-09-21T10:34:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.287+0000 7f15b7fff640 1 -- 172.21.15.60:0/617196802 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) v1 ==== 123+0+0 (secure 0 0 0) 0x7f15c004a0c0 con 0x7f15d00fea80 2024-09-21T10:34:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.289+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f15b806cbd0 msgr2=0x7f15b806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.289+0000 7f15d5563640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f15b806cbd0 0x7f15b806f090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f15d0198c40 tx=0x7f15c400a2d0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.289+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 msgr2=0x7f15d0197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.289+0000 7f15d5563640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d0197720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009230 tx=0x7f15c0004da0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 shutdown_connections 2024-09-21T10:34:02.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f15b806cbd0 0x7f15b806f090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15d00ffc80 0x7f15d0197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 --2- 172.21.15.60:0/617196802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d00fea80 0x7f15d0197720 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:02.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 >> 172.21.15.60:0/617196802 conn(0x7f15d00fa230 msgr2=0x7f15d0068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:02.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 shutdown_connections 2024-09-21T10:34:02.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:02.290+0000 7f15d5563640 1 -- 172.21.15.60:0/617196802 wait complete. 2024-09-21T10:34:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:02 smithi060 ceph-mon[28215]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:02 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/4220253718' entity='client.admin' 2024-09-21T10:34:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:02 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/617196802' entity='client.admin' 2024-09-21T10:34:02.898 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T10:34:02.899 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi060') 2024-09-21T10:34:02.899 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi060') 2024-09-21T10:34:02.899 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi060') 2024-09-21T10:34:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:02 smithi112 ceph-mon[35117]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:02 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/4220253718' entity='client.admin' 2024-09-21T10:34:02.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:02 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/617196802' entity='client.admin' 2024-09-21T10:34:03.268 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi060') 2024-09-21T10:34:03.269 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.712 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:04 smithi060 ceph-mon[28215]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:04.736 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:reef', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6621b92e-7804-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi060') 2024-09-21T10:34:04.737 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T10:34:04.738 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:34:04.738 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T10:34:04.756 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T10:34:04.756 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 10:32:30.877409208 +0000 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 10:27:13.717136917 +0000 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 10:27:13.717136917 +0000 2024-09-21T10:34:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 10:27:13.717136917 +0000 2024-09-21T10:34:04.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T10:34:04.882 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T10:34:04.882 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T10:34:04.882 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 9.8421e-05 s, 5.2 MB/s 2024-09-21T10:34:04.883 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T10:34:04.931 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:04 smithi112 ceph-mon[35117]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:04.941 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-21T10:34:04.996 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 10:32:30.877409208 +0000 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 10:27:14.036133742 +0000 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 10:27:14.036133742 +0000 2024-09-21T10:34:04.997 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 10:27:14.036133742 +0000 2024-09-21T10:34:04.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T10:34:05.063 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T10:34:05.063 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T10:34:05.063 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00011389 s, 4.5 MB/s 2024-09-21T10:34:05.064 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T10:34:05.121 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 10:32:30.878409198 +0000 2024-09-21T10:34:05.178 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 10:27:14.350130616 +0000 2024-09-21T10:34:05.179 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 10:27:14.350130616 +0000 2024-09-21T10:34:05.179 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 10:27:14.350130616 +0000 2024-09-21T10:34:05.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T10:34:05.242 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T10:34:05.242 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T10:34:05.242 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000105451 s, 4.9 MB/s 2024-09-21T10:34:05.243 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T10:34:05.300 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 10:32:30.878409198 +0000 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 10:27:14.660127530 +0000 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 10:27:14.660127530 +0000 2024-09-21T10:34:05.357 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 10:27:14.660127530 +0000 2024-09-21T10:34:05.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T10:34:05.424 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T10:34:05.424 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T10:34:05.424 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000110119 s, 4.6 MB/s 2024-09-21T10:34:05.426 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T10:34:05.483 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:34:05.483 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T10:34:05.503 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T10:34:05.503 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 10:33:10.806511947 +0000 2024-09-21T10:34:05.562 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 10:27:02.066044788 +0000 2024-09-21T10:34:05.563 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 10:27:02.066044788 +0000 2024-09-21T10:34:05.563 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 10:27:02.066044788 +0000 2024-09-21T10:34:05.563 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T10:34:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T10:34:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T10:34:05.631 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000226974 s, 2.3 MB/s 2024-09-21T10:34:05.632 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T10:34:05.691 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-21T10:34:05.748 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 10:33:10.806511947 +0000 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 10:27:02.378036667 +0000 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 10:27:02.378036667 +0000 2024-09-21T10:34:05.749 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 10:27:02.378036667 +0000 2024-09-21T10:34:05.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T10:34:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T10:34:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T10:34:05.814 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000203871 s, 2.5 MB/s 2024-09-21T10:34:05.816 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T10:34:05.873 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 10:33:10.807511921 +0000 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 10:27:02.694028443 +0000 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 10:27:02.694028443 +0000 2024-09-21T10:34:05.929 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 10:27:02.694028443 +0000 2024-09-21T10:34:05.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T10:34:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T10:34:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T10:34:05.993 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00033919 s, 1.5 MB/s 2024-09-21T10:34:05.995 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T10:34:06.051 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-21T10:34:06.107 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T10:34:06.107 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-21 10:33:10.807511921 +0000 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 10:27:03.016020061 +0000 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 10:27:03.016020061 +0000 2024-09-21T10:34:06.108 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 10:27:03.016020061 +0000 2024-09-21T10:34:06.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T10:34:06.171 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-21T10:34:06.171 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-21T10:34:06.171 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00019371 s, 2.6 MB/s 2024-09-21T10:34:06.172 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T10:34:06.229 INFO:tasks.cephadm:Deploying osd.0 on smithi060 with /dev/vg_nvme/lv_4... 2024-09-21T10:34:06.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T10:34:06.623 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:34:06.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:06 smithi060 ceph-mon[28215]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:06 smithi112 ceph-mon[35117]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:07 smithi060 ceph-mon[28215]: Reconfiguring grafana.smithi060 (dependencies changed)... 2024-09-21T10:34:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:07 smithi060 ceph-mon[28215]: Reconfiguring daemon grafana.smithi060 on smithi060 2024-09-21T10:34:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:07 smithi060 ceph-mon[28215]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:07 smithi112 ceph-mon[35117]: Reconfiguring grafana.smithi060 (dependencies changed)... 2024-09-21T10:34:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:07 smithi112 ceph-mon[35117]: Reconfiguring daemon grafana.smithi060 on smithi060 2024-09-21T10:34:07.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:07 smithi112 ceph-mon[35117]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:07.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:10.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:10 smithi060 ceph-mon[28215]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:10 smithi112 ceph-mon[35117]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:12.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:12 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:12.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:12 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:12.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:12 smithi060 ceph-mon[28215]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-09-21T10:34:12.365 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:12 smithi060 ceph-mon[28215]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:12 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:12 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:12.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:12 smithi112 ceph-mon[35117]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-09-21T10:34:12.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:12 smithi112 ceph-mon[35117]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:12.794 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:34:12.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-09-21T10:34:13.636 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:34:13.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:13 smithi060 ceph-mon[28215]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-09-21T10:34:13.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:13 smithi112 ceph-mon[35117]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-09-21T10:34:14.610 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:14 smithi060 ceph-mon[28215]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:14.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:14 smithi112 ceph-mon[35117]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 -- 172.21.15.60:0/1082525513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680ffcf0 msgr2=0x7f2868100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 --2- 172.21.15.60:0/1082525513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680ffcf0 0x7f2868100170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2858009880 tx=0x7f285802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:34:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 -- 172.21.15.60:0/1082525513 shutdown_connections 2024-09-21T10:34:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 --2- 172.21.15.60:0/1082525513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680ffcf0 0x7f2868100170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 --2- 172.21.15.60:0/1082525513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28680feaf0 0x7f28680feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:15.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 -- 172.21.15.60:0/1082525513 >> 172.21.15.60:0/1082525513 conn(0x7f28680fa280 msgr2=0x7f28680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:15.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 -- 172.21.15.60:0/1082525513 shutdown_connections 2024-09-21T10:34:15.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.980+0000 7f2870461640 1 -- 172.21.15.60:0/1082525513 wait complete. 2024-09-21T10:34:15.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f2870461640 1 Processor -- start 2024-09-21T10:34:15.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f2870461640 1 -- start start 2024-09-21T10:34:15.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f2870461640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 0x7f2868102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:15.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f2870461640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28680ffcf0 0x7f28681010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:15.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f2870461640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868101610 con 0x7f28680feaf0 2024-09-21T10:34:15.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f2870461640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868101780 con 0x7f28680ffcf0 2024-09-21T10:34:15.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f286e1fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 0x7f2868102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:15.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.981+0000 7f286e1fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 0x7f2868102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53284/0 (socket says 172.21.15.60:53284) 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f286e1fd640 1 -- 172.21.15.60:0/979755312 learned_addr learned my addr 172.21.15.60:0/979755312 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f286d9fc640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28680ffcf0 0x7f28681010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f286e1fd640 1 -- 172.21.15.60:0/979755312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28680ffcf0 msgr2=0x7f28681010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f286e1fd640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28680ffcf0 0x7f28681010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f286e1fd640 1 -- 172.21.15.60:0/979755312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858009560 con 0x7f28680feaf0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f286e1fd640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 0x7f2868102a80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f286400ea00 tx=0x7f286400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286400cd50 con 0x7f28680feaf0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2864011930 con 0x7f28680feaf0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868101a60 con 0x7f28680feaf0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286401a9a0 con 0x7f28680feaf0 2024-09-21T10:34:15.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.982+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286819d750 con 0x7f28680feaf0 2024-09-21T10:34:15.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.983+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28681076e0 con 0x7f28680feaf0 2024-09-21T10:34:15.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.984+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f2864011aa0 con 0x7f28680feaf0 2024-09-21T10:34:15.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.984+0000 7f285f7fe640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f285406cbd0 0x7f285406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:15.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.985+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f286408b630 con 0x7f28680feaf0 2024-09-21T10:34:15.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.985+0000 7f286d9fc640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f285406cbd0 0x7f285406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:15.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.985+0000 7f286d9fc640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f285406cbd0 0x7f285406f090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2858009230 tx=0x7f28580058d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:15.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:15.989+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2864056b60 con 0x7f28680feaf0 2024-09-21T10:34:16.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:16.176+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f28680683d0 con 0x7f285406cbd0 2024-09-21T10:34:16.831 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:16 smithi060 ceph-mon[28215]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:16.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:16 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:34:16.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:16 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:34:16.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:16 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:16 smithi112 ceph-mon[35117]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:16.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:16 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:34:16.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:16 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:34:16.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:16 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:17.914 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:17 smithi060 ceph-mon[28215]: from='client.14318 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:34:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:17 smithi112 ceph-mon[35117]: from='client.14318 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:34:18.851 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:18 smithi112 ceph-mon[35117]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:18.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:18 smithi060 ceph-mon[28215]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:20.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:20 smithi060 ceph-mon[28215]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:20.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:20.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:20.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:34:20.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:20.922 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:20 smithi112 ceph-mon[35117]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:20.922 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:20.922 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:20.922 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:34:20.922 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: Reconfiguring ceph-exporter.smithi112 (monmap changed)... 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: Reconfiguring daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/6745467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f773ee-264c-4ae2-82d5-ad981f25dbdb"}]: dispatch 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/6745467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09f773ee-264c-4ae2-82d5-ad981f25dbdb"}]': finished 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:21 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1071500205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: Reconfiguring ceph-exporter.smithi112 (monmap changed)... 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: Reconfiguring daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/6745467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f773ee-264c-4ae2-82d5-ad981f25dbdb"}]: dispatch 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/6745467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09f773ee-264c-4ae2-82d5-ad981f25dbdb"}]': finished 2024-09-21T10:34:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T10:34:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T10:34:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:21 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1071500205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:34:22.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:22.841 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:23.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: Reconfiguring mgr.smithi112.gkunly (monmap changed)... 2024-09-21T10:34:23.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: Reconfiguring daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:34:23.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:23.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:23.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:34:23.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T10:34:23.827 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: Reconfiguring mgr.smithi112.gkunly (monmap changed)... 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: Reconfiguring daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T10:34:23.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:24 smithi112 ceph-mon[35117]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:24 smithi112 ceph-mon[35117]: Reconfiguring mon.smithi112 (monmap changed)... 2024-09-21T10:34:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:24 smithi112 ceph-mon[35117]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-21T10:34:24.796 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:24 smithi060 ceph-mon[28215]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:24.796 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:24 smithi060 ceph-mon[28215]: Reconfiguring mon.smithi112 (monmap changed)... 2024-09-21T10:34:24.797 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:24 smithi060 ceph-mon[28215]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T10:34:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:34:25.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:25 smithi060 ceph-mon[28215]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:26.138 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:26.138 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi060.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi060.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:34:26.139 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T10:34:26.140 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi060.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T10:34:26.140 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:26.140 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:34:26.140 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:25 smithi112 ceph-mon[35117]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:27.724 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:27 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:27.724 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:27 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:27.724 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:27 smithi060 ceph-mon[28215]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:27 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:27 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:27 smithi112 ceph-mon[35117]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:29.642 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:29 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T10:34:29.642 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:29 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:29 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T10:34:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:29 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:30.594 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:30 smithi060 ceph-mon[28215]: Deploying daemon osd.0 on smithi060 2024-09-21T10:34:30.595 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:30 smithi060 ceph-mon[28215]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:30 smithi112 ceph-mon[35117]: Deploying daemon osd.0 on smithi060 2024-09-21T10:34:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:30 smithi112 ceph-mon[35117]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:32.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:32 smithi060 ceph-mon[28215]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:34:32.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:32.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:32.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:32.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:32 smithi112 ceph-mon[35117]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:32.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:32.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:34:32.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:34.884 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:34 smithi060 ceph-mon[28215]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:34 smithi112 ceph-mon[35117]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:35.830 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:35 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:34:35.830 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:35 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:35.830 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:35 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:35 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:34:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:35 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:35 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:36.793 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:36 smithi060 ceph-mon[28215]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:36.795 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:36 smithi112 ceph-mon[35117]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:38.406 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:38.406 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:38.406 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:38 smithi060 ceph-mon[28215]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:38.406 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:38 smithi112 ceph-mon[35117]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:39.293 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 0 on host 'smithi060' 2024-09-21T10:34:39.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.290+0000 7f285f7fe640 1 -- 172.21.15.60:0/979755312 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f28680683d0 con 0x7f285406cbd0 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f285406cbd0 msgr2=0x7f285406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f285406cbd0 0x7f285406f090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2858009230 tx=0x7f28580058d0 comp rx=0 tx=0).stop 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 msgr2=0x7f2868102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 0x7f2868102a80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f286400ea00 tx=0x7f286400eec0 comp rx=0 tx=0).stop 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 shutdown_connections 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f285406cbd0 0x7f285406f090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28680ffcf0 0x7f28681010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 --2- 172.21.15.60:0/979755312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28680feaf0 0x7f2868102a80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.292+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 >> 172.21.15.60:0/979755312 conn(0x7f28680fa280 msgr2=0x7f2868067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.293+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 shutdown_connections 2024-09-21T10:34:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:39.293+0000 7f2870461640 1 -- 172.21.15.60:0/979755312 wait complete. 2024-09-21T10:34:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:40 smithi060 ceph-mon[28215]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T10:34:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:40 smithi060 ceph-mon[28215]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:40.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:40.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:40.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:40 smithi112 ceph-mon[35117]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T10:34:40.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:40 smithi112 ceph-mon[35117]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:41.156 DEBUG:teuthology.orchestra.run.smithi060:osd.0> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T10:34:41.159 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_3... 2024-09-21T10:34:41.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T10:34:41.404 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:41 smithi060 ceph-mon[28215]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T10:34:41.404 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:41 smithi060 ceph-mon[28215]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T10:34:41.405 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:41.405 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:41 smithi060 ceph-mon[28215]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-21T10:34:41.405 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:34:41 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[50590]: 2024-09-21T10:34:41.297+0000 7fb4aeb58640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T10:34:41.405 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:34:41 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[50590]: 2024-09-21T10:34:41.301+0000 7fb4ab193640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:34:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:41 smithi112 ceph-mon[35117]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T10:34:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:41 smithi112 ceph-mon[35117]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T10:34:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:41.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:41 smithi112 ceph-mon[35117]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-21T10:34:41.859 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:34:42.669 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T10:34:42.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T10:34:42.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:42.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:42.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:42.670 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:42.671 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: from='osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T10:34:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T10:34:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:42.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T10:34:42.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:42.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:43.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:43 smithi060 ceph-mon[28215]: purged_snaps scrub starts 2024-09-21T10:34:43.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:43 smithi060 ceph-mon[28215]: purged_snaps scrub ok 2024-09-21T10:34:43.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:43 smithi060 ceph-mon[28215]: osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] boot 2024-09-21T10:34:43.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:43 smithi060 ceph-mon[28215]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T10:34:43.515 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:43 smithi112 ceph-mon[35117]: purged_snaps scrub starts 2024-09-21T10:34:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:43 smithi112 ceph-mon[35117]: purged_snaps scrub ok 2024-09-21T10:34:43.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:43 smithi112 ceph-mon[35117]: osd.0 [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] boot 2024-09-21T10:34:43.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:43 smithi112 ceph-mon[35117]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T10:34:43.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:43 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:34:44.560 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:44 smithi060 ceph-mon[28215]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T10:34:44.560 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:44 smithi060 ceph-mon[28215]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:44.564 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:34:44.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-09-21T10:34:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:44 smithi112 ceph-mon[35117]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T10:34:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:44 smithi112 ceph-mon[35117]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:45.516 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:34:46.910 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:46 smithi060 ceph-mon[28215]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:46.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:46 smithi112 ceph-mon[35117]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 -- 172.21.15.60:0/2895906587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 msgr2=0x7fe6c4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/2895906587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c4101210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009880 tx=0x7fe6b402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:34:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 -- 172.21.15.60:0/2895906587 shutdown_connections 2024-09-21T10:34:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/2895906587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c4101210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/2895906587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c40ffb90 0x7fe6c40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 -- 172.21.15.60:0/2895906587 >> 172.21.15.60:0/2895906587 conn(0x7fe6c40fb320 msgr2=0x7fe6c40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:34:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 -- 172.21.15.60:0/2895906587 shutdown_connections 2024-09-21T10:34:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.697+0000 7fe6cc76c640 1 -- 172.21.15.60:0/2895906587 wait complete. 2024-09-21T10:34:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6cc76c640 1 Processor -- start 2024-09-21T10:34:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6cc76c640 1 -- start start 2024-09-21T10:34:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6cc76c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c40ffb90 0x7fe6c419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6cc76c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c419c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6cc76c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419c740 con 0x7fe6c4100d90 2024-09-21T10:34:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6cc76c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419c8b0 con 0x7fe6c40ffb90 2024-09-21T10:34:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6c9d07640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c419c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6c9d07640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c419c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59844/0 (socket says 172.21.15.60:59844) 2024-09-21T10:34:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.698+0000 7fe6c9d07640 1 -- 172.21.15.60:0/3113933017 learned_addr learned my addr 172.21.15.60:0/3113933017 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:34:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6ca508640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c40ffb90 0x7fe6c419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6c9d07640 1 -- 172.21.15.60:0/3113933017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c40ffb90 msgr2=0x7fe6c419bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:34:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6c9d07640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c40ffb90 0x7fe6c419bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:34:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6c9d07640 1 -- 172.21.15.60:0/3113933017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009560 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6c9d07640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c419c170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4006010 tx=0x7fe6b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b4004aa0 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c41a12e0 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6b4005d50 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b4003a80 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.699+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c41a1850 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.700+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c41052a0 con 0x7fe6c4100d90 2024-09-21T10:34:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.701+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fe6b4003d00 con 0x7fe6c4100d90 2024-09-21T10:34:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.702+0000 7fe6bb7fe640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe6b006cbc0 0x7fe6b006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:34:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.702+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fe6b40ac9b0 con 0x7fe6c4100d90 2024-09-21T10:34:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.702+0000 7fe6ca508640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe6b006cbc0 0x7fe6b006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:34:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.702+0000 7fe6ca508640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe6b006cbc0 0x7fe6b006f080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe6c419d110 tx=0x7fe6c0005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:34:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.706+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe6b4077d30 con 0x7fe6c4100d90 2024-09-21T10:34:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:34:47.896+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6c402c4f0 con 0x7fe6b006cbc0 2024-09-21T10:34:47.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: Detected new or changed devices on smithi060 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi060 to 11844M 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:34:47.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:47 smithi112 ceph-mon[35117]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:48.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: Detected new or changed devices on smithi060 2024-09-21T10:34:48.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:48.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:48.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi060 to 11844M 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:34:48.162 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:47 smithi060 ceph-mon[28215]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:48 smithi060 ceph-mon[28215]: from='client.14336 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:34:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:34:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:34:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:48 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:49.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:48 smithi112 ceph-mon[35117]: from='client.14336 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:34:49.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:48 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:34:49.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:48 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:34:49.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:48 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:49.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:48 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:49.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:48 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:49.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:49 smithi060 ceph-mon[28215]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:50.021 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:49 smithi112 ceph-mon[35117]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:51.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:51 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3410307442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c4c1a09-06c2-4843-8df1-8603fc43594d"}]: dispatch 2024-09-21T10:34:51.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:51 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3410307442' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c4c1a09-06c2-4843-8df1-8603fc43594d"}]': finished 2024-09-21T10:34:51.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:51 smithi060 ceph-mon[28215]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T10:34:51.618 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:51 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:34:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:51 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3410307442' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c4c1a09-06c2-4843-8df1-8603fc43594d"}]: dispatch 2024-09-21T10:34:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:51 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3410307442' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c4c1a09-06c2-4843-8df1-8603fc43594d"}]': finished 2024-09-21T10:34:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:51 smithi112 ceph-mon[35117]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T10:34:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:51 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:34:52.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:52 smithi060 ceph-mon[28215]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:52.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:52 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2329006640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:34:52.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:52 smithi112 ceph-mon[35117]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:52.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:52 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2329006640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:34:53.668 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:53.668 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:53.668 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:53.669 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:53.669 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:34:53.669 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:53.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:34:53.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:34:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:34:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:54 smithi060 ceph-mon[28215]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:54.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:54 smithi112 ceph-mon[35117]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:56.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:56 smithi060 ceph-mon[28215]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:56.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:56 smithi112 ceph-mon[35117]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:58.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:58 smithi060 ceph-mon[28215]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:58.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T10:34:58.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:58 smithi112 ceph-mon[35117]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:34:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T10:34:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:34:59.747 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:34:59 smithi060 ceph-mon[28215]: Deploying daemon osd.1 on smithi060 2024-09-21T10:34:59.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:34:59 smithi112 ceph-mon[35117]: Deploying daemon osd.1 on smithi060 2024-09-21T10:35:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:00 smithi112 ceph-mon[35117]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:00.918 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:00 smithi060 ceph-mon[28215]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:02.822 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:02 smithi060 ceph-mon[28215]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:02 smithi112 ceph-mon[35117]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:03.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:03.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:03.719 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:04.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:04 smithi060 ceph-mon[28215]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:04.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:04 smithi112 ceph-mon[35117]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:05.842 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:05 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:05.843 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:05 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:05.843 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:05 smithi060 ceph-mon[28215]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:06.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:05 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:06.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:05 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:06.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:05 smithi112 ceph-mon[35117]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:06.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.647+0000 7fe6bb7fe640 1 -- 172.21.15.60:0/3113933017 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe6c402c4f0 con 0x7fe6b006cbc0 2024-09-21T10:35:06.651 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2024-09-21T10:35:06.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe6b006cbc0 msgr2=0x7fe6b006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:06.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe6b006cbc0 0x7fe6b006f080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe6c419d110 tx=0x7fe6c0005f90 comp rx=0 tx=0).stop 2024-09-21T10:35:06.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 msgr2=0x7fe6c419c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:06.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c419c170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4006010 tx=0x7fe6b40055a0 comp rx=0 tx=0).stop 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 shutdown_connections 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe6b006cbc0 0x7fe6b006f080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c4100d90 0x7fe6c419c170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 --2- 172.21.15.60:0/3113933017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6c40ffb90 0x7fe6c419bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 >> 172.21.15.60:0/3113933017 conn(0x7fe6c40fb320 msgr2=0x7fe6c4102470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 shutdown_connections 2024-09-21T10:35:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:06.650+0000 7fe6cc76c640 1 -- 172.21.15.60:0/3113933017 wait complete. 2024-09-21T10:35:07.508 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T10:35:07.510 INFO:tasks.cephadm:Deploying osd.2 on smithi060 with /dev/vg_nvme/lv_2... 2024-09-21T10:35:07.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T10:35:07.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:07.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:07.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:07 smithi060 ceph-mon[28215]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T10:35:07.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:07 smithi060 ceph-mon[28215]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:07.761 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:07.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:07 smithi112 ceph-mon[35117]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T10:35:07.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:07 smithi112 ceph-mon[35117]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:07.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:08.272 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:35:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:08 smithi060 ceph-mon[28215]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T10:35:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:08 smithi060 ceph-mon[28215]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T10:35:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:08 smithi060 ceph-mon[28215]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-21T10:35:08.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:08 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[57958]: 2024-09-21T10:35:08.652+0000 7ff2a5c65640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T10:35:08.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:08 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[57958]: 2024-09-21T10:35:08.657+0000 7ff2a22a0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:35:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:08 smithi112 ceph-mon[35117]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T10:35:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:08 smithi112 ceph-mon[35117]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T10:35:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:08 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:08 smithi112 ceph-mon[35117]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-21T10:35:09.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:09 smithi060 ceph-mon[28215]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T10:35:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:09 smithi060 ceph-mon[28215]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T10:35:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:09 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:09 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:09 smithi060 ceph-mon[28215]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:09 smithi112 ceph-mon[35117]: from='osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T10:35:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:09 smithi112 ceph-mon[35117]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T10:35:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:09 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:09.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:09 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:09.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:09 smithi112 ceph-mon[35117]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T10:35:10.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: purged_snaps scrub starts 2024-09-21T10:35:10.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: purged_snaps scrub ok 2024-09-21T10:35:10.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:10.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] boot 2024-09-21T10:35:10.683 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T10:35:10.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:10.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:10.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: purged_snaps scrub starts 2024-09-21T10:35:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: purged_snaps scrub ok 2024-09-21T10:35:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:10.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: osd.1 [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] boot 2024-09-21T10:35:10.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T10:35:10.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:35:10.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:10.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:12.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:11 smithi060 ceph-mon[28215]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T10:35:12.036 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:11 smithi060 ceph-mon[28215]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:12.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:11 smithi112 ceph-mon[35117]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T10:35:12.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:11 smithi112 ceph-mon[35117]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:12.306 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:35:12.328 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-09-21T10:35:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:35:14.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:14.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.902 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:14.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:14.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:14.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:14.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:14 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:14.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:14.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:14.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:14.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:14.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:14 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:15.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 -- 172.21.15.60:0/862632378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440ffca0 msgr2=0x7f4744100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 --2- 172.21.15.60:0/862632378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440ffca0 0x7f4744100120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f472c009880 tx=0x7f472c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 -- 172.21.15.60:0/862632378 shutdown_connections 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 --2- 172.21.15.60:0/862632378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440ffca0 0x7f4744100120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 --2- 172.21.15.60:0/862632378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47440feaa0 0x7f47440feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 -- 172.21.15.60:0/862632378 >> 172.21.15.60:0/862632378 conn(0x7f47440fa230 msgr2=0x7f47440fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 -- 172.21.15.60:0/862632378 shutdown_connections 2024-09-21T10:35:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.396+0000 7f474ac0f640 1 -- 172.21.15.60:0/862632378 wait complete. 2024-09-21T10:35:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f474ac0f640 1 Processor -- start 2024-09-21T10:35:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f474ac0f640 1 -- start start 2024-09-21T10:35:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f474ac0f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 0x7f4744068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f474ac0f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47440ffca0 0x7f474419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f474ac0f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474419a8f0 con 0x7f47440feaa0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f474ac0f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474419aa60 con 0x7f47440ffca0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f47489ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 0x7f4744068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f47489ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 0x7f4744068f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51272/0 (socket says 172.21.15.60:51272) 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f47489ab640 1 -- 172.21.15.60:0/769882501 learned_addr learned my addr 172.21.15.60:0/769882501 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.397+0000 7f4743fff640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47440ffca0 0x7f474419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f47489ab640 1 -- 172.21.15.60:0/769882501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47440ffca0 msgr2=0x7f474419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f47489ab640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47440ffca0 0x7f474419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f47489ab640 1 -- 172.21.15.60:0/769882501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009560 con 0x7f47440feaa0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f47489ab640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 0x7f4744068f60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f473400d8d0 tx=0x7f473400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4734009a30 con 0x7f47440feaa0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4734009b90 con 0x7f47440feaa0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474419ad40 con 0x7f47440feaa0 2024-09-21T10:35:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473400f680 con 0x7f47440feaa0 2024-09-21T10:35:15.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.398+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474419b280 con 0x7f47440feaa0 2024-09-21T10:35:15.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.399+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474418e640 con 0x7f47440feaa0 2024-09-21T10:35:15.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.400+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f4734009d00 con 0x7f47440feaa0 2024-09-21T10:35:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.400+0000 7f4741ffb640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f473006cbd0 0x7f473006f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:35:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.401+0000 7f4743fff640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f473006cbd0 0x7f473006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:35:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.401+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f473408b2b0 con 0x7f47440feaa0 2024-09-21T10:35:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.401+0000 7f4743fff640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f473006cbd0 0x7f473006f090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f472c000c00 tx=0x7f472c0314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:35:15.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.405+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f47340563f0 con 0x7f47440feaa0 2024-09-21T10:35:15.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:15.597+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f474402c520 con 0x7f473006cbd0 2024-09-21T10:35:15.831 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:15 smithi060 ceph-mon[28215]: Detected new or changed devices on smithi060 2024-09-21T10:35:15.831 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:15 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi060 to 5922M 2024-09-21T10:35:15.832 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:15 smithi112 ceph-mon[35117]: Detected new or changed devices on smithi060 2024-09-21T10:35:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:15 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi060 to 5922M 2024-09-21T10:35:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:16 smithi060 ceph-mon[28215]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:16 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:35:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:16 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:35:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:16 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:16 smithi112 ceph-mon[35117]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:16 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:35:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:16 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:35:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:16 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:17 smithi060 ceph-mon[28215]: from='client.14354 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:35:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:17 smithi112 ceph-mon[35117]: from='client.14354 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:35:18.827 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:18 smithi060 ceph-mon[28215]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:18.827 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:18 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2642310895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80b3ce3a-e177-43f2-b457-0c94e4160914"}]: dispatch 2024-09-21T10:35:18.827 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:18 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2642310895' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80b3ce3a-e177-43f2-b457-0c94e4160914"}]': finished 2024-09-21T10:35:18.827 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:18 smithi060 ceph-mon[28215]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T10:35:18.827 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:18.851 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:18 smithi112 ceph-mon[35117]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:18.852 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:18 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2642310895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80b3ce3a-e177-43f2-b457-0c94e4160914"}]: dispatch 2024-09-21T10:35:18.852 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:18 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2642310895' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80b3ce3a-e177-43f2-b457-0c94e4160914"}]': finished 2024-09-21T10:35:18.852 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:18 smithi112 ceph-mon[35117]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T10:35:18.852 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:19.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:19 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/4083110385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:35:19.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:19 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/4083110385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:35:20.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:20 smithi060 ceph-mon[28215]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:20.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:20 smithi112 ceph-mon[35117]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:21 smithi060 ceph-mon[28215]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:21.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:21 smithi112 ceph-mon[35117]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:22.846 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:23.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:23 smithi060 ceph-mon[28215]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:23.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:23 smithi112 ceph-mon[35117]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:25.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:25 smithi060 ceph-mon[28215]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:25.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T10:35:25.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:25.903 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:25 smithi060 ceph-mon[28215]: Deploying daemon osd.2 on smithi060 2024-09-21T10:35:25.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:25 smithi112 ceph-mon[35117]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:25.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T10:35:25.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:25.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:25 smithi112 ceph-mon[35117]: Deploying daemon osd.2 on smithi060 2024-09-21T10:35:28.844 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:28 smithi060 ceph-mon[28215]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:28 smithi112 ceph-mon[35117]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:30.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:30 smithi060 ceph-mon[28215]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:30 smithi112 ceph-mon[35117]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:31.804 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:31.805 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:31.805 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:32.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:32 smithi060 ceph-mon[28215]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:32 smithi112 ceph-mon[35117]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:34.187 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 2 on host 'smithi060' 2024-09-21T10:35:34.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.184+0000 7f4741ffb640 1 -- 172.21.15.60:0/769882501 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f474402c520 con 0x7f473006cbd0 2024-09-21T10:35:34.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f473006cbd0 msgr2=0x7f473006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f473006cbd0 0x7f473006f090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f472c000c00 tx=0x7f472c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 msgr2=0x7f4744068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 0x7f4744068f60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f473400d8d0 tx=0x7f473400dd90 comp rx=0 tx=0).stop 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 shutdown_connections 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f473006cbd0 0x7f473006f090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47440ffca0 0x7f474419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 --2- 172.21.15.60:0/769882501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440feaa0 0x7f4744068f60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 >> 172.21.15.60:0/769882501 conn(0x7f47440fa230 msgr2=0x7f4744103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 shutdown_connections 2024-09-21T10:35:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:35:34.187+0000 7f474ac0f640 1 -- 172.21.15.60:0/769882501 wait complete. 2024-09-21T10:35:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:34 smithi060 ceph-mon[28215]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:34 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:34 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:34 smithi112 ceph-mon[35117]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:34 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:34 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:35.070 DEBUG:teuthology.orchestra.run.smithi060:osd.2> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T10:35:35.072 INFO:tasks.cephadm:Deploying osd.3 on smithi112 with /dev/vg_nvme/lv_4... 2024-09-21T10:35:35.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T10:35:35.277 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:35:35.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:35 smithi112 ceph-mon[35117]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T10:35:35.825 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:35 smithi060 ceph-mon[28215]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T10:35:36.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:36 smithi112 ceph-mon[35117]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:36.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:36 smithi112 ceph-mon[35117]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T10:35:36.839 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:36 smithi112 ceph-mon[35117]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T10:35:36.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:36 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:36.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:36 smithi112 ceph-mon[35117]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-21T10:35:36.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:36 smithi060 ceph-mon[28215]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:36.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:36 smithi060 ceph-mon[28215]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T10:35:36.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:36 smithi060 ceph-mon[28215]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T10:35:36.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:36 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:36.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:36 smithi060 ceph-mon[28215]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-21T10:35:37.449 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[65408]: 2024-09-21T10:35:37.342+0000 7f589c3f0640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T10:35:37.449 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[65408]: 2024-09-21T10:35:37.347+0000 7f5894a23640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:35:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T10:35:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T10:35:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' 2024-09-21T10:35:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T10:35:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T10:35:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: from='osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032]' entity='osd.2' 2024-09-21T10:35:37.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T10:35:37.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:35:38.018 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-09-21T10:35:38.231 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: purged_snaps scrub starts 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: purged_snaps scrub ok 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] boot 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T10:35:38.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: purged_snaps scrub starts 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: purged_snaps scrub ok 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: osd.2 [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] boot 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T10:35:38.692 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:35:39.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 -- 172.21.15.112:0/3085291776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea10100070 msgr2=0x7fea10100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:39.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 --2- 172.21.15.112:0/3085291776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea10100070 0x7fea10100470 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fea00009880 tx=0x7fea0002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:35:39.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 -- 172.21.15.112:0/3085291776 shutdown_connections 2024-09-21T10:35:39.764 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 --2- 172.21.15.112:0/3085291776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea100fed20 0x7fea100ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 --2- 172.21.15.112:0/3085291776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea10100070 0x7fea10100470 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 -- 172.21.15.112:0/3085291776 >> 172.21.15.112:0/3085291776 conn(0x7fea100f99c0 msgr2=0x7fea100fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 -- 172.21.15.112:0/3085291776 shutdown_connections 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.758+0000 7fea15d45640 1 -- 172.21.15.112:0/3085291776 wait complete. 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea15d45640 1 Processor -- start 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea15d45640 1 -- start start 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea15d45640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 0x7fea10195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea15d45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea10100070 0x7fea10195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea15d45640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10196170 con 0x7fea10100070 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea15d45640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101962e0 con 0x7fea100fed20 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea0f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 0x7fea10195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:35:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea0f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 0x7fea10195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:35854/0 (socket says 172.21.15.112:35854) 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea0f7fe640 1 -- 172.21.15.112:0/292243439 learned_addr learned my addr 172.21.15.112:0/292243439 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.759+0000 7fea07fff640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea10100070 0x7fea10195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0f7fe640 1 -- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea10100070 msgr2=0x7fea10195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0f7fe640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea10100070 0x7fea10195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0f7fe640 1 -- 172.21.15.112:0/292243439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea00009560 con 0x7fea100fed20 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0f7fe640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 0x7fea10195660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fea0002a9c0 tx=0x7fea000054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea00004aa0 con 0x7fea100fed20 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea00004c00 con 0x7fea100fed20 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1019ad20 con 0x7fea100fed20 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea00003a50 con 0x7fea100fed20 2024-09-21T10:35:39.766 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.760+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1019b240 con 0x7fea100fed20 2024-09-21T10:35:39.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.761+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10107690 con 0x7fea100fed20 2024-09-21T10:35:39.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.761+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fea00003c80 con 0x7fea100fed20 2024-09-21T10:35:39.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.762+0000 7fea0d7fa640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe9fc06cbd0 0x7fe9fc06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:35:39.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.762+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2846+0+0 (secure 0 0 0) 0x7fea000ac6f0 con 0x7fea100fed20 2024-09-21T10:35:39.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.762+0000 7fea07fff640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe9fc06cbd0 0x7fe9fc06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:35:39.767 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.763+0000 7fea07fff640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe9fc06cbd0 0x7fe9fc06f090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fea10196b80 tx=0x7fe9f800b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:35:39.768 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.767+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fea00077710 con 0x7fea100fed20 2024-09-21T10:35:39.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:39.934+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fea1019b480 con 0x7fe9fc06cbd0 2024-09-21T10:35:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: pgmap v98: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T10:35:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:35:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T10:35:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T10:35:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:35:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T10:35:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:40 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: pgmap v98: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T10:35:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:40 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:41.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:41 smithi112 ceph-mon[35117]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:35:41.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T10:35:41.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:41 smithi112 ceph-mon[35117]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T10:35:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:41 smithi060 ceph-mon[28215]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:35:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T10:35:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:41 smithi060 ceph-mon[28215]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: Detected new or changed devices on smithi060 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi060 to 3948M 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:42.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:42.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:42.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:42.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:42 smithi112 ceph-mon[35117]: pgmap v101: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:42.449 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69691]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T10:35:42.449 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69691]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:42.449 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:42.449 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69691]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: Detected new or changed devices on smithi060 2024-09-21T10:35:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi060 to 3948M 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:42.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:42 smithi060 ceph-mon[28215]: pgmap v101: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:43.104 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69694]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T10:35:43.105 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69694]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:43.105 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:43.105 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:35:42 smithi060 sudo[69694]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2019132690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b881e2-6400-4c14-a7f7-6c54e182660a"}]: dispatch 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b881e2-6400-4c14-a7f7-6c54e182660a"}]: dispatch 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8b881e2-6400-4c14-a7f7-6c54e182660a"}]': finished 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2804123825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:35:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:43 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:43.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69697]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T10:35:43.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69697]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:43.450 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:43.450 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69697]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:43.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/2019132690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b881e2-6400-4c14-a7f7-6c54e182660a"}]: dispatch 2024-09-21T10:35:43.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b881e2-6400-4c14-a7f7-6c54e182660a"}]: dispatch 2024-09-21T10:35:43.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8b881e2-6400-4c14-a7f7-6c54e182660a"}]': finished 2024-09-21T10:35:43.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T10:35:43.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:35:43.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/2804123825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:35:43.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:43 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:43.948 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69700]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T10:35:43.949 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69700]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:43.949 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:43.949 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:35:43 smithi060 sudo[69700]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:44.112 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:44.110+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fea00077ae0 con 0x7fea100fed20 2024-09-21T10:35:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:44 smithi060 ceph-mon[28215]: pgmap v103: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:44.449 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69703]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T10:35:44.449 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69703]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:44.449 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:44.449 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69703]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:44 smithi112 ceph-mon[35117]: pgmap v103: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:44.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69706]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T10:35:44.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69706]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:44.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:44.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:35:44 smithi060 sudo[69706]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69709]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T10:35:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69709]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:45.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:45.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69709]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:45.757 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 ceph-mon[35117]: mgrmap e19: smithi060.mulzpr(active, since 3m), standbys: smithi112.gkunly 2024-09-21T10:35:45.757 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T10:35:45.757 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40164]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T10:35:45.757 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40164]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:45.758 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:45.758 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40164]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69712]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T10:35:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69712]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 sudo[69712]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 ceph-mon[28215]: mgrmap e19: smithi060.mulzpr(active, since 3m), standbys: smithi112.gkunly 2024-09-21T10:35:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:45 smithi060 ceph-mon[28215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T10:35:46.023 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40171]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T10:35:46.024 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40171]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T10:35:46.024 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T10:35:46.024 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:45 smithi112 sudo[40171]: pam_unix(sudo:session): session closed for user root 2024-09-21T10:35:46.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: pgmap v104: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:46.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T10:35:46.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:35:46.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:35:46.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T10:35:46.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:35:46.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:35:46.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T10:35:46.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: pgmap v104: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:35:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:35:46.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T10:35:46.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:48.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:48 smithi112 ceph-mon[35117]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:48 smithi060 ceph-mon[28215]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:49.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:49 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T10:35:49.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:49 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:49.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:49 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T10:35:49.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:49 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:50 smithi112 ceph-mon[35117]: Deploying daemon osd.3 on smithi112 2024-09-21T10:35:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:50 smithi112 ceph-mon[35117]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:50 smithi060 ceph-mon[28215]: Deploying daemon osd.3 on smithi112 2024-09-21T10:35:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:50 smithi060 ceph-mon[28215]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:35:52.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:52 smithi112 ceph-mon[35117]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-21T10:35:52.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:52.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:52 smithi060 ceph-mon[28215]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-21T10:35:52.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:35:54.831 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:54 smithi112 ceph-mon[35117]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T10:35:54.831 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:54.831 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:54.831 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:54 smithi060 ceph-mon[28215]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T10:35:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:56.583 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:56 smithi112 ceph-mon[35117]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T10:35:56.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:56 smithi060 ceph-mon[28215]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T10:35:58.156 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.154+0000 7fea0d7fa640 1 -- 172.21.15.112:0/292243439 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fea1019b480 con 0x7fe9fc06cbd0 2024-09-21T10:35:58.156 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 3 on host 'smithi112' 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe9fc06cbd0 msgr2=0x7fe9fc06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe9fc06cbd0 0x7fe9fc06f090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fea10196b80 tx=0x7fe9f800b390 comp rx=0 tx=0).stop 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 msgr2=0x7fea10195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 0x7fea10195660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fea0002a9c0 tx=0x7fea000054f0 comp rx=0 tx=0).stop 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 shutdown_connections 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe9fc06cbd0 0x7fe9fc06f090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea10100070 0x7fea10195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.156+0000 7fea15d45640 1 --2- 172.21.15.112:0/292243439 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea100fed20 0x7fea10195660 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:35:58.159 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.157+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 >> 172.21.15.112:0/292243439 conn(0x7fea100f99c0 msgr2=0x7fea100fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:35:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.157+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 shutdown_connections 2024-09-21T10:35:58.160 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:35:58.157+0000 7fea15d45640 1 -- 172.21.15.112:0/292243439 wait complete. 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='osd.3 [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:58.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:58 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='osd.3 [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T10:35:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:35:58.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:58 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:35:58.706 DEBUG:teuthology.orchestra.run.smithi112:osd.3> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T10:35:58.709 INFO:tasks.cephadm:Deploying osd.4 on smithi112 with /dev/vg_nvme/lv_3... 2024-09-21T10:35:58.709 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T10:35:59.430 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:35:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:59 smithi060 ceph-mon[28215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T10:35:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:59 smithi060 ceph-mon[28215]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T10:35:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:59 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:35:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:59 smithi060 ceph-mon[28215]: from='osd.3 [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:35:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:35:59 smithi060 ceph-mon[28215]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:35:59.907 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:59 smithi112 ceph-mon[35117]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T10:35:59.907 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:59 smithi112 ceph-mon[35117]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T10:35:59.907 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:59 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:35:59.907 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:59 smithi112 ceph-mon[35117]: from='osd.3 [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:35:59.907 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:35:59 smithi112 ceph-mon[35117]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:00.443 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[41028]: 2024-09-21T10:36:00.239+0000 7fcb2b65c640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T10:36:00.443 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[41028]: 2024-09-21T10:36:00.248+0000 7fcb23c8f640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: from='osd.3 ' entity='osd.3' 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: osd.3 [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] boot 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T10:36:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:00 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:36:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T10:36:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T10:36:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:36:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:36:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T10:36:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: from='osd.3 ' entity='osd.3' 2024-09-21T10:36:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: osd.3 [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] boot 2024-09-21T10:36:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T10:36:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:00 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:36:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:01 smithi112 ceph-mon[35117]: purged_snaps scrub starts 2024-09-21T10:36:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:01 smithi112 ceph-mon[35117]: purged_snaps scrub ok 2024-09-21T10:36:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:01 smithi112 ceph-mon[35117]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T10:36:01.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:01 smithi060 ceph-mon[28215]: purged_snaps scrub starts 2024-09-21T10:36:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:01 smithi060 ceph-mon[28215]: purged_snaps scrub ok 2024-09-21T10:36:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:01 smithi060 ceph-mon[28215]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T10:36:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:02 smithi060 ceph-mon[28215]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:02 smithi060 ceph-mon[28215]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T10:36:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:02 smithi112 ceph-mon[35117]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:02 smithi112 ceph-mon[35117]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: Detected new or changed devices on smithi112 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi112 to 14912M 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:04.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.146 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T10:36:04.146 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:03 smithi060 ceph-mon[28215]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:04.156 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: Detected new or changed devices on smithi112 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi112 to 14912M 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T10:36:04.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:03 smithi112 ceph-mon[35117]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:04.159 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:36:04.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-09-21T10:36:04.371 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:36:05.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:05 smithi060 ceph-mon[28215]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T10:36:05.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:05 smithi112 ceph-mon[35117]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T10:36:05.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.928+0000 7fa44124b640 1 -- 172.21.15.112:0/3704412592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0ffcf0 msgr2=0x7fa43c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:05.934 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.928+0000 7fa44124b640 1 --2- 172.21.15.112:0/3704412592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0ffcf0 0x7fa43c100170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa430009880 tx=0x7fa43002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.928+0000 7fa44124b640 1 -- 172.21.15.112:0/3704412592 shutdown_connections 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.928+0000 7fa44124b640 1 --2- 172.21.15.112:0/3704412592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0ffcf0 0x7fa43c100170 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.928+0000 7fa44124b640 1 --2- 172.21.15.112:0/3704412592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c0feaf0 0x7fa43c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.928+0000 7fa44124b640 1 -- 172.21.15.112:0/3704412592 >> 172.21.15.112:0/3704412592 conn(0x7fa43c0fa280 msgr2=0x7fa43c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.929+0000 7fa44124b640 1 -- 172.21.15.112:0/3704412592 shutdown_connections 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.929+0000 7fa44124b640 1 -- 172.21.15.112:0/3704412592 wait complete. 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.929+0000 7fa44124b640 1 Processor -- start 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.929+0000 7fa44124b640 1 -- start start 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa44124b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 0x7fa43c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa44124b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c0ffcf0 0x7fa43c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa44124b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c1983f0 con 0x7fa43c0ffcf0 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa44124b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c198560 con 0x7fa43c0feaf0 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa43ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 0x7fa43c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:05.935 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa43ad9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 0x7fa43c1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37388/0 (socket says 172.21.15.112:37388) 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa43ad9d640 1 -- 172.21.15.112:0/1835416055 learned_addr learned my addr 172.21.15.112:0/1835416055 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa43ad9d640 1 -- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c0ffcf0 msgr2=0x7fa43c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa43ad9d640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c0ffcf0 0x7fa43c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.930+0000 7fa43ad9d640 1 -- 172.21.15.112:0/1835416055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009560 con 0x7fa43c0feaf0 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.931+0000 7fa43ad9d640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 0x7fa43c1978e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c8f0 tx=0x7fa42c00cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.931+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42c007b80 con 0x7fa43c0feaf0 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.931+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c19d000 con 0x7fa43c0feaf0 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.931+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa42c007ce0 con 0x7fa43c0feaf0 2024-09-21T10:36:05.936 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.931+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42c018800 con 0x7fa43c0feaf0 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.931+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c19d520 con 0x7fa43c0feaf0 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.932+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0feef0 con 0x7fa43c0feaf0 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.933+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa42c018a70 con 0x7fa43c0feaf0 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.933+0000 7fa423fff640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa42406cc50 0x7fa42406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.933+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7fa42c08bcb0 con 0x7fa43c0feaf0 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.934+0000 7fa43a59c640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa42406cc50 0x7fa42406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:05.937 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.934+0000 7fa43a59c640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa42406cc50 0x7fa42406f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa43002a9c0 tx=0x7fa430000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:05.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:05.938+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa42c0567d0 con 0x7fa43c0feaf0 2024-09-21T10:36:06.108 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:06.105+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa43c068340 con 0x7fa42406cc50 2024-09-21T10:36:06.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:06 smithi060 ceph-mon[28215]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:06.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:36:06.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:36:06.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:06.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:06 smithi112 ceph-mon[35117]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:06.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:36:06.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:36:06.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:07.652 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:07 smithi112 ceph-mon[35117]: from='client.24195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:36:07.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:07 smithi060 ceph-mon[28215]: from='client.24195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/3258745095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "539008c2-85e1-4b46-8df6-4fc052a8204b"}]: dispatch 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "539008c2-85e1-4b46-8df6-4fc052a8204b"}]: dispatch 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "539008c2-85e1-4b46-8df6-4fc052a8204b"}]': finished 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T10:36:08.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:08.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T10:36:08.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:08.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/3258745095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "539008c2-85e1-4b46-8df6-4fc052a8204b"}]: dispatch 2024-09-21T10:36:08.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "539008c2-85e1-4b46-8df6-4fc052a8204b"}]: dispatch 2024-09-21T10:36:08.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "539008c2-85e1-4b46-8df6-4fc052a8204b"}]': finished 2024-09-21T10:36:08.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T10:36:08.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:08 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:09.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:09 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/3746534655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:36:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:09 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/3746534655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:36:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:10 smithi060 ceph-mon[28215]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-21T10:36:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:10 smithi112 ceph-mon[35117]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-21T10:36:12.774 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:12 smithi112 ceph-mon[35117]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T10:36:12.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:12 smithi060 ceph-mon[28215]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T10:36:14.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:14 smithi112 ceph-mon[35117]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T10:36:14.917 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:14 smithi060 ceph-mon[28215]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T10:36:15.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T10:36:15.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T10:36:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:16 smithi060 ceph-mon[28215]: Deploying daemon osd.4 on smithi112 2024-09-21T10:36:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:16 smithi060 ceph-mon[28215]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T10:36:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:16 smithi112 ceph-mon[35117]: Deploying daemon osd.4 on smithi112 2024-09-21T10:36:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:16 smithi112 ceph-mon[35117]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T10:36:18.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:18 smithi060 ceph-mon[28215]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:18.838 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:18 smithi112 ceph-mon[35117]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:20.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:20 smithi112 ceph-mon[35117]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:20.841 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:20.841 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:20.841 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:20 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:20.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:20 smithi060 ceph-mon[28215]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:20.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:20.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:20.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:20 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:22 smithi060 ceph-mon[28215]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:22 smithi112 ceph-mon[35117]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:24.298 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.296+0000 7fa423fff640 1 -- 172.21.15.112:0/1835416055 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa43c068340 con 0x7fa42406cc50 2024-09-21T10:36:24.298 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 4 on host 'smithi112' 2024-09-21T10:36:24.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa42406cc50 msgr2=0x7fa42406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:24.300 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa42406cc50 0x7fa42406f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa43002a9c0 tx=0x7fa430000bc0 comp rx=0 tx=0).stop 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 msgr2=0x7fa43c1978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 0x7fa43c1978e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c8f0 tx=0x7fa42c00cdb0 comp rx=0 tx=0).stop 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 shutdown_connections 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa42406cc50 0x7fa42406f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa43c0ffcf0 0x7fa43c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 --2- 172.21.15.112:0/1835416055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa43c0feaf0 0x7fa43c1978e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 >> 172.21.15.112:0/1835416055 conn(0x7fa43c0fa280 msgr2=0x7fa43c067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 shutdown_connections 2024-09-21T10:36:24.301 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:24.298+0000 7fa44124b640 1 -- 172.21.15.112:0/1835416055 wait complete. 2024-09-21T10:36:24.905 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:24 smithi112 ceph-mon[35117]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:24.905 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:24.905 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:24.905 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:24 smithi112 ceph-mon[35117]: from='osd.4 [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T10:36:24.906 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:24 smithi112 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T10:36:24.926 DEBUG:teuthology.orchestra.run.smithi112:osd.4> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T10:36:24.929 INFO:tasks.cephadm:Deploying osd.5 on smithi112 with /dev/vg_nvme/lv_2... 2024-09-21T10:36:24.929 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T10:36:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:24 smithi060 ceph-mon[28215]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:24 smithi060 ceph-mon[28215]: from='osd.4 [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T10:36:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:24 smithi060 ceph-mon[28215]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T10:36:25.180 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:36:26.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: from='osd.4 [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:26.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-mon[35117]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: from='osd.4 [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:26 smithi060 ceph-mon[28215]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:26.617 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[47743]: 2024-09-21T10:36:26.304+0000 7fdabf143640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T10:36:26.617 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:36:26 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[47743]: 2024-09-21T10:36:26.311+0000 7fdabb77e640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:36:27.561 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:27 smithi112 ceph-mon[35117]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T10:36:27.561 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:27 smithi112 ceph-mon[35117]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T10:36:27.561 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:27 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:27.561 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:27 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:27 smithi060 ceph-mon[28215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T10:36:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:27 smithi060 ceph-mon[28215]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T10:36:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:27 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:27 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:28.110 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-21T10:36:28.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-09-21T10:36:28.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:28 smithi112 ceph-mon[35117]: purged_snaps scrub starts 2024-09-21T10:36:28.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:28 smithi112 ceph-mon[35117]: purged_snaps scrub ok 2024-09-21T10:36:28.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:28 smithi112 ceph-mon[35117]: osd.4 [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] boot 2024-09-21T10:36:28.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:28 smithi112 ceph-mon[35117]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T10:36:28.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:28 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:28.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:28 smithi112 ceph-mon[35117]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:28 smithi060 ceph-mon[28215]: purged_snaps scrub starts 2024-09-21T10:36:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:28 smithi060 ceph-mon[28215]: purged_snaps scrub ok 2024-09-21T10:36:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:28 smithi060 ceph-mon[28215]: osd.4 [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] boot 2024-09-21T10:36:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:28 smithi060 ceph-mon[28215]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T10:36:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:28 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:36:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:28 smithi060 ceph-mon[28215]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T10:36:29.193 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:36:29.584 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:29 smithi112 ceph-mon[35117]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T10:36:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:29 smithi060 ceph-mon[28215]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T10:36:30.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:30 smithi060 ceph-mon[28215]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:30 smithi112 ceph-mon[35117]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 -- 172.21.15.112:0/164772625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80ffca0 msgr2=0x7f96b8100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 --2- 172.21.15.112:0/164772625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80ffca0 0x7f96b8100120 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009880 tx=0x7f96ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 -- 172.21.15.112:0/164772625 shutdown_connections 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 --2- 172.21.15.112:0/164772625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80ffca0 0x7f96b8100120 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 --2- 172.21.15.112:0/164772625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80feaa0 0x7f96b80feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 -- 172.21.15.112:0/164772625 >> 172.21.15.112:0/164772625 conn(0x7f96b80fa250 msgr2=0x7f96b80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 -- 172.21.15.112:0/164772625 shutdown_connections 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.432+0000 7f96bde7f640 1 -- 172.21.15.112:0/164772625 wait complete. 2024-09-21T10:36:31.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96bde7f640 1 Processor -- start 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96bde7f640 1 -- start start 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96bde7f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 0x7f96b8068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96bde7f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80ffca0 0x7f96b819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96bde7f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b819aa80 con 0x7f96b80ffca0 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96bde7f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b819abc0 con 0x7f96b80feaa0 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96b77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 0x7f96b8068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96b77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 0x7f96b8068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:43412/0 (socket says 172.21.15.112:43412) 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96b77fe640 1 -- 172.21.15.112:0/3916090798 learned_addr learned my addr 172.21.15.112:0/3916090798 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96b6ffd640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80ffca0 0x7f96b819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.433+0000 7f96b77fe640 1 -- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80ffca0 msgr2=0x7f96b819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b77fe640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80ffca0 0x7f96b819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b77fe640 1 -- 172.21.15.112:0/3916090798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac009560 con 0x7f96b80feaa0 2024-09-21T10:36:31.438 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b6ffd640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80ffca0 0x7f96b819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:36:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b77fe640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 0x7f96b8068fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f96a800b3d0 tx=0x7f96a800b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a8011800 con 0x7f96b80feaa0 2024-09-21T10:36:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96a8011e20 con 0x7f96b80feaa0 2024-09-21T10:36:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b819ae70 con 0x7f96b80feaa0 2024-09-21T10:36:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a800f510 con 0x7f96b80feaa0 2024-09-21T10:36:31.439 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.434+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b819b410 con 0x7f96b80feaa0 2024-09-21T10:36:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.435+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b80fef20 con 0x7f96b80feaa0 2024-09-21T10:36:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.436+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f96a8010380 con 0x7f96b80feaa0 2024-09-21T10:36:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.436+0000 7f96b4ff9640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f96a006cc50 0x7f96a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.436+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f96a808baf0 con 0x7f96b80feaa0 2024-09-21T10:36:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.437+0000 7f96b6ffd640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f96a006cc50 0x7f96a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:31.440 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.437+0000 7f96b6ffd640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f96a006cc50 0x7f96a006f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f96ac000c00 tx=0x7f96ac005de0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:31.443 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.441+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96a8056350 con 0x7f96b80feaa0 2024-09-21T10:36:31.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:31.612+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f96b81045f0 con 0x7f96a006cc50 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: Detected new or changed devices on smithi112 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi112 to 7456M 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:31 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: Detected new or changed devices on smithi112 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi112 to 7456M 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:31 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:32.634 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:32 smithi112 ceph-mon[35117]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:32.634 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:36:32.634 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:36:32.635 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:32.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:32 smithi060 ceph-mon[28215]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:32.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T10:36:32.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T10:36:32.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:33.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:33 smithi060 ceph-mon[28215]: from='client.24213 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:36:33.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:33 smithi112 ceph-mon[35117]: from='client.24213 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:36:34.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:34.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/983765210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d63332d-29f7-4f7a-af36-2a7f4f6e90ca"}]: dispatch 2024-09-21T10:36:34.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d63332d-29f7-4f7a-af36-2a7f4f6e90ca"}]: dispatch 2024-09-21T10:36:34.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d63332d-29f7-4f7a-af36-2a7f4f6e90ca"}]': finished 2024-09-21T10:36:34.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T10:36:34.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:34.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:34 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/206658250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/983765210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d63332d-29f7-4f7a-af36-2a7f4f6e90ca"}]: dispatch 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d63332d-29f7-4f7a-af36-2a7f4f6e90ca"}]: dispatch 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d63332d-29f7-4f7a-af36-2a7f4f6e90ca"}]': finished 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:34.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:34 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/206658250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T10:36:36.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:36 smithi060 ceph-mon[28215]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:36.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:36 smithi112 ceph-mon[35117]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:37.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:38.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:38 smithi112 ceph-mon[35117]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:38.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:38 smithi060 ceph-mon[28215]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:40.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:40 smithi112 ceph-mon[35117]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:40.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:40 smithi060 ceph-mon[28215]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:41.547 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T10:36:41.548 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:41.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T10:36:41.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:42.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:42 smithi112 ceph-mon[35117]: Deploying daemon osd.5 on smithi112 2024-09-21T10:36:42.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:42 smithi112 ceph-mon[35117]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:42.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:42 smithi060 ceph-mon[28215]: Deploying daemon osd.5 on smithi112 2024-09-21T10:36:42.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:42 smithi060 ceph-mon[28215]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:44.600 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:44 smithi112 ceph-mon[35117]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:44.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:44 smithi060 ceph-mon[28215]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:46.804 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:46 smithi112 ceph-mon[35117]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:46.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:46.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:46.805 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:46 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:46 smithi060 ceph-mon[28215]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:46.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:46 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:48.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:48 smithi060 ceph-mon[28215]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:48.872 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:48 smithi112 ceph-mon[35117]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:50.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.004+0000 7f96b4ff9640 1 -- 172.21.15.112:0/3916090798 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f96b81045f0 con 0x7f96a006cc50 2024-09-21T10:36:50.007 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 5 on host 'smithi112' 2024-09-21T10:36:50.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f96a006cc50 msgr2=0x7f96a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:50.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f96a006cc50 0x7f96a006f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f96ac000c00 tx=0x7f96ac005de0 comp rx=0 tx=0).stop 2024-09-21T10:36:50.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 msgr2=0x7f96b8068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:50.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 0x7f96b8068fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f96a800b3d0 tx=0x7f96a800b890 comp rx=0 tx=0).stop 2024-09-21T10:36:50.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 shutdown_connections 2024-09-21T10:36:50.009 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f96a006cc50 0x7f96a006f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96b80ffca0 0x7f96b819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 --2- 172.21.15.112:0/3916090798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96b80feaa0 0x7f96b8068fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 >> 172.21.15.112:0/3916090798 conn(0x7f96b80fa250 msgr2=0x7f96b8102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 shutdown_connections 2024-09-21T10:36:50.010 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:36:50.007+0000 7f96bde7f640 1 -- 172.21.15.112:0/3916090798 wait complete. 2024-09-21T10:36:50.644 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:50 smithi112 ceph-mon[35117]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:50.644 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:50 smithi112 ceph-mon[35117]: from='osd.5 [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T10:36:50.644 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:50 smithi112 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T10:36:50.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:50 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:50.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:50 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:50.668 DEBUG:teuthology.orchestra.run.smithi112:osd.5> sudo journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T10:36:50.670 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-21T10:36:50.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T10:36:50.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:50 smithi060 ceph-mon[28215]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:50 smithi060 ceph-mon[28215]: from='osd.5 [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T10:36:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:50 smithi060 ceph-mon[28215]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T10:36:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:50 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:36:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T10:36:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T10:36:51.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:51.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: from='osd.5 [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:51.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:51.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:51.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:51 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: from='osd.5 [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:51 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1951193456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60102f60 msgr2=0x7f6e60105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1951193456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60102f60 0x7f6e60105350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098b0 tx=0x7f6e5402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1951193456 shutdown_connections 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1951193456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60102f60 0x7f6e60105350 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1951193456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e60100630 0x7f6e60102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1951193456 >> 172.21.15.60:0/1951193456 conn(0x7f6e600fa250 msgr2=0x7f6e600fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1951193456 shutdown_connections 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.481+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1951193456 wait complete. 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e65bb6640 1 Processor -- start 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e65bb6640 1 -- start start 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e65bb6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 0x7f6e60195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e65bb6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e60102f60 0x7f6e60195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e65bb6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60196260 con 0x7f6e60100630 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e65bb6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e601963d0 con 0x7f6e60102f60 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 0x7f6e60195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 0x7f6e60195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59048/0 (socket says 172.21.15.60:59048) 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.482+0000 7f6e5f7fe640 1 -- 172.21.15.60:0/1313231890 learned_addr learned my addr 172.21.15.60:0/1313231890 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5effd640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e60102f60 0x7f6e60195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5f7fe640 1 -- 172.21.15.60:0/1313231890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e60102f60 msgr2=0x7f6e60195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5f7fe640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e60102f60 0x7f6e60195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5f7fe640 1 -- 172.21.15.60:0/1313231890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009560 con 0x7f6e60100630 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5f7fe640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 0x7f6e60195750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000b450 tx=0x7f6e5000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e50011860 con 0x7f6e60100630 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e50011e80 con 0x7f6e60100630 2024-09-21T10:36:52.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6019ae70 con 0x7f6e60100630 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5000f570 con 0x7f6e60100630 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.483+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6019b3b0 con 0x7f6e60100630 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.484+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e60100a90 con 0x7f6e60100630 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.485+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6e500103e0 con 0x7f6e60100630 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.485+0000 7f6e5cff9640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f6e4806cc50 0x7f6e4806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.485+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4358+0+0 (secure 0 0 0) 0x7f6e5008bd10 con 0x7f6e60100630 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.485+0000 7f6e5effd640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f6e4806cc50 0x7f6e4806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.486+0000 7f6e5effd640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f6e4806cc50 0x7f6e4806f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009880 tx=0x7f6e54005b50 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.490+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6e50056530 con 0x7f6e60100630 2024-09-21T10:36:52.653 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:52.653 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T10:36:52.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T10:36:52.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:52.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:52.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: from='osd.5 ' entity='osd.5' 2024-09-21T10:36:52.654 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:52.654 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[54164]: 2024-09-21T10:36:52.339+0000 7fe426e8f640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T10:36:52.654 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:36:52 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[54164]: 2024-09-21T10:36:52.351+0000 7fe41f4c2640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:36:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.669+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6e60108810 con 0x7f6e60100630 2024-09-21T10:36:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.669+0000 7f6e5cff9640 1 -- 172.21.15.60:0/1313231890 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6e50059b50 con 0x7f6e60100630 2024-09-21T10:36:52.672 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:36:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.671+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f6e4806cc50 msgr2=0x7f6e4806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.671+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f6e4806cc50 0x7f6e4806f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009880 tx=0x7f6e54005b50 comp rx=0 tx=0).stop 2024-09-21T10:36:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.671+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 msgr2=0x7f6e60195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.671+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 0x7f6e60195750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000b450 tx=0x7f6e5000b910 comp rx=0 tx=0).stop 2024-09-21T10:36:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 shutdown_connections 2024-09-21T10:36:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f6e4806cc50 0x7f6e4806f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e60102f60 0x7f6e60195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 --2- 172.21.15.60:0/1313231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e60100630 0x7f6e60195750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 >> 172.21.15.60:0/1313231890 conn(0x7f6e600fa250 msgr2=0x7f6e600fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 shutdown_connections 2024-09-21T10:36:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:52.672+0000 7f6e65bb6640 1 -- 172.21.15.60:0/1313231890 wait complete. 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: from='osd.5 ' entity='osd.5' 2024-09-21T10:36:52.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:36:53.389 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726914987,"num_in_osds":6,"osd_in_since":1726914993,"num_remapped_pgs":0} 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: purged_snaps scrub starts 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: purged_snaps scrub ok 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1313231890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: osd.5 [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] boot 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T10:36:53.665 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:53 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:53.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: purged_snaps scrub starts 2024-09-21T10:36:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: purged_snaps scrub ok 2024-09-21T10:36:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1313231890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T10:36:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: osd.5 [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] boot 2024-09-21T10:36:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T10:36:53.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:53 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:36:54.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T10:36:54.604 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:54.693 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:54.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:54.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:54.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:54.694 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T10:36:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:36:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:36:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:55 smithi060 ceph-mon[28215]: Detected new or changed devices on smithi112 2024-09-21T10:36:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:55 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi112 to 4970M 2024-09-21T10:36:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:55 smithi060 ceph-mon[28215]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T10:36:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:55 smithi112 ceph-mon[35117]: Detected new or changed devices on smithi112 2024-09-21T10:36:55.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:55 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi112 to 4970M 2024-09-21T10:36:55.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:55 smithi112 ceph-mon[35117]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T10:36:56.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 -- 172.21.15.60:0/2903370290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8100690 msgr2=0x7f94d8102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:56.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 --2- 172.21.15.60:0/2903370290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8100690 0x7f94d8102a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009880 tx=0x7f94c802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 -- 172.21.15.60:0/2903370290 shutdown_connections 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 --2- 172.21.15.60:0/2903370290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d8102fc0 0x7f94d81053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 --2- 172.21.15.60:0/2903370290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8100690 0x7f94d8102a80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 -- 172.21.15.60:0/2903370290 >> 172.21.15.60:0/2903370290 conn(0x7f94d80fa250 msgr2=0x7f94d80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 -- 172.21.15.60:0/2903370290 shutdown_connections 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.276+0000 7f94de5db640 1 -- 172.21.15.60:0/2903370290 wait complete. 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94de5db640 1 Processor -- start 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94de5db640 1 -- start start 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94de5db640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d8100690 0x7f94d81955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94de5db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 0x7f94d8195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94de5db640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8196100 con 0x7f94d8102fc0 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94de5db640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8196270 con 0x7f94d8100690 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 0x7f94d8195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:56.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 0x7f94d8195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52584/0 (socket says 172.21.15.60:52584) 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94d77fe640 1 -- 172.21.15.60:0/1870208809 learned_addr learned my addr 172.21.15.60:0/1870208809 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.277+0000 7f94d7fff640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d8100690 0x7f94d81955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d77fe640 1 -- 172.21.15.60:0/1870208809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d8100690 msgr2=0x7f94d81955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d77fe640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d8100690 0x7f94d81955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d77fe640 1 -- 172.21.15.60:0/1870208809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8009560 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d77fe640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 0x7f94d8195b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00d6f0 tx=0x7f94cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc0051f0 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94cc009ce0 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d819ad10 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc004e80 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.278+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d819b2e0 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.279+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d8108770 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.279+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f94cc0046c0 con 0x7f94d8102fc0 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.280+0000 7f94d57fa640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f94c006cbf0 0x7f94c006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.280+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f94cc08b980 con 0x7f94d8102fc0 2024-09-21T10:36:56.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.280+0000 7f94d7fff640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f94c006cbf0 0x7f94c006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:56.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.280+0000 7f94d7fff640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f94c006cbf0 0x7f94c006f0b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c80314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:56.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.284+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94cc056090 con 0x7f94d8102fc0 2024-09-21T10:36:56.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.454+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f94d8108950 con 0x7f94d8102fc0 2024-09-21T10:36:56.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.454+0000 7f94d57fa640 1 -- 172.21.15.60:0/1870208809 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f94cc020090 con 0x7f94d8102fc0 2024-09-21T10:36:56.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:36:56.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f94c006cbf0 msgr2=0x7f94c006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:56.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f94c006cbf0 0x7f94c006f0b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c80314e0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 msgr2=0x7f94d8195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 0x7f94d8195b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00d6f0 tx=0x7f94cc00dbb0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 shutdown_connections 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f94c006cbf0 0x7f94c006f0b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d8102fc0 0x7f94d8195b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 --2- 172.21.15.60:0/1870208809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d8100690 0x7f94d81955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 >> 172.21.15.60:0/1870208809 conn(0x7f94d80fa250 msgr2=0x7f94d80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 shutdown_connections 2024-09-21T10:36:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:56.456+0000 7f94de5db640 1 -- 172.21.15.60:0/1870208809 wait complete. 2024-09-21T10:36:56.756 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:56 smithi060 ceph-mon[28215]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:36:56.756 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:56 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1870208809' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T10:36:56.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:56 smithi112 ceph-mon[35117]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:36:56.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:56 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1870208809' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T10:36:57.070 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1726915013,"num_in_osds":6,"osd_in_since":1726914993,"num_remapped_pgs":0} 2024-09-21T10:36:57.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T10:36:57.276 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:36:58.628 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:58 smithi060 ceph-mon[28215]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:36:58.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/1764976751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 msgr2=0x7f0e78100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/1764976751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e78100180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009880 tx=0x7f0e6802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/1764976751 shutdown_connections 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/1764976751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e78100750 0x7f0e781047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/1764976751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e78100180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/1764976751 >> 172.21.15.60:0/1764976751 conn(0x7f0e780fb840 msgr2=0x7f0e780fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/1764976751 shutdown_connections 2024-09-21T10:36:58.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.850+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/1764976751 wait complete. 2024-09-21T10:36:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e7e6d8640 1 Processor -- start 2024-09-21T10:36:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e7e6d8640 1 -- start start 2024-09-21T10:36:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e7e6d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e780727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e7e6d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e78100750 0x7f0e78072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e7e6d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78073230 con 0x7f0e780ffda0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e7e6d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78073370 con 0x7f0e78100750 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e780727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e780727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52598/0 (socket says 172.21.15.60:52598) 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.851+0000 7f0e77fff640 1 -- 172.21.15.60:0/2779787432 learned_addr learned my addr 172.21.15.60:0/2779787432 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e777fe640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e78100750 0x7f0e78072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e77fff640 1 -- 172.21.15.60:0/2779787432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e78100750 msgr2=0x7f0e78072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e77fff640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e78100750 0x7f0e78072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e77fff640 1 -- 172.21.15.60:0/2779787432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68009560 con 0x7f0e780ffda0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e77fff640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e780727b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e68006010 tx=0x7f0e680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e68004aa0 con 0x7f0e780ffda0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e68031470 con 0x7f0e780ffda0 2024-09-21T10:36:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e780735f0 con 0x7f0e780ffda0 2024-09-21T10:36:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e68003940 con 0x7f0e780ffda0 2024-09-21T10:36:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.852+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e781a20e0 con 0x7f0e780ffda0 2024-09-21T10:36:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.853+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e78101280 con 0x7f0e780ffda0 2024-09-21T10:36:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.854+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0e68031b90 con 0x7f0e780ffda0 2024-09-21T10:36:58.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.854+0000 7f0e757fa640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0e6006cc60 0x7f0e6006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:36:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.854+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0e680acf60 con 0x7f0e780ffda0 2024-09-21T10:36:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.854+0000 7f0e777fe640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0e6006cc60 0x7f0e6006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:36:58.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.855+0000 7f0e777fe640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0e6006cc60 0x7f0e6006f120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e780742b0 tx=0x7f0e6c00b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:36:58.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:58.859+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0e68077700 con 0x7f0e780ffda0 2024-09-21T10:36:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:58 smithi112 ceph-mon[35117]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:36:59.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.029+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e781080e0 con 0x7f0e780ffda0 2024-09-21T10:36:59.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.030+0000 7f0e757fa640 1 -- 172.21.15.60:0/2779787432 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11339 (secure 0 0 0) 0x7f0e6807ad20 con 0x7f0e780ffda0 2024-09-21T10:36:59.032 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:36:59.032 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","created":"2024-09-21T10:30:33.359796+0000","modified":"2024-09-21T10:36:54.554013+0000","last_up_change":"2024-09-21T10:36:53.341806+0000","last_in_change":"2024-09-21T10:36:33.875582+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T10:35:39.965486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09f773ee-264c-4ae2-82d5-ad981f25dbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6803","nonce":2184374024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6805","nonce":2184374024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6809","nonce":2184374024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6807","nonce":2184374024}]},"public_addr":"172.21.15.60:6803/2184374024","cluster_addr":"172.21.15.60:6805/2184374024","heartbeat_back_addr":"172.21.15.60:6809/2184374024","heartbeat_front_addr":"172.21.15.60:6807/2184374024","state":["exists","up"]},{"osd":1,"uuid":"0c4c1a09-06c2-4843-8df1-8603fc43594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6811","nonce":2267629556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6813","nonce":2267629556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6817","nonce":2267629556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6815","nonce":2267629556}]},"public_addr":"172.21.15.60:6811/2267629556","cluster_addr":"172.21.15.60:6813/2267629556","heartbeat_back_addr":"172.21.15.60:6817/2267629556","heartbeat_front_addr":"172.21.15.60:6815/2267629556","state":["exists","up"]},{"osd":2,"uuid":"80b3ce3a-e177-43f2-b457-0c94e4160914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6819","nonce":4195573032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6821","nonce":4195573032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6825","nonce":4195573032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6823","nonce":4195573032}]},"public_addr":"172.21.15.60:6819/4195573032","cluster_addr":"172.21.15.60:6821/4195573032","heartbeat_back_addr":"172.21.15.60:6825/4195573032","heartbeat_front_addr":"172.21.15.60:6823/4195573032","state":["exists","up"]},{"osd":3,"uuid":"f8b881e2-6400-4c14-a7f7-6c54e182660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6801","nonce":4117307015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6803","nonce":4117307015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6807","nonce":4117307015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6805","nonce":4117307015}]},"public_addr":"172.21.15.112:6801/4117307015","cluster_addr":"172.21.15.112:6803/4117307015","heartbeat_back_addr":"172.21.15.112:6807/4117307015","heartbeat_front_addr":"172.21.15.112:6805/4117307015","state":["exists","up"]},{"osd":4,"uuid":"539008c2-85e1-4b46-8df6-4fc052a8204b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6809","nonce":3782973484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6811","nonce":3782973484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6815","nonce":3782973484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6813","nonce":3782973484}]},"public_addr":"172.21.15.112:6809/3782973484","cluster_addr":"172.21.15.112:6811/3782973484","heartbeat_back_addr":"172.21.15.112:6815/3782973484","heartbeat_front_addr":"172.21.15.112:6813/3782973484","state":["exists","up"]},{"osd":5,"uuid":"6d63332d-29f7-4f7a-af36-2a7f4f6e90ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6817","nonce":853919786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6819","nonce":853919786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6823","nonce":853919786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6821","nonce":853919786}]},"public_addr":"172.21.15.112:6817/853919786","cluster_addr":"172.21.15.112:6819/853919786","heartbeat_back_addr":"172.21.15.112:6823/853919786","heartbeat_front_addr":"172.21.15.112:6821/853919786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:34:40.339540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:07.960486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:35.636732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:59.056716+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:36:25.350652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:36:51.006851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/3364675318":"2024-09-22T10:32:37.452284+0000","172.21.15.60:6801/1631962843":"2024-09-22T10:32:37.452284+0000","172.21.15.60:0/2957889149":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6800/1152707410":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/1410574713":"2024-09-22T10:31:05.936397+0000","172.21.15.60:0/2185187485":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/3611925388":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6800/4213874648":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6801/4213874648":"2024-09-22T10:31:05.936397+0000","172.21.15.60:0/1074459672":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/3334685987":"2024-09-22T10:31:36.919711+0000","172.21.15.60:6801/1152707410":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/1375438723":"2024-09-22T10:32:37.452284+0000","172.21.15.60:0/2300592546":"2024-09-22T10:32:37.452284+0000","172.21.15.60:6800/1631962843":"2024-09-22T10:32:37.452284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0e6006cc60 msgr2=0x7f0e6006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0e6006cc60 0x7f0e6006f120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e780742b0 tx=0x7f0e6c00b390 comp rx=0 tx=0).stop 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 msgr2=0x7f0e780727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e780727b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e68006010 tx=0x7f0e680055a0 comp rx=0 tx=0).stop 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 shutdown_connections 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0e6006cc60 0x7f0e6006f120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:59.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0e78100750 0x7f0e78072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:59.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 --2- 172.21.15.60:0/2779787432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780ffda0 0x7f0e780727b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:36:59.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 >> 172.21.15.60:0/2779787432 conn(0x7f0e780fb840 msgr2=0x7f0e780fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:36:59.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 shutdown_connections 2024-09-21T10:36:59.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:36:59.032+0000 7f0e7e6d8640 1 -- 172.21.15.60:0/2779787432 wait complete. 2024-09-21T10:36:59.613 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:36:59 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2779787432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T10:36:59.637 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T10:35:39.965486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T10:36:59.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T10:36:59.850 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:36:59.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:36:59 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2779787432' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T10:37:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:00 smithi060 ceph-mon[28215]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:00 smithi112 ceph-mon[35117]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/901652048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 msgr2=0x7fd0b4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/901652048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b4100180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009c20 tx=0x7fd0b002a970 comp rx=0 tx=0).stop 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/901652048 shutdown_connections 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/901652048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0b4100750 0x7fd0b41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/901652048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b4100180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/901652048 >> 172.21.15.60:0/901652048 conn(0x7fd0b40fb840 msgr2=0x7fd0b40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/901652048 shutdown_connections 2024-09-21T10:37:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.535+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/901652048 wait complete. 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0bb3c9640 1 Processor -- start 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0bb3c9640 1 -- start start 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0bb3c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0bb3c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0b4100750 0x7fd0b4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0bb3c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b4073230 con 0x7fd0b40ffda0 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0bb3c9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40733a0 con 0x7fd0b4100750 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0b9165640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0b9165640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b40727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52614/0 (socket says 172.21.15.60:52614) 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0b9165640 1 -- 172.21.15.60:0/1938687538 learned_addr learned my addr 172.21.15.60:0/1938687538 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0b8964640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0b4100750 0x7fd0b4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0b9165640 1 -- 172.21.15.60:0/1938687538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0b4100750 msgr2=0x7fd0b4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.536+0000 7fd0b9165640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0b4100750 0x7fd0b4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0b9165640 1 -- 172.21.15.60:0/1938687538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0009900 con 0x7fd0b40ffda0 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0b9165640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b40727b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd0b002ae90 tx=0x7fd0b00308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b002f590 con 0x7fd0b40ffda0 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b4073620 con 0x7fd0b40ffda0 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0b0030ca0 con 0x7fd0b40ffda0 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b0039680 con 0x7fd0b40ffda0 2024-09-21T10:37:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.537+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b41a1f10 con 0x7fd0b40ffda0 2024-09-21T10:37:01.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.538+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b4101280 con 0x7fd0b40ffda0 2024-09-21T10:37:01.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.538+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd0b000a040 con 0x7fd0b40ffda0 2024-09-21T10:37:01.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.539+0000 7fd0aa7fc640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd0a006cc50 0x7fd0a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:01.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.539+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd0b002c040 con 0x7fd0b40ffda0 2024-09-21T10:37:01.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.539+0000 7fd0b8964640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd0a006cc50 0x7fd0a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:01.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.539+0000 7fd0b8964640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd0a006cc50 0x7fd0a006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4005fd0 tx=0x7fd0a4005e20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:01.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.543+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0b00779b0 con 0x7fd0b40ffda0 2024-09-21T10:37:01.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.717+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0b4073d30 con 0x7fd0b40ffda0 2024-09-21T10:37:01.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.717+0000 7fd0aa7fc640 1 -- 172.21.15.60:0/1938687538 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0b007afd0 con 0x7fd0b40ffda0 2024-09-21T10:37:01.719 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.719+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd0a006cc50 msgr2=0x7fd0a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.719+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd0a006cc50 0x7fd0a006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4005fd0 tx=0x7fd0a4005e20 comp rx=0 tx=0).stop 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.719+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 msgr2=0x7fd0b40727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.719+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b40727b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd0b002ae90 tx=0x7fd0b00308a0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 shutdown_connections 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd0a006cc50 0x7fd0a006f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd0b4100750 0x7fd0b4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 --2- 172.21.15.60:0/1938687538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b40ffda0 0x7fd0b40727b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:01.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 >> 172.21.15.60:0/1938687538 conn(0x7fd0b40fb840 msgr2=0x7fd0b40fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:01.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 shutdown_connections 2024-09-21T10:37:01.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:01.720+0000 7fd0bb3c9640 1 -- 172.21.15.60:0/1938687538 wait complete. 2024-09-21T10:37:02.432 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T10:37:02.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T10:37:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:02 smithi060 ceph-mon[28215]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:02 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1938687538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T10:37:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:02 smithi112 ceph-mon[35117]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:02 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1938687538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T10:37:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:03 smithi060 ceph-mon[28215]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:03 smithi112 ceph-mon[35117]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 -- 172.21.15.60:0/3809738667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400ffc80 msgr2=0x7fe140100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 --2- 172.21.15.60:0/3809738667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400ffc80 0x7fe140100100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe130009880 tx=0x7fe13002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 -- 172.21.15.60:0/3809738667 shutdown_connections 2024-09-21T10:37:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 --2- 172.21.15.60:0/3809738667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400ffc80 0x7fe140100100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 --2- 172.21.15.60:0/3809738667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1400fea80 0x7fe1400fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 -- 172.21.15.60:0/3809738667 >> 172.21.15.60:0/3809738667 conn(0x7fe1400fa230 msgr2=0x7fe1400fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 -- 172.21.15.60:0/3809738667 shutdown_connections 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.255+0000 7fe1482cc640 1 -- 172.21.15.60:0/3809738667 wait complete. 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe1482cc640 1 Processor -- start 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe1482cc640 1 -- start start 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe1482cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 0x7fe140068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe1482cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1400ffc80 0x7fe14019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe1482cc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14019a9f0 con 0x7fe1400fea80 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe1482cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14019ab30 con 0x7fe1400ffc80 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe146068640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 0x7fe140068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe146068640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 0x7fe140068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39466/0 (socket says 172.21.15.60:39466) 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe146068640 1 -- 172.21.15.60:0/1483042412 learned_addr learned my addr 172.21.15.60:0/1483042412 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe145867640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1400ffc80 0x7fe14019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe146068640 1 -- 172.21.15.60:0/1483042412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1400ffc80 msgr2=0x7fe14019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe146068640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1400ffc80 0x7fe14019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.256+0000 7fe146068640 1 -- 172.21.15.60:0/1483042412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe130009560 con 0x7fe1400fea80 2024-09-21T10:37:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.257+0000 7fe146068640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 0x7fe140068fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b3d0 tx=0x7fe13c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.257+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13c011800 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.257+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe13c011e20 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.257+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14019ade0 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.257+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13c00f510 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.257+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14019b330 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.258+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400fef00 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.258+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe13c010380 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.259+0000 7fe1377fe640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe12c06cc50 0x7fe12c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.259+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe13c08bb80 con 0x7fe1400fea80 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.259+0000 7fe145867640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe12c06cc50 0x7fe12c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.259+0000 7fe145867640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe12c06cc50 0x7fe12c06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe130000c00 tx=0x7fe1300314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.263+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe13c056310 con 0x7fe1400fea80 2024-09-21T10:37:04.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.504+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe140107710 con 0x7fe1400fea80 2024-09-21T10:37:04.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.508+0000 7fe1377fe640 1 -- 172.21.15.60:0/1483042412 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe13c059930 con 0x7fe1400fea80 2024-09-21T10:37:04.511 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-21T10:37:04.511 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQoe5mBmUhHhAATU80PESHBZp2GPdVWl3RZA== 2024-09-21T10:37:04.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe12c06cc50 msgr2=0x7fe12c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:04.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe12c06cc50 0x7fe12c06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe130000c00 tx=0x7fe1300314e0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 msgr2=0x7fe140068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:04.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 0x7fe140068fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b3d0 tx=0x7fe13c00b890 comp rx=0 tx=0).stop 2024-09-21T10:37:04.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 shutdown_connections 2024-09-21T10:37:04.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe12c06cc50 0x7fe12c06f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1400ffc80 0x7fe14019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 --2- 172.21.15.60:0/1483042412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1400fea80 0x7fe140068fb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.510+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 >> 172.21.15.60:0/1483042412 conn(0x7fe1400fa230 msgr2=0x7fe140102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.511+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 shutdown_connections 2024-09-21T10:37:04.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:04.511+0000 7fe1482cc640 1 -- 172.21.15.60:0/1483042412 wait complete. 2024-09-21T10:37:04.758 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:04 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1483042412' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T10:37:04.758 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:04 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1483042412' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T10:37:04.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:04 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1483042412' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T10:37:04.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:04 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1483042412' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T10:37:05.158 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:37:05.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T10:37:05.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T10:37:05.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T10:37:05.408 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi112/config 2024-09-21T10:37:05.878 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:05 smithi112 ceph-mon[35117]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:05.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:05 smithi060 ceph-mon[28215]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 -- 172.21.15.112:0/1609669530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400fea80 msgr2=0x7fe5400fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:06.997 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 --2- 172.21.15.112:0/1609669530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400fea80 0x7fe5400fee80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe530009880 tx=0x7fe53002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 -- 172.21.15.112:0/1609669530 shutdown_connections 2024-09-21T10:37:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 --2- 172.21.15.112:0/1609669530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5400ffc80 0x7fe540100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 --2- 172.21.15.112:0/1609669530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400fea80 0x7fe5400fee80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 -- 172.21.15.112:0/1609669530 >> 172.21.15.112:0/1609669530 conn(0x7fe5400fa230 msgr2=0x7fe5400fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 -- 172.21.15.112:0/1609669530 shutdown_connections 2024-09-21T10:37:06.998 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.995+0000 7fe5468cc640 1 -- 172.21.15.112:0/1609669530 wait complete. 2024-09-21T10:37:06.999 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe5468cc640 1 Processor -- start 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe5468cc640 1 -- start start 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe5468cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5400fea80 0x7fe540068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe5468cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 0x7fe54019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe5468cc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54019aa30 con 0x7fe5400fea80 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe5468cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54019ab70 con 0x7fe5400ffc80 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe53f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 0x7fe54019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe53f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 0x7fe54019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:49934/0 (socket says 172.21.15.112:49934) 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.996+0000 7fe53f7fe640 1 -- 172.21.15.112:0/2715929426 learned_addr learned my addr 172.21.15.112:0/2715929426 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53ffff640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5400fea80 0x7fe540068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53f7fe640 1 -- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5400fea80 msgr2=0x7fe540068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53f7fe640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5400fea80 0x7fe540068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:07.000 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53f7fe640 1 -- 172.21.15.112:0/2715929426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009560 con 0x7fe5400ffc80 2024-09-21T10:37:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53f7fe640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 0x7fe54019a460 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b420 tx=0x7fe53400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe534011800 con 0x7fe5400ffc80 2024-09-21T10:37:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe534011e20 con 0x7fe5400ffc80 2024-09-21T10:37:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54019ae20 con 0x7fe5400ffc80 2024-09-21T10:37:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53400f2e0 con 0x7fe5400ffc80 2024-09-21T10:37:07.001 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.997+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54019b3c0 con 0x7fe5400ffc80 2024-09-21T10:37:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.998+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5400fef00 con 0x7fe5400ffc80 2024-09-21T10:37:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.999+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe534010380 con 0x7fe5400ffc80 2024-09-21T10:37:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.999+0000 7fe53d7fa640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc60 0x7fe52806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.999+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe53408b7e0 con 0x7fe5400ffc80 2024-09-21T10:37:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:06.999+0000 7fe53ffff640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc60 0x7fe52806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:07.002 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.000+0000 7fe53ffff640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc60 0x7fe52806f120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe53002a9c0 tx=0x7fe530000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:07.005 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.003+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe534055f70 con 0x7fe5400ffc80 2024-09-21T10:37:07.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.226+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe5401076f0 con 0x7fe5400ffc80 2024-09-21T10:37:07.234 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.232+0000 7fe53d7fa640 1 -- 172.21.15.112:0/2715929426 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe534059590 con 0x7fe5400ffc80 2024-09-21T10:37:07.234 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-21T10:37:07.234 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQDToe5mncahDRAAVI1m9c359sxogNLAyxNDQA== 2024-09-21T10:37:07.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc60 msgr2=0x7fe52806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:07.236 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc60 0x7fe52806f120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe53002a9c0 tx=0x7fe530000bc0 comp rx=0 tx=0).stop 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 msgr2=0x7fe54019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 0x7fe54019a460 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b420 tx=0x7fe53400b8e0 comp rx=0 tx=0).stop 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 shutdown_connections 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc60 0x7fe52806f120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5400ffc80 0x7fe54019a460 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 --2- 172.21.15.112:0/2715929426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5400fea80 0x7fe540068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 >> 172.21.15.112:0/2715929426 conn(0x7fe5400fa230 msgr2=0x7fe540102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 shutdown_connections 2024-09-21T10:37:07.237 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:37:07.234+0000 7fe5468cc640 1 -- 172.21.15.112:0/2715929426 wait complete. 2024-09-21T10:37:07.606 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:07 smithi112 ceph-mon[35117]: from='client.? 172.21.15.112:0/2715929426' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T10:37:07.606 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:07 smithi112 ceph-mon[35117]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T10:37:07.606 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:07 smithi112 ceph-mon[35117]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T10:37:07.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:07 smithi060 ceph-mon[28215]: from='client.? 172.21.15.112:0/2715929426' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T10:37:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:07 smithi060 ceph-mon[28215]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T10:37:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:07 smithi060 ceph-mon[28215]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T10:37:07.913 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:37:07.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T10:37:07.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T10:37:07.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T10:37:08.162 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:08.623 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:08 smithi060 ceph-mon[28215]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:08.623 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:08 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:08.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:08 smithi112 ceph-mon[35117]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:08.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:08 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 -- 172.21.15.60:0/81377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 msgr2=0x7f75cc109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 --2- 172.21.15.60:0/81377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc109b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009880 tx=0x7f75b402a530 comp rx=0 tx=0).stop 2024-09-21T10:37:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 -- 172.21.15.60:0/81377361 shutdown_connections 2024-09-21T10:37:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 --2- 172.21.15.60:0/81377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc109b80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 --2- 172.21.15.60:0/81377361 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc100d70 0x7f75cc101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 -- 172.21.15.60:0/81377361 >> 172.21.15.60:0/81377361 conn(0x7f75cc0758a0 msgr2=0x7f75cc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 -- 172.21.15.60:0/81377361 shutdown_connections 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.819+0000 7f75d1440640 1 -- 172.21.15.60:0/81377361 wait complete. 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75d1440640 1 Processor -- start 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75d1440640 1 -- start start 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75d1440640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc100d70 0x7f75cc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75d1440640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75d1440640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc19c390 con 0x7f75cc101690 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75d1440640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc195920 con 0x7f75cc100d70 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75ca7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75ca7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39488/0 (socket says 172.21.15.60:39488) 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75ca7fc640 1 -- 172.21.15.60:0/2839362527 learned_addr learned my addr 172.21.15.60:0/2839362527 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75caffd640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc100d70 0x7f75cc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75ca7fc640 1 -- 172.21.15.60:0/2839362527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc100d70 msgr2=0x7f75cc19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.820+0000 7f75ca7fc640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc100d70 0x7f75cc19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75ca7fc640 1 -- 172.21.15.60:0/2839362527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4009560 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75ca7fc640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc19bd70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f75b402aa50 tx=0x7f75b4032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b40037c0 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75b4005d50 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc195ba0 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b403be30 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.821+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc196090 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.822+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc068450 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.823+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f75b402ad50 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.823+0000 7f75c3fff640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f75b806cbf0 0x7f75b806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.823+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f75b40acac0 con 0x7f75cc101690 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.823+0000 7f75caffd640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f75b806cbf0 0x7f75b806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.824+0000 7f75caffd640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f75b806cbf0 0x7f75b806f0b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75c4005fd0 tx=0x7f75c4005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:09.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:09.827+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f75b40771d0 con 0x7f75cc101690 2024-09-21T10:37:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.002+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f75cc104420 con 0x7f75cc101690 2024-09-21T10:37:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.003+0000 7f75c3fff640 1 -- 172.21.15.60:0/2839362527 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v40) v1 ==== 86+0+187 (secure 0 0 0) 0x7f75b407a7f0 con 0x7f75cc101690 2024-09-21T10:37:10.005 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:10.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f75b806cbf0 msgr2=0x7f75b806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:10.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f75b806cbf0 0x7f75b806f0b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75c4005fd0 tx=0x7f75c4005850 comp rx=0 tx=0).stop 2024-09-21T10:37:10.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 msgr2=0x7f75cc19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:10.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc19bd70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f75b402aa50 tx=0x7f75b4032bb0 comp rx=0 tx=0).stop 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 shutdown_connections 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f75b806cbf0 0x7f75b806f0b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75cc101690 0x7f75cc19bd70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 --2- 172.21.15.60:0/2839362527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc100d70 0x7f75cc19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 >> 172.21.15.60:0/2839362527 conn(0x7f75cc0758a0 msgr2=0x7f75cc101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 shutdown_connections 2024-09-21T10:37:10.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:10.005+0000 7f75d1440640 1 -- 172.21.15.60:0/2839362527 wait complete. 2024-09-21T10:37:10.526 INFO:teuthology.orchestra.run.smithi060.stdout:[{"version":40,"timestamp":"2024-09-21T10:36:54.239799+0000","name":"","changes":[{"name":"osd/host:smithi112/osd_memory_target","previous_value":"7818195763","new_value":"5212130508"}]}] 2024-09-21T10:37:10.526 INFO:tasks.ceph_manager:config epoch is 40 2024-09-21T10:37:10.527 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T10:37:10.527 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T10:37:10.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T10:37:10.597 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:10 smithi060 ceph-mon[28215]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:10.597 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:10 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2839362527' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T10:37:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:10 smithi112 ceph-mon[35117]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:10 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2839362527' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T10:37:12.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 -- 172.21.15.60:0/3324794545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 msgr2=0x7fa264100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 --2- 172.21.15.60:0/3324794545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa264100180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa254009c20 tx=0x7fa25402a970 comp rx=0 tx=0).stop 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 -- 172.21.15.60:0/3324794545 shutdown_connections 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 --2- 172.21.15.60:0/3324794545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 0x7fa2641047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 --2- 172.21.15.60:0/3324794545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa264100180 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 -- 172.21.15.60:0/3324794545 >> 172.21.15.60:0/3324794545 conn(0x7fa2640fb840 msgr2=0x7fa2640fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 -- 172.21.15.60:0/3324794545 shutdown_connections 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.317+0000 7fa26aff4640 1 -- 172.21.15.60:0/3324794545 wait complete. 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa26aff4640 1 Processor -- start 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa26aff4640 1 -- start start 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa26aff4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa26419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa26aff4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 0x7fa26419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa26aff4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26419c480 con 0x7fa2640ffda0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa26aff4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264195a10 con 0x7fa264100750 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa268d90640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa26419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa268d90640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa26419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39512/0 (socket says 172.21.15.60:39512) 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.318+0000 7fa268d90640 1 -- 172.21.15.60:0/252923421 learned_addr learned my addr 172.21.15.60:0/252923421 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa263fff640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 0x7fa26419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa268d90640 1 -- 172.21.15.60:0/252923421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 msgr2=0x7fa26419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa268d90640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 0x7fa26419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa268d90640 1 -- 172.21.15.60:0/252923421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254009900 con 0x7fa2640ffda0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa263fff640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 0x7fa26419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa268d90640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa26419b920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa25402ae90 tx=0x7fa2540308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa25402f590 con 0x7fa2640ffda0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa264195c90 con 0x7fa2640ffda0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa254030ca0 con 0x7fa2640ffda0 2024-09-21T10:37:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254039680 con 0x7fa2640ffda0 2024-09-21T10:37:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.319+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa264196180 con 0x7fa2640ffda0 2024-09-21T10:37:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.320+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa264101280 con 0x7fa2640ffda0 2024-09-21T10:37:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.321+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa25400a040 con 0x7fa2640ffda0 2024-09-21T10:37:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.321+0000 7fa261ffb640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa24c06cc50 0x7fa24c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.321+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa25402c040 con 0x7fa2640ffda0 2024-09-21T10:37:12.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.321+0000 7fa263fff640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa24c06cc50 0x7fa24c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:12.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.322+0000 7fa263fff640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa24c06cc50 0x7fa24c06f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa258006fd0 tx=0x7fa258008040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:12.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.326+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa254077b70 con 0x7fa2640ffda0 2024-09-21T10:37:12.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.545+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa2641080b0 con 0x7fa2640ffda0 2024-09-21T10:37:12.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.548+0000 7fa261ffb640 1 -- 172.21.15.60:0/252923421 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174013 (secure 0 0 0) 0x7fa25407b190 con 0x7fa2640ffda0 2024-09-21T10:37:12.553 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa24c06cc50 msgr2=0x7fa24c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa24c06cc50 0x7fa24c06f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa258006fd0 tx=0x7fa258008040 comp rx=0 tx=0).stop 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 msgr2=0x7fa26419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa26419b920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa25402ae90 tx=0x7fa2540308a0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 shutdown_connections 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa24c06cc50 0x7fa24c06f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa264100750 0x7fa26419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 --2- 172.21.15.60:0/252923421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2640ffda0 0x7fa26419b920 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:12.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 >> 172.21.15.60:0/252923421 conn(0x7fa2640fb840 msgr2=0x7fa2640fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:12.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 shutdown_connections 2024-09-21T10:37:12.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:12.551+0000 7fa26aff4640 1 -- 172.21.15.60:0/252923421 wait complete. 2024-09-21T10:37:12.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:12 smithi060 ceph-mon[28215]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:12.939 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:12 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/252923421' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T10:37:12.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:12 smithi112 ceph-mon[35117]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:12.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:12 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/252923421' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T10:37:13.283 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":19,"flags":0,"active_gid":14209,"active_name":"smithi060.mulzpr","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1365116952},{"type":"v1","addr":"172.21.15.60:6801","nonce":1365116952}]},"active_addr":"172.21.15.60:6801/1365116952","active_change":"2024-09-21T10:32:37.452390+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14236,"name":"smithi112.gkunly","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.60:8443/","prometheus":"http://172.21.15.60:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2595991099}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":1994264567}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3248589549}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":1846043547}]}]} 2024-09-21T10:37:13.288 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T10:37:13.288 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T10:37:13.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T10:37:13.505 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:14.883 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:14 smithi060 ceph-mon[28215]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:14 smithi112 ceph-mon[35117]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 -- 172.21.15.60:0/3681185972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c101610 msgr2=0x7f7c7c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 --2- 172.21.15.60:0/3681185972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c101610 0x7f7c7c109b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009c50 tx=0x7f7c7002a9a0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 -- 172.21.15.60:0/3681185972 shutdown_connections 2024-09-21T10:37:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 --2- 172.21.15.60:0/3681185972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c101610 0x7f7c7c109b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 --2- 172.21.15.60:0/3681185972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c7c100c60 0x7f7c7c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 -- 172.21.15.60:0/3681185972 >> 172.21.15.60:0/3681185972 conn(0x7f7c7c0fa730 msgr2=0x7f7c7c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 -- 172.21.15.60:0/3681185972 shutdown_connections 2024-09-21T10:37:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.141+0000 7f7c80b12640 1 -- 172.21.15.60:0/3681185972 wait complete. 2024-09-21T10:37:15.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c80b12640 1 Processor -- start 2024-09-21T10:37:15.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c80b12640 1 -- start start 2024-09-21T10:37:15.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c80b12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 0x7f7c7c0fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:15.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c80b12640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c7c101610 0x7f7c7c0fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c80b12640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0ff3d0 con 0x7f7c7c100c60 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c80b12640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0ff540 con 0x7f7c7c101610 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c7a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 0x7f7c7c0fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c7a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 0x7f7c7c0fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59054/0 (socket says 172.21.15.60:59054) 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.142+0000 7f7c7a59c640 1 -- 172.21.15.60:0/833339604 learned_addr learned my addr 172.21.15.60:0/833339604 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c79d9b640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c7c101610 0x7f7c7c0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c7a59c640 1 -- 172.21.15.60:0/833339604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c7c101610 msgr2=0x7f7c7c0fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c7a59c640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c7c101610 0x7f7c7c0fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c7a59c640 1 -- 172.21.15.60:0/833339604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009900 con 0x7f7c7c100c60 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c7a59c640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 0x7f7c7c0fe950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00d8d0 tx=0x7f7c6c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6c00bea0 con 0x7f7c7c100c60 2024-09-21T10:37:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c6c009c00 con 0x7f7c7c100c60 2024-09-21T10:37:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6c00f710 con 0x7f7c7c100c60 2024-09-21T10:37:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c1a1cd0 con 0x7f7c7c100c60 2024-09-21T10:37:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.143+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c1a2030 con 0x7f7c7c100c60 2024-09-21T10:37:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.144+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c068d30 con 0x7f7c7c100c60 2024-09-21T10:37:15.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.145+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7c6c010460 con 0x7f7c7c100c60 2024-09-21T10:37:15.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.145+0000 7f7c6b7fe640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7c6406cc60 0x7f7c6406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:15.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.145+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7c6c08bb90 con 0x7f7c7c100c60 2024-09-21T10:37:15.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.145+0000 7f7c79d9b640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7c6406cc60 0x7f7c6406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:15.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.146+0000 7f7c79d9b640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7c6406cc60 0x7f7c6406f120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c1000d0 tx=0x7f7c70009800 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:15.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.149+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c6c056320 con 0x7f7c7c100c60 2024-09-21T10:37:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.323+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7c1043b0 con 0x7f7c7c100c60 2024-09-21T10:37:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.324+0000 7f7c6b7fe640 1 -- 172.21.15.60:0/833339604 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11339 (secure 0 0 0) 0x7f7c6c059940 con 0x7f7c7c100c60 2024-09-21T10:37:15.327 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:15.327 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","created":"2024-09-21T10:30:33.359796+0000","modified":"2024-09-21T10:36:54.554013+0000","last_up_change":"2024-09-21T10:36:53.341806+0000","last_in_change":"2024-09-21T10:36:33.875582+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T10:35:39.965486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09f773ee-264c-4ae2-82d5-ad981f25dbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6803","nonce":2184374024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6805","nonce":2184374024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6809","nonce":2184374024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6807","nonce":2184374024}]},"public_addr":"172.21.15.60:6803/2184374024","cluster_addr":"172.21.15.60:6805/2184374024","heartbeat_back_addr":"172.21.15.60:6809/2184374024","heartbeat_front_addr":"172.21.15.60:6807/2184374024","state":["exists","up"]},{"osd":1,"uuid":"0c4c1a09-06c2-4843-8df1-8603fc43594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6811","nonce":2267629556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6813","nonce":2267629556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6817","nonce":2267629556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6815","nonce":2267629556}]},"public_addr":"172.21.15.60:6811/2267629556","cluster_addr":"172.21.15.60:6813/2267629556","heartbeat_back_addr":"172.21.15.60:6817/2267629556","heartbeat_front_addr":"172.21.15.60:6815/2267629556","state":["exists","up"]},{"osd":2,"uuid":"80b3ce3a-e177-43f2-b457-0c94e4160914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6819","nonce":4195573032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6821","nonce":4195573032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6825","nonce":4195573032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6823","nonce":4195573032}]},"public_addr":"172.21.15.60:6819/4195573032","cluster_addr":"172.21.15.60:6821/4195573032","heartbeat_back_addr":"172.21.15.60:6825/4195573032","heartbeat_front_addr":"172.21.15.60:6823/4195573032","state":["exists","up"]},{"osd":3,"uuid":"f8b881e2-6400-4c14-a7f7-6c54e182660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6801","nonce":4117307015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6803","nonce":4117307015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6807","nonce":4117307015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6805","nonce":4117307015}]},"public_addr":"172.21.15.112:6801/4117307015","cluster_addr":"172.21.15.112:6803/4117307015","heartbeat_back_addr":"172.21.15.112:6807/4117307015","heartbeat_front_addr":"172.21.15.112:6805/4117307015","state":["exists","up"]},{"osd":4,"uuid":"539008c2-85e1-4b46-8df6-4fc052a8204b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6809","nonce":3782973484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6811","nonce":3782973484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6815","nonce":3782973484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6813","nonce":3782973484}]},"public_addr":"172.21.15.112:6809/3782973484","cluster_addr":"172.21.15.112:6811/3782973484","heartbeat_back_addr":"172.21.15.112:6815/3782973484","heartbeat_front_addr":"172.21.15.112:6813/3782973484","state":["exists","up"]},{"osd":5,"uuid":"6d63332d-29f7-4f7a-af36-2a7f4f6e90ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6817","nonce":853919786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6819","nonce":853919786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6823","nonce":853919786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6821","nonce":853919786}]},"public_addr":"172.21.15.112:6817/853919786","cluster_addr":"172.21.15.112:6819/853919786","heartbeat_back_addr":"172.21.15.112:6823/853919786","heartbeat_front_addr":"172.21.15.112:6821/853919786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:34:40.339540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:07.960486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:35.636732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:59.056716+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:36:25.350652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:36:51.006851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/3364675318":"2024-09-22T10:32:37.452284+0000","172.21.15.60:6801/1631962843":"2024-09-22T10:32:37.452284+0000","172.21.15.60:0/2957889149":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6800/1152707410":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/1410574713":"2024-09-22T10:31:05.936397+0000","172.21.15.60:0/2185187485":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/3611925388":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6800/4213874648":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6801/4213874648":"2024-09-22T10:31:05.936397+0000","172.21.15.60:0/1074459672":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/3334685987":"2024-09-22T10:31:36.919711+0000","172.21.15.60:6801/1152707410":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/1375438723":"2024-09-22T10:32:37.452284+0000","172.21.15.60:0/2300592546":"2024-09-22T10:32:37.452284+0000","172.21.15.60:6800/1631962843":"2024-09-22T10:32:37.452284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T10:37:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7c6406cc60 msgr2=0x7f7c6406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7c6406cc60 0x7f7c6406f120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c1000d0 tx=0x7f7c70009800 comp rx=0 tx=0).stop 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 msgr2=0x7f7c7c0fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 0x7f7c7c0fe950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00d8d0 tx=0x7f7c6c00dd90 comp rx=0 tx=0).stop 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 shutdown_connections 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7c6406cc60 0x7f7c6406f120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c7c101610 0x7f7c7c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 --2- 172.21.15.60:0/833339604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c7c100c60 0x7f7c7c0fe950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.326+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 >> 172.21.15.60:0/833339604 conn(0x7f7c7c0fa730 msgr2=0x7f7c7c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.327+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 shutdown_connections 2024-09-21T10:37:15.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:15.327+0000 7f7c80b12640 1 -- 172.21.15.60:0/833339604 wait complete. 2024-09-21T10:37:15.840 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:15 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/833339604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T10:37:15.944 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:15 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/833339604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T10:37:15.966 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T10:37:15.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T10:37:16.171 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:16.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:16 smithi060 ceph-mon[28215]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:16 smithi112 ceph-mon[35117]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 -- 172.21.15.60:0/3695180115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 msgr2=0x7f0068109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 --2- 172.21.15.60:0/3695180115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f0068109b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0058009c50 tx=0x7f005802a9a0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 -- 172.21.15.60:0/3695180115 shutdown_connections 2024-09-21T10:37:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 --2- 172.21.15.60:0/3695180115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f0068109b00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 --2- 172.21.15.60:0/3695180115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0068100c60 0x7f0068101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 -- 172.21.15.60:0/3695180115 >> 172.21.15.60:0/3695180115 conn(0x7f00680fa730 msgr2=0x7f00680fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 -- 172.21.15.60:0/3695180115 shutdown_connections 2024-09-21T10:37:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 -- 172.21.15.60:0/3695180115 wait complete. 2024-09-21T10:37:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 Processor -- start 2024-09-21T10:37:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 -- start start 2024-09-21T10:37:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.721+0000 7f006efb1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0068100c60 0x7f00680fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f006efb1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f00680fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f006efb1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ff3d0 con 0x7f0068101610 2024-09-21T10:37:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f006efb1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ff540 con 0x7f0068100c60 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f00680fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f00680fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59074/0 (socket says 172.21.15.60:59074) 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 -- 172.21.15.60:0/3437824655 learned_addr learned my addr 172.21.15.60:0/3437824655 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f006cd4d640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0068100c60 0x7f00680fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 -- 172.21.15.60:0/3437824655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0068100c60 msgr2=0x7f00680fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0068100c60 0x7f00680fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 -- 172.21.15.60:0/3437824655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058009900 con 0x7f0068101610 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0067fff640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f00680fee90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0058000f80 tx=0x7f005802f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f005802fb10 con 0x7f0068101610 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f005803a8f0 con 0x7f0068101610 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680ff7c0 con 0x7f0068101610 2024-09-21T10:37:17.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.722+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0058039920 con 0x7f0068101610 2024-09-21T10:37:17.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.723+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00681a2050 con 0x7f0068101610 2024-09-21T10:37:17.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.724+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0068068d30 con 0x7f0068101610 2024-09-21T10:37:17.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.724+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f005800a040 con 0x7f0068101610 2024-09-21T10:37:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.725+0000 7f0065ffb640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f005406cc50 0x7f005406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.725+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f00580ad3a0 con 0x7f0068101610 2024-09-21T10:37:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.725+0000 7f006cd4d640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f005406cc50 0x7f005406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.725+0000 7f006cd4d640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f005406cc50 0x7f005406f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0050009990 tx=0x7f0050009110 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.729+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0058077b30 con 0x7f0068101610 2024-09-21T10:37:17.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.905+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00680ff7c0 con 0x7f0068101610 2024-09-21T10:37:17.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.905+0000 7f0065ffb640 1 -- 172.21.15.60:0/3437824655 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11339 (secure 0 0 0) 0x7f00680ff7c0 con 0x7f0068101610 2024-09-21T10:37:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:17.908 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"fsid":"6621b92e-7804-11ef-baf6-efdc52797490","created":"2024-09-21T10:30:33.359796+0000","modified":"2024-09-21T10:36:54.554013+0000","last_up_change":"2024-09-21T10:36:53.341806+0000","last_in_change":"2024-09-21T10:36:33.875582+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T10:35:39.965486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09f773ee-264c-4ae2-82d5-ad981f25dbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6803","nonce":2184374024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6805","nonce":2184374024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6809","nonce":2184374024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2184374024},{"type":"v1","addr":"172.21.15.60:6807","nonce":2184374024}]},"public_addr":"172.21.15.60:6803/2184374024","cluster_addr":"172.21.15.60:6805/2184374024","heartbeat_back_addr":"172.21.15.60:6809/2184374024","heartbeat_front_addr":"172.21.15.60:6807/2184374024","state":["exists","up"]},{"osd":1,"uuid":"0c4c1a09-06c2-4843-8df1-8603fc43594d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6811","nonce":2267629556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6813","nonce":2267629556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6817","nonce":2267629556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2267629556},{"type":"v1","addr":"172.21.15.60:6815","nonce":2267629556}]},"public_addr":"172.21.15.60:6811/2267629556","cluster_addr":"172.21.15.60:6813/2267629556","heartbeat_back_addr":"172.21.15.60:6817/2267629556","heartbeat_front_addr":"172.21.15.60:6815/2267629556","state":["exists","up"]},{"osd":2,"uuid":"80b3ce3a-e177-43f2-b457-0c94e4160914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6819","nonce":4195573032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6821","nonce":4195573032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6825","nonce":4195573032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":4195573032},{"type":"v1","addr":"172.21.15.60:6823","nonce":4195573032}]},"public_addr":"172.21.15.60:6819/4195573032","cluster_addr":"172.21.15.60:6821/4195573032","heartbeat_back_addr":"172.21.15.60:6825/4195573032","heartbeat_front_addr":"172.21.15.60:6823/4195573032","state":["exists","up"]},{"osd":3,"uuid":"f8b881e2-6400-4c14-a7f7-6c54e182660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6801","nonce":4117307015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6803","nonce":4117307015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6807","nonce":4117307015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":4117307015},{"type":"v1","addr":"172.21.15.112:6805","nonce":4117307015}]},"public_addr":"172.21.15.112:6801/4117307015","cluster_addr":"172.21.15.112:6803/4117307015","heartbeat_back_addr":"172.21.15.112:6807/4117307015","heartbeat_front_addr":"172.21.15.112:6805/4117307015","state":["exists","up"]},{"osd":4,"uuid":"539008c2-85e1-4b46-8df6-4fc052a8204b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6809","nonce":3782973484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6811","nonce":3782973484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6815","nonce":3782973484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3782973484},{"type":"v1","addr":"172.21.15.112:6813","nonce":3782973484}]},"public_addr":"172.21.15.112:6809/3782973484","cluster_addr":"172.21.15.112:6811/3782973484","heartbeat_back_addr":"172.21.15.112:6815/3782973484","heartbeat_front_addr":"172.21.15.112:6813/3782973484","state":["exists","up"]},{"osd":5,"uuid":"6d63332d-29f7-4f7a-af36-2a7f4f6e90ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6817","nonce":853919786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6819","nonce":853919786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6823","nonce":853919786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":853919786},{"type":"v1","addr":"172.21.15.112:6821","nonce":853919786}]},"public_addr":"172.21.15.112:6817/853919786","cluster_addr":"172.21.15.112:6819/853919786","heartbeat_back_addr":"172.21.15.112:6823/853919786","heartbeat_front_addr":"172.21.15.112:6821/853919786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:34:40.339540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:07.960486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:35.636732+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:35:59.056716+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:36:25.350652+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T10:36:51.006851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/3364675318":"2024-09-22T10:32:37.452284+0000","172.21.15.60:6801/1631962843":"2024-09-22T10:32:37.452284+0000","172.21.15.60:0/2957889149":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6800/1152707410":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/1410574713":"2024-09-22T10:31:05.936397+0000","172.21.15.60:0/2185187485":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/3611925388":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6800/4213874648":"2024-09-22T10:31:05.936397+0000","172.21.15.60:6801/4213874648":"2024-09-22T10:31:05.936397+0000","172.21.15.60:0/1074459672":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/3334685987":"2024-09-22T10:31:36.919711+0000","172.21.15.60:6801/1152707410":"2024-09-22T10:31:36.919711+0000","172.21.15.60:0/1375438723":"2024-09-22T10:32:37.452284+0000","172.21.15.60:0/2300592546":"2024-09-22T10:32:37.452284+0000","172.21.15.60:6800/1631962843":"2024-09-22T10:32:37.452284+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T10:37:17.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f005406cc50 msgr2=0x7f005406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:17.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f005406cc50 0x7f005406f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0050009990 tx=0x7f0050009110 comp rx=0 tx=0).stop 2024-09-21T10:37:17.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 msgr2=0x7f00680fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:17.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f00680fee90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0058000f80 tx=0x7f005802f5c0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 shutdown_connections 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f005406cc50 0x7f005406f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0068101610 0x7f00680fee90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 --2- 172.21.15.60:0/3437824655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0068100c60 0x7f00680fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 >> 172.21.15.60:0/3437824655 conn(0x7f00680fa730 msgr2=0x7f0068101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 shutdown_connections 2024-09-21T10:37:17.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:17.908+0000 7f006efb1640 1 -- 172.21.15.60:0/3437824655 wait complete. 2024-09-21T10:37:18.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T10:37:18.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T10:37:18.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T10:37:18.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T10:37:18.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T10:37:18.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T10:37:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:18.948 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:18.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:18 smithi060 ceph-mon[28215]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:18.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:18 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3437824655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T10:37:18.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:18 smithi112 ceph-mon[35117]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:18.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:18 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3437824655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T10:37:20.274 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:20.274 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:20.866 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:20 smithi060 ceph-mon[28215]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:20.901 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:20 smithi112 ceph-mon[35117]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.410+0000 7f45754e9640 1 -- 172.21.15.60:0/4193339149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 msgr2=0x7f4570105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 --2- 172.21.15.60:0/4193339149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f4570105fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4560009880 tx=0x7f456002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 -- 172.21.15.60:0/4193339149 shutdown_connections 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 --2- 172.21.15.60:0/4193339149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45700ffb40 0x7f45700fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 --2- 172.21.15.60:0/4193339149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f4570105fd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 -- 172.21.15.60:0/4193339149 >> 172.21.15.60:0/4193339149 conn(0x7f45700fb860 msgr2=0x7f45700fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 -- 172.21.15.60:0/4193339149 shutdown_connections 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 -- 172.21.15.60:0/4193339149 wait complete. 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 Processor -- start 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.411+0000 7f45754e9640 1 -- start start 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f45754e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45700ffb40 0x7f457019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f45754e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f457019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f45754e9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457019c360 con 0x7f4570105bf0 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f45754e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45701958f0 con 0x7f45700ffb40 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f457019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f457019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59084/0 (socket says 172.21.15.60:59084) 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 -- 172.21.15.60:0/3668651260 learned_addr learned my addr 172.21.15.60:0/3668651260 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f456effd640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45700ffb40 0x7f457019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 -- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45700ffb40 msgr2=0x7f457019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45700ffb40 0x7f457019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 -- 172.21.15.60:0/3668651260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009560 con 0x7f4570105bf0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f4567fff640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f457019bd40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f455800d6f0 tx=0x7f455800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4558009a30 con 0x7f4570105bf0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45580054e0 con 0x7f4570105bf0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4570195bd0 con 0x7f4570105bf0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.412+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4558010460 con 0x7f4570105bf0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.413+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45701961a0 con 0x7f4570105bf0 2024-09-21T10:37:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.413+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f457010d0b0 con 0x7f4570105bf0 2024-09-21T10:37:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.414+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4558009b90 con 0x7f4570105bf0 2024-09-21T10:37:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456cff9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f455c06cc50 0x7f455c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f455808b9d0 con 0x7f4570105bf0 2024-09-21T10:37:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456effd640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f455c06cc50 0x7f455c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456cff9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] conn(0x7f455c0729e0 0x7f455c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 --> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f455c0754b0 con 0x7f455c0729e0 2024-09-21T10:37:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45580902a0 con 0x7f4570105bf0 2024-09-21T10:37:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456f7fe640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] conn(0x7f455c0729e0 0x7f455c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.415+0000 7f456effd640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f455c06cc50 0x7f455c06f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4560000c00 tx=0x7f4560005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.416+0000 7f456f7fe640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] conn(0x7f455c0729e0 0x7f455c074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.417+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== osd.4 v2:172.21.15.112:6808/3782973484 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f455c0754b0 con 0x7f455c0729e0 2024-09-21T10:37:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 --> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4570196650 con 0x7f455c0729e0 2024-09-21T10:37:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f456cff9640 1 -- 172.21.15.60:0/3668651260 <== osd.4 v2:172.21.15.112:6808/3782973484 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4570196650 con 0x7f455c0729e0 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] conn(0x7f455c0729e0 msgr2=0x7f455c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] conn(0x7f455c0729e0 0x7f455c074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f455c06cc50 msgr2=0x7f455c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f455c06cc50 0x7f455c06f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4560000c00 tx=0x7f4560005a20 comp rx=0 tx=0).stop 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 msgr2=0x7f457019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f457019bd40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f455800d6f0 tx=0x7f455800dbb0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 shutdown_connections 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:6808/3782973484,v1:172.21.15.112:6809/3782973484] conn(0x7f455c0729e0 0x7f455c074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f455c06cc50 0x7f455c06f110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4570105bf0 0x7f457019bd40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 --2- 172.21.15.60:0/3668651260 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45700ffb40 0x7f457019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.430+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 >> 172.21.15.60:0/3668651260 conn(0x7f45700fb860 msgr2=0x7f45700fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.431+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 shutdown_connections 2024-09-21T10:37:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:22.431+0000 7f45754e9640 1 -- 172.21.15.60:0/3668651260 wait complete. 2024-09-21T10:37:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:22 smithi060 ceph-mon[28215]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:22 smithi112 ceph-mon[35117]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:23.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 -- 172.21.15.60:0/3870794564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27901016b0 msgr2=0x7f2790109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3870794564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27901016b0 0x7f2790109ba0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f27840098b0 tx=0x7f278402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 -- 172.21.15.60:0/3870794564 shutdown_connections 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3870794564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27901016b0 0x7f2790109ba0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3870794564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2790100d90 0x7f2790101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 -- 172.21.15.60:0/3870794564 >> 172.21.15.60:0/3870794564 conn(0x7f27900fa730 msgr2=0x7f27900fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 -- 172.21.15.60:0/3870794564 shutdown_connections 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.118+0000 7f2795cfb640 1 -- 172.21.15.60:0/3870794564 wait complete. 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.119+0000 7f2795cfb640 1 Processor -- start 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.119+0000 7f2795cfb640 1 -- start start 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.119+0000 7f2795cfb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 0x7f27900fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:23.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.119+0000 7f2795cfb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27901016b0 0x7f27900fef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.119+0000 7f2795cfb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27901009c0 con 0x7f2790100d90 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.119+0000 7f2795cfb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27900ff470 con 0x7f27901016b0 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 0x7f27900fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 0x7f27900fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59104/0 (socket says 172.21.15.60:59104) 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 -- 172.21.15.60:0/3563924951 learned_addr learned my addr 172.21.15.60:0/3563924951 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278effd640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27901016b0 0x7f27900fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 -- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27901016b0 msgr2=0x7f27900fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27901016b0 0x7f27900fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 -- 172.21.15.60:0/3563924951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784009560 con 0x7f2790100d90 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278effd640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27901016b0 0x7f27900fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278f7fe640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 0x7f27900fe9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f278000c8a0 tx=0x7f278000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2780007b80 con 0x7f2790100d90 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27900ff750 con 0x7f2790100d90 2024-09-21T10:37:23.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2780007ce0 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2780018810 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.120+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27901a1f90 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.121+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f279010d0b0 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2780018a80 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278cff9640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f277806cc50 0x7f277806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f278008c120 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278effd640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f277806cc50 0x7f277806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278cff9640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] conn(0x7f27780729e0 0x7f2778074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 --> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27780754b0 con 0x7f27780729e0 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.122+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f278008e7f0 con 0x7f2790100d90 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.123+0000 7f278effd640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f277806cc50 0x7f277806f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2784000c00 tx=0x7f2784005e60 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.123+0000 7f278ffff640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] conn(0x7f27780729e0 0x7f2778074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.123+0000 7f278ffff640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] conn(0x7f27780729e0 0x7f2778074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:23.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.124+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== osd.3 v2:172.21.15.112:6800/4117307015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f27780754b0 con 0x7f27780729e0 2024-09-21T10:37:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.137+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 --> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2790068c90 con 0x7f27780729e0 2024-09-21T10:37:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f278cff9640 1 -- 172.21.15.60:0/3563924951 <== osd.3 v2:172.21.15.112:6800/4117307015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2790068c90 con 0x7f27780729e0 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] conn(0x7f27780729e0 msgr2=0x7f2778074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] conn(0x7f27780729e0 0x7f2778074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f277806cc50 msgr2=0x7f277806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f277806cc50 0x7f277806f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2784000c00 tx=0x7f2784005e60 comp rx=0 tx=0).stop 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 msgr2=0x7f27900fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 0x7f27900fe9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f278000c8a0 tx=0x7f278000cd60 comp rx=0 tx=0).stop 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 shutdown_connections 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:6800/4117307015,v1:172.21.15.112:6801/4117307015] conn(0x7f27780729e0 0x7f2778074e00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f277806cc50 0x7f277806f110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f27901016b0 0x7f27900fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 --2- 172.21.15.60:0/3563924951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2790100d90 0x7f27900fe9f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.138+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 >> 172.21.15.60:0/3563924951 conn(0x7f27900fa730 msgr2=0x7f2790101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.139+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 shutdown_connections 2024-09-21T10:37:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:23.139+0000 7f2795cfb640 1 -- 172.21.15.60:0/3563924951 wait complete. 2024-09-21T10:37:23.749 INFO:teuthology.orchestra.run.smithi060.stdout:107374182419 2024-09-21T10:37:23.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T10:37:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:24 smithi060 ceph-mon[28215]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:24 smithi112 ceph-mon[35117]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 -- 172.21.15.60:0/532225641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e940fea30 msgr2=0x7f1e940fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/532225641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e940fea30 0x7f1e940fee90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009880 tx=0x7f1e9002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 -- 172.21.15.60:0/532225641 shutdown_connections 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/532225641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e940fea30 0x7f1e940fee90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/532225641 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e94104a30 0x7f1e94104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 -- 172.21.15.60:0/532225641 >> 172.21.15.60:0/532225641 conn(0x7f1e940fa730 msgr2=0x7f1e940fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 -- 172.21.15.60:0/532225641 shutdown_connections 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.349+0000 7f1e9c48f640 1 -- 172.21.15.60:0/532225641 wait complete. 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e9c48f640 1 Processor -- start 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e9c48f640 1 -- start start 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e9c48f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e940fea30 0x7f1e940fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e9c48f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 0x7f1e940fb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e9c48f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940fcfb0 con 0x7f1e94104a30 2024-09-21T10:37:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e9c48f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940fba60 con 0x7f1e940fea30 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e99a2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 0x7f1e940fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e99a2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 0x7f1e940fb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44624/0 (socket says 172.21.15.60:44624) 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.350+0000 7f1e99a2a640 1 -- 172.21.15.60:0/2561213048 learned_addr learned my addr 172.21.15.60:0/2561213048 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e9a22b640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e940fea30 0x7f1e940fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e99a2a640 1 -- 172.21.15.60:0/2561213048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e940fea30 msgr2=0x7f1e940fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e99a2a640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e940fea30 0x7f1e940fafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e99a2a640 1 -- 172.21.15.60:0/2561213048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009560 con 0x7f1e94104a30 2024-09-21T10:37:26.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e99a2a640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 0x7f1e940fb520 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1e90006010 tx=0x7f1e900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e90004aa0 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e940fbce0 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e90004c00 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e90003a20 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.351+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e941a1e90 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.352+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e9410bfa0 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.352+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1e90031c90 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e877fe640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e8006cc60 0x7f1e8006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1e900ad130 con 0x7f1e94104a30 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e9a22b640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e8006cc60 0x7f1e8006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e877fe640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] conn(0x7f1e800729f0 0x7f1e80074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 --> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e800754c0 con 0x7f1e800729f0 2024-09-21T10:37:26.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e900af800 con 0x7f1e94104a30 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e9aa2c640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] conn(0x7f1e800729f0 0x7f1e80074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.353+0000 7f1e9a22b640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e8006cc60 0x7f1e8006f120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e88005e10 tx=0x7f1e88005da0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.354+0000 7f1e9aa2c640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] conn(0x7f1e800729f0 0x7f1e80074e10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.354+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== osd.1 v2:172.21.15.60:6810/2267629556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1e800754c0 con 0x7f1e800729f0 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.367+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 --> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e94060b30 con 0x7f1e800729f0 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e877fe640 1 -- 172.21.15.60:0/2561213048 <== osd.1 v2:172.21.15.60:6810/2267629556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e94060b30 con 0x7f1e800729f0 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] conn(0x7f1e800729f0 msgr2=0x7f1e80074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] conn(0x7f1e800729f0 0x7f1e80074e10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e8006cc60 msgr2=0x7f1e8006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e8006cc60 0x7f1e8006f120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e88005e10 tx=0x7f1e88005da0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 msgr2=0x7f1e940fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 0x7f1e940fb520 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1e90006010 tx=0x7f1e900055a0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 shutdown_connections 2024-09-21T10:37:26.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6810/2267629556,v1:172.21.15.60:6811/2267629556] conn(0x7f1e800729f0 0x7f1e80074e10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e8006cc60 0x7f1e8006f120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e94104a30 0x7f1e940fb520 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 --2- 172.21.15.60:0/2561213048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e940fea30 0x7f1e940fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 >> 172.21.15.60:0/2561213048 conn(0x7f1e940fa730 msgr2=0x7f1e94068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 shutdown_connections 2024-09-21T10:37:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:26.368+0000 7f1e9c48f640 1 -- 172.21.15.60:0/2561213048 wait complete. 2024-09-21T10:37:26.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:26 smithi060 ceph-mon[28215]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:26.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:26 smithi112 ceph-mon[35117]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:27.308 INFO:teuthology.orchestra.run.smithi060.stdout:141733920781 2024-09-21T10:37:27.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T10:37:28.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 -- 172.21.15.60:0/887519037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b240ff1d0 msgr2=0x7f2b240ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:28.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 --2- 172.21.15.60:0/887519037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b240ff1d0 0x7f2b240ff610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009880 tx=0x7f2b1802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 -- 172.21.15.60:0/887519037 shutdown_connections 2024-09-21T10:37:28.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 --2- 172.21.15.60:0/887519037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b240ff1d0 0x7f2b240ff610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 --2- 172.21.15.60:0/887519037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b24103a20 0x7f2b24103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 -- 172.21.15.60:0/887519037 >> 172.21.15.60:0/887519037 conn(0x7f2b240f9e70 msgr2=0x7f2b240fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:28.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 -- 172.21.15.60:0/887519037 shutdown_connections 2024-09-21T10:37:28.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.130+0000 7f2b288a0640 1 -- 172.21.15.60:0/887519037 wait complete. 2024-09-21T10:37:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.131+0000 7f2b288a0640 1 Processor -- start 2024-09-21T10:37:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.131+0000 7f2b288a0640 1 -- start start 2024-09-21T10:37:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b288a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b240ff1d0 0x7f2b2419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b288a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 0x7f2b2419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b288a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2419c410 con 0x7f2b24103a20 2024-09-21T10:37:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b288a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241959a0 con 0x7f2b240ff1d0 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 0x7f2b2419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 0x7f2b2419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44640/0 (socket says 172.21.15.60:44640) 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 -- 172.21.15.60:0/2948449279 learned_addr learned my addr 172.21.15.60:0/2948449279 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b2259c640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b240ff1d0 0x7f2b2419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 -- 172.21.15.60:0/2948449279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b240ff1d0 msgr2=0x7f2b2419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b240ff1d0 0x7f2b2419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 -- 172.21.15.60:0/2948449279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18009560 con 0x7f2b24103a20 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b2259c640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b240ff1d0 0x7f2b2419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:37:28.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b21d9b640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 0x7f2b2419bdf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2b1802a9c0 tx=0x7f2b180055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b18004aa0 con 0x7f2b24103a20 2024-09-21T10:37:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.132+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b24195c20 con 0x7f2b24103a20 2024-09-21T10:37:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.133+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b24196110 con 0x7f2b24103a20 2024-09-21T10:37:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.133+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b18004c00 con 0x7f2b24103a20 2024-09-21T10:37:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.133+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b18003ab0 con 0x7f2b24103a20 2024-09-21T10:37:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.133+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b2410d150 con 0x7f2b24103a20 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.134+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2b18031d20 con 0x7f2b24103a20 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b137fe640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2b0c06cc50 0x7f2b0c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2b180ad650 con 0x7f2b24103a20 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b2259c640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2b0c06cc50 0x7f2b0c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b137fe640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] conn(0x7f2b0c0729e0 0x7f2b0c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 --> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b0c0754b0 con 0x7f2b0c0729e0 2024-09-21T10:37:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b180ada90 con 0x7f2b24103a20 2024-09-21T10:37:28.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b22d9d640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] conn(0x7f2b0c0729e0 0x7f2b0c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:28.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.135+0000 7f2b2259c640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2b0c06cc50 0x7f2b0c06f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b140058c0 tx=0x7f2b14005ec0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:28.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.136+0000 7f2b22d9d640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] conn(0x7f2b0c0729e0 0x7f2b0c074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:28.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.136+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== osd.0 v2:172.21.15.60:6802/2184374024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2b0c0754b0 con 0x7f2b0c0729e0 2024-09-21T10:37:28.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.150+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 --> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b24196630 con 0x7f2b0c0729e0 2024-09-21T10:37:28.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b137fe640 1 -- 172.21.15.60:0/2948449279 <== osd.0 v2:172.21.15.60:6802/2184374024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b24196630 con 0x7f2b0c0729e0 2024-09-21T10:37:28.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] conn(0x7f2b0c0729e0 msgr2=0x7f2b0c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:28.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] conn(0x7f2b0c0729e0 0x7f2b0c074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2b0c06cc50 msgr2=0x7f2b0c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:28.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2b0c06cc50 0x7f2b0c06f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2b140058c0 tx=0x7f2b14005ec0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 msgr2=0x7f2b2419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 0x7f2b2419bdf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2b1802a9c0 tx=0x7f2b180055a0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 shutdown_connections 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6802/2184374024,v1:172.21.15.60:6803/2184374024] conn(0x7f2b0c0729e0 0x7f2b0c074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2b0c06cc50 0x7f2b0c06f110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b24103a20 0x7f2b2419bdf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.151+0000 7f2b288a0640 1 --2- 172.21.15.60:0/2948449279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b240ff1d0 0x7f2b2419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.152+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 >> 172.21.15.60:0/2948449279 conn(0x7f2b240f9e70 msgr2=0x7f2b240fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.152+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 shutdown_connections 2024-09-21T10:37:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:28.152+0000 7f2b288a0640 1 -- 172.21.15.60:0/2948449279 wait complete. 2024-09-21T10:37:28.917 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:28 smithi060 ceph-mon[28215]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:28.943 INFO:teuthology.orchestra.run.smithi060.stdout:60129542175 2024-09-21T10:37:28.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T10:37:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:28 smithi112 ceph-mon[35117]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3306841558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 msgr2=0x7f2c9c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3306841558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c100180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009880 tx=0x7f2c8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3306841558 shutdown_connections 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3306841558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 0x7f2c9c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3306841558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c100180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3306841558 >> 172.21.15.60:0/3306841558 conn(0x7f2c9c0fb840 msgr2=0x7f2c9c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.158+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3306841558 shutdown_connections 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3306841558 wait complete. 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 Processor -- start 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 -- start start 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 0x7f2c9c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c19c360 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.159+0000 7f2ca1b74640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c1958f0 con 0x7f2c9c100750 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44664/0 (socket says 172.21.15.60:44664) 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/3369094996 learned_addr learned my addr 172.21.15.60:0/3369094996 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9affd640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 0x7f2c9c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/3369094996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 msgr2=0x7f2c9c19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 0x7f2c9c19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/3369094996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009560 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9affd640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 0x7f2c9c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c9b7fe640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c19b800 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c02a9c0 tx=0x7f2c8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8c004aa0 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c8c004c00 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c195b70 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8c003980 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.160+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c196060 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.161+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c9c10d0b0 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2c8c003bf0 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c98ff9640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2c8406cc50 0x7f2c8406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2c8c0acf80 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c9affd640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2c8406cc50 0x7f2c8406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c98ff9640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] conn(0x7f2c840729e0 0x7f2c84074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:29.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 --> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c840754b0 con 0x7f2c840729e0 2024-09-21T10:37:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.162+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c8c0af650 con 0x7f2c9c0ffda0 2024-09-21T10:37:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.163+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] conn(0x7f2c840729e0 0x7f2c84074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.163+0000 7f2c9affd640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2c8406cc50 0x7f2c8406f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c196d60 tx=0x7f2c90005e50 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.163+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] conn(0x7f2c840729e0 0x7f2c84074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:29.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.164+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== osd.2 v2:172.21.15.60:6818/4195573032 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2c840754b0 con 0x7f2c840729e0 2024-09-21T10:37:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.177+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 --> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c9c1964c0 con 0x7f2c840729e0 2024-09-21T10:37:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2c98ff9640 1 -- 172.21.15.60:0/3369094996 <== osd.2 v2:172.21.15.60:6818/4195573032 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c9c1964c0 con 0x7f2c840729e0 2024-09-21T10:37:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] conn(0x7f2c840729e0 msgr2=0x7f2c84074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] conn(0x7f2c840729e0 0x7f2c84074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2c8406cc50 msgr2=0x7f2c8406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2c8406cc50 0x7f2c8406f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c196d60 tx=0x7f2c90005e50 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 msgr2=0x7f2c9c19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c19b800 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c02a9c0 tx=0x7f2c8c0055a0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 shutdown_connections 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2c8406cc50 0x7f2c8406f110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:6818/4195573032,v1:172.21.15.60:6819/4195573032] conn(0x7f2c840729e0 0x7f2c84074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c9c100750 0x7f2c9c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 --2- 172.21.15.60:0/3369094996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0ffda0 0x7f2c9c19b800 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.178+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 >> 172.21.15.60:0/3369094996 conn(0x7f2c9c0fb840 msgr2=0x7f2c9c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.179+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 shutdown_connections 2024-09-21T10:37:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:29.179+0000 7f2ca1b74640 1 -- 172.21.15.60:0/3369094996 wait complete. 2024-09-21T10:37:29.920 INFO:teuthology.orchestra.run.smithi060.stdout:81604378650 2024-09-21T10:37:29.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T10:37:30.229 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:30.233 INFO:teuthology.orchestra.run.smithi060.stdout:38654705700 2024-09-21T10:37:30.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T10:37:30.816 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:30 smithi060 ceph-mon[28215]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:30 smithi112 ceph-mon[35117]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.841+0000 7fa80ccff640 1 -- 172.21.15.60:0/1947408130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 msgr2=0x7fa8081047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.841+0000 7fa80ccff640 1 --2- 172.21.15.60:0/1947408130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa8081047a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009c20 tx=0x7fa7fc02a970 comp rx=0 tx=0).stop 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.841+0000 7fa80ccff640 1 -- 172.21.15.60:0/1947408130 shutdown_connections 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.841+0000 7fa80ccff640 1 --2- 172.21.15.60:0/1947408130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa8081047a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.841+0000 7fa80ccff640 1 --2- 172.21.15.60:0/1947408130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8080ffda0 0x7fa808100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.841+0000 7fa80ccff640 1 -- 172.21.15.60:0/1947408130 >> 172.21.15.60:0/1947408130 conn(0x7fa8080fb840 msgr2=0x7fa8080fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.842+0000 7fa80ccff640 1 -- 172.21.15.60:0/1947408130 shutdown_connections 2024-09-21T10:37:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.842+0000 7fa80ccff640 1 -- 172.21.15.60:0/1947408130 wait complete. 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.842+0000 7fa80ccff640 1 Processor -- start 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.842+0000 7fa80ccff640 1 -- start start 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa80ccff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8080ffda0 0x7fa8080727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa80ccff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa808072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa80ccff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808073230 con 0x7fa808100750 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa80ccff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808073370 con 0x7fa8080ffda0 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa808072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa808072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44674/0 (socket says 172.21.15.60:44674) 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 -- 172.21.15.60:0/4156245531 learned_addr learned my addr 172.21.15.60:0/4156245531 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa80659c640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8080ffda0 0x7fa8080727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 -- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8080ffda0 msgr2=0x7fa8080727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8080ffda0 0x7fa8080727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 -- 172.21.15.60:0/4156245531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc009900 con 0x7fa808100750 2024-09-21T10:37:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.843+0000 7fa805d9b640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa808072cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc02ae90 tx=0x7fa7fc030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.844+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc02f3c0 con 0x7fa808100750 2024-09-21T10:37:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.844+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7fc02f9e0 con 0x7fa808100750 2024-09-21T10:37:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.844+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8080735f0 con 0x7fa808100750 2024-09-21T10:37:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.844+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc039450 con 0x7fa808100750 2024-09-21T10:37:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.844+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8081a2000 con 0x7fa808100750 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.844+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa80810d010 con 0x7fa808100750 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.845+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa7fc00a040 con 0x7fa808100750 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa7f77fe640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa7f006cc50 0x7fa7f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa7fc02c040 con 0x7fa808100750 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa80659c640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa7f006cc50 0x7fa7f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa7f77fe640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] conn(0x7fa7f00729e0 0x7fa7f0074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 --> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7f00754b0 con 0x7fa7f00729e0 2024-09-21T10:37:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7fc0af680 con 0x7fa808100750 2024-09-21T10:37:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa80659c640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa7f006cc50 0x7fa7f006f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005fd0 tx=0x7fa7f800b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.846+0000 7fa806d9d640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] conn(0x7fa7f00729e0 0x7fa7f0074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.847+0000 7fa806d9d640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] conn(0x7fa7f00729e0 0x7fa7f0074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.847+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== osd.5 v2:172.21.15.112:6816/853919786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa7f00754b0 con 0x7fa7f00729e0 2024-09-21T10:37:31.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.860+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 --> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa808060b30 con 0x7fa7f00729e0 2024-09-21T10:37:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa7f77fe640 1 -- 172.21.15.60:0/4156245531 <== osd.5 v2:172.21.15.112:6816/853919786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa808060b30 con 0x7fa7f00729e0 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] conn(0x7fa7f00729e0 msgr2=0x7fa7f0074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] conn(0x7fa7f00729e0 0x7fa7f0074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa7f006cc50 msgr2=0x7fa7f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa7f006cc50 0x7fa7f006f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005fd0 tx=0x7fa7f800b390 comp rx=0 tx=0).stop 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 msgr2=0x7fa808072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa808072cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc02ae90 tx=0x7fa7fc030880 comp rx=0 tx=0).stop 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 shutdown_connections 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:6816/853919786,v1:172.21.15.112:6817/853919786] conn(0x7fa7f00729e0 0x7fa7f0074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa7f006cc50 0x7fa7f006f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa808100750 0x7fa808072cf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 --2- 172.21.15.60:0/4156245531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8080ffda0 0x7fa8080727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:31.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 >> 172.21.15.60:0/4156245531 conn(0x7fa8080fb840 msgr2=0x7fa8080fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:31.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 shutdown_connections 2024-09-21T10:37:31.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:31.861+0000 7fa80ccff640 1 -- 172.21.15.60:0/4156245531 wait complete. 2024-09-21T10:37:32.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:32 smithi060 ceph-mon[28215]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:32 smithi112 ceph-mon[35117]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:33.760 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:34.430 INFO:teuthology.orchestra.run.smithi060.stdout:163208757259 2024-09-21T10:37:34.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T10:37:34.664 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:34 smithi060 ceph-mon[28215]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 -- 172.21.15.60:0/339091747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 msgr2=0x7f22dc072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/339091747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc072cc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009880 tx=0x7f22cc02a530 comp rx=0 tx=0).stop 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 -- 172.21.15.60:0/339091747 shutdown_connections 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/339091747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22dc073200 0x7f22dc10bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/339091747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc072cc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 -- 172.21.15.60:0/339091747 >> 172.21.15.60:0/339091747 conn(0x7f22dc0fb900 msgr2=0x7f22dc0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 -- 172.21.15.60:0/339091747 shutdown_connections 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.905+0000 7f22e1e5e640 1 -- 172.21.15.60:0/339091747 wait complete. 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.906+0000 7f22e1e5e640 1 Processor -- start 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.906+0000 7f22e1e5e640 1 -- start start 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.906+0000 7f22e1e5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.906+0000 7f22e1e5e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22dc073200 0x7f22dc198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.906+0000 7f22e1e5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc198870 con 0x7f22dc0728e0 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.906+0000 7f22e1e5e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc1989e0 con 0x7f22dc073200 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40276/0 (socket says 172.21.15.60:40276) 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 -- 172.21.15.60:0/358924370 learned_addr learned my addr 172.21.15.60:0/358924370 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22daffd640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22dc073200 0x7f22dc198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 -- 172.21.15.60:0/358924370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22dc073200 msgr2=0x7f22dc198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22dc073200 0x7f22dc198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 -- 172.21.15.60:0/358924370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc009560 con 0x7f22dc0728e0 2024-09-21T10:37:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.907+0000 7f22db7fe640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc197d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f22cc02aa50 tx=0x7f22cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.908+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22cc004aa0 con 0x7f22dc0728e0 2024-09-21T10:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.908+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc19c760 con 0x7f22dc0728e0 2024-09-21T10:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.908+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22cc004c00 con 0x7f22dc0728e0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.908+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22cc003a20 con 0x7f22dc0728e0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.908+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc19cc50 con 0x7f22dc0728e0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.909+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc073f90 con 0x7f22dc0728e0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.909+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f22cc02ad50 con 0x7f22dc0728e0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.910+0000 7f22d8ff9640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f22c406cc50 0x7f22c406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.910+0000 7f22daffd640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f22c406cc50 0x7f22c406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.910+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f22cc0acd00 con 0x7f22dc0728e0 2024-09-21T10:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.910+0000 7f22daffd640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f22c406cc50 0x7f22c406f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22dc1992e0 tx=0x7f22d000a2d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:34.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:34.914+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22cc0b0030 con 0x7f22dc0728e0 2024-09-21T10:37:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:34 smithi112 ceph-mon[35117]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:35.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.086+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22dc10f0c0 con 0x7f22dc0728e0 2024-09-21T10:37:35.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.087+0000 7f22d8ff9640 1 -- 172.21.15.60:0/358924370 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22cc077410 con 0x7f22dc0728e0 2024-09-21T10:37:35.089 INFO:teuthology.orchestra.run.smithi060.stdout:107374182421 2024-09-21T10:37:35.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f22c406cc50 msgr2=0x7f22c406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:35.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f22c406cc50 0x7f22c406f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22dc1992e0 tx=0x7f22d000a2d0 comp rx=0 tx=0).stop 2024-09-21T10:37:35.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 msgr2=0x7f22dc197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc197d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f22cc02aa50 tx=0x7f22cc0055a0 comp rx=0 tx=0).stop 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 shutdown_connections 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f22c406cc50 0x7f22c406f110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22dc073200 0x7f22dc198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 --2- 172.21.15.60:0/358924370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22dc0728e0 0x7f22dc197d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 >> 172.21.15.60:0/358924370 conn(0x7f22dc0fb900 msgr2=0x7f22dc1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 shutdown_connections 2024-09-21T10:37:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:35.089+0000 7f22e1e5e640 1 -- 172.21.15.60:0/358924370 wait complete. 2024-09-21T10:37:35.908 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:35 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/358924370' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T10:37:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:35 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/358924370' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T10:37:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 -- 172.21.15.60:0/2931634666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc100750 msgr2=0x7ff2cc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2931634666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc100750 0x7ff2cc1047a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009880 tx=0x7ff2c002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 -- 172.21.15.60:0/2931634666 shutdown_connections 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2931634666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc100750 0x7ff2cc1047a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2931634666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 -- 172.21.15.60:0/2931634666 >> 172.21.15.60:0/2931634666 conn(0x7ff2cc0fb840 msgr2=0x7ff2cc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 -- 172.21.15.60:0/2931634666 shutdown_connections 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.040+0000 7ff2d258d640 1 -- 172.21.15.60:0/2931634666 wait complete. 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2d258d640 1 Processor -- start 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2d258d640 1 -- start start 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2d258d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2d258d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2cc100750 0x7ff2cc19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2d258d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc19c380 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2d258d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc195910 con 0x7ff2cc100750 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2cbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2cbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40282/0 (socket says 172.21.15.60:40282) 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2cbfff640 1 -- 172.21.15.60:0/2301718863 learned_addr learned my addr 172.21.15.60:0/2301718863 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.041+0000 7ff2cb7fe640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2cc100750 0x7ff2cc19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2cbfff640 1 -- 172.21.15.60:0/2301718863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2cc100750 msgr2=0x7ff2cc19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2cbfff640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2cc100750 0x7ff2cc19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2cbfff640 1 -- 172.21.15.60:0/2301718863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0009560 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2cbfff640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc19b820 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00d8d0 tx=0x7ff2bc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2bc009c00 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc195bf0 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2bc009d60 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2bc0049d0 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.042+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc196110 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.043+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc101280 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.043+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff2bc004c90 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.044+0000 7ff2c97fa640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff2b406cc50 0x7ff2b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.044+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff2bc08bc50 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.044+0000 7ff2cb7fe640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff2b406cc50 0x7ff2b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.045+0000 7ff2cb7fe640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff2b406cc50 0x7ff2b406f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009230 tx=0x7ff2c00058d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.048+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2bc0562c0 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.235+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2cc100180 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.235+0000 7ff2c97fa640 1 -- 172.21.15.60:0/2301718863 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2bc0598e0 con 0x7ff2cc0ffda0 2024-09-21T10:37:36.237 INFO:teuthology.orchestra.run.smithi060.stdout:38654705702 2024-09-21T10:37:36.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff2b406cc50 msgr2=0x7ff2b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:36.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff2b406cc50 0x7ff2b406f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009230 tx=0x7ff2c00058d0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 msgr2=0x7ff2cc19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc19b820 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00d8d0 tx=0x7ff2bc00dd90 comp rx=0 tx=0).stop 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 shutdown_connections 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff2b406cc50 0x7ff2b406f110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2cc100750 0x7ff2cc19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 --2- 172.21.15.60:0/2301718863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc0ffda0 0x7ff2cc19b820 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 >> 172.21.15.60:0/2301718863 conn(0x7ff2cc0fb840 msgr2=0x7ff2cc0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 shutdown_connections 2024-09-21T10:37:36.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:36.237+0000 7ff2d258d640 1 -- 172.21.15.60:0/2301718863 wait complete. 2024-09-21T10:37:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:36 smithi060 ceph-mon[28215]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:36 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2301718863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T10:37:36.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:36 smithi112 ceph-mon[35117]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:36.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:36 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2301718863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T10:37:37.095 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182419 got 107374182421 for osd.3 2024-09-21T10:37:37.095 DEBUG:teuthology.parallel:result is None 2024-09-21T10:37:37.105 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:37.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:37.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:37 smithi060 ceph-mon[28215]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:37 smithi112 ceph-mon[35117]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:38.178 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-09-21T10:37:38.178 DEBUG:teuthology.parallel:result is None 2024-09-21T10:37:38.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.338+0000 7f24a31f8640 1 -- 172.21.15.60:0/223837633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 msgr2=0x7f249c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.338+0000 7f24a31f8640 1 --2- 172.21.15.60:0/223837633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c0fee50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f248c009880 tx=0x7f248c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.338+0000 7f24a31f8640 1 -- 172.21.15.60:0/223837633 shutdown_connections 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 --2- 172.21.15.60:0/223837633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c0fee50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 --2- 172.21.15.60:0/223837633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c1049f0 0x7f249c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 -- 172.21.15.60:0/223837633 >> 172.21.15.60:0/223837633 conn(0x7f249c0758a0 msgr2=0x7f249c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 -- 172.21.15.60:0/223837633 shutdown_connections 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 -- 172.21.15.60:0/223837633 wait complete. 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 Processor -- start 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.339+0000 7f24a31f8640 1 -- start start 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a31f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c109f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a31f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c1049f0 0x7f249c10a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a31f8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c10aa00 con 0x7f249c0fe9f0 2024-09-21T10:37:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a31f8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c10ab70 con 0x7f249c1049f0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c109f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c109f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40296/0 (socket says 172.21.15.60:40296) 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 -- 172.21.15.60:0/2247842611 learned_addr learned my addr 172.21.15.60:0/2247842611 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f2493fff640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c1049f0 0x7f249c10a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 -- 172.21.15.60:0/2247842611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c1049f0 msgr2=0x7f249c10a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c1049f0 0x7f249c10a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 -- 172.21.15.60:0/2247842611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c009560 con 0x7f249c0fe9f0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a0f94640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c109f80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f249800d6f0 tx=0x7f249800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2498009a30 con 0x7f249c0fe9f0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.340+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c1a1ce0 con 0x7f249c0fe9f0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.341+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24980054e0 con 0x7f249c0fe9f0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.341+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2498004e20 con 0x7f249c0fe9f0 2024-09-21T10:37:38.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.341+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c1a2040 con 0x7f249c0fe9f0 2024-09-21T10:37:38.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.342+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c100130 con 0x7f249c0fe9f0 2024-09-21T10:37:38.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.343+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2498009b90 con 0x7f249c0fe9f0 2024-09-21T10:37:38.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.343+0000 7f2491ffb640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f248406ccb0 0x7f248406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:38.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.343+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f249808b9d0 con 0x7f249c0fe9f0 2024-09-21T10:37:38.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.343+0000 7f2493fff640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f248406ccb0 0x7f248406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:38.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.344+0000 7f2493fff640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f248406ccb0 0x7f248406f170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f248c02aa90 tx=0x7f248c02a9a0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:38.348 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:38.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.348+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2498056190 con 0x7f249c0fe9f0 2024-09-21T10:37:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.526+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f249c10cd80 con 0x7f249c0fe9f0 2024-09-21T10:37:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.526+0000 7f2491ffb640 1 -- 172.21.15.60:0/2247842611 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24980597b0 con 0x7f249c0fe9f0 2024-09-21T10:37:38.529 INFO:teuthology.orchestra.run.smithi060.stdout:141733920784 2024-09-21T10:37:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f248406ccb0 msgr2=0x7f248406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f248406ccb0 0x7f248406f170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f248c02aa90 tx=0x7f248c02a9a0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 msgr2=0x7f249c109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c109f80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f249800d6f0 tx=0x7f249800dbb0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 shutdown_connections 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f248406ccb0 0x7f248406f170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c1049f0 0x7f249c10a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 --2- 172.21.15.60:0/2247842611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0fe9f0 0x7f249c109f80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 >> 172.21.15.60:0/2247842611 conn(0x7f249c0758a0 msgr2=0x7f249c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 shutdown_connections 2024-09-21T10:37:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:38.528+0000 7f24a31f8640 1 -- 172.21.15.60:0/2247842611 wait complete. 2024-09-21T10:37:38.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:38 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2247842611' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T10:37:38.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:38 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2247842611' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.025+0000 7f4797fb5640 1 -- 172.21.15.60:0/1254218905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 msgr2=0x7f47900fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.025+0000 7f4797fb5640 1 --2- 172.21.15.60:0/1254218905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f47900fee50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4780009880 tx=0x7f478002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.025+0000 7f4797fb5640 1 -- 172.21.15.60:0/1254218905 shutdown_connections 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.025+0000 7f4797fb5640 1 --2- 172.21.15.60:0/1254218905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f47900fee50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.025+0000 7f4797fb5640 1 --2- 172.21.15.60:0/1254218905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 0x7f4790104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.025+0000 7f4797fb5640 1 -- 172.21.15.60:0/1254218905 >> 172.21.15.60:0/1254218905 conn(0x7f47900758a0 msgr2=0x7f47900fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.026+0000 7f4797fb5640 1 -- 172.21.15.60:0/1254218905 shutdown_connections 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.026+0000 7f4797fb5640 1 -- 172.21.15.60:0/1254218905 wait complete. 2024-09-21T10:37:39.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.026+0000 7f4797fb5640 1 Processor -- start 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.026+0000 7f4797fb5640 1 -- start start 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.026+0000 7f4797fb5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f479019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.026+0000 7f4797fb5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 0x7f479019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4797fb5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790194800 con 0x7f47900fe9f0 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4797fb5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790194970 con 0x7f47901049f0 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f479019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f479019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40322/0 (socket says 172.21.15.60:40322) 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 -- 172.21.15.60:0/290892450 learned_addr learned my addr 172.21.15.60:0/290892450 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795550640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 0x7f479019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 -- 172.21.15.60:0/290892450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 msgr2=0x7f479019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 0x7f479019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 -- 172.21.15.60:0/290892450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780009560 con 0x7f47900fe9f0 2024-09-21T10:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795550640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 0x7f479019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4795d51640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f479019a710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f478c00d8d0 tx=0x7f478c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f478c00bea0 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4790194c50 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f478c009c00 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f478c00f710 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.027+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4790195170 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.028+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4790100130 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.029+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f478c00f990 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.029+0000 7f4786ffd640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f477c06cc50 0x7f477c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.029+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f478c08bc80 con 0x7f47900fe9f0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.029+0000 7f4795550640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f477c06cc50 0x7f477c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.030+0000 7f4795550640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f477c06cc50 0x7f477c06f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4780000c00 tx=0x7f4780005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.034+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f478c056390 con 0x7f47900fe9f0 2024-09-21T10:37:39.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.208+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47900fee50 con 0x7f47900fe9f0 2024-09-21T10:37:39.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.208+0000 7f4786ffd640 1 -- 172.21.15.60:0/290892450 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f478c0599b0 con 0x7f47900fe9f0 2024-09-21T10:37:39.220 INFO:teuthology.orchestra.run.smithi060.stdout:60129542177 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f477c06cc50 msgr2=0x7f477c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f477c06cc50 0x7f477c06f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4780000c00 tx=0x7f4780005a20 comp rx=0 tx=0).stop 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 msgr2=0x7f479019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f479019a710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f478c00d8d0 tx=0x7f478c00dd90 comp rx=0 tx=0).stop 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 shutdown_connections 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f477c06cc50 0x7f477c06f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47901049f0 0x7f479019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 --2- 172.21.15.60:0/290892450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47900fe9f0 0x7f479019a710 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 >> 172.21.15.60:0/290892450 conn(0x7f47900758a0 msgr2=0x7f47900fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 shutdown_connections 2024-09-21T10:37:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:39.211+0000 7f4797fb5640 1 -- 172.21.15.60:0/290892450 wait complete. 2024-09-21T10:37:39.393 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920781 got 141733920784 for osd.4 2024-09-21T10:37:39.393 DEBUG:teuthology.parallel:result is None 2024-09-21T10:37:39.792 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:39 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/290892450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T10:37:39.792 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:39 smithi060 ceph-mon[28215]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:39 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/290892450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T10:37:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:39 smithi112 ceph-mon[35117]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:40.165 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542177 for osd.1 2024-09-21T10:37:40.165 DEBUG:teuthology.parallel:result is None 2024-09-21T10:37:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:42 smithi060 ceph-mon[28215]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:42.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 -- 172.21.15.60:0/1623080957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8101610 msgr2=0x7f00b8109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:42.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/1623080957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8101610 0x7f00b8109b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009880 tx=0x7f00a802a530 comp rx=0 tx=0).stop 2024-09-21T10:37:42.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 -- 172.21.15.60:0/1623080957 shutdown_connections 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/1623080957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8101610 0x7f00b8109b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/1623080957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b8100cf0 0x7f00b81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 -- 172.21.15.60:0/1623080957 >> 172.21.15.60:0/1623080957 conn(0x7f00b80fa710 msgr2=0x7f00b80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 -- 172.21.15.60:0/1623080957 shutdown_connections 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.753+0000 7f00bf4a8640 1 -- 172.21.15.60:0/1623080957 wait complete. 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bf4a8640 1 Processor -- start 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bf4a8640 1 -- start start 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bf4a8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 0x7f00b80fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bf4a8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b8101610 0x7f00b80fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bf4a8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b8100690 con 0x7f00b8100cf0 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bf4a8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b8100800 con 0x7f00b8101610 2024-09-21T10:37:42.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bd244640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 0x7f00b80fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bd244640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 0x7f00b80fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40334/0 (socket says 172.21.15.60:40334) 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bd244640 1 -- 172.21.15.60:0/4094294935 learned_addr learned my addr 172.21.15.60:0/4094294935 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bca43640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b8101610 0x7f00b80fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bd244640 1 -- 172.21.15.60:0/4094294935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b8101610 msgr2=0x7f00b80fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bd244640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b8101610 0x7f00b80fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.754+0000 7f00bd244640 1 -- 172.21.15.60:0/4094294935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8009560 con 0x7f00b8100cf0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.755+0000 7f00bd244640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 0x7f00b80fe950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ea00 tx=0x7f00b400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.755+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b400cd50 con 0x7f00b8100cf0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.755+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00b4005020 con 0x7f00b8100cf0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.755+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b80ff430 con 0x7f00b8100cf0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.755+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b40116a0 con 0x7f00b8100cf0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.755+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b80ff7b0 con 0x7f00b8100cf0 2024-09-21T10:37:42.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.756+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b8068d30 con 0x7f00b8100cf0 2024-09-21T10:37:42.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.756+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f00b4005190 con 0x7f00b8100cf0 2024-09-21T10:37:42.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.757+0000 7f00ae7fc640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00a406cc50 0x7f00a406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:42.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.757+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f00b408c370 con 0x7f00b8100cf0 2024-09-21T10:37:42.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.757+0000 7f00bca43640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00a406cc50 0x7f00a406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:42.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.757+0000 7f00bca43640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00a406cc50 0x7f00a406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00b8100180 tx=0x7f00a8004040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:42.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.761+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f00b4056a80 con 0x7f00b8100cf0 2024-09-21T10:37:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f00b810cde0 con 0x7f00b8100cf0 2024-09-21T10:37:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f00ae7fc640 1 -- 172.21.15.60:0/4094294935 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00b405a0a0 con 0x7f00b8100cf0 2024-09-21T10:37:42.937 INFO:teuthology.orchestra.run.smithi060.stdout:163208757261 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00a406cc50 msgr2=0x7f00a406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00a406cc50 0x7f00a406f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00b8100180 tx=0x7f00a8004040 comp rx=0 tx=0).stop 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 msgr2=0x7f00b80fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 0x7f00b80fe950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ea00 tx=0x7f00b400eec0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 shutdown_connections 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00a406cc50 0x7f00a406f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b8101610 0x7f00b80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 --2- 172.21.15.60:0/4094294935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b8100cf0 0x7f00b80fe950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 >> 172.21.15.60:0/4094294935 conn(0x7f00b80fa710 msgr2=0x7f00b8101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:42.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 shutdown_connections 2024-09-21T10:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f00bf4a8640 1 -- 172.21.15.60:0/4094294935 wait complete. 2024-09-21T10:37:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 -- 172.21.15.60:0/4243056422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b80fe9f0 msgr2=0x7f72b80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 --2- 172.21.15.60:0/4243056422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b80fe9f0 0x7f72b80fee50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009880 tx=0x7f72a402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 -- 172.21.15.60:0/4243056422 shutdown_connections 2024-09-21T10:37:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 --2- 172.21.15.60:0/4243056422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b80fe9f0 0x7f72b80fee50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 --2- 172.21.15.60:0/4243056422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b81049f0 0x7f72b8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 -- 172.21.15.60:0/4243056422 >> 172.21.15.60:0/4243056422 conn(0x7f72b80758a0 msgr2=0x7f72b80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 -- 172.21.15.60:0/4243056422 shutdown_connections 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 -- 172.21.15.60:0/4243056422 wait complete. 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.933+0000 7f72beaf5640 1 Processor -- start 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72beaf5640 1 -- start start 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72beaf5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b80fe9f0 0x7f72b8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72beaf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 0x7f72b8196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72beaf5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8197490 con 0x7f72b81049f0 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72beaf5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8197600 con 0x7f72b80fe9f0 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 0x7f72b8196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 0x7f72b8196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40358/0 (socket says 172.21.15.60:40358) 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72b7fff640 1 -- 172.21.15.60:0/3275677783 learned_addr learned my addr 172.21.15.60:0/3275677783 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72bc891640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b80fe9f0 0x7f72b8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72b7fff640 1 -- 172.21.15.60:0/3275677783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b80fe9f0 msgr2=0x7f72b8196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72b7fff640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b80fe9f0 0x7f72b8196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.934+0000 7f72b7fff640 1 -- 172.21.15.60:0/3275677783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4009560 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f72b7fff640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 0x7f72b8196ec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f72a402a9c0 tx=0x7f72a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a40048d0 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b819f9f0 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72a4031640 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a40038d0 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.935+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b819fd50 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.936+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b8100130 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f72a4003b90 con 0x7f72b81049f0 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f72b5ffb640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f72a806cc50 0x7f72a806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f72a40ace30 con 0x7f72b81049f0 2024-09-21T10:37:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.937+0000 7f72bc891640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f72a806cc50 0x7f72a806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.938+0000 7f72bc891640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f72a806cc50 0x7f72a806f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009bd0 tx=0x7f72ac005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:42.942+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f72a40775f0 con 0x7f72b81049f0 2024-09-21T10:37:42.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:42 smithi112 ceph-mon[35117]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.121+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72b80fee50 con 0x7f72b81049f0 2024-09-21T10:37:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.121+0000 7f72b5ffb640 1 -- 172.21.15.60:0/3275677783 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72b80fee50 con 0x7f72b81049f0 2024-09-21T10:37:43.124 INFO:teuthology.orchestra.run.smithi060.stdout:81604378652 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f72a806cc50 msgr2=0x7f72a806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f72a806cc50 0x7f72a806f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009bd0 tx=0x7f72ac005f90 comp rx=0 tx=0).stop 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 msgr2=0x7f72b8196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 0x7f72b8196ec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f72a402a9c0 tx=0x7f72a40055a0 comp rx=0 tx=0).stop 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 shutdown_connections 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f72a806cc50 0x7f72a806f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b81049f0 0x7f72b8196ec0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.123+0000 7f72beaf5640 1 --2- 172.21.15.60:0/3275677783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b80fe9f0 0x7f72b8196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.124+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 >> 172.21.15.60:0/3275677783 conn(0x7f72b80758a0 msgr2=0x7f72b80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.124+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 shutdown_connections 2024-09-21T10:37:43.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:43.124+0000 7f72beaf5640 1 -- 172.21.15.60:0/3275677783 wait complete. 2024-09-21T10:37:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:43 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/4094294935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T10:37:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:43 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3275677783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T10:37:43.747 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378650 got 81604378652 for osd.2 2024-09-21T10:37:43.748 DEBUG:teuthology.parallel:result is None 2024-09-21T10:37:43.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:43 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/4094294935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T10:37:43.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:43 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3275677783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T10:37:44.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757259 got 163208757261 for osd.5 2024-09-21T10:37:44.223 DEBUG:teuthology.parallel:result is None 2024-09-21T10:37:44.223 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T10:37:44.223 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T10:37:44.437 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:44.811 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:44 smithi060 ceph-mon[28215]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:44.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:44 smithi112 ceph-mon[35117]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 -- 172.21.15.60:0/1214149232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0ff230 msgr2=0x7f8c6c10bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 --2- 172.21.15.60:0/1214149232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0ff230 0x7f8c6c10bef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009880 tx=0x7f8c5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 -- 172.21.15.60:0/1214149232 shutdown_connections 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 --2- 172.21.15.60:0/1214149232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0ff230 0x7f8c6c10bef0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 --2- 172.21.15.60:0/1214149232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c0fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 -- 172.21.15.60:0/1214149232 >> 172.21.15.60:0/1214149232 conn(0x7f8c6c0fa730 msgr2=0x7f8c6c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 -- 172.21.15.60:0/1214149232 shutdown_connections 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.004+0000 7f8c732fd640 1 -- 172.21.15.60:0/1214149232 wait complete. 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c732fd640 1 Processor -- start 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c732fd640 1 -- start start 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c732fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c732fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c6c0ff230 0x7f8c6c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c732fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c198840 con 0x7f8c6c0fe880 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c732fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c1989b0 con 0x7f8c6c0ff230 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c71099640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c71099640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34980/0 (socket says 172.21.15.60:34980) 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c71099640 1 -- 172.21.15.60:0/653119174 learned_addr learned my addr 172.21.15.60:0/653119174 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c70898640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c6c0ff230 0x7f8c6c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c71099640 1 -- 172.21.15.60:0/653119174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c6c0ff230 msgr2=0x7f8c6c1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c71099640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c6c0ff230 0x7f8c6c1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.005+0000 7f8c71099640 1 -- 172.21.15.60:0/653119174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009560 con 0x7f8c6c0fe880 2024-09-21T10:37:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.006+0000 7f8c71099640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c197cb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c8a0 tx=0x7f8c6800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:46.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.006+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c68007b80 con 0x7f8c6c0fe880 2024-09-21T10:37:46.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.006+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c68007ce0 con 0x7f8c6c0fe880 2024-09-21T10:37:46.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.006+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c19b690 con 0x7f8c6c0fe880 2024-09-21T10:37:46.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.006+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c68018810 con 0x7f8c6c0fe880 2024-09-21T10:37:46.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.006+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c19bbb0 con 0x7f8c6c0fe880 2024-09-21T10:37:46.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.007+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c068d30 con 0x7f8c6c0fe880 2024-09-21T10:37:46.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.007+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8c68018970 con 0x7f8c6c0fe880 2024-09-21T10:37:46.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.008+0000 7f8c627fc640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f8c5806cc50 0x7f8c5806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:46.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.008+0000 7f8c70898640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f8c5806cc50 0x7f8c5806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:46.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.008+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8c6808c030 con 0x7f8c6c0fe880 2024-09-21T10:37:46.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.009+0000 7f8c70898640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f8c5806cc50 0x7f8c5806f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:46.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.012+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8c680567c0 con 0x7f8c6c0fe880 2024-09-21T10:37:46.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.182+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c6c106830 con 0x7f8c5806cc50 2024-09-21T10:37:46.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.184+0000 7f8c627fc640 1 -- 172.21.15.60:0/653119174 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28156 (secure 0 0 0) 0x7f8c6c106830 con 0x7f8c5806cc50 2024-09-21T10:37:46.186 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:46.186 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-21T10:37:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f8c5806cc50 msgr2=0x7f8c5806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f8c5806cc50 0x7f8c5806f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c005a20 comp rx=0 tx=0).stop 2024-09-21T10:37:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 msgr2=0x7f8c6c197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c197cb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c8a0 tx=0x7f8c6800cd60 comp rx=0 tx=0).stop 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 shutdown_connections 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f8c5806cc50 0x7f8c5806f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c6c0ff230 0x7f8c6c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 --2- 172.21.15.60:0/653119174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c6c0fe880 0x7f8c6c197cb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 >> 172.21.15.60:0/653119174 conn(0x7f8c6c0fa730 msgr2=0x7f8c6c0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 shutdown_connections 2024-09-21T10:37:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:46.186+0000 7f8c732fd640 1 -- 172.21.15.60:0/653119174 wait complete. 2024-09-21T10:37:46.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:46 smithi060 ceph-mon[28215]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:46.799 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-21T10:37:45.507472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":186428,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":182518,"kb_avail":562284484,"statfs":{"total":575970213888,"available":575779311616,"internally_reserved":0,"allocated":3915776,"data_stored":2587905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":186899111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002169"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T10:36:53.344997+0000","last_change":"2024-09-21T10:36:27.308216+0000","last_active":"2024-09-21T10:36:53.344997+0000","last_peered":"2024-09-21T10:36:53.344997+0000","last_clean":"2024-09-21T10:36:53.344997+0000","last_became_active":"2024-09-21T10:36:27.307890+0000","last_became_peered":"2024-09-21T10:36:27.307890+0000","last_unstale":"2024-09-21T10:36:53.344997+0000","last_undegraded":"2024-09-21T10:36:53.344997+0000","last_fullsized":"2024-09-21T10:36:53.344997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T10:35:39.965866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T10:35:39.965866+0000","last_clean_scrub_stamp":"2024-09-21T10:35:39.965866+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:15.385282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31464,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713688,"statfs":{"total":95995035648,"available":95962816512,"internally_reserved":0,"allocated":356352,"data_stored":136245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717784,"statfs":{"total":95995035648,"available":95967010816,"internally_reserved":0,"allocated":356352,"data_stored":136245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.378},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.186999999999999,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.30399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182424,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":950272,"data_stored":726613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.432},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.442}]},{"osd":1,"last update":"Sat Sep 21 10:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 21 10:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.497}]},{"osd":4,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39652,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93705500,"statfs":{"total":95995035648,"available":95954432000,"internally_reserved":0,"allocated":352256,"data_stored":135576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Sep 21 10:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.38},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Sep 21 10:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Sep 21 10:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.755},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":726613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:37:12 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.249},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Sep 21 10:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Sep 21 10:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Sep 21 10:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":726613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 10:37:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51400000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.32200000000000001}]},{"osd":2,"last update":"Sat Sep 21 10:37:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Sep 21 10:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Sep 21 10:37:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T10:37:46.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T10:37:46.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:46 smithi112 ceph-mon[35117]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:47.008 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:47.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:47 smithi060 ceph-mon[28215]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T10:37:47.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:47 smithi112 ceph-mon[35117]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 -- 172.21.15.60:0/3421762999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 msgr2=0x7f3480104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 --2- 172.21.15.60:0/3421762999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480104dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3470009880 tx=0x7f347002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 -- 172.21.15.60:0/3421762999 shutdown_connections 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 --2- 172.21.15.60:0/3421762999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800fe9f0 0x7f34800fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 --2- 172.21.15.60:0/3421762999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480104dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 -- 172.21.15.60:0/3421762999 >> 172.21.15.60:0/3421762999 conn(0x7f34800fa730 msgr2=0x7f34800fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 -- 172.21.15.60:0/3421762999 shutdown_connections 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.562+0000 7f348772d640 1 -- 172.21.15.60:0/3421762999 wait complete. 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f348772d640 1 Processor -- start 2024-09-21T10:37:48.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f348772d640 1 -- start start 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f348772d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800fe9f0 0x7f3480196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f348772d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f348772d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34801975f0 con 0x7f34801049f0 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f348772d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480197760 con 0x7f34800fe9f0 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f3484cc8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f3484cc8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35002/0 (socket says 172.21.15.60:35002) 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f3484cc8640 1 -- 172.21.15.60:0/2292701200 learned_addr learned my addr 172.21.15.60:0/2292701200 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f34854c9640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800fe9f0 0x7f3480196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f3484cc8640 1 -- 172.21.15.60:0/2292701200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800fe9f0 msgr2=0x7f3480196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.563+0000 7f3484cc8640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800fe9f0 0x7f3480196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f3484cc8640 1 -- 172.21.15.60:0/2292701200 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470009560 con 0x7f34801049f0 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f3484cc8640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480197020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f347400b420 tx=0x7f347400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:48.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3474011800 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3474011e20 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348019fb50 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347400f2e0 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.564+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348019ffc0 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.565+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480100130 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.565+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3474010380 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.566+0000 7f347e7fc640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f346806cc50 0x7f346806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.566+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f347408b720 con 0x7f34801049f0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.566+0000 7f34854c9640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f346806cc50 0x7f346806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.566+0000 7f34854c9640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f346806cc50 0x7f346806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3470009230 tx=0x7f34700058d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:48.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.570+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3474055eb0 con 0x7f34801049f0 2024-09-21T10:37:48.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:48 smithi060 ceph-mon[28215]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.741+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f348010bce0 con 0x7f346806cc50 2024-09-21T10:37:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.742+0000 7f347e7fc640 1 -- 172.21.15.60:0/2292701200 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28086 (secure 0 0 0) 0x7f348010bce0 con 0x7f346806cc50 2024-09-21T10:37:48.744 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-21T10:37:48.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f346806cc50 msgr2=0x7f346806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f346806cc50 0x7f346806f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3470009230 tx=0x7f34700058d0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 msgr2=0x7f3480197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480197020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f347400b420 tx=0x7f347400b8e0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 shutdown_connections 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f346806cc50 0x7f346806f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34801049f0 0x7f3480197020 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 --2- 172.21.15.60:0/2292701200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34800fe9f0 0x7f3480196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 >> 172.21.15.60:0/2292701200 conn(0x7f34800fa730 msgr2=0x7f34800fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 shutdown_connections 2024-09-21T10:37:48.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:48.744+0000 7f348772d640 1 -- 172.21.15.60:0/2292701200 wait complete. 2024-09-21T10:37:48.852 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:48 smithi112 ceph-mon[35117]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:49.360 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-21T10:37:47.507873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":186428,"kb_used_data":3824,"kb_used_omap":9,"kb_used_meta":182518,"kb_avail":562284484,"statfs":{"total":575970213888,"available":575779311616,"internally_reserved":0,"allocated":3915776,"data_stored":2587905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":186899111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002218"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T10:36:53.344997+0000","last_change":"2024-09-21T10:36:27.308216+0000","last_active":"2024-09-21T10:36:53.344997+0000","last_peered":"2024-09-21T10:36:53.344997+0000","last_clean":"2024-09-21T10:36:53.344997+0000","last_became_active":"2024-09-21T10:36:27.307890+0000","last_became_peered":"2024-09-21T10:36:27.307890+0000","last_unstale":"2024-09-21T10:36:53.344997+0000","last_undegraded":"2024-09-21T10:36:53.344997+0000","last_fullsized":"2024-09-21T10:36:53.344997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T10:35:39.965866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T10:35:39.965866+0000","last_clean_scrub_stamp":"2024-09-21T10:35:39.965866+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:15.385282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31464,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713688,"statfs":{"total":95995035648,"available":95962816512,"internally_reserved":0,"allocated":356352,"data_stored":136245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717784,"statfs":{"total":95995035648,"available":95967010816,"internally_reserved":0,"allocated":356352,"data_stored":136245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.378},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":11.186999999999999,"5min":11.186999999999999,"15min":11.186999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.30399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182424,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":950272,"data_stored":726613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.432},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.442}]},{"osd":1,"last update":"Sat Sep 21 10:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Sep 21 10:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.497}]},{"osd":4,"last update":"Sat Sep 21 10:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39652,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93705500,"statfs":{"total":95995035648,"available":95954432000,"internally_reserved":0,"allocated":352256,"data_stored":135576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Sep 21 10:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.38},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Sep 21 10:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Sep 21 10:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.755},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":726613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 10:37:12 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.24199999999999999}]},{"osd":2,"last update":"Sat Sep 21 10:37:41 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.312},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.38100000000000001,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27800000000000002}]},{"osd":3,"last update":"Sat Sep 21 10:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.503},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.54300000000000004}]},{"osd":4,"last update":"Sat Sep 21 10:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":4.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":726613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 10:37:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.51400000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.32200000000000001}]},{"osd":2,"last update":"Sat Sep 21 10:37:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.39400000000000002,"15min":0.40200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Sep 21 10:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Sep 21 10:37:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T10:37:49.361 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T10:37:49.361 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T10:37:49.361 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T10:37:49.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T10:37:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:50.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:50 smithi060 ceph-mon[28215]: from='client.14494 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T10:37:50.684 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:50 smithi060 ceph-mon[28215]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:50 smithi112 ceph-mon[35117]: from='client.14494 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T10:37:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:50 smithi112 ceph-mon[35117]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 -- 172.21.15.60:0/2394185464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 msgr2=0x7ff808104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 --2- 172.21.15.60:0/2394185464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808104dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff804009880 tx=0x7ff80402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 -- 172.21.15.60:0/2394185464 shutdown_connections 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 --2- 172.21.15.60:0/2394185464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8080fe9f0 0x7ff8080fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 --2- 172.21.15.60:0/2394185464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808104dd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 -- 172.21.15.60:0/2394185464 >> 172.21.15.60:0/2394185464 conn(0x7ff8080758a0 msgr2=0x7ff8080fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 -- 172.21.15.60:0/2394185464 shutdown_connections 2024-09-21T10:37:51.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.119+0000 7ff80f783640 1 -- 172.21.15.60:0/2394185464 wait complete. 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80f783640 1 Processor -- start 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80f783640 1 -- start start 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80f783640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8080fe9f0 0x7ff808196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80f783640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80f783640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff808197490 con 0x7ff8081049f0 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80f783640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff808197600 con 0x7ff8080fe9f0 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80cd1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80cd1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35020/0 (socket says 172.21.15.60:35020) 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80cd1e640 1 -- 172.21.15.60:0/782396819 learned_addr learned my addr 172.21.15.60:0/782396819 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.120+0000 7ff80d51f640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8080fe9f0 0x7ff808196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.121+0000 7ff80cd1e640 1 -- 172.21.15.60:0/782396819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8080fe9f0 msgr2=0x7ff808196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.121+0000 7ff80cd1e640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8080fe9f0 0x7ff808196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.121+0000 7ff80cd1e640 1 -- 172.21.15.60:0/782396819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804009560 con 0x7ff8081049f0 2024-09-21T10:37:51.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.121+0000 7ff80cd1e640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808196ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800d6f0 tx=0x7ff7f800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:51.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.122+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f8009a30 con 0x7ff8081049f0 2024-09-21T10:37:51.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.122+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80819f9f0 con 0x7ff8081049f0 2024-09-21T10:37:51.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.122+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7f80054e0 con 0x7ff8081049f0 2024-09-21T10:37:51.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.122+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f8004e40 con 0x7ff8081049f0 2024-09-21T10:37:51.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.122+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80819fe60 con 0x7ff8081049f0 2024-09-21T10:37:51.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.123+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff808100130 con 0x7ff8081049f0 2024-09-21T10:37:51.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.123+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff7f8004fc0 con 0x7ff8081049f0 2024-09-21T10:37:51.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.124+0000 7ff7fe7fc640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff7f406cbf0 0x7ff7f406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.124+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff7f808bb70 con 0x7ff8081049f0 2024-09-21T10:37:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.124+0000 7ff80d51f640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff7f406cbf0 0x7ff7f406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:51.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.124+0000 7ff80d51f640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff7f406cbf0 0x7ff7f406f0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff804000c00 tx=0x7ff804004040 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:51.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.132+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff7f8056280 con 0x7ff8081049f0 2024-09-21T10:37:51.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.344+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff808107000 con 0x7ff8081049f0 2024-09-21T10:37:51.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.344+0000 7ff7fe7fc640 1 -- 172.21.15.60:0/782396819 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff7f80598a0 con 0x7ff8081049f0 2024-09-21T10:37:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:37:51.346 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T10:37:51.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff7f406cbf0 msgr2=0x7ff7f406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:51.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff7f406cbf0 0x7ff7f406f0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff804000c00 tx=0x7ff804004040 comp rx=0 tx=0).stop 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 msgr2=0x7ff808196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808196ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800d6f0 tx=0x7ff7f800dbb0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 shutdown_connections 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff7f406cbf0 0x7ff7f406f0b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8081049f0 0x7ff808196ec0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 --2- 172.21.15.60:0/782396819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff8080fe9f0 0x7ff808196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 >> 172.21.15.60:0/782396819 conn(0x7ff8080758a0 msgr2=0x7ff8080fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 shutdown_connections 2024-09-21T10:37:51.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:51.346+0000 7ff80f783640 1 -- 172.21.15.60:0/782396819 wait complete. 2024-09-21T10:37:51.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:51 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/782396819' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T10:37:51.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:51 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/782396819' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T10:37:51.991 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T10:37:51.992 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T10:37:51.992 INFO:teuthology.run_tasks:Running task print... 2024-09-21T10:37:52.001 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-21T10:37:52.001 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:37:52.010 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:37:52.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-21T10:37:52.219 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:52.596 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:52 smithi060 ceph-mon[28215]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:52.596 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:52.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:52 smithi112 ceph-mon[35117]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:52.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 -- 172.21.15.60:0/3421184574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 msgr2=0x7f82b0100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 --2- 172.21.15.60:0/3421184574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0100170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8298009880 tx=0x7f829802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 -- 172.21.15.60:0/3421184574 shutdown_connections 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 --2- 172.21.15.60:0/3421184574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0100170 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 --2- 172.21.15.60:0/3421184574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00feaf0 0x7f82b00feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 -- 172.21.15.60:0/3421184574 >> 172.21.15.60:0/3421184574 conn(0x7f82b00fa280 msgr2=0x7f82b00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 -- 172.21.15.60:0/3421184574 shutdown_connections 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.798+0000 7f82b6379640 1 -- 172.21.15.60:0/3421184574 wait complete. 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82b6379640 1 Processor -- start 2024-09-21T10:37:53.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82b6379640 1 -- start start 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82b6379640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00feaf0 0x7f82b0195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82b6379640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82b6379640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b0196290 con 0x7f82b00ffcf0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82b6379640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b0196400 con 0x7f82b00feaf0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0195cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35040/0 (socket says 172.21.15.60:35040) 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 -- 172.21.15.60:0/2226318291 learned_addr learned my addr 172.21.15.60:0/2226318291 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82affff640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00feaf0 0x7f82b0195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 -- 172.21.15.60:0/2226318291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00feaf0 msgr2=0x7f82b0195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00feaf0 0x7f82b0195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 -- 172.21.15.60:0/2226318291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298009560 con 0x7f82b00ffcf0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.799+0000 7f82a7fff640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0195cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f82980055a0 tx=0x7f82980055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.800+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8298004b20 con 0x7f82b00ffcf0 2024-09-21T10:37:53.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.800+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b019ae40 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.800+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8298004c80 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.800+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8298003a80 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.800+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b019b380 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.801+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b00feed0 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.801+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8298031c90 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.802+0000 7f82adffb640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f829c06cc50 0x7f829c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.802+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f82980ad0a0 con 0x7f82b00ffcf0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.802+0000 7f82affff640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f829c06cc50 0x7f829c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.802+0000 7f82affff640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f829c06cc50 0x7f829c06f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82b00ffb50 tx=0x7f82a0009110 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:53.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.806+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82980777b0 con 0x7f82b00ffcf0 2024-09-21T10:37:53.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.978+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f82b0107780 con 0x7f82b00ffcf0 2024-09-21T10:37:53.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.982+0000 7f82adffb640 1 -- 172.21.15.60:0/2226318291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v41)=0 v41) v1 ==== 143+0+0 (secure 0 0 0) 0x7f82b0107780 con 0x7f82b00ffcf0 2024-09-21T10:37:53.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f829c06cc50 msgr2=0x7f829c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:53.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f829c06cc50 0x7f829c06f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82b00ffb50 tx=0x7f82a0009110 comp rx=0 tx=0).stop 2024-09-21T10:37:53.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 msgr2=0x7f82b0195cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:53.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0195cc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f82980055a0 tx=0x7f82980055d0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 shutdown_connections 2024-09-21T10:37:53.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f829c06cc50 0x7f829c06f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82b00ffcf0 0x7f82b0195cc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 --2- 172.21.15.60:0/2226318291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82b00feaf0 0x7f82b0195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:53.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 >> 172.21.15.60:0/2226318291 conn(0x7f82b00fa280 msgr2=0x7f82b0067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:53.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 shutdown_connections 2024-09-21T10:37:53.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:53.984+0000 7f82b6379640 1 -- 172.21.15.60:0/2226318291 wait complete. 2024-09-21T10:37:54.663 INFO:teuthology.run_tasks:Running task print... 2024-09-21T10:37:54.679 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-21T10:37:54.679 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:37:54.717 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:37:54.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T10:37:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:54.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:54 smithi060 ceph-mon[28215]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:54 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2226318291' entity='client.admin' 2024-09-21T10:37:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:37:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:37:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:37:54.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:54 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:37:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:54 smithi112 ceph-mon[35117]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:54 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2226318291' entity='client.admin' 2024-09-21T10:37:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:37:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:37:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:37:54.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:54 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 -- 172.21.15.60:0/4208050157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 msgr2=0x7fb4900fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 --2- 172.21.15.60:0/4208050157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb4900fe870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb480009c20 tx=0x7fb48002a970 comp rx=0 tx=0).stop 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 -- 172.21.15.60:0/4208050157 shutdown_connections 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 --2- 172.21.15.60:0/4208050157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4900fedb0 0x7fb4900ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 --2- 172.21.15.60:0/4208050157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb4900fe870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 -- 172.21.15.60:0/4208050157 >> 172.21.15.60:0/4208050157 conn(0x7fb4900fa280 msgr2=0x7fb4900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 -- 172.21.15.60:0/4208050157 shutdown_connections 2024-09-21T10:37:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 -- 172.21.15.60:0/4208050157 wait complete. 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.447+0000 7fb497a86640 1 Processor -- start 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb497a86640 1 -- start start 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb497a86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb490197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb497a86640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4900fedb0 0x7fb490197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb497a86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490198350 con 0x7fb4900fe470 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb497a86640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901984c0 con 0x7fb4900fedb0 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb490197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb490197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58848/0 (socket says 172.21.15.60:58848) 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 -- 172.21.15.60:0/866741368 learned_addr learned my addr 172.21.15.60:0/866741368 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495021640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4900fedb0 0x7fb490197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 -- 172.21.15.60:0/866741368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4900fedb0 msgr2=0x7fb490197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4900fedb0 0x7fb490197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 -- 172.21.15.60:0/866741368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480009900 con 0x7fb4900fe470 2024-09-21T10:37:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.448+0000 7fb495822640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb490197840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb480009d40 tx=0x7fb48002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.449+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb480030840 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.449+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb48002fa20 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.449+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48003a660 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.449+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49019ce90 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.449+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49019d300 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.450+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb490191950 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.451+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb48000a040 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.451+0000 7fb48effd640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb47806cc50 0x7fb47806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.451+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb48002c040 con 0x7fb4900fe470 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.451+0000 7fb495021640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb47806cc50 0x7fb47806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.452+0000 7fb495021640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb47806cc50 0x7fb47806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb490198cf0 tx=0x7fb48400b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:56.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.456+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb480077d90 con 0x7fb4900fe470 2024-09-21T10:37:56.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.642+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb49002c4f0 con 0x7fb47806cc50 2024-09-21T10:37:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.643+0000 7fb48effd640 1 -- 172.21.15.60:0/866741368 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb49002c4f0 con 0x7fb47806cc50 2024-09-21T10:37:56.645 INFO:teuthology.orchestra.run.smithi060.stdout:Backend: cephadm 2024-09-21T10:37:56.645 INFO:teuthology.orchestra.run.smithi060.stdout:Available: Yes 2024-09-21T10:37:56.645 INFO:teuthology.orchestra.run.smithi060.stdout:Paused: No 2024-09-21T10:37:56.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb47806cc50 msgr2=0x7fb47806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:56.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb47806cc50 0x7fb47806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb490198cf0 tx=0x7fb48400b390 comp rx=0 tx=0).stop 2024-09-21T10:37:56.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 msgr2=0x7fb490197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:56.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb490197840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb480009d40 tx=0x7fb48002f5f0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 shutdown_connections 2024-09-21T10:37:56.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fb47806cc50 0x7fb47806f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4900fedb0 0x7fb490197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 --2- 172.21.15.60:0/866741368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4900fe470 0x7fb490197840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:56.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 >> 172.21.15.60:0/866741368 conn(0x7fb4900fa280 msgr2=0x7fb490106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:56.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 shutdown_connections 2024-09-21T10:37:56.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:56.645+0000 7fb497a86640 1 -- 172.21.15.60:0/866741368 wait complete. 2024-09-21T10:37:56.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:56 smithi060 ceph-mon[28215]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:56.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:56 smithi112 ceph-mon[35117]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:57.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T10:37:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:37:58.809 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:58 smithi060 ceph-mon[28215]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:37:58.809 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:37:58 smithi060 ceph-mon[28215]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:58 smithi112 ceph-mon[35117]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:37:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:37:58 smithi112 ceph-mon[35117]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:37:58.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 -- 172.21.15.60:0/2210656881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 msgr2=0x7f75600ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:58.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 --2- 172.21.15.60:0/2210656881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f75600ff1c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7554009880 tx=0x7f755402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 -- 172.21.15.60:0/2210656881 shutdown_connections 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 --2- 172.21.15.60:0/2210656881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f75600ff1c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 --2- 172.21.15.60:0/2210656881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 0x7f75600fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 -- 172.21.15.60:0/2210656881 >> 172.21.15.60:0/2210656881 conn(0x7f75600fa250 msgr2=0x7f75600fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 -- 172.21.15.60:0/2210656881 shutdown_connections 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 -- 172.21.15.60:0/2210656881 wait complete. 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 Processor -- start 2024-09-21T10:37:58.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.989+0000 7f756651d640 1 -- start start 2024-09-21T10:37:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f756651d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 0x7f75601977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f756651d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f7560197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f756651d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75601982d0 con 0x7f75600fed60 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f756651d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560198440 con 0x7f75600fe420 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f7560197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f7560197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58866/0 (socket says 172.21.15.60:58866) 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 -- 172.21.15.60:0/1591257631 learned_addr learned my addr 172.21.15.60:0/1591257631 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755ffff640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 0x7f75601977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 -- 172.21.15.60:0/1591257631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 msgr2=0x7f75601977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 0x7f75601977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 -- 172.21.15.60:0/1591257631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009560 con 0x7f75600fed60 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755ffff640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 0x7f75601977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.990+0000 7f755f7fe640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f7560197d00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7554005520 tx=0x7f7554005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.991+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7554004aa0 con 0x7f75600fed60 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.991+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7554004c00 con 0x7f75600fed60 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.991+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756019ce80 con 0x7f75600fed60 2024-09-21T10:37:58.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.991+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7554003b10 con 0x7f75600fed60 2024-09-21T10:37:58.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.991+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756019d3c0 con 0x7f75600fed60 2024-09-21T10:37:58.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.992+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75600fe820 con 0x7f75600fed60 2024-09-21T10:37:58.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.992+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7554031d20 con 0x7f75600fed60 2024-09-21T10:37:58.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.993+0000 7f755d7fa640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f754806cc50 0x7f754806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:37:58.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.993+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f75540ad0f0 con 0x7f75600fed60 2024-09-21T10:37:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.993+0000 7f755ffff640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f754806cc50 0x7f754806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:37:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.993+0000 7f755ffff640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f754806cc50 0x7f754806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f75500058c0 tx=0x7f7550005850 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:37:58.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:58.997+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7554077800 con 0x7f75600fed60 2024-09-21T10:37:59.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.176+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7560107fb0 con 0x7f754806cc50 2024-09-21T10:37:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.184+0000 7f755d7fa640 1 -- 172.21.15.60:0/1591257631 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3080 (secure 0 0 0) 0x7f7560107fb0 con 0x7f754806cc50 2024-09-21T10:37:59.186 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:37:59.186 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (3m) 2m ago 5m 25.8M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:37:59.186 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (6m) 2m ago 6m 7033k - 18.2.4-871-g6a1bdf85 0adab276c97e 6a6a2a8801c8 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (5m) 68s ago 5m 7050k - 18.2.4-871-g6a1bdf85 0adab276c97e 7163dd4d91a2 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (6m) 2m ago 6m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (5m) 68s ago 5m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (3m) 2m ago 5m 76.9M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:9283,8765,8443 running (7m) 2m ago 7m 477M - 18.2.4-871-g6a1bdf85 0adab276c97e d9748f7fa031 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (4m) 68s ago 4m 439M - 18.2.4-871-g6a1bdf85 0adab276c97e 644d995876b0 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (7m) 2m ago 7m 44.1M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (4m) 68s ago 4m 40.9M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (4m) 68s ago 4m 15.4M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (3m) 2m ago 3m 40.9M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:37:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (2m) 2m ago 2m 37.2M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (2m) 2m ago 2m 11.8M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (2m) 68s ago 2m 48.5M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (99s) 68s ago 98s 38.6M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (73s) 68s ago 73s 12.1M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (3m) 2m ago 5m 44.4M - 2.43.0 a07b618ecd1d 9edc141eabb8 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f754806cc50 msgr2=0x7f754806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f754806cc50 0x7f754806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f75500058c0 tx=0x7f7550005850 comp rx=0 tx=0).stop 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 msgr2=0x7f7560197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f7560197d00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7554005520 tx=0x7f7554005550 comp rx=0 tx=0).stop 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 shutdown_connections 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f754806cc50 0x7f754806f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75600fed60 0x7f7560197d00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 --2- 172.21.15.60:0/1591257631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75600fe420 0x7f75601977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 >> 172.21.15.60:0/1591257631 conn(0x7f75600fa250 msgr2=0x7f75600fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 shutdown_connections 2024-09-21T10:37:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:37:59.186+0000 7f756651d640 1 -- 172.21.15.60:0/1591257631 wait complete. 2024-09-21T10:37:59.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T10:37:59.995 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:00 smithi060 ceph-mon[28215]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:00 smithi060 ceph-mon[28215]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:00 smithi112 ceph-mon[35117]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:00 smithi112 ceph-mon[35117]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 -- 172.21.15.60:0/1009049742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 msgr2=0x7f7ea00fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/1009049742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea00fff90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009880 tx=0x7f7e9002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 -- 172.21.15.60:0/1009049742 shutdown_connections 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/1009049742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ea0100d90 0x7f7ea0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/1009049742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea00fff90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 -- 172.21.15.60:0/1009049742 >> 172.21.15.60:0/1009049742 conn(0x7f7ea00fb320 msgr2=0x7f7ea00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 -- 172.21.15.60:0/1009049742 shutdown_connections 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 -- 172.21.15.60:0/1009049742 wait complete. 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 Processor -- start 2024-09-21T10:38:01.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 -- start start 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.492+0000 7f7ea6db7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea0195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea6db7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ea0100d90 0x7f7ea0195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea6db7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01961a0 con 0x7f7ea00ffb90 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea6db7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0196310 con 0x7f7ea0100d90 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea0195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea0195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58876/0 (socket says 172.21.15.60:58876) 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 -- 172.21.15.60:0/173184512 learned_addr learned my addr 172.21.15.60:0/173184512 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7e9ffff640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ea0100d90 0x7f7ea0195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 -- 172.21.15.60:0/173184512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ea0100d90 msgr2=0x7f7ea0195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ea0100d90 0x7f7ea0195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 -- 172.21.15.60:0/173184512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009560 con 0x7f7ea00ffb90 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea4b53640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea0195690 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e900054f0 tx=0x7f7e90005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:01.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e90004aa0 con 0x7f7ea00ffb90 2024-09-21T10:38:01.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e90004c00 con 0x7f7ea00ffb90 2024-09-21T10:38:01.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea019ad00 con 0x7f7ea00ffb90 2024-09-21T10:38:01.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.493+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e90003ac0 con 0x7f7ea00ffb90 2024-09-21T10:38:01.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.494+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea019b220 con 0x7f7ea00ffb90 2024-09-21T10:38:01.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.495+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea018f730 con 0x7f7ea00ffb90 2024-09-21T10:38:01.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.495+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7e90003d30 con 0x7f7ea00ffb90 2024-09-21T10:38:01.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.495+0000 7f7e9dffb640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7e8806cc50 0x7f7e8806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:01.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.496+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7e900acfd0 con 0x7f7ea00ffb90 2024-09-21T10:38:01.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.496+0000 7f7e9ffff640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7e8806cc50 0x7f7e8806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:01.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.496+0000 7f7e9ffff640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7e8806cc50 0x7f7e8806f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0196b60 tx=0x7f7e94009680 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:01.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.500+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e90077810 con 0x7f7ea00ffb90 2024-09-21T10:38:01.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.682+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ea002c550 con 0x7f7e8806cc50 2024-09-21T10:38:01.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.686+0000 7f7e9dffb640 1 -- 172.21.15.60:0/173184512 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f7ea002c550 con 0x7f7e8806cc50 2024-09-21T10:38:01.688 INFO:teuthology.orchestra.run.smithi060.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:crash 2/2 2m ago 6m * 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:mgr 2/2 2m ago 6m count:2 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:mon 2/2 2m ago 5m smithi060:172.21.15.60=smithi060;smithi112:172.21.15.112=smithi112;count:2 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:osd 6 2m ago - 2024-09-21T10:38:01.689 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7e8806cc50 msgr2=0x7f7e8806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7e8806cc50 0x7f7e8806f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0196b60 tx=0x7f7e94009680 comp rx=0 tx=0).stop 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 msgr2=0x7f7ea0195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea0195690 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e900054f0 tx=0x7f7e90005520 comp rx=0 tx=0).stop 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 shutdown_connections 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f7e8806cc50 0x7f7e8806f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ea0100d90 0x7f7ea0195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 --2- 172.21.15.60:0/173184512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ea00ffb90 0x7f7ea0195690 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:01.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.688+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 >> 172.21.15.60:0/173184512 conn(0x7f7ea00fb320 msgr2=0x7f7ea01044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:01.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.689+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 shutdown_connections 2024-09-21T10:38:01.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:01.689+0000 7f7ea6db7640 1 -- 172.21.15.60:0/173184512 wait complete. 2024-09-21T10:38:02.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T10:38:02.561 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:02.860 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:02 smithi060 ceph-mon[28215]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:02 smithi112 ceph-mon[35117]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:03.850 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:03 smithi060 ceph-mon[28215]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:03 smithi112 ceph-mon[35117]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.212+0000 7f23b369a640 1 -- 172.21.15.60:0/320575382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 msgr2=0x7f23ac072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.212+0000 7f23b369a640 1 --2- 172.21.15.60:0/320575382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac072940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009880 tx=0x7f23a802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.212+0000 7f23b369a640 1 -- 172.21.15.60:0/320575382 shutdown_connections 2024-09-21T10:38:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.212+0000 7f23b369a640 1 --2- 172.21.15.60:0/320575382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23ac072f10 0x7f23ac073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.212+0000 7f23b369a640 1 --2- 172.21.15.60:0/320575382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac072940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.212+0000 7f23b369a640 1 -- 172.21.15.60:0/320575382 >> 172.21.15.60:0/320575382 conn(0x7f23ac0fb2f0 msgr2=0x7f23ac0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.213+0000 7f23b369a640 1 -- 172.21.15.60:0/320575382 shutdown_connections 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.213+0000 7f23b369a640 1 -- 172.21.15.60:0/320575382 wait complete. 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.213+0000 7f23b369a640 1 Processor -- start 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.213+0000 7f23b369a640 1 -- start start 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b369a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23ac072f10 0x7f23ac19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b369a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b369a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac19c640 con 0x7f23ac0744e0 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b369a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac19c7b0 con 0x7f23ac072f10 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac19c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33702/0 (socket says 172.21.15.60:33702) 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 -- 172.21.15.60:0/1837356315 learned_addr learned my addr 172.21.15.60:0/1837356315 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b1436640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23ac072f10 0x7f23ac19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 -- 172.21.15.60:0/1837356315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23ac072f10 msgr2=0x7f23ac19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23ac072f10 0x7f23ac19bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 -- 172.21.15.60:0/1837356315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009560 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b0c35640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac19c070 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f239c00d900 tx=0x7f239c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239c009c00 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac1a1250 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f239c009d60 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239c0049d0 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.214+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac1a17a0 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.216+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac10ed00 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.216+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f239c004020 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.216+0000 7f23a27fc640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f239806cc50 0x7f239806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.217+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f239c08bb90 con 0x7f23ac0744e0 2024-09-21T10:38:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.217+0000 7f23b1436640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f239806cc50 0x7f239806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.217+0000 7f23b1436640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f239806cc50 0x7f239806f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009230 tx=0x7f23a80314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.221+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f239c056320 con 0x7f23ac0744e0 2024-09-21T10:38:04.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.396+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f23ac1a1a70 con 0x7f239806cc50 2024-09-21T10:38:04.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.398+0000 7f23a27fc640 1 -- 172.21.15.60:0/1837356315 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f23ac1a1a70 con 0x7f239806cc50 2024-09-21T10:38:04.400 INFO:teuthology.orchestra.run.smithi060.stdout:HOST ADDR LABELS STATUS 2024-09-21T10:38:04.400 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 172.21.15.60 2024-09-21T10:38:04.400 INFO:teuthology.orchestra.run.smithi060.stdout:smithi112 172.21.15.112 2024-09-21T10:38:04.400 INFO:teuthology.orchestra.run.smithi060.stdout:2 hosts in cluster 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.400+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f239806cc50 msgr2=0x7f239806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.400+0000 7f23b369a640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f239806cc50 0x7f239806f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009230 tx=0x7f23a80314e0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.400+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 msgr2=0x7f23ac19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.400+0000 7f23b369a640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac19c070 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f239c00d900 tx=0x7f239c00ddc0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 shutdown_connections 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f239806cc50 0x7f239806f110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23ac0744e0 0x7f23ac19c070 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 --2- 172.21.15.60:0/1837356315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23ac072f10 0x7f23ac19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 >> 172.21.15.60:0/1837356315 conn(0x7f23ac0fb2f0 msgr2=0x7f23ac101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 shutdown_connections 2024-09-21T10:38:04.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:04.401+0000 7f23b369a640 1 -- 172.21.15.60:0/1837356315 wait complete. 2024-09-21T10:38:04.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:04 smithi060 ceph-mon[28215]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:04.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:04 smithi112 ceph-mon[35117]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:04.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T10:38:05.192 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:05.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:05 smithi060 ceph-mon[28215]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:05.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:05 smithi112 ceph-mon[35117]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:06.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:06 smithi112 ceph-mon[35117]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/1860677017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 msgr2=0x7f5d84102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/1860677017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d84102a80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009880 tx=0x7f5d8002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/1860677017 shutdown_connections 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/1860677017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d84102fc0 0x7f5d841053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/1860677017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d84102a80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/1860677017 >> 172.21.15.60:0/1860677017 conn(0x7f5d840fa250 msgr2=0x7f5d840fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/1860677017 shutdown_connections 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.722+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/1860677017 wait complete. 2024-09-21T10:38:06.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d8bc9b640 1 Processor -- start 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d8bc9b640 1 -- start start 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d8bc9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d840ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d8bc9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d84102fc0 0x7f5d840fe640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d8bc9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840feb80 con 0x7f5d84100690 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d8bc9b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840fecf0 con 0x7f5d84102fc0 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d89a37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d840ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d89a37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d840ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33712/0 (socket says 172.21.15.60:33712) 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.723+0000 7f5d89a37640 1 -- 172.21.15.60:0/2904909315 learned_addr learned my addr 172.21.15.60:0/2904909315 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d89236640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d84102fc0 0x7f5d840fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d89a37640 1 -- 172.21.15.60:0/2904909315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d84102fc0 msgr2=0x7f5d840fe640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d89a37640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d84102fc0 0x7f5d840fe640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d89a37640 1 -- 172.21.15.60:0/2904909315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80009560 con 0x7f5d84100690 2024-09-21T10:38:06.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d89a37640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d840ffff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d800054f0 tx=0x7f5d80005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:06.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d80004aa0 con 0x7f5d84100690 2024-09-21T10:38:06.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d840fefd0 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d80004c00 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d80003ac0 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.724+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8419d650 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.725+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d84108770 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.726+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5d80031c70 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.726+0000 7f5d7affd640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f5d7006cc50 0x7f5d7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.727+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5d800ad0a0 con 0x7f5d84100690 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.727+0000 7f5d89236640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f5d7006cc50 0x7f5d7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:06.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.727+0000 7f5d89236640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f5d7006cc50 0x7f5d7006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ffd70 tx=0x7f5d7400b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:06.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.731+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d80077860 con 0x7f5d84100690 2024-09-21T10:38:06.909 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:06 smithi060 ceph-mon[28215]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.907+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d84103980 con 0x7f5d7006cc50 2024-09-21T10:38:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.909+0000 7f5d7affd640 1 -- 172.21.15.60:0/2904909315 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f5d84103980 con 0x7f5d7006cc50 2024-09-21T10:38:06.911 INFO:teuthology.orchestra.run.smithi060.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T10:38:06.911 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-21T10:38:06.911 INFO:teuthology.orchestra.run.smithi060.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-09-21T10:38:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f5d7006cc50 msgr2=0x7f5d7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f5d7006cc50 0x7f5d7006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ffd70 tx=0x7f5d7400b390 comp rx=0 tx=0).stop 2024-09-21T10:38:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 msgr2=0x7f5d840ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d840ffff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5d800054f0 tx=0x7f5d80005520 comp rx=0 tx=0).stop 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 shutdown_connections 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f5d7006cc50 0x7f5d7006f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d84102fc0 0x7f5d840fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 --2- 172.21.15.60:0/2904909315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d84100690 0x7f5d840ffff0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 >> 172.21.15.60:0/2904909315 conn(0x7f5d840fa250 msgr2=0x7f5d840fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 shutdown_connections 2024-09-21T10:38:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:06.911+0000 7f5d8bc9b640 1 -- 172.21.15.60:0/2904909315 wait complete. 2024-09-21T10:38:07.566 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:38:07.576 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:07.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-21T10:38:07.785 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:07.906 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:08.869 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:08 smithi060 ceph-mon[28215]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:08.870 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:08 smithi060 ceph-mon[28215]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:08 smithi112 ceph-mon[35117]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:08 smithi112 ceph-mon[35117]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:09.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.297+0000 7fcd5340b640 1 -- 172.21.15.60:0/2423431145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0ffcf0 msgr2=0x7fcd4c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:09.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.297+0000 7fcd5340b640 1 --2- 172.21.15.60:0/2423431145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0ffcf0 0x7fcd4c100170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009880 tx=0x7fcd3c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.297+0000 7fcd5340b640 1 -- 172.21.15.60:0/2423431145 shutdown_connections 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.297+0000 7fcd5340b640 1 --2- 172.21.15.60:0/2423431145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0ffcf0 0x7fcd4c100170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.297+0000 7fcd5340b640 1 --2- 172.21.15.60:0/2423431145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.297+0000 7fcd5340b640 1 -- 172.21.15.60:0/2423431145 >> 172.21.15.60:0/2423431145 conn(0x7fcd4c0fa280 msgr2=0x7fcd4c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.298+0000 7fcd5340b640 1 -- 172.21.15.60:0/2423431145 shutdown_connections 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.298+0000 7fcd5340b640 1 -- 172.21.15.60:0/2423431145 wait complete. 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.298+0000 7fcd5340b640 1 Processor -- start 2024-09-21T10:38:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd5340b640 1 -- start start 2024-09-21T10:38:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd5340b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd5340b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd4c0ffcf0 0x7fcd4c195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd5340b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c196160 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd5340b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1962d0 con 0x7fcd4c0ffcf0 2024-09-21T10:38:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33736/0 (socket says 172.21.15.60:33736) 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 -- 172.21.15.60:0/1195565949 learned_addr learned my addr 172.21.15.60:0/1195565949 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd509a6640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd4c0ffcf0 0x7fcd4c195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 -- 172.21.15.60:0/1195565949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd4c0ffcf0 msgr2=0x7fcd4c195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd4c0ffcf0 0x7fcd4c195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 -- 172.21.15.60:0/1195565949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c009560 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.299+0000 7fcd511a7640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c195650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800d900 tx=0x7fcd4800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.300+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd48009c00 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.300+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd48009d60 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.300+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c19ad70 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.300+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4800f7b0 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.301+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c19b230 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.301+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcd4800f9b0 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.302+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c1076e0 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.302+0000 7fcd427fc640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fcd3806cc50 0x7fcd3806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.302+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcd4808f3f0 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.302+0000 7fcd509a6640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fcd3806cc50 0x7fcd3806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.302+0000 7fcd509a6640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fcd3806cc50 0x7fcd3806f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000c00 tx=0x7fcd3c0314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.307+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd48055b80 con 0x7fcd4c0feaf0 2024-09-21T10:38:09.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:09.501+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd4c0608f0 con 0x7fcd3806cc50 2024-09-21T10:38:10.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:10 smithi060 ceph-mon[28215]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:10.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T10:38:10.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:10 smithi060 ceph-mon[28215]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:10 smithi112 ceph-mon[35117]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:38:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T10:38:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:10 smithi112 ceph-mon[35117]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:11.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.013+0000 7fcd427fc640 1 -- 172.21.15.60:0/1195565949 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcd4c0608f0 con 0x7fcd3806cc50 2024-09-21T10:38:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.017+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fcd3806cc50 msgr2=0x7fcd3806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.017+0000 7fcd5340b640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fcd3806cc50 0x7fcd3806f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000c00 tx=0x7fcd3c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:38:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 msgr2=0x7fcd4c195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c195650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800d900 tx=0x7fcd4800ddc0 comp rx=0 tx=0).stop 2024-09-21T10:38:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 shutdown_connections 2024-09-21T10:38:11.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fcd3806cc50 0x7fcd3806f110 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000c00 tx=0x7fcd3c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:38:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd4c0ffcf0 0x7fcd4c195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 --2- 172.21.15.60:0/1195565949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd4c0feaf0 0x7fcd4c195650 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800d900 tx=0x7fcd4800ddc0 comp rx=0 tx=0).stop 2024-09-21T10:38:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 >> 172.21.15.60:0/1195565949 conn(0x7fcd4c0fa280 msgr2=0x7fcd4c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 shutdown_connections 2024-09-21T10:38:11.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:11.018+0000 7fcd5340b640 1 -- 172.21.15.60:0/1195565949 wait complete. 2024-09-21T10:38:11.324 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:10 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[28211]: 2024-09-21T10:38:10.994+0000 7f8600f29640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:38:11.616 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: fsmap cephfs:0 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:11.617 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:11 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:11.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T10:38:11.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: fsmap cephfs:0 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:11 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:12 smithi060 ceph-mon[28215]: Saving service mds.cephfs spec with placement count:4 2024-09-21T10:38:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:12 smithi060 ceph-mon[28215]: Deploying daemon mds.cephfs.smithi060.xjabvh on smithi060 2024-09-21T10:38:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:12 smithi060 ceph-mon[28215]: pgmap v197: 65 pgs: 16 creating+peering, 1 active+clean, 48 unknown; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:12 smithi060 ceph-mon[28215]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T10:38:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:12 smithi112 ceph-mon[35117]: Saving service mds.cephfs spec with placement count:4 2024-09-21T10:38:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:12 smithi112 ceph-mon[35117]: Deploying daemon mds.cephfs.smithi060.xjabvh on smithi060 2024-09-21T10:38:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:12 smithi112 ceph-mon[35117]: pgmap v197: 65 pgs: 16 creating+peering, 1 active+clean, 48 unknown; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:12 smithi112 ceph-mon[35117]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T10:38:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:14.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:14 smithi060 ceph-mon[28215]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T10:38:14.145 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:14 smithi060 ceph-mon[28215]: pgmap v200: 65 pgs: 16 creating+peering, 16 active+clean, 33 unknown; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:14 smithi112 ceph-mon[35117]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T10:38:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:14 smithi112 ceph-mon[35117]: pgmap v200: 65 pgs: 16 creating+peering, 16 active+clean, 33 unknown; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/1674272345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64102fb0 msgr2=0x7f2e641053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/1674272345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64102fb0 0x7f2e641053a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e580098b0 tx=0x7f2e5802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/1674272345 shutdown_connections 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/1674272345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64102fb0 0x7f2e641053a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/1674272345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e64100680 0x7f2e64102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/1674272345 >> 172.21.15.60:0/1674272345 conn(0x7f2e640fa280 msgr2=0x7f2e640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/1674272345 shutdown_connections 2024-09-21T10:38:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.152+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/1674272345 wait complete. 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.153+0000 7f2e6a2b6640 1 Processor -- start 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.153+0000 7f2e6a2b6640 1 -- start start 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e6a2b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 0x7f2e64195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e6a2b6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e64102fb0 0x7f2e64195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e6a2b6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64196230 con 0x7f2e64100680 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e6a2b6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e641963a0 con 0x7f2e64102fb0 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 0x7f2e64195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 0x7f2e64195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34596/0 (socket says 172.21.15.60:34596) 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 -- 172.21.15.60:0/2426453824 learned_addr learned my addr 172.21.15.60:0/2426453824 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e637fe640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e64102fb0 0x7f2e64195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 -- 172.21.15.60:0/2426453824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e64102fb0 msgr2=0x7f2e64195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e64102fb0 0x7f2e64195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 -- 172.21.15.60:0/2426453824 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58009560 con 0x7f2e64100680 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e63fff640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 0x7f2e64195720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c920 tx=0x7f2e5400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e54007b80 con 0x7f2e64100680 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e540054e0 con 0x7f2e64100680 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6419ae40 con 0x7f2e64100680 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5400f450 con 0x7f2e64100680 2024-09-21T10:38:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.154+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6419b300 con 0x7f2e64100680 2024-09-21T10:38:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.155+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e64100a60 con 0x7f2e64100680 2024-09-21T10:38:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.156+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2e54004f60 con 0x7f2e64100680 2024-09-21T10:38:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.156+0000 7f2e617fa640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2e4c06cc50 0x7f2e4c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.156+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2e5408bfe0 con 0x7f2e64100680 2024-09-21T10:38:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.157+0000 7f2e637fe640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2e4c06cc50 0x7f2e4c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.157+0000 7f2e637fe640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2e4c06cc50 0x7f2e4c06f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009880 tx=0x7f2e58005b50 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:15.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.161+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e54056430 con 0x7f2e64100680 2024-09-21T10:38:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.368+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2e64108800 con 0x7f2e64100680 2024-09-21T10:38:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.368+0000 7f2e617fa640 1 -- 172.21.15.60:0/2426453824 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1285 (secure 0 0 0) 0x7f2e5401d520 con 0x7f2e64100680 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:e4 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 4 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:15.008422+0000 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:38:15.372 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14530} 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:38:15.373 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 0 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{0:14530} state up:creating seq 1 addr [v2:172.21.15.60:6826/1450096155,v1:172.21.15.60:6827/1450096155] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 4 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2e4c06cc50 msgr2=0x7f2e4c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2e4c06cc50 0x7f2e4c06f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009880 tx=0x7f2e58005b50 comp rx=0 tx=0).stop 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 msgr2=0x7f2e64195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 0x7f2e64195720 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c920 tx=0x7f2e5400cde0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 shutdown_connections 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f2e4c06cc50 0x7f2e4c06f110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2e64102fb0 0x7f2e64195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 --2- 172.21.15.60:0/2426453824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64100680 0x7f2e64195720 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 >> 172.21.15.60:0/2426453824 conn(0x7f2e640fa280 msgr2=0x7f2e640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 shutdown_connections 2024-09-21T10:38:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:15.370+0000 7f2e6a2b6640 1 -- 172.21.15.60:0/2426453824 wait complete. 2024-09-21T10:38:15.972 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: Deploying daemon mds.cephfs.smithi112.worwat on smithi112 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6826/1450096155,v1:172.21.15.60:6827/1450096155] up:boot 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: daemon mds.cephfs.smithi060.xjabvh assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: Cluster is now healthy 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: fsmap cephfs:0 1 up:standby 2024-09-21T10:38:15.973 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:38:15.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:creating} 2024-09-21T10:38:15.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: daemon mds.cephfs.smithi060.xjabvh is now active in filesystem cephfs as rank 0 2024-09-21T10:38:15.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2426453824' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:38:15.974 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:15 smithi060 ceph-mon[28215]: pgmap v201: 65 pgs: 7 creating+peering, 53 active+clean, 5 unknown; 578 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 679 B/s wr, 2 op/s 2024-09-21T10:38:15.975 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:38:16.219 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:16.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-21T10:38:16.220 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:16.220 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:16.220 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: Deploying daemon mds.cephfs.smithi112.worwat on smithi112 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6826/1450096155,v1:172.21.15.60:6827/1450096155] up:boot 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: daemon mds.cephfs.smithi060.xjabvh assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: Cluster is now healthy 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: fsmap cephfs:0 1 up:standby 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:creating} 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: daemon mds.cephfs.smithi060.xjabvh is now active in filesystem cephfs as rank 0 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2426453824' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:38:16.221 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:15 smithi112 ceph-mon[35117]: pgmap v201: 65 pgs: 7 creating+peering, 53 active+clean, 5 unknown; 578 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 679 B/s wr, 2 op/s 2024-09-21T10:38:16.445 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:17.067 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:17 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6826/1450096155,v1:172.21.15.60:6827/1450096155] up:active 2024-09-21T10:38:17.067 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:17 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2024-09-21T10:38:17.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:17 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6826/1450096155,v1:172.21.15.60:6827/1450096155] up:active 2024-09-21T10:38:17.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:17 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2024-09-21T10:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 -- 172.21.15.60:0/3482120115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f04100d90 msgr2=0x7f4f04101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 --2- 172.21.15.60:0/3482120115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f04100d90 0x7f4f04101210 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009880 tx=0x7f4eec02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 -- 172.21.15.60:0/3482120115 shutdown_connections 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 --2- 172.21.15.60:0/3482120115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f04100d90 0x7f4f04101210 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 --2- 172.21.15.60:0/3482120115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f040ffb90 0x7f4f040fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 -- 172.21.15.60:0/3482120115 >> 172.21.15.60:0/3482120115 conn(0x7f4f040fb320 msgr2=0x7f4f040fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 -- 172.21.15.60:0/3482120115 shutdown_connections 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 -- 172.21.15.60:0/3482120115 wait complete. 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 Processor -- start 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.207+0000 7f4f08b67640 1 -- start start 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f08b67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 0x7f4f04074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f08b67640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f04100d90 0x7f4f040728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f08b67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04072de0 con 0x7f4f040ffb90 2024-09-21T10:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f08b67640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04072f50 con 0x7f4f04100d90 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 0x7f4f04074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 0x7f4f04074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34604/0 (socket says 172.21.15.60:34604) 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 -- 172.21.15.60:0/2324224389 learned_addr learned my addr 172.21.15.60:0/2324224389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f01d9b640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f04100d90 0x7f4f040728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 -- 172.21.15.60:0/2324224389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f04100d90 msgr2=0x7f4f040728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f04100d90 0x7f4f040728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 -- 172.21.15.60:0/2324224389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009560 con 0x7f4f040ffb90 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f01d9b640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f04100d90 0x7f4f040728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f0259c640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 0x7f4f04074200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400eaf0 tx=0x7f4ef400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef4003970 con 0x7f4f040ffb90 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f04073230 con 0x7f4f040ffb90 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ef4004020 con 0x7f4f040ffb90 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.208+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef4010660 con 0x7f4f040ffb90 2024-09-21T10:38:18.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.209+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0419d6a0 con 0x7f4f040ffb90 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.210+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0418f730 con 0x7f4f040ffb90 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.210+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ef4004190 con 0x7f4f040ffb90 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.211+0000 7f4efb7fe640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ef006cc50 0x7f4ef006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.211+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4ef4014070 con 0x7f4f040ffb90 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.211+0000 7f4f01d9b640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ef006cc50 0x7f4ef006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.211+0000 7f4f01d9b640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ef006cc50 0x7f4ef006f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4eec031540 tx=0x7f4eec005de0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.215+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ef4056f90 con 0x7f4f040ffb90 2024-09-21T10:38:18.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:18.424+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f4f0402c480 con 0x7f4f040ffb90 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:boot 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 1 up:standby 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"}]: dispatch 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:18.427 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:18.428 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:18.428 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:18.428 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: Deploying daemon mds.cephfs.smithi060.lljnqu on smithi060 2024-09-21T10:38:18.428 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:18 smithi060 ceph-mon[28215]: pgmap v202: 65 pgs: 65 active+clean; 578 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 785 B/s wr, 2 op/s 2024-09-21T10:38:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:boot 2024-09-21T10:38:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 1 up:standby 2024-09-21T10:38:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"}]: dispatch 2024-09-21T10:38:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: Deploying daemon mds.cephfs.smithi060.lljnqu on smithi060 2024-09-21T10:38:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:18 smithi112 ceph-mon[35117]: pgmap v202: 65 pgs: 65 active+clean; 578 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 785 B/s wr, 2 op/s 2024-09-21T10:38:19.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.227+0000 7f4efb7fe640 1 -- 172.21.15.60:0/2324224389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4ef4004440 con 0x7f4f040ffb90 2024-09-21T10:38:19.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ef006cc50 msgr2=0x7f4ef006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:19.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ef006cc50 0x7f4ef006f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4eec031540 tx=0x7f4eec005de0 comp rx=0 tx=0).stop 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 msgr2=0x7f4f04074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 0x7f4f04074200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400eaf0 tx=0x7f4ef400c2d0 comp rx=0 tx=0).stop 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 shutdown_connections 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4ef006cc50 0x7f4ef006f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f04100d90 0x7f4f040728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 --2- 172.21.15.60:0/2324224389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f040ffb90 0x7f4f04074200 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 >> 172.21.15.60:0/2324224389 conn(0x7f4f040fb320 msgr2=0x7f4f04104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 shutdown_connections 2024-09-21T10:38:19.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:19.229+0000 7f4f08b67640 1 -- 172.21.15.60:0/2324224389 wait complete. 2024-09-21T10:38:19.387 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:19 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2324224389' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T10:38:19.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:19 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2324224389' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T10:38:20.147 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:38:20.157 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:20.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-21T10:38:20.421 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:20 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2324224389' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T10:38:20.421 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:20 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 1 up:standby 2024-09-21T10:38:20.421 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:20 smithi060 ceph-mon[28215]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T10:38:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:20 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2324224389' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T10:38:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:20 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 1 up:standby 2024-09-21T10:38:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:20 smithi112 ceph-mon[35117]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T10:38:20.813 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: Deploying daemon mds.cephfs.smithi112.urlyzu on smithi112 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:boot 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2 up:standby 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"}]: dispatch 2024-09-21T10:38:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:21 smithi060 ceph-mon[28215]: pgmap v204: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T10:38:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: Deploying daemon mds.cephfs.smithi112.urlyzu on smithi112 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:boot 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2 up:standby 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"}]: dispatch 2024-09-21T10:38:22.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:21 smithi112 ceph-mon[35117]: pgmap v204: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T10:38:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 -- 172.21.15.60:0/2516157709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c100630 msgr2=0x7f323c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 --2- 172.21.15.60:0/2516157709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c100630 0x7f323c102a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f322c0098b0 tx=0x7f322c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:38:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 -- 172.21.15.60:0/2516157709 shutdown_connections 2024-09-21T10:38:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 --2- 172.21.15.60:0/2516157709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c102f60 0x7f323c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 --2- 172.21.15.60:0/2516157709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c100630 0x7f323c102a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 -- 172.21.15.60:0/2516157709 >> 172.21.15.60:0/2516157709 conn(0x7f323c0fa250 msgr2=0x7f323c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 -- 172.21.15.60:0/2516157709 shutdown_connections 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.464+0000 7f3241cba640 1 -- 172.21.15.60:0/2516157709 wait complete. 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.465+0000 7f3241cba640 1 Processor -- start 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.465+0000 7f3241cba640 1 -- start start 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.465+0000 7f3241cba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c100630 0x7f323c195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.465+0000 7f3241cba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 0x7f323c195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.465+0000 7f3241cba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1961a0 con 0x7f323c102f60 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.465+0000 7f3241cba640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c196310 con 0x7f323c100630 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 0x7f323c195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 0x7f323c195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34642/0 (socket says 172.21.15.60:34642) 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 -- 172.21.15.60:0/2294332500 learned_addr learned my addr 172.21.15.60:0/2294332500 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323b7fe640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c100630 0x7f323c195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 -- 172.21.15.60:0/2294332500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c100630 msgr2=0x7f323c195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c100630 0x7f323c195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 -- 172.21.15.60:0/2294332500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009560 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f323affd640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 0x7f323c195bd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f323000d6f0 tx=0x7f323000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32300051f0 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3230009ce0 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3230004e80 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c19adb0 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.466+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c19b350 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.467+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c100a10 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.468+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f32300046c0 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.468+0000 7f3238ff9640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f322406cbf0 0x7f322406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.468+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f323008bc10 con 0x7f323c102f60 2024-09-21T10:38:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.468+0000 7f323b7fe640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f322406cbf0 0x7f322406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:22.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.469+0000 7f323b7fe640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f322406cbf0 0x7f322406f0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f322c006010 tx=0x7f322c0314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:22.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.473+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3230056090 con 0x7f323c102f60 2024-09-21T10:38:22.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:22.692+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f323c1087e0 con 0x7f323c102f60 2024-09-21T10:38:23.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.240+0000 7f3238ff9640 1 -- 172.21.15.60:0/2294332500 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32300200c0 con 0x7f323c102f60 2024-09-21T10:38:23.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f322406cbf0 msgr2=0x7f322406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:23.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f322406cbf0 0x7f322406f0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f322c006010 tx=0x7f322c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:38:23.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 msgr2=0x7f323c195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:23.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 0x7f323c195bd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f323000d6f0 tx=0x7f323000dbb0 comp rx=0 tx=0).stop 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 shutdown_connections 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f322406cbf0 0x7f322406f0b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f323c102f60 0x7f323c195bd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 --2- 172.21.15.60:0/2294332500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f323c100630 0x7f323c195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 >> 172.21.15.60:0/2294332500 conn(0x7f323c0fa250 msgr2=0x7f323c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 shutdown_connections 2024-09-21T10:38:23.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:23.242+0000 7f3241cba640 1 -- 172.21.15.60:0/2294332500 wait complete. 2024-09-21T10:38:23.379 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:23 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:23.379 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:23 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2294332500' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T10:38:23.585 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:23 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:23.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:23 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2294332500' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T10:38:23.991 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:38:24.003 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:24.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-21T10:38:24.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2294332500' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2 up:standby 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:24 smithi112 ceph-mon[35117]: pgmap v205: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2294332500' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2 up:standby 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:24.573 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:24.574 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:24 smithi060 ceph-mon[28215]: pgmap v205: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-21T10:38:24.758 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:25.447 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:25 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:boot 2024-09-21T10:38:25.447 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:25 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 3 up:standby 2024-09-21T10:38:25.447 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:25 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"}]: dispatch 2024-09-21T10:38:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:25 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:boot 2024-09-21T10:38:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:25 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 3 up:standby 2024-09-21T10:38:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:25 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"}]: dispatch 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:standby 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:standby 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: Dropping low affinity active daemon mds.cephfs.smithi060.xjabvh in favor of higher affinity standby. 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: Replacing daemon mds.cephfs.smithi060.xjabvh as rank 0 with standby daemon mds.cephfs.smithi060.lljnqu 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 3 up:standby 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: fsmap cephfs:1/1 {0=cephfs.smithi060.lljnqu=up:replay} 2 up:standby 2024-09-21T10:38:26.542 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:26 smithi060 ceph-mon[28215]: pgmap v207: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:standby 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:standby 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: Dropping low affinity active daemon mds.cephfs.smithi060.xjabvh in favor of higher affinity standby. 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: Replacing daemon mds.cephfs.smithi060.xjabvh as rank 0 with standby daemon mds.cephfs.smithi060.lljnqu 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 3 up:standby 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: fsmap cephfs:1/1 {0=cephfs.smithi060.lljnqu=up:replay} 2 up:standby 2024-09-21T10:38:26.682 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:26 smithi112 ceph-mon[35117]: pgmap v207: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T10:38:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 -- 172.21.15.60:0/358588920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf00ffb90 msgr2=0x7f9bf00fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/358588920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf00ffb90 0x7f9bf00fff90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009880 tx=0x7f9be002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 -- 172.21.15.60:0/358588920 shutdown_connections 2024-09-21T10:38:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/358588920 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf0100d90 0x7f9bf0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/358588920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf00ffb90 0x7f9bf00fff90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 -- 172.21.15.60:0/358588920 >> 172.21.15.60:0/358588920 conn(0x7f9bf00fb320 msgr2=0x7f9bf00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 -- 172.21.15.60:0/358588920 shutdown_connections 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.038+0000 7f9bf64cb640 1 -- 172.21.15.60:0/358588920 wait complete. 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bf64cb640 1 Processor -- start 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bf64cb640 1 -- start start 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bf64cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf00ffb90 0x7f9bf0195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bf64cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 0x7f9bf0195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bf64cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0196180 con 0x7f9bf0100d90 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bf64cb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf01962f0 con 0x7f9bf00ffb90 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bef7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 0x7f9bf0195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bef7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 0x7f9bf0195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44892/0 (socket says 172.21.15.60:44892) 2024-09-21T10:38:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9bef7fe640 1 -- 172.21.15.60:0/1833294949 learned_addr learned my addr 172.21.15.60:0/1833294949 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.039+0000 7f9beffff640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf00ffb90 0x7f9bf0195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bef7fe640 1 -- 172.21.15.60:0/1833294949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf00ffb90 msgr2=0x7f9bf0195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bef7fe640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf00ffb90 0x7f9bf0195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bef7fe640 1 -- 172.21.15.60:0/1833294949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0009560 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bef7fe640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 0x7f9bf0195bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9be400d720 tx=0x7f9be400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9be40051f0 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf019ad40 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9be4009ce0 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9be4010460 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.040+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf019b310 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.041+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf018f730 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.041+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9be4009820 con 0x7f9bf0100d90 2024-09-21T10:38:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.042+0000 7f9bed7fa640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9bd806cc50 0x7f9bd806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.042+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9be408be00 con 0x7f9bf0100d90 2024-09-21T10:38:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.042+0000 7f9beffff640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9bd806cc50 0x7f9bd806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.042+0000 7f9beffff640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9bd806cc50 0x7f9bd806f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009230 tx=0x7f9be00314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.046+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9be4056220 con 0x7f9bf0100d90 2024-09-21T10:38:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.284+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f9bf01087a0 con 0x7f9bf0100d90 2024-09-21T10:38:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.450+0000 7f9bed7fa640 1 -- 172.21.15.60:0/1833294949 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v14) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9be4059840 con 0x7f9bf0100d90 2024-09-21T10:38:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:inline data disabled 2024-09-21T10:38:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9bd806cc50 msgr2=0x7f9bd806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9bd806cc50 0x7f9bd806f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009230 tx=0x7f9be00314e0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 msgr2=0x7f9bf0195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 0x7f9bf0195bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9be400d720 tx=0x7f9be400dbe0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 shutdown_connections 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f9bd806cc50 0x7f9bd806f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bf0100d90 0x7f9bf0195bb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 --2- 172.21.15.60:0/1833294949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bf00ffb90 0x7f9bf0195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 >> 172.21.15.60:0/1833294949 conn(0x7f9bf00fb320 msgr2=0x7f9bf01044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 shutdown_connections 2024-09-21T10:38:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:27.453+0000 7f9bf64cb640 1 -- 172.21.15.60:0/1833294949 wait complete. 2024-09-21T10:38:27.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:27 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:reconnect 2024-09-21T10:38:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:27 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] up:boot 2024-09-21T10:38:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:27 smithi060 ceph-mon[28215]: fsmap cephfs:1/1 {0=cephfs.smithi060.lljnqu=up:reconnect} 3 up:standby 2024-09-21T10:38:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:27 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:38:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:27 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:27 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1833294949' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-21T10:38:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:27 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:reconnect 2024-09-21T10:38:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:27 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] up:boot 2024-09-21T10:38:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:27 smithi112 ceph-mon[35117]: fsmap cephfs:1/1 {0=cephfs.smithi060.lljnqu=up:reconnect} 3 up:standby 2024-09-21T10:38:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:27 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:38:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:27 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:27 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1833294949' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-21T10:38:28.199 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:38:28.209 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:28.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T10:38:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:28 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:rejoin 2024-09-21T10:38:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:28 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1833294949' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-21T10:38:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:28 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:standby 2024-09-21T10:38:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:28 smithi060 ceph-mon[28215]: fsmap cephfs:1/1 {0=cephfs.smithi060.lljnqu=up:rejoin} 3 up:standby 2024-09-21T10:38:28.737 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:28 smithi060 ceph-mon[28215]: daemon mds.cephfs.smithi060.lljnqu is now active in filesystem cephfs as rank 0 2024-09-21T10:38:28.738 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:28 smithi060 ceph-mon[28215]: pgmap v208: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 921 B/s wr, 3 op/s 2024-09-21T10:38:28.934 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:28 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:rejoin 2024-09-21T10:38:28.934 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:28 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1833294949' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-21T10:38:28.934 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:28 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:standby 2024-09-21T10:38:28.934 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:28 smithi112 ceph-mon[35117]: fsmap cephfs:1/1 {0=cephfs.smithi060.lljnqu=up:rejoin} 3 up:standby 2024-09-21T10:38:28.934 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:28 smithi112 ceph-mon[35117]: daemon mds.cephfs.smithi060.lljnqu is now active in filesystem cephfs as rank 0 2024-09-21T10:38:28.934 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:28 smithi112 ceph-mon[35117]: pgmap v208: 65 pgs: 65 active+clean; 579 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 921 B/s wr, 3 op/s 2024-09-21T10:38:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:29 smithi060 ceph-mon[28215]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:38:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:29 smithi060 ceph-mon[28215]: Cluster is now healthy 2024-09-21T10:38:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:29 smithi060 ceph-mon[28215]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:active 2024-09-21T10:38:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:29 smithi060 ceph-mon[28215]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:38:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:29 smithi112 ceph-mon[35117]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:38:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:29 smithi112 ceph-mon[35117]: Cluster is now healthy 2024-09-21T10:38:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:29 smithi112 ceph-mon[35117]: mds.? [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] up:active 2024-09-21T10:38:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:29 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:38:30.655 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:30 smithi060 ceph-mon[28215]: pgmap v209: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T10:38:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:30 smithi112 ceph-mon[35117]: pgmap v209: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-21T10:38:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 -- 172.21.15.60:0/1263144879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102f60 msgr2=0x7f0238105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 --2- 172.21.15.60:0/1263144879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102f60 0x7f0238105350 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f02280098b0 tx=0x7f022802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 -- 172.21.15.60:0/1263144879 shutdown_connections 2024-09-21T10:38:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 --2- 172.21.15.60:0/1263144879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102f60 0x7f0238105350 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 --2- 172.21.15.60:0/1263144879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0238100630 0x7f0238102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 -- 172.21.15.60:0/1263144879 >> 172.21.15.60:0/1263144879 conn(0x7f02380fa250 msgr2=0x7f02380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 -- 172.21.15.60:0/1263144879 shutdown_connections 2024-09-21T10:38:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.409+0000 7f02404d8640 1 -- 172.21.15.60:0/1263144879 wait complete. 2024-09-21T10:38:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f02404d8640 1 Processor -- start 2024-09-21T10:38:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f02404d8640 1 -- start start 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f02404d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 0x7f0238195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f02404d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0238102f60 0x7f0238195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f02404d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238196180 con 0x7f0238100630 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f02404d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02381962f0 con 0x7f0238102f60 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f023e274640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 0x7f0238195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f023e274640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 0x7f0238195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44920/0 (socket says 172.21.15.60:44920) 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.410+0000 7f023e274640 1 -- 172.21.15.60:0/3531859428 learned_addr learned my addr 172.21.15.60:0/3531859428 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f023e274640 1 -- 172.21.15.60:0/3531859428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0238102f60 msgr2=0x7f0238195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f023e274640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0238102f60 0x7f0238195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f023e274640 1 -- 172.21.15.60:0/3531859428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009560 con 0x7f0238100630 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f023e274640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 0x7f0238195670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f023400c920 tx=0x7f023400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0234007b80 con 0x7f0238100630 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02340054e0 con 0x7f0238100630 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f023400f450 con 0x7f0238100630 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023819ad90 con 0x7f0238100630 2024-09-21T10:38:31.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.411+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023819b330 con 0x7f0238100630 2024-09-21T10:38:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.412+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0238100a10 con 0x7f0238100630 2024-09-21T10:38:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.413+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0234004f60 con 0x7f0238100630 2024-09-21T10:38:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.413+0000 7f022f7fe640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f022406cc50 0x7f022406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.413+0000 7f023da73640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f022406cc50 0x7f022406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.413+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f023408c0c0 con 0x7f0238100630 2024-09-21T10:38:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.414+0000 7f023da73640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f022406cc50 0x7f022406f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f022802a9f0 tx=0x7f0228000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.418+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0234056430 con 0x7f0238100630 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.645+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f023819b5b0 con 0x7f0238100630 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.646+0000 7f022f7fe640 1 -- 172.21.15.60:0/3531859428 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f0234059a50 con 0x7f0238100630 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:38:31.649 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:38:31.650 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:38:31.651 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:38:31.652 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f022406cc50 msgr2=0x7f022406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f022406cc50 0x7f022406f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f022802a9f0 tx=0x7f0228000bc0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 msgr2=0x7f0238195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 0x7f0238195670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f023400c920 tx=0x7f023400cde0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 shutdown_connections 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f022406cc50 0x7f022406f110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0238102f60 0x7f0238195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 --2- 172.21.15.60:0/3531859428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238100630 0x7f0238195670 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 >> 172.21.15.60:0/3531859428 conn(0x7f02380fa250 msgr2=0x7f02380fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 shutdown_connections 2024-09-21T10:38:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:31.648+0000 7f02404d8640 1 -- 172.21.15.60:0/3531859428 wait complete. 2024-09-21T10:38:32.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-21T10:38:32.876 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:32.918 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: pgmap v210: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 6 op/s 2024-09-21T10:38:32.918 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:32.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:32.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:32.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:32.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:32.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3531859428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:38:32.919 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: pgmap v210: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 6 op/s 2024-09-21T10:38:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3531859428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:38:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:34.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:34 smithi060 ceph-mon[28215]: pgmap v211: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-09-21T10:38:34.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:34 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:34.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:34 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 -- 172.21.15.60:0/3067892392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e18100d90 msgr2=0x7f1e18101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/3067892392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e18100d90 0x7f1e18101210 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009880 tx=0x7f1e0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 -- 172.21.15.60:0/3067892392 shutdown_connections 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/3067892392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e18100d90 0x7f1e18101210 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/3067892392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e180ffb90 0x7f1e180fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 -- 172.21.15.60:0/3067892392 >> 172.21.15.60:0/3067892392 conn(0x7f1e180fb360 msgr2=0x7f1e180fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 -- 172.21.15.60:0/3067892392 shutdown_connections 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 -- 172.21.15.60:0/3067892392 wait complete. 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 Processor -- start 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.906+0000 7f1e1ed92640 1 -- start start 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1ed92640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 0x7f1e18197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1ed92640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e18100d90 0x7f1e18197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1ed92640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18198360 con 0x7f1e180ffb90 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1ed92640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181984d0 con 0x7f1e18100d90 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 0x7f1e18197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 0x7f1e18197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54116/0 (socket says 172.21.15.60:54116) 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 -- 172.21.15.60:0/1585651828 learned_addr learned my addr 172.21.15.60:0/1585651828 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e17fff640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e18100d90 0x7f1e18197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 -- 172.21.15.60:0/1585651828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e18100d90 msgr2=0x7f1e18197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:34.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e18100d90 0x7f1e18197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 -- 172.21.15.60:0/1585651828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009560 con 0x7f1e180ffb90 2024-09-21T10:38:34.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e17fff640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e18100d90 0x7f1e18197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1cb2e640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 0x7f1e18197850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d900 tx=0x7f1e0800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e08009c00 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e08009d60 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1819cf70 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.907+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e0800f660 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.908+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1819d4e0 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.909+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e181056d0 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.909+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1e08010460 con 0x7f1e180ffb90 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.910+0000 7f1e15ffb640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e0006cc50 0x7f1e0006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.910+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1e0808c180 con 0x7f1e180ffb90 2024-09-21T10:38:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.910+0000 7f1e17fff640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e0006cc50 0x7f1e0006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.910+0000 7f1e17fff640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e0006cc50 0x7f1e0006f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c031540 tx=0x7f1e0c005de0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:34.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:34.914+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1e080564f0 con 0x7f1e180ffb90 2024-09-21T10:38:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:34 smithi112 ceph-mon[35117]: pgmap v211: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-09-21T10:38:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:34 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:34 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:35.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.126+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e181087a0 con 0x7f1e180ffb90 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.127+0000 7f1e15ffb640 1 -- 172.21.15.60:0/1585651828 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4825 (secure 0 0 0) 0x7f1e08059b10 con 0x7f1e180ffb90 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e0006cc50 msgr2=0x7f1e0006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e0006cc50 0x7f1e0006f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c031540 tx=0x7f1e0c005de0 comp rx=0 tx=0).stop 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 msgr2=0x7f1e18197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 0x7f1e18197850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d900 tx=0x7f1e0800ddc0 comp rx=0 tx=0).stop 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 shutdown_connections 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f1e0006cc50 0x7f1e0006f110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e18100d90 0x7f1e18197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 --2- 172.21.15.60:0/1585651828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e180ffb90 0x7f1e18197850 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800d900 tx=0x7f1e0800ddc0 comp rx=0 tx=0).stop 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 >> 172.21.15.60:0/1585651828 conn(0x7f1e180fb360 msgr2=0x7f1e18072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:35.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 shutdown_connections 2024-09-21T10:38:35.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:35.129+0000 7f1e1ed92640 1 -- 172.21.15.60:0/1585651828 wait complete. 2024-09-21T10:38:35.141 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:38:35.855 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:35 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1585651828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T10:38:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:35 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1585651828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T10:38:36.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-21T10:38:36.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:36 smithi060 ceph-mon[28215]: pgmap v212: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 7 op/s 2024-09-21T10:38:36.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:36 smithi112 ceph-mon[35117]: pgmap v212: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 7 op/s 2024-09-21T10:38:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:38.411 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:38 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:38.411 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:38 smithi060 ceph-mon[28215]: pgmap v213: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T10:38:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:38 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:38 smithi112 ceph-mon[35117]: pgmap v213: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T10:38:39.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 -- 172.21.15.60:0/1469785380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580fde80 msgr2=0x7fc0580fe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:39.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 --2- 172.21.15.60:0/1469785380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580fde80 0x7fc0580fe280 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc048009880 tx=0x7fc04802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 -- 172.21.15.60:0/1469785380 shutdown_connections 2024-09-21T10:38:39.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 --2- 172.21.15.60:0/1469785380 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc058100f00 0x7fc058101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 --2- 172.21.15.60:0/1469785380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580fde80 0x7fc0580fe280 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 -- 172.21.15.60:0/1469785380 >> 172.21.15.60:0/1469785380 conn(0x7fc0580f99b0 msgr2=0x7fc0580fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 -- 172.21.15.60:0/1469785380 shutdown_connections 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.578+0000 7fc05e10d640 1 -- 172.21.15.60:0/1469785380 wait complete. 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc05e10d640 1 Processor -- start 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc05e10d640 1 -- start start 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc05e10d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0580fde80 0x7fc058195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc05e10d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 0x7fc058195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc05e10d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc058196140 con 0x7fc058100f00 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc05e10d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581962b0 con 0x7fc0580fde80 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc04ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 0x7fc058195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc04ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 0x7fc058195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54132/0 (socket says 172.21.15.60:54132) 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc04ffff640 1 -- 172.21.15.60:0/2745277635 learned_addr learned my addr 172.21.15.60:0/2745277635 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.579+0000 7fc0577fe640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0580fde80 0x7fc058195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc04ffff640 1 -- 172.21.15.60:0/2745277635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0580fde80 msgr2=0x7fc058195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc04ffff640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0580fde80 0x7fc058195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc04ffff640 1 -- 172.21.15.60:0/2745277635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009560 con 0x7fc058100f00 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc0577fe640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0580fde80 0x7fc058195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc04ffff640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 0x7fc058195b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc04000e9a0 tx=0x7fc04000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc04000cd50 con 0x7fc058100f00 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc04000ceb0 con 0x7fc058100f00 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05819ad50 con 0x7fc058100f00 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc040010660 con 0x7fc058100f00 2024-09-21T10:38:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.580+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05819b320 con 0x7fc058100f00 2024-09-21T10:38:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.581+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0581087b0 con 0x7fc058100f00 2024-09-21T10:38:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.581+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc0400048a0 con 0x7fc058100f00 2024-09-21T10:38:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.582+0000 7fc0557fa640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc04406cc50 0x7fc04406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.582+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc040014070 con 0x7fc058100f00 2024-09-21T10:38:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.582+0000 7fc0577fe640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc04406cc50 0x7fc04406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.583+0000 7fc0577fe640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc04406cc50 0x7fc04406f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc048009230 tx=0x7fc0480314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:39.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.586+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc04005a660 con 0x7fc058100f00 2024-09-21T10:38:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.829+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fc058108940 con 0x7fc058100f00 2024-09-21T10:38:39.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.829+0000 7fc0557fa640 1 -- 172.21.15.60:0/2745277635 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+97 (secure 0 0 0) 0x7fc04005a1f0 con 0x7fc058100f00 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.831+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc04406cc50 msgr2=0x7fc04406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.831+0000 7fc05e10d640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc04406cc50 0x7fc04406f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc048009230 tx=0x7fc0480314e0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 msgr2=0x7fc058195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 0x7fc058195b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc04000e9a0 tx=0x7fc04000eda0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 shutdown_connections 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc04406cc50 0x7fc04406f110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc058100f00 0x7fc058195b70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 --2- 172.21.15.60:0/2745277635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc0580fde80 0x7fc058195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:39.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 >> 172.21.15.60:0/2745277635 conn(0x7fc0580f99b0 msgr2=0x7fc058104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:39.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 shutdown_connections 2024-09-21T10:38:39.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:39.832+0000 7fc05e10d640 1 -- 172.21.15.60:0/2745277635 wait complete. 2024-09-21T10:38:39.842 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:38:40.553 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-21T10:38:40.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T10:38:40.795 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:40.916 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:40 smithi060 ceph-mon[28215]: pgmap v214: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T10:38:40.916 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:40 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2745277635' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T10:38:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:40 smithi112 ceph-mon[35117]: pgmap v214: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T10:38:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:40 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2745277635' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T10:38:41.921 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:41.922 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:41.922 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:41.922 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:41.922 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:41 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:41.922 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:41 smithi060 ceph-mon[28215]: pgmap v215: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T10:38:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:41 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:41 smithi112 ceph-mon[35117]: pgmap v215: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 -- 172.21.15.60:0/733125810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 msgr2=0x7f08cc109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 --2- 172.21.15.60:0/733125810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc109b00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f08c00098b0 tx=0x7f08c002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 -- 172.21.15.60:0/733125810 shutdown_connections 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 --2- 172.21.15.60:0/733125810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc109b00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 --2- 172.21.15.60:0/733125810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc100c60 0x7f08cc101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 -- 172.21.15.60:0/733125810 >> 172.21.15.60:0/733125810 conn(0x7f08cc0fa730 msgr2=0x7f08cc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 -- 172.21.15.60:0/733125810 shutdown_connections 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.387+0000 7f08d1faa640 1 -- 172.21.15.60:0/733125810 wait complete. 2024-09-21T10:38:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08d1faa640 1 Processor -- start 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08d1faa640 1 -- start start 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08d1faa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc100c60 0x7f08cc0fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08d1faa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc0fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08d1faa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc100920 con 0x7f08cc101610 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08d1faa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0ff3d0 con 0x7f08cc100c60 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08caffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08caffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc0fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54146/0 (socket says 172.21.15.60:54146) 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.388+0000 7f08caffd640 1 -- 172.21.15.60:0/1208788856 learned_addr learned my addr 172.21.15.60:0/1208788856 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08cb7fe640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc100c60 0x7f08cc0fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08caffd640 1 -- 172.21.15.60:0/1208788856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc100c60 msgr2=0x7f08cc0fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08caffd640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc100c60 0x7f08cc0fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08caffd640 1 -- 172.21.15.60:0/1208788856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c0009560 con 0x7f08cc101610 2024-09-21T10:38:42.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08caffd640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc0fee90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f08c0006010 tx=0x7f08c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:42.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08c0004aa0 con 0x7f08cc101610 2024-09-21T10:38:42.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc0ff650 con 0x7f08cc101610 2024-09-21T10:38:42.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08c0004c00 con 0x7f08cc101610 2024-09-21T10:38:42.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08c0003a20 con 0x7f08cc101610 2024-09-21T10:38:42.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.389+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc1a1ef0 con 0x7f08cc101610 2024-09-21T10:38:42.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.390+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc068d30 con 0x7f08cc101610 2024-09-21T10:38:42.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.391+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f08c0003c60 con 0x7f08cc101610 2024-09-21T10:38:42.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.391+0000 7f08c8ff9640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f08b406cc50 0x7f08b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:42.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.391+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f08c00ad3e0 con 0x7f08cc101610 2024-09-21T10:38:42.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.391+0000 7f08cb7fe640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f08b406cc50 0x7f08b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:42.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.392+0000 7f08cb7fe640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f08b406cc50 0x7f08b406f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005e10 tx=0x7f08bc005da0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:42.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.395+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f08c00777d0 con 0x7f08cc101610 2024-09-21T10:38:42.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.601+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08cc101040 con 0x7f08cc101610 2024-09-21T10:38:42.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.602+0000 7f08c8ff9640 1 -- 172.21.15.60:0/1208788856 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4825 (secure 0 0 0) 0x7f08c007adf0 con 0x7f08cc101610 2024-09-21T10:38:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:38:42.604 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/524330333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":524330333},{"type":"v1","addr":"172.21.15.60:6827","nonce":524330333}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24329,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:38:28.451343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi060.lljnqu","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6829/4161459268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4161459268},{"type":"v1","addr":"172.21.15.60:6829","nonce":4161459268}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-21T10:38:42.605 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:38:42.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f08b406cc50 msgr2=0x7f08b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f08b406cc50 0x7f08b406f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f08bc005e10 tx=0x7f08bc005da0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 msgr2=0x7f08cc0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc0fee90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f08c0006010 tx=0x7f08c00055a0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 shutdown_connections 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f08b406cc50 0x7f08b406f110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc101610 0x7f08cc0fee90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 --2- 172.21.15.60:0/1208788856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08cc100c60 0x7f08cc0fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 >> 172.21.15.60:0/1208788856 conn(0x7f08cc0fa730 msgr2=0x7f08cc101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 shutdown_connections 2024-09-21T10:38:42.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:42.604+0000 7f08d1faa640 1 -- 172.21.15.60:0/1208788856 wait complete. 2024-09-21T10:38:42.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:42 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1208788856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T10:38:43.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:42 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1208788856' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T10:38:43.332 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-21T10:38:43.332 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T10:38:43.360 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T10:38:43.360 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-21T10:38:43.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:43.361 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-21T10:38:43.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:43.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-21T10:38:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-21T10:38:43.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:38:43.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:43.458 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-21T10:38:43.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:43.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-21T10:38:43.553 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-21T10:38:43.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:38:43.555 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-21T10:38:43.555 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T10:38:43.555 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:43.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T10:38:43.776 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:43.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:43 smithi112 ceph-mon[35117]: pgmap v216: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T10:38:44.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:43 smithi060 ceph-mon[28215]: pgmap v216: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-21T10:38:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 -- 172.21.15.60:0/407879858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c1015d0 msgr2=0x7fa65c109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 --2- 172.21.15.60:0/407879858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c1015d0 0x7fa65c109ac0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa650009880 tx=0x7fa65002a530 comp rx=0 tx=0).stop 2024-09-21T10:38:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 -- 172.21.15.60:0/407879858 shutdown_connections 2024-09-21T10:38:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 --2- 172.21.15.60:0/407879858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c1015d0 0x7fa65c109ac0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 --2- 172.21.15.60:0/407879858 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65c100cb0 0x7fa65c101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 -- 172.21.15.60:0/407879858 >> 172.21.15.60:0/407879858 conn(0x7fa65c0758a0 msgr2=0x7fa65c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 -- 172.21.15.60:0/407879858 shutdown_connections 2024-09-21T10:38:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 -- 172.21.15.60:0/407879858 wait complete. 2024-09-21T10:38:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.403+0000 7fa661450640 1 Processor -- start 2024-09-21T10:38:45.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa661450640 1 -- start start 2024-09-21T10:38:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa661450640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 0x7fa65c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa661450640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65c1015d0 0x7fa65c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa661450640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c19c4b0 con 0x7fa65c100cb0 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa661450640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c195a40 con 0x7fa65c1015d0 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 0x7fa65c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 0x7fa65c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55270/0 (socket says 172.21.15.60:55270) 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 -- 172.21.15.60:0/1547275931 learned_addr learned my addr 172.21.15.60:0/1547275931 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65a7fc640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65c1015d0 0x7fa65c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 -- 172.21.15.60:0/1547275931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65c1015d0 msgr2=0x7fa65c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65c1015d0 0x7fa65c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 -- 172.21.15.60:0/1547275931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009560 con 0x7fa65c100cb0 2024-09-21T10:38:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.404+0000 7fa65affd640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 0x7fa65c19b950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00b420 tx=0x7fa64c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.405+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64c011800 con 0x7fa65c100cb0 2024-09-21T10:38:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.405+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa64c011e20 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.405+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c195d20 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.405+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64c00f2e0 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.405+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c196240 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.406+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c068510 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.406+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa64c010380 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.407+0000 7fa643fff640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa64406cc50 0x7fa64406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.407+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa64c08bb90 con 0x7fa65c100cb0 2024-09-21T10:38:45.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.407+0000 7fa65a7fc640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa64406cc50 0x7fa64406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:45.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.407+0000 7fa65a7fc640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa64406cc50 0x7fa64406f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa650009230 tx=0x7fa6500058d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:45.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.411+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa64c055f00 con 0x7fa65c100cb0 2024-09-21T10:38:45.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.628+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa65c10ce00 con 0x7fa65c100cb0 2024-09-21T10:38:45.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.629+0000 7fa643fff640 1 -- 172.21.15.60:0/1547275931 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa64c059520 con 0x7fa65c100cb0 2024-09-21T10:38:45.632 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T10:38:45.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa64406cc50 msgr2=0x7fa64406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:45.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa64406cc50 0x7fa64406f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa650009230 tx=0x7fa6500058d0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 msgr2=0x7fa65c19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:45.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 0x7fa65c19b950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00b420 tx=0x7fa64c00b8e0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 shutdown_connections 2024-09-21T10:38:45.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fa64406cc50 0x7fa64406f110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa65c1015d0 0x7fa65c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 --2- 172.21.15.60:0/1547275931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c100cb0 0x7fa65c19b950 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:45.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 >> 172.21.15.60:0/1547275931 conn(0x7fa65c0758a0 msgr2=0x7fa65c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:45.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 shutdown_connections 2024-09-21T10:38:45.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:45.631+0000 7fa661450640 1 -- 172.21.15.60:0/1547275931 wait complete. 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T10:38:46.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T10:38:46.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T10:38:46.327 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T10:38:46.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:46.327 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-21T10:38:46.345 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T10:38:46.345 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T10:38:46.345 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T10:38:46.345 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-21T10:38:46.345 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-21T10:38:46.345 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T10:38:46.346 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42255sec preferred_lft 42255sec 2024-09-21T10:38:46.347 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-21T10:38:46.347 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-21T10:38:46.347 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T10:38:46.347 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:46.347 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-21T10:38:46.347 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T10:38:46.347 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:46.347 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T10:38:46.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2024-09-21T10:38:46.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2024-09-21T10:38:46.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2024-09-21T10:38:46.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T10:38:46.348 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T10:38:46.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:46.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:46.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:46.550 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T10:38:46.585 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-21T10:38:46.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:46.586 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-21T10:38:46.666 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-21T10:38:46.666 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T10:38:46.666 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T10:38:46.666 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T10:38:46.667 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T10:38:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:46.874 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:46 smithi060 ceph-mon[28215]: pgmap v217: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-21T10:38:46.874 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:46 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1547275931' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T10:38:46.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:46 smithi112 ceph-mon[35117]: pgmap v217: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-21T10:38:46.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:46 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1547275931' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T10:38:46.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:46.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:46.997 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-21T10:38:47.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:47.014 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-09-21T10:38:47.070 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:47.070 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T10:38:47.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T10:38:47.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T10:38:47.071 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T10:38:47.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:47.191 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T10:38:47.191 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T10:38:47.192 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T10:38:47.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:47.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:47.324 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:47.324 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T10:38:47.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-21T10:38:47.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T10:38:47.324 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T10:38:47.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:47.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:47.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T10:38:47.402 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:47.431 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T10:38:47.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T10:38:47.431 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:47.487 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T10:38:47.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:47.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T10:38:47.594 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T10:38:47.594 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T10:38:47.594 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2024-09-21T10:38:47.722 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T10:38:47.722 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T10:38:47.722 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2024-09-21T10:38:47.722 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.112:3300" 2024-09-21T10:38:47.723 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T10:38:47.727 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T10:38:47.727 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T10:38:47.727 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2024-09-21T10:38:47.728 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.112:3300" 2024-09-21T10:38:47.728 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T10:38:47.728 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.112:6789" 2024-09-21T10:38:47.728 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.112:6789:/ 2024-09-21T10:38:47.728 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6621b92e-7804-11ef-baf6-efdc52797490" will pass to kernel 2024-09-21T10:38:47.729 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T10:38:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-21T10:38:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T10:38:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T10:38:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T10:38:47.730 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T10:38:47.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:47.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:47.756 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T10:38:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T10:38:47.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:47.859 INFO:teuthology.orchestra.run.smithi060.stdout:client14582 2024-09-21T10:38:47.859 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:38:47.859 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T10:38:47.877 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T10:38:47.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T10:38:47.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:47.979 INFO:teuthology.orchestra.run.smithi060.stdout:client14582 2024-09-21T10:38:47.979 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T10:38:48.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T10:38:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:48.040 INFO:teuthology.orchestra.run.smithi060.stdout:client14582 2024-09-21T10:38:48.040 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6621b92e-7804-11ef-baf6-efdc52797490.client14582/status') 2024-09-21T10:38:48.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:48.103 INFO:teuthology.orchestra.run.smithi060.stdout:instance: client.14582 (3)192.168.0.1:0/1778017099 2024-09-21T10:38:48.103 INFO:teuthology.orchestra.run.smithi060.stdout:blocklisted: false 2024-09-21T10:38:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2024-09-21T10:38:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2024-09-21T10:38:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:70 bytes copied, 2.5504e-05 s, 2.7 MB/s 2024-09-21T10:38:48.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:48.111 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-21T10:38:48.111 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T10:38:48.111 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:48.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T10:38:48.320 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:48.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:48 smithi060 ceph-mon[28215]: pgmap v218: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-21T10:38:48.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:48 smithi112 ceph-mon[35117]: pgmap v218: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 -- 172.21.15.60:0/4276934381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec1049f0 msgr2=0x7fd8ec104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 --2- 172.21.15.60:0/4276934381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec1049f0 0x7fd8ec104dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009c20 tx=0x7fd8dc02a970 comp rx=0 tx=0).stop 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 -- 172.21.15.60:0/4276934381 shutdown_connections 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 --2- 172.21.15.60:0/4276934381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 --2- 172.21.15.60:0/4276934381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec1049f0 0x7fd8ec104dd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 -- 172.21.15.60:0/4276934381 >> 172.21.15.60:0/4276934381 conn(0x7fd8ec0758a0 msgr2=0x7fd8ec0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 -- 172.21.15.60:0/4276934381 shutdown_connections 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.056+0000 7fd8f136e640 1 -- 172.21.15.60:0/4276934381 wait complete. 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8f136e640 1 Processor -- start 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8f136e640 1 -- start start 2024-09-21T10:38:50.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8f136e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8f136e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ec1049f0 0x7fd8ec19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8f136e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec195900 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8f136e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec195a40 con 0x7fd8ec1049f0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8eaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8eaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55290/0 (socket says 172.21.15.60:55290) 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8eaffd640 1 -- 172.21.15.60:0/1494013030 learned_addr learned my addr 172.21.15.60:0/1494013030 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.057+0000 7fd8ea7fc640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ec1049f0 0x7fd8ec19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8eaffd640 1 -- 172.21.15.60:0/1494013030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ec1049f0 msgr2=0x7fd8ec19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8eaffd640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ec1049f0 0x7fd8ec19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8eaffd640 1 -- 172.21.15.60:0/1494013030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc009900 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8eaffd640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec19b8a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc02ae90 tx=0x7fd8dc0308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8dc02f590 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8dc030ca0 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8dc039450 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ec195cc0 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.058+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec1961b0 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.060+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec100130 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.060+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd8dc00a040 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.061+0000 7fd8d3fff640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd8d406cc50 0x7fd8d406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.061+0000 7fd8ea7fc640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd8d406cc50 0x7fd8d406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.061+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd8dc02c040 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.061+0000 7fd8ea7fc640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd8d406cc50 0x7fd8d406f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec197150 tx=0x7fd8e0005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:50.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.065+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd8dc077840 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.272+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8ec0fee50 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.272+0000 7fd8d3fff640 1 -- 172.21.15.60:0/1494013030 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd8dc07ae60 con 0x7fd8ec0fe9f0 2024-09-21T10:38:50.275 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.274+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd8d406cc50 msgr2=0x7fd8d406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.274+0000 7fd8f136e640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd8d406cc50 0x7fd8d406f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec197150 tx=0x7fd8e0005f90 comp rx=0 tx=0).stop 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.274+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 msgr2=0x7fd8ec19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.274+0000 7fd8f136e640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec19b8a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc02ae90 tx=0x7fd8dc0308a0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.274+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 shutdown_connections 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.275+0000 7fd8f136e640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fd8d406cc50 0x7fd8d406f110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.275+0000 7fd8f136e640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ec1049f0 0x7fd8ec19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.275+0000 7fd8f136e640 1 --2- 172.21.15.60:0/1494013030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8ec0fe9f0 0x7fd8ec19b8a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.275+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 >> 172.21.15.60:0/1494013030 conn(0x7fd8ec0758a0 msgr2=0x7fd8ec0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.275+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 shutdown_connections 2024-09-21T10:38:50.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:50.275+0000 7fd8f136e640 1 -- 172.21.15.60:0/1494013030 wait complete. 2024-09-21T10:38:50.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:50 smithi060 ceph-mon[28215]: pgmap v219: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:50.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:50 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1494013030' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T10:38:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:50 smithi112 ceph-mon[35117]: pgmap v219: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:38:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:50 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1494013030' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T10:38:51.014 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T10:38:51.014 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T10:38:51.015 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T10:38:51.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:51.015 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:51.034 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42268sec preferred_lft 42268sec 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-21T10:38:51.035 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-21T10:38:51.035 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T10:38:51.036 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T10:38:51.125 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:51.242 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:51.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:51.249 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T10:38:51.273 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-21T10:38:51.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:51.275 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-21T10:38:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-21T10:38:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T10:38:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T10:38:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T10:38:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T10:38:51.347 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:51.347 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T10:38:51.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T10:38:51.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T10:38:51.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T10:38:51.347 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T10:38:51.434 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:51.630 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:51.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:51.636 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-21T10:38:51.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:51.652 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-21T10:38:51.707 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:51.707 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T10:38:51.707 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T10:38:51.707 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T10:38:51.707 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T10:38:51.794 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:51.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:51.823 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T10:38:51.824 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T10:38:51.872 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:51.942 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:51.948 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T10:38:51.948 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-21T10:38:51.948 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-21T10:38:51.948 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T10:38:51.948 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-21T10:38:51.995 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:52.019 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:52.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T10:38:52.027 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:52.042 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T10:38:52.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T10:38:52.042 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:52.097 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T10:38:52.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:52.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T10:38:52.198 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T10:38:52.198 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T10:38:52.198 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-21T10:38:52.326 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T10:38:52.326 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T10:38:52.326 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-21T10:38:52.326 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.112:3300" 2024-09-21T10:38:52.327 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T10:38:52.331 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T10:38:52.331 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T10:38:52.331 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-21T10:38:52.331 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.112:3300" 2024-09-21T10:38:52.332 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T10:38:52.332 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.112:6789" 2024-09-21T10:38:52.332 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.112:6789:/ 2024-09-21T10:38:52.332 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6621b92e-7804-11ef-baf6-efdc52797490" will pass to kernel 2024-09-21T10:38:52.332 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T10:38:52.332 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-21T10:38:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T10:38:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T10:38:52.333 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T10:38:52.334 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T10:38:52.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:38:52.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:52.358 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T10:38:52.447 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T10:38:52.449 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:52.455 INFO:teuthology.orchestra.run.smithi112.stdout:client14588 2024-09-21T10:38:52.455 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:38:52.455 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T10:38:52.472 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T10:38:52.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T10:38:52.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:52.567 INFO:teuthology.orchestra.run.smithi112.stdout:client14588 2024-09-21T10:38:52.567 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T10:38:52.616 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T10:38:52.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:52.624 INFO:teuthology.orchestra.run.smithi112.stdout:client14588 2024-09-21T10:38:52.624 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6621b92e-7804-11ef-baf6-efdc52797490.client14588/status') 2024-09-21T10:38:52.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T10:38:52.682 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.14588 (3)172.21.15.112:0/3195548319 2024-09-21T10:38:52.682 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-09-21T10:38:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-09-21T10:38:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-09-21T10:38:52.682 INFO:teuthology.orchestra.run.smithi112.stderr:72 bytes copied, 2.2953e-05 s, 3.1 MB/s 2024-09-21T10:38:52.683 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-21T10:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T10:38:52.689 INFO:teuthology.run_tasks:Running task print... 2024-09-21T10:38:52.700 INFO:teuthology.task.print:**** done client 2024-09-21T10:38:52.700 INFO:teuthology.run_tasks:Running task parallel... 2024-09-21T10:38:52.766 INFO:teuthology.task.parallel:starting parallel... 2024-09-21T10:38:52.766 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T10:38:52.767 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T10:38:52.767 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:52.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-21T10:38:52.768 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T10:38:52.768 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-21T10:38:52.772 INFO:tasks.workunit:Pulling workunits from ref 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:38:52.772 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T10:38:52.772 INFO:tasks.workunit:timeout=3h 2024-09-21T10:38:52.772 INFO:tasks.workunit:cleanup=True 2024-09-21T10:38:52.773 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:52.794 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T10:38:52.794 INFO:teuthology.orchestra.run.smithi060.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-21T10:38:52.794 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:38:52.795 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T10:38:52.795 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T10:38:52.795 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 10:38:15.012325344 +0000 2024-09-21T10:38:52.795 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 10:38:47.752677266 +0000 2024-09-21T10:38:52.795 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 10:38:15.012325344 +0000 2024-09-21T10:38:52.795 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T10:38:52.795 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T10:38:52.858 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:52 smithi060 ceph-mon[28215]: pgmap v220: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T10:38:52.858 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:52.867 DEBUG:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:52.882 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-21T10:38:52.882 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-21T10:38:52.883 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T10:38:52.883 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T10:38:52.883 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T10:38:52.883 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-21 10:38:52.859626638 +0000 2024-09-21T10:38:52.883 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-21 10:38:52.859626638 +0000 2024-09-21T10:38:52.883 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-21 10:38:15.012325344 +0000 2024-09-21T10:38:52.883 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T10:38:52.883 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T10:38:52.943 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:52 smithi112 ceph-mon[35117]: pgmap v220: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T10:38:52.944 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:38:52.951 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:38:52.951 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:38:52.968 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T10:38:52.999 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:53.007 INFO:tasks.workunit.client.1.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T10:38:54.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 -- 172.21.15.60:0/1598901666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5898100d90 msgr2=0x7f5898101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:54.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 --2- 172.21.15.60:0/1598901666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5898100d90 0x7f5898101210 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5888009880 tx=0x7f588802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 -- 172.21.15.60:0/1598901666 shutdown_connections 2024-09-21T10:38:54.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 --2- 172.21.15.60:0/1598901666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5898100d90 0x7f5898101210 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 --2- 172.21.15.60:0/1598901666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58980ffb90 0x7f58980fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 -- 172.21.15.60:0/1598901666 >> 172.21.15.60:0/1598901666 conn(0x7f58980fb320 msgr2=0x7f58980fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 -- 172.21.15.60:0/1598901666 shutdown_connections 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.623+0000 7f589f30f640 1 -- 172.21.15.60:0/1598901666 wait complete. 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589f30f640 1 Processor -- start 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589f30f640 1 -- start start 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589f30f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 0x7f58981956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589f30f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5898100d90 0x7f5898195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589f30f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981961f0 con 0x7f58980ffb90 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589f30f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898196360 con 0x7f5898100d90 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589d0ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 0x7f58981956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589d0ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 0x7f58981956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44932/0 (socket says 172.21.15.60:44932) 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.624+0000 7f589d0ab640 1 -- 172.21.15.60:0/1970597351 learned_addr learned my addr 172.21.15.60:0/1970597351 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589c8aa640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5898100d90 0x7f5898195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589d0ab640 1 -- 172.21.15.60:0/1970597351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5898100d90 msgr2=0x7f5898195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:54.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589d0ab640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5898100d90 0x7f5898195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589d0ab640 1 -- 172.21.15.60:0/1970597351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5888009560 con 0x7f58980ffb90 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589c8aa640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5898100d90 0x7f5898195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589d0ab640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 0x7f58981956e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f589400b400 tx=0x7f589400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5894011800 con 0x7f58980ffb90 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5894011e20 con 0x7f58980ffb90 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589819ae00 con 0x7f58980ffb90 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f589400f2e0 con 0x7f58980ffb90 2024-09-21T10:38:54.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.625+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589819b350 con 0x7f58980ffb90 2024-09-21T10:38:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.626+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589818f7b0 con 0x7f58980ffb90 2024-09-21T10:38:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.627+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5894010380 con 0x7f58980ffb90 2024-09-21T10:38:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.627+0000 7f588e7fc640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f588406cc60 0x7f588406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.627+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f589408bfe0 con 0x7f58980ffb90 2024-09-21T10:38:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.627+0000 7f589c8aa640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f588406cc60 0x7f588406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:54.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.628+0000 7f589c8aa640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f588406cc60 0x7f588406f120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5888031540 tx=0x7f5888000bc0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:54.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.632+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5894056350 con 0x7f58980ffb90 2024-09-21T10:38:54.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:54 smithi060 ceph-mon[28215]: pgmap v221: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T10:38:54.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.805+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f5898108820 con 0x7f58980ffb90 2024-09-21T10:38:54.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.810+0000 7f588e7fc640 1 -- 172.21.15.60:0/1970597351 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v43)=0 v43) v1 ==== 126+0+0 (secure 0 0 0) 0x7f5894059970 con 0x7f58980ffb90 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f588406cc60 msgr2=0x7f588406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f588406cc60 0x7f588406f120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5888031540 tx=0x7f5888000bc0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 msgr2=0x7f58981956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 0x7f58981956e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f589400b400 tx=0x7f589400b8c0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 shutdown_connections 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f588406cc60 0x7f588406f120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5898100d90 0x7f5898195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 --2- 172.21.15.60:0/1970597351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58980ffb90 0x7f58981956e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 >> 172.21.15.60:0/1970597351 conn(0x7f58980fb320 msgr2=0x7f58981044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 shutdown_connections 2024-09-21T10:38:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:54.812+0000 7f589f30f640 1 -- 172.21.15.60:0/1970597351 wait complete. 2024-09-21T10:38:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:54 smithi112 ceph-mon[35117]: pgmap v221: 65 pgs: 65 active+clean; 579 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T10:38:55.500 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T10:38:55.500 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:38:55.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T10:38:55.746 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:56.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:55 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1970597351' entity='client.admin' 2024-09-21T10:38:56.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:56.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:56.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:56.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:55 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:56.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:55 smithi060 ceph-mon[28215]: pgmap v222: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T10:38:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:55 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1970597351' entity='client.admin' 2024-09-21T10:38:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:55 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:38:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:55 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:38:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:55 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:38:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:55 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:38:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:55 smithi112 ceph-mon[35117]: pgmap v222: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T10:38:57.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 -- 172.21.15.60:0/4178479076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 msgr2=0x7fbf500feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:57.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 --2- 172.21.15.60:0/4178479076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf500feef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009880 tx=0x7fbf4c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 -- 172.21.15.60:0/4178479076 shutdown_connections 2024-09-21T10:38:57.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 --2- 172.21.15.60:0/4178479076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500ffcf0 0x7fbf50100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 --2- 172.21.15.60:0/4178479076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf500feef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 -- 172.21.15.60:0/4178479076 >> 172.21.15.60:0/4178479076 conn(0x7fbf500fa280 msgr2=0x7fbf500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 -- 172.21.15.60:0/4178479076 shutdown_connections 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 -- 172.21.15.60:0/4178479076 wait complete. 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.346+0000 7fbf587da640 1 Processor -- start 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf587da640 1 -- start start 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf587da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf50068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf587da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500ffcf0 0x7fbf5019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:57.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf587da640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5019a9b0 con 0x7fbf500feaf0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf587da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5019aaf0 con 0x7fbf500ffcf0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf50068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf50068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44948/0 (socket says 172.21.15.60:44948) 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 -- 172.21.15.60:0/2565225455 learned_addr learned my addr 172.21.15.60:0/2565225455 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf55d75640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500ffcf0 0x7fbf5019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 -- 172.21.15.60:0/2565225455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500ffcf0 msgr2=0x7fbf5019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500ffcf0 0x7fbf5019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 -- 172.21.15.60:0/2565225455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009560 con 0x7fbf500feaf0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.347+0000 7fbf56576640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf50068790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c02a9c0 tx=0x7fbf4c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.348+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4c004aa0 con 0x7fbf500feaf0 2024-09-21T10:38:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.348+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf4c004c00 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.348+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5019ad40 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.348+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4c003a80 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.348+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5019b230 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.349+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5018e670 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.349+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbf4c003d40 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.350+0000 7fbf477fe640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbf3c06cc50 0x7fbf3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.350+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbf4c0ad3e0 con 0x7fbf500feaf0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.350+0000 7fbf55d75640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbf3c06cc50 0x7fbf3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.350+0000 7fbf55d75640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbf3c06cc50 0x7fbf3c06f110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbf50068d10 tx=0x7fbf4000b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:38:57.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.354+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbf4c077800 con 0x7fbf500feaf0 2024-09-21T10:38:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.529+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fbf501076e0 con 0x7fbf500feaf0 2024-09-21T10:38:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.530+0000 7fbf477fe640 1 -- 172.21.15.60:0/2565225455 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) v1 ==== 155+0+0 (secure 0 0 0) 0x7fbf4c07ae20 con 0x7fbf500feaf0 2024-09-21T10:38:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbf3c06cc50 msgr2=0x7fbf3c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbf3c06cc50 0x7fbf3c06f110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbf50068d10 tx=0x7fbf4000b390 comp rx=0 tx=0).stop 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 msgr2=0x7fbf50068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf50068790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c02a9c0 tx=0x7fbf4c0054f0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 shutdown_connections 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbf3c06cc50 0x7fbf3c06f110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf500ffcf0 0x7fbf5019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 --2- 172.21.15.60:0/2565225455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500feaf0 0x7fbf50068790 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 >> 172.21.15.60:0/2565225455 conn(0x7fbf500fa280 msgr2=0x7fbf501033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 shutdown_connections 2024-09-21T10:38:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:57.532+0000 7fbf587da640 1 -- 172.21.15.60:0/2565225455 wait complete. 2024-09-21T10:38:58.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T10:38:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:38:58.744 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:38:58 smithi060 ceph-mon[28215]: pgmap v223: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T10:38:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:38:58 smithi112 ceph-mon[35117]: pgmap v223: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T10:39:00.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.985+0000 7f0b97e0c640 1 -- 172.21.15.60:0/51085860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 msgr2=0x7f0b90073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:00.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.985+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/51085860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b90073370 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009880 tx=0x7f0b8002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 -- 172.21.15.60:0/51085860 shutdown_connections 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/51085860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b90073370 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/51085860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b900744e0 0x7f0b90072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 -- 172.21.15.60:0/51085860 >> 172.21.15.60:0/51085860 conn(0x7f0b900fb320 msgr2=0x7f0b900fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 -- 172.21.15.60:0/51085860 shutdown_connections 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 -- 172.21.15.60:0/51085860 wait complete. 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 Processor -- start 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 -- start start 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b9019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.986+0000 7f0b97e0c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b900744e0 0x7f0b9019c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b97e0c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9019c730 con 0x7f0b90072f10 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b97e0c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9019c8a0 con 0x7f0b900744e0 2024-09-21T10:39:00.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b9019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b9019bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44956/0 (socket says 172.21.15.60:44956) 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 -- 172.21.15.60:0/3386690710 learned_addr learned my addr 172.21.15.60:0/3386690710 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b953a7640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b900744e0 0x7f0b9019c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 -- 172.21.15.60:0/3386690710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b900744e0 msgr2=0x7f0b9019c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b900744e0 0x7f0b9019c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 -- 172.21.15.60:0/3386690710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80009560 con 0x7f0b90072f10 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b95ba8640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b9019bc20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00e970 tx=0x7f0b8c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b8c00cc90 con 0x7f0b90072f10 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b8c00cdf0 con 0x7f0b90072f10 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b901a1330 con 0x7f0b90072f10 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b8c010430 con 0x7f0b90072f10 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.987+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b901a1900 con 0x7f0b90072f10 2024-09-21T10:39:00.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.988+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9010edb0 con 0x7f0b90072f10 2024-09-21T10:39:00.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.989+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0b8c0046c0 con 0x7f0b90072f10 2024-09-21T10:39:00.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.989+0000 7f0b86ffd640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0b7c06cc50 0x7f0b7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:00.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.990+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0b8c014070 con 0x7f0b90072f10 2024-09-21T10:39:00.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.990+0000 7f0b953a7640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0b7c06cc50 0x7f0b7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:00.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.990+0000 7f0b953a7640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0b7c06cc50 0x7f0b7c06f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b80000c00 tx=0x7f0b800314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:00.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:38:59.994+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0b8c056c50 con 0x7f0b90072f10 2024-09-21T10:39:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.171+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f0b9010efb0 con 0x7f0b90072f10 2024-09-21T10:39:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.171+0000 7f0b86ffd640 1 -- 172.21.15.60:0/3386690710 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) v1 ==== 163+0+0 (secure 0 0 0) 0x7f0b8c05a270 con 0x7f0b90072f10 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0b7c06cc50 msgr2=0x7f0b7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0b7c06cc50 0x7f0b7c06f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b80000c00 tx=0x7f0b800314e0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 msgr2=0x7f0b9019bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b9019bc20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00e970 tx=0x7f0b8c00ee30 comp rx=0 tx=0).stop 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 shutdown_connections 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f0b7c06cc50 0x7f0b7c06f110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0b900744e0 0x7f0b9019c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 --2- 172.21.15.60:0/3386690710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b90072f10 0x7f0b9019bc20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 >> 172.21.15.60:0/3386690710 conn(0x7f0b900fb320 msgr2=0x7f0b90101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 shutdown_connections 2024-09-21T10:39:00.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:00.174+0000 7f0b97e0c640 1 -- 172.21.15.60:0/3386690710 wait complete. 2024-09-21T10:39:00.830 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:00 smithi060 ceph-mon[28215]: pgmap v224: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T10:39:00.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T10:39:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:00 smithi112 ceph-mon[35117]: pgmap v224: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-21T10:39:01.059 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:39:02.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 -- 172.21.15.60:0/1693317863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 msgr2=0x7face0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:02.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 --2- 172.21.15.60:0/1693317863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face0101210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7facd0009880 tx=0x7facd002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 -- 172.21.15.60:0/1693317863 shutdown_connections 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 --2- 172.21.15.60:0/1693317863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face0101210 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 --2- 172.21.15.60:0/1693317863 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7face00ffb90 0x7face00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 -- 172.21.15.60:0/1693317863 >> 172.21.15.60:0/1693317863 conn(0x7face00fb320 msgr2=0x7face00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 -- 172.21.15.60:0/1693317863 shutdown_connections 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 -- 172.21.15.60:0/1693317863 wait complete. 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 Processor -- start 2024-09-21T10:39:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.593+0000 7face5d59640 1 -- start start 2024-09-21T10:39:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7face5d59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7face00ffb90 0x7face0074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7face5d59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7face5d59640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face0072de0 con 0x7face0100d90 2024-09-21T10:39:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7face5d59640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face0072f50 con 0x7face00ffb90 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face00728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44968/0 (socket says 172.21.15.60:44968) 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 -- 172.21.15.60:0/2017581271 learned_addr learned my addr 172.21.15.60:0/2017581271 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdf7fe640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7face00ffb90 0x7face0074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 -- 172.21.15.60:0/2017581271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7face00ffb90 msgr2=0x7face0074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7face00ffb90 0x7face0074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 -- 172.21.15.60:0/2017581271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0009560 con 0x7face0100d90 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.594+0000 7facdeffd640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face00728a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7facd0005610 tx=0x7facd0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.595+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd0004ba0 con 0x7face0100d90 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.595+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facd0004d00 con 0x7face0100d90 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.595+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face00731d0 con 0x7face0100d90 2024-09-21T10:39:02.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.595+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face019d6a0 con 0x7face0100d90 2024-09-21T10:39:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.595+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd0003bd0 con 0x7face0100d90 2024-09-21T10:39:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.596+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face00fff90 con 0x7face0100d90 2024-09-21T10:39:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.596+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7facd0031640 con 0x7face0100d90 2024-09-21T10:39:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.597+0000 7facdcff9640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faccc06cc50 0x7faccc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.597+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7facd00ad590 con 0x7face0100d90 2024-09-21T10:39:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.597+0000 7facdf7fe640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faccc06cc50 0x7faccc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.597+0000 7facdf7fe640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faccc06cc50 0x7faccc06f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facc80058c0 tx=0x7facc800a2d0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.601+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7facd00779b0 con 0x7face0100d90 2024-09-21T10:39:02.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:02 smithi060 ceph-mon[28215]: pgmap v225: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-21T10:39:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.775+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7face002c3e0 con 0x7face0100d90 2024-09-21T10:39:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.775+0000 7facdcff9640 1 -- 172.21.15.60:0/2017581271 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) v1 ==== 135+0+0 (secure 0 0 0) 0x7facd007afd0 con 0x7face0100d90 2024-09-21T10:39:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faccc06cc50 msgr2=0x7faccc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faccc06cc50 0x7faccc06f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facc80058c0 tx=0x7facc800a2d0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 msgr2=0x7face00728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face00728a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7facd0005610 tx=0x7facd0005640 comp rx=0 tx=0).stop 2024-09-21T10:39:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 shutdown_connections 2024-09-21T10:39:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faccc06cc50 0x7faccc06f110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face0100d90 0x7face00728a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 --2- 172.21.15.60:0/2017581271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7face00ffb90 0x7face0074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 >> 172.21.15.60:0/2017581271 conn(0x7face00fb320 msgr2=0x7face01044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 shutdown_connections 2024-09-21T10:39:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:02.777+0000 7face5d59640 1 -- 172.21.15.60:0/2017581271 wait complete. 2024-09-21T10:39:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:02 smithi112 ceph-mon[35117]: pgmap v225: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-21T10:39:03.598 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T10:39:03.812 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:39:04.843 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:04 smithi060 ceph-mon[28215]: pgmap v226: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T10:39:04.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:04 smithi112 ceph-mon[35117]: pgmap v226: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T10:39:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 -- 172.21.15.60:0/3427244424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 msgr2=0x7f09a41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 --2- 172.21.15.60:0/3427244424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a41031c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0994009880 tx=0x7f099402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 -- 172.21.15.60:0/3427244424 shutdown_connections 2024-09-21T10:39:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 --2- 172.21.15.60:0/3427244424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a41031c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 --2- 172.21.15.60:0/3427244424 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a40fe400 0x7f09a4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 -- 172.21.15.60:0/3427244424 >> 172.21.15.60:0/3427244424 conn(0x7f09a40fa230 msgr2=0x7f09a40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 -- 172.21.15.60:0/3427244424 shutdown_connections 2024-09-21T10:39:05.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 -- 172.21.15.60:0/3427244424 wait complete. 2024-09-21T10:39:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.372+0000 7f09abe0f640 1 Processor -- start 2024-09-21T10:39:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09abe0f640 1 -- start start 2024-09-21T10:39:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09abe0f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a40fe400 0x7f09a419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:05.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09abe0f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09abe0f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a419c6b0 con 0x7f09a4100d50 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09abe0f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a419c820 con 0x7f09a40fe400 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a93aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a93aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a419c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43528/0 (socket says 172.21.15.60:43528) 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a93aa640 1 -- 172.21.15.60:0/2084852511 learned_addr learned my addr 172.21.15.60:0/2084852511 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a9bab640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a40fe400 0x7f09a419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a93aa640 1 -- 172.21.15.60:0/2084852511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a40fe400 msgr2=0x7f09a419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a93aa640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a40fe400 0x7f09a419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.373+0000 7f09a93aa640 1 -- 172.21.15.60:0/2084852511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009560 con 0x7f09a4100d50 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.374+0000 7f09a93aa640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a419c0e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0994005520 tx=0x7f0994005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.374+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0994004aa0 con 0x7f09a4100d50 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.374+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0994004c00 con 0x7f09a4100d50 2024-09-21T10:39:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.374+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a41a1260 con 0x7f09a4100d50 2024-09-21T10:39:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.374+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0994003b10 con 0x7f09a4100d50 2024-09-21T10:39:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.374+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a41a17d0 con 0x7f09a4100d50 2024-09-21T10:39:05.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.375+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a410ed50 con 0x7f09a4100d50 2024-09-21T10:39:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.375+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0994031d20 con 0x7f09a4100d50 2024-09-21T10:39:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.376+0000 7f099affd640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f099006cc50 0x7f099006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.376+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f09940ad350 con 0x7f09a4100d50 2024-09-21T10:39:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.376+0000 7f09a9bab640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f099006cc50 0x7f099006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.376+0000 7f09a9bab640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f099006cc50 0x7f099006f110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09a000bbe0 tx=0x7f09a000b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.380+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f09940777f0 con 0x7f09a4100d50 2024-09-21T10:39:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.569+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}) v1 -- 0x7f09a4101710 con 0x7f099006cc50 2024-09-21T10:39:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.574+0000 7f099affd640 1 -- 172.21.15.60:0/2084852511 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f09a4101710 con 0x7f099006cc50 2024-09-21T10:39:05.576 INFO:teuthology.orchestra.run.smithi060.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f099006cc50 msgr2=0x7f099006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f099006cc50 0x7f099006f110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09a000bbe0 tx=0x7f09a000b390 comp rx=0 tx=0).stop 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 msgr2=0x7f09a419c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a419c0e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0994005520 tx=0x7f0994005550 comp rx=0 tx=0).stop 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 shutdown_connections 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f099006cc50 0x7f099006f110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a4100d50 0x7f09a419c0e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 --2- 172.21.15.60:0/2084852511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09a40fe400 0x7f09a419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 >> 172.21.15.60:0/2084852511 conn(0x7f09a40fa230 msgr2=0x7f09a40fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 shutdown_connections 2024-09-21T10:39:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:05.577+0000 7f09abe0f640 1 -- 172.21.15.60:0/2084852511 wait complete. 2024-09-21T10:39:06.315 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T10:39:06.315 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:39:06.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-21T10:39:06.538 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:39:06.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: pgmap v227: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T10:39:06.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:06.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:39:06.879 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:06.880 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:39:06.880 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:39:06.880 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:39:06.880 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:06 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: pgmap v227: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T10:39:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:39:06.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:06.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:39:06.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:39:06.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:39:06.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:06 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:07.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:07 smithi060 ceph-mon[28215]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:39:07.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:07 smithi112 ceph-mon[35117]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T10:39:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:08.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 -- 172.21.15.60:0/1560143614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 msgr2=0x7f4d1c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1560143614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c1053a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d100098b0 tx=0x7f4d1002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 -- 172.21.15.60:0/1560143614 shutdown_connections 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1560143614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c1053a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1560143614 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c100680 0x7f4d1c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 -- 172.21.15.60:0/1560143614 >> 172.21.15.60:0/1560143614 conn(0x7f4d1c0fa280 msgr2=0x7f4d1c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 -- 172.21.15.60:0/1560143614 shutdown_connections 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.400+0000 7f4d21a15640 1 -- 172.21.15.60:0/1560143614 wait complete. 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d21a15640 1 Processor -- start 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d21a15640 1 -- start start 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d21a15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c100680 0x7f4d1c197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:08.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d21a15640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d21a15640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c198460 con 0x7f4d1c102fb0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d21a15640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c1985d0 con 0x7f4d1c100680 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43540/0 (socket says 172.21.15.60:43540) 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1a7fc640 1 -- 172.21.15.60:0/1177935673 learned_addr learned my addr 172.21.15.60:0/1177935673 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1affd640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c100680 0x7f4d1c197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1a7fc640 1 -- 172.21.15.60:0/1177935673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c100680 msgr2=0x7f4d1c197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1a7fc640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c100680 0x7f4d1c197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.401+0000 7f4d1a7fc640 1 -- 172.21.15.60:0/1177935673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10009560 con 0x7f4d1c102fb0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.402+0000 7f4d1a7fc640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c197e90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d100055a0 tx=0x7f4d100055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.402+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d10004aa0 con 0x7f4d1c102fb0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.402+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d10004c00 con 0x7f4d1c102fb0 2024-09-21T10:39:08.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.402+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c19cfa0 con 0x7f4d1c102fb0 2024-09-21T10:39:08.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.402+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d10003b50 con 0x7f4d1c102fb0 2024-09-21T10:39:08.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.402+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c19d460 con 0x7f4d1c102fb0 2024-09-21T10:39:08.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.403+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c100a60 con 0x7f4d1c102fb0 2024-09-21T10:39:08.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.404+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4d10003cb0 con 0x7f4d1c102fb0 2024-09-21T10:39:08.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.404+0000 7f4d20a13640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4d0406cc50 0x7f4d0406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:08.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.404+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4d100ad420 con 0x7f4d1c102fb0 2024-09-21T10:39:08.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.404+0000 7f4d1affd640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4d0406cc50 0x7f4d0406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:08.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.405+0000 7f4d1affd640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4d0406cc50 0x7f4d0406f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bbe0 tx=0x7f4d0c00b390 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.409+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4d10077840 con 0x7f4d1c102fb0 2024-09-21T10:39:08.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.620+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d1c02c4a0 con 0x7f4d0406cc50 2024-09-21T10:39:08.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.622+0000 7f4d20a13640 1 -- 172.21.15.60:0/1177935673 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f4d1c02c4a0 con 0x7f4d0406cc50 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4d0406cc50 msgr2=0x7f4d0406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4d0406cc50 0x7f4d0406f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bbe0 tx=0x7f4d0c00b390 comp rx=0 tx=0).stop 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 msgr2=0x7f4d1c197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c197e90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d100055a0 tx=0x7f4d100055d0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 shutdown_connections 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f4d0406cc50 0x7f4d0406f110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d1c102fb0 0x7f4d1c197e90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 --2- 172.21.15.60:0/1177935673 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d1c100680 0x7f4d1c197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 >> 172.21.15.60:0/1177935673 conn(0x7f4d1c0fa280 msgr2=0x7f4d1c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 shutdown_connections 2024-09-21T10:39:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.624+0000 7f4d21a15640 1 -- 172.21.15.60:0/1177935673 wait complete. 2024-09-21T10:39:08.635 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 -- 172.21.15.60:0/1159168904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 msgr2=0x7f7694102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 --2- 172.21.15.60:0/1159168904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f7694102a70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76840098b0 tx=0x7f768402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 -- 172.21.15.60:0/1159168904 shutdown_connections 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 --2- 172.21.15.60:0/1159168904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7694102fb0 0x7f76941053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 --2- 172.21.15.60:0/1159168904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f7694102a70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 -- 172.21.15.60:0/1159168904 >> 172.21.15.60:0/1159168904 conn(0x7f76940fa280 msgr2=0x7f76940fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 -- 172.21.15.60:0/1159168904 shutdown_connections 2024-09-21T10:39:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.716+0000 7f769a559640 1 -- 172.21.15.60:0/1159168904 wait complete. 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.717+0000 7f769a559640 1 Processor -- start 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.717+0000 7f769a559640 1 -- start start 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.717+0000 7f769a559640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f76941956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.717+0000 7f769a559640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7694102fb0 0x7f7694195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.717+0000 7f769a559640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694196200 con 0x7f7694100680 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.717+0000 7f769a559640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694196370 con 0x7f7694102fb0 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f76941956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f76941956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43564/0 (socket says 172.21.15.60:43564) 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 -- 172.21.15.60:0/1447775279 learned_addr learned my addr 172.21.15.60:0/1447775279 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f768bfff640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7694102fb0 0x7f7694195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 -- 172.21.15.60:0/1447775279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7694102fb0 msgr2=0x7f7694195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7694102fb0 0x7f7694195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 -- 172.21.15.60:0/1447775279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009560 con 0x7f7694100680 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7693fff640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f76941956f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7684004650 tx=0x7f76840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7684004aa0 con 0x7f7694100680 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7684005d50 con 0x7f7694100680 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.718+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769419adb0 con 0x7f7694100680 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.719+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76840039f0 con 0x7f7694100680 2024-09-21T10:39:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.719+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769419b240 con 0x7f7694100680 2024-09-21T10:39:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.720+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7694108810 con 0x7f7694100680 2024-09-21T10:39:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.720+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7684031c00 con 0x7f7694100680 2024-09-21T10:39:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.721+0000 7f7691ffb640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f768006cc50 0x7f768006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.721+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f76840ad2f0 con 0x7f7694100680 2024-09-21T10:39:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.721+0000 7f768bfff640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f768006cc50 0x7f768006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:08.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.722+0000 7f768bfff640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f768006cc50 0x7f768006f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7694196c10 tx=0x7f767c005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:08.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.726+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7684077710 con 0x7f7694100680 2024-09-21T10:39:08.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.938+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76941039d0 con 0x7f768006cc50 2024-09-21T10:39:08.940 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:08 smithi060 ceph-mon[28215]: pgmap v228: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.939+0000 7f7691ffb640 1 -- 172.21.15.60:0/1447775279 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f76941039d0 con 0x7f768006cc50 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f768006cc50 msgr2=0x7f768006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f768006cc50 0x7f768006f110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7694196c10 tx=0x7f767c005f90 comp rx=0 tx=0).stop 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 msgr2=0x7f76941956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f76941956f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7684004650 tx=0x7f76840055a0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 shutdown_connections 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f768006cc50 0x7f768006f110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7694102fb0 0x7f7694195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 --2- 172.21.15.60:0/1447775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7694100680 0x7f76941956f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 >> 172.21.15.60:0/1447775279 conn(0x7f76940fa280 msgr2=0x7f76940fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 shutdown_connections 2024-09-21T10:39:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:08.942+0000 7f769a559640 1 -- 172.21.15.60:0/1447775279 wait complete. 2024-09-21T10:39:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:08 smithi112 ceph-mon[35117]: pgmap v228: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 -- 172.21.15.60:0/638970781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 msgr2=0x7f40600fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 --2- 172.21.15.60:0/638970781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40600fffd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f405c009880 tx=0x7f405c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 -- 172.21.15.60:0/638970781 shutdown_connections 2024-09-21T10:39:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 --2- 172.21.15.60:0/638970781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060100dd0 0x7f4060101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 --2- 172.21.15.60:0/638970781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40600fffd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 -- 172.21.15.60:0/638970781 >> 172.21.15.60:0/638970781 conn(0x7f40600fb360 msgr2=0x7f40600fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 -- 172.21.15.60:0/638970781 shutdown_connections 2024-09-21T10:39:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.033+0000 7f406865d640 1 -- 172.21.15.60:0/638970781 wait complete. 2024-09-21T10:39:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f406865d640 1 Processor -- start 2024-09-21T10:39:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f406865d640 1 -- start start 2024-09-21T10:39:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f406865d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40601956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f406865d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060100dd0 0x7f4060195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f406865d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601961b0 con 0x7f40600ffbd0 2024-09-21T10:39:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f406865d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060196320 con 0x7f4060100dd0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f40663f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40601956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f40663f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40601956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43584/0 (socket says 172.21.15.60:43584) 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f40663f9640 1 -- 172.21.15.60:0/3334688757 learned_addr learned my addr 172.21.15.60:0/3334688757 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f4065bf8640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060100dd0 0x7f4060195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f40663f9640 1 -- 172.21.15.60:0/3334688757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060100dd0 msgr2=0x7f4060195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f40663f9640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060100dd0 0x7f4060195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.034+0000 7f40663f9640 1 -- 172.21.15.60:0/3334688757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009560 con 0x7f40600ffbd0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.035+0000 7f40663f9640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40601956a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f405c004650 tx=0x7f405c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.035+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c004aa0 con 0x7f40600ffbd0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.035+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f405c005d50 con 0x7f40600ffbd0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.035+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406019ad10 con 0x7f40600ffbd0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.035+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c0039e0 con 0x7f40600ffbd0 2024-09-21T10:39:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.035+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406019b230 con 0x7f40600ffbd0 2024-09-21T10:39:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.036+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406018f770 con 0x7f40600ffbd0 2024-09-21T10:39:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.037+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f405c031c00 con 0x7f40600ffbd0 2024-09-21T10:39:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.037+0000 7f40577fe640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f404c06cc50 0x7f404c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.037+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f405c0ad310 con 0x7f40600ffbd0 2024-09-21T10:39:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.037+0000 7f4065bf8640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f404c06cc50 0x7f404c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.038+0000 7f4065bf8640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f404c06cc50 0x7f404c06f110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4060196b70 tx=0x7f4050005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.042+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f405c077700 con 0x7f40600ffbd0 2024-09-21T10:39:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.253+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f406002c4f0 con 0x7f404c06cc50 2024-09-21T10:39:09.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.263+0000 7f40577fe640 1 -- 172.21.15.60:0/3334688757 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f406002c4f0 con 0x7f404c06cc50 2024-09-21T10:39:09.265 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:39:09.265 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (5m) 28s ago 6m 24.7M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:39:09.265 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (7m) 28s ago 7m 7520k - 18.2.4-871-g6a1bdf85 0adab276c97e 6a6a2a8801c8 2024-09-21T10:39:09.265 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (6m) 35s ago 6m 7251k - 18.2.4-871-g6a1bdf85 0adab276c97e 7163dd4d91a2 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (7m) 28s ago 7m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (6m) 35s ago 6m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (4m) 28s ago 6m 82.1M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (48s) 28s ago 48s 19.0M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (55s) 28s ago 54s 11.9M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (46s) 35s ago 45s 13.7M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (52s) 35s ago 52s 16.0M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:9283,8765,8443 running (8m) 28s ago 8m 487M - 18.2.4-871-g6a1bdf85 0adab276c97e d9748f7fa031 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (6m) 35s ago 6m 439M - 18.2.4-871-g6a1bdf85 0adab276c97e 644d995876b0 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (8m) 28s ago 8m 45.6M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (5m) 35s ago 5m 35.2M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (7m) 28s ago 7m 15.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:39:09.266 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 35s ago 6m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (4m) 28s ago 4m 50.6M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (4m) 28s ago 4m 47.2M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (3m) 28s ago 3m 54.7M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (3m) 35s ago 3m 54.2M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (2m) 35s ago 2m 43.7M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (2m) 35s ago 2m 52.2M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:39:09.267 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (4m) 28s ago 6m 56.4M - 2.43.0 a07b618ecd1d 9edc141eabb8 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f404c06cc50 msgr2=0x7f404c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f404c06cc50 0x7f404c06f110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4060196b70 tx=0x7f4050005f90 comp rx=0 tx=0).stop 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 msgr2=0x7f40601956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40601956a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f405c004650 tx=0x7f405c0055a0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 shutdown_connections 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f404c06cc50 0x7f404c06f110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4060100dd0 0x7f4060195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 --2- 172.21.15.60:0/3334688757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40600ffbd0 0x7f40601956a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 >> 172.21.15.60:0/3334688757 conn(0x7f40600fb360 msgr2=0x7f40601044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 shutdown_connections 2024-09-21T10:39:09.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.265+0000 7f406865d640 1 -- 172.21.15.60:0/3334688757 wait complete. 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3194544411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 msgr2=0x7ff9b40ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3194544411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b40ff270 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009880 tx=0x7ff9a402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3194544411 shutdown_connections 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3194544411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b40ff270 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3194544411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9b40fe4d0 0x7ff9b40fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3194544411 >> 172.21.15.60:0/3194544411 conn(0x7ff9b40fa280 msgr2=0x7ff9b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.355+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3194544411 shutdown_connections 2024-09-21T10:39:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3194544411 wait complete. 2024-09-21T10:39:09.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 Processor -- start 2024-09-21T10:39:09.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 -- start start 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9b40fe4d0 0x7ff9b41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4198330 con 0x7ff9b40fee10 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9bb8ca640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b41984a0 con 0x7ff9b40fe4d0 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.356+0000 7ff9b8e65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b8e65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b4197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43598/0 (socket says 172.21.15.60:43598) 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b8e65640 1 -- 172.21.15.60:0/3593130315 learned_addr learned my addr 172.21.15.60:0/3593130315 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b9666640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9b40fe4d0 0x7ff9b41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b8e65640 1 -- 172.21.15.60:0/3593130315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9b40fe4d0 msgr2=0x7ff9b41978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b8e65640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9b40fe4d0 0x7ff9b41978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b8e65640 1 -- 172.21.15.60:0/3593130315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4009560 con 0x7ff9b40fee10 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9b8e65640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b4197df0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4005610 tx=0x7ff9a4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:09.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9a4004ba0 con 0x7ff9b40fee10 2024-09-21T10:39:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b419ced0 con 0x7ff9b40fee10 2024-09-21T10:39:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.357+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9a4004d00 con 0x7ff9b40fee10 2024-09-21T10:39:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.358+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9a4003bd0 con 0x7ff9b40fee10 2024-09-21T10:39:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.358+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b419d340 con 0x7ff9b40fee10 2024-09-21T10:39:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.359+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff9a4031640 con 0x7ff9b40fee10 2024-09-21T10:39:09.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.359+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b4191950 con 0x7ff9b40fee10 2024-09-21T10:39:09.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.359+0000 7ff9aa7fc640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff9a006cc50 0x7ff9a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.360+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff9a40ad540 con 0x7ff9b40fee10 2024-09-21T10:39:09.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.360+0000 7ff9b9666640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff9a006cc50 0x7ff9a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.360+0000 7ff9b9666640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff9a006cc50 0x7ff9a006f110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0005e10 tx=0x7ff9b0005da0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:09.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.365+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9a4077930 con 0x7ff9b40fee10 2024-09-21T10:39:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.630+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff9b402c480 con 0x7ff9b40fee10 2024-09-21T10:39:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.631+0000 7ff9aa7fc640 1 -- 172.21.15.60:0/3593130315 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7ff9a407af50 con 0x7ff9b40fee10 2024-09-21T10:39:09.633 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:39:09.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:39:09.633 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:39:09.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:09.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 14 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:39:09.634 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:39:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff9a006cc50 msgr2=0x7ff9a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff9a006cc50 0x7ff9a006f110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0005e10 tx=0x7ff9b0005da0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 msgr2=0x7ff9b4197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b4197df0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4005610 tx=0x7ff9a4005640 comp rx=0 tx=0).stop 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 shutdown_connections 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7ff9a006cc50 0x7ff9a006f110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9b40fee10 0x7ff9b4197df0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 --2- 172.21.15.60:0/3593130315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9b40fe4d0 0x7ff9b41978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.633+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 >> 172.21.15.60:0/3593130315 conn(0x7ff9b40fa280 msgr2=0x7ff9b4106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.634+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 shutdown_connections 2024-09-21T10:39:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.634+0000 7ff9bb8ca640 1 -- 172.21.15.60:0/3593130315 wait complete. 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.726+0000 7fe53ec5d640 1 -- 172.21.15.60:0/2444646445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 msgr2=0x7fe538101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.726+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/2444646445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe538101250 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe524009880 tx=0x7fe52402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.726+0000 7fe53ec5d640 1 -- 172.21.15.60:0/2444646445 shutdown_connections 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.726+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/2444646445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe538101250 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.726+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/2444646445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5380ffbd0 0x7fe5380fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.726+0000 7fe53ec5d640 1 -- 172.21.15.60:0/2444646445 >> 172.21.15.60:0/2444646445 conn(0x7fe5380fb360 msgr2=0x7fe5380fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 -- 172.21.15.60:0/2444646445 shutdown_connections 2024-09-21T10:39:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 -- 172.21.15.60:0/2444646445 wait complete. 2024-09-21T10:39:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 Processor -- start 2024-09-21T10:39:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 -- start start 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5380ffbd0 0x7fe538074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe5380728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538072de0 con 0x7fe538100dd0 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.727+0000 7fe53ec5d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538072f50 con 0x7fe5380ffbd0 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe5380728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe5380728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43618/0 (socket says 172.21.15.60:43618) 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 -- 172.21.15.60:0/988597555 learned_addr learned my addr 172.21.15.60:0/988597555 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe53c9f9640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5380ffbd0 0x7fe538074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 -- 172.21.15.60:0/988597555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5380ffbd0 msgr2=0x7fe538074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5380ffbd0 0x7fe538074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 -- 172.21.15.60:0/988597555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009560 con 0x7fe538100dd0 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe537fff640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe5380728a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe524004650 tx=0x7fe5240055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe524004aa0 con 0x7fe538100dd0 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe524005d50 con 0x7fe538100dd0 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.728+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5380731d0 con 0x7fe538100dd0 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.729+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5240039e0 con 0x7fe538100dd0 2024-09-21T10:39:09.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.729+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53819d6e0 con 0x7fe538100dd0 2024-09-21T10:39:09.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.730+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380fffd0 con 0x7fe538100dd0 2024-09-21T10:39:09.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.730+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe524031c00 con 0x7fe538100dd0 2024-09-21T10:39:09.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.731+0000 7fe535ffb640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc50 0x7fe52806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:09.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.731+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe5240ad360 con 0x7fe538100dd0 2024-09-21T10:39:09.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.731+0000 7fe53c9f9640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc50 0x7fe52806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.731+0000 7fe53c9f9640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc50 0x7fe52806f110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe538100c30 tx=0x7fe52c005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.736+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe524077720 con 0x7fe538100dd0 2024-09-21T10:39:09.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.982+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe53818f770 con 0x7fe538100dd0 2024-09-21T10:39:09.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.982+0000 7fe535ffb640 1 -- 172.21.15.60:0/988597555 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fe52407ad40 con 0x7fe538100dd0 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:39:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:39:09.986 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:09.988 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:39:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.984+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc50 msgr2=0x7fe52806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.984+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc50 0x7fe52806f110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe538100c30 tx=0x7fe52c005f90 comp rx=0 tx=0).stop 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.984+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 msgr2=0x7fe5380728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe5380728a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe524004650 tx=0x7fe5240055a0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 shutdown_connections 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe52806cc50 0x7fe52806f110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe538100dd0 0x7fe5380728a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 --2- 172.21.15.60:0/988597555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe5380ffbd0 0x7fe538074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 >> 172.21.15.60:0/988597555 conn(0x7fe5380fb360 msgr2=0x7fe538104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 shutdown_connections 2024-09-21T10:39:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:09.985+0000 7fe53ec5d640 1 -- 172.21.15.60:0/988597555 wait complete. 2024-09-21T10:39:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 -- 172.21.15.60:0/1489698475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d00ffbd0 msgr2=0x7f12d00fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/1489698475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d00ffbd0 0x7f12d00fffd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009880 tx=0x7f12c002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 -- 172.21.15.60:0/1489698475 shutdown_connections 2024-09-21T10:39:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/1489698475 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d0100dd0 0x7f12d0101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/1489698475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d00ffbd0 0x7f12d00fffd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 -- 172.21.15.60:0/1489698475 >> 172.21.15.60:0/1489698475 conn(0x7f12d00fb360 msgr2=0x7f12d00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 -- 172.21.15.60:0/1489698475 shutdown_connections 2024-09-21T10:39:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 -- 172.21.15.60:0/1489698475 wait complete. 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.081+0000 7f12d6a5f640 1 Processor -- start 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12d6a5f640 1 -- start start 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12d6a5f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d00ffbd0 0x7f12d01956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12d6a5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 0x7f12d0195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12d6a5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01961b0 con 0x7f12d0100dd0 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12d6a5f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0196320 con 0x7f12d00ffbd0 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 0x7f12d0195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12cf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 0x7f12d0195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43630/0 (socket says 172.21.15.60:43630) 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12cf7fe640 1 -- 172.21.15.60:0/3526582011 learned_addr learned my addr 172.21.15.60:0/3526582011 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.082+0000 7f12cffff640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d00ffbd0 0x7f12d01956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cf7fe640 1 -- 172.21.15.60:0/3526582011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d00ffbd0 msgr2=0x7f12d01956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cf7fe640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d00ffbd0 0x7f12d01956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cf7fe640 1 -- 172.21.15.60:0/3526582011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0009560 con 0x7f12d0100dd0 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cf7fe640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 0x7f12d0195be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f12c400d720 tx=0x7f12c400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c40051f0 con 0x7f12d0100dd0 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d019ad70 con 0x7f12d0100dd0 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d019b340 con 0x7f12d0100dd0 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12c4009ce0 con 0x7f12d0100dd0 2024-09-21T10:39:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.083+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c4010460 con 0x7f12d0100dd0 2024-09-21T10:39:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.084+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc005280 con 0x7f12d0100dd0 2024-09-21T10:39:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.085+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f12c4005350 con 0x7f12d0100dd0 2024-09-21T10:39:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.086+0000 7f12cd7fa640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f12b806cc50 0x7f12b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.086+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f12c408bcf0 con 0x7f12d0100dd0 2024-09-21T10:39:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.086+0000 7f12cffff640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f12b806cc50 0x7f12b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.086+0000 7f12cffff640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f12b806cc50 0x7f12b806f110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009230 tx=0x7f12c0005d50 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.091+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f12c40560e0 con 0x7f12d0100dd0 2024-09-21T10:39:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.307+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12bc000bf0 con 0x7f12b806cc50 2024-09-21T10:39:10.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.308+0000 7f12cd7fa640 1 -- 172.21.15.60:0/3526582011 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f12bc000bf0 con 0x7f12b806cc50 2024-09-21T10:39:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:39:10.310 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", 2024-09-21T10:39:10.310 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:39:10.310 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:39:10.311 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-09-21T10:39:10.311 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "", 2024-09-21T10:39:10.311 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 image", 2024-09-21T10:39:10.311 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:39:10.311 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.310+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f12b806cc50 msgr2=0x7f12b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.310+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f12b806cc50 0x7f12b806f110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009230 tx=0x7f12c0005d50 comp rx=0 tx=0).stop 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.310+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 msgr2=0x7f12d0195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.310+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 0x7f12d0195be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f12c400d720 tx=0x7f12c400dbe0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 shutdown_connections 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f12b806cc50 0x7f12b806f110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12d0100dd0 0x7f12d0195be0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 --2- 172.21.15.60:0/3526582011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12d00ffbd0 0x7f12d01956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 >> 172.21.15.60:0/3526582011 conn(0x7f12d00fb360 msgr2=0x7f12d01044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 shutdown_connections 2024-09-21T10:39:10.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.311+0000 7f12d6a5f640 1 -- 172.21.15.60:0/3526582011 wait complete. 2024-09-21T10:39:10.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 -- 172.21.15.60:0/3039744506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000ffcf0 msgr2=0x7faf00100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 --2- 172.21.15.60:0/3039744506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000ffcf0 0x7faf00100170 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faef4009880 tx=0x7faef402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 -- 172.21.15.60:0/3039744506 shutdown_connections 2024-09-21T10:39:10.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 --2- 172.21.15.60:0/3039744506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000ffcf0 0x7faf00100170 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 --2- 172.21.15.60:0/3039744506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000feaf0 0x7faf000feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 -- 172.21.15.60:0/3039744506 >> 172.21.15.60:0/3039744506 conn(0x7faf000fa280 msgr2=0x7faf000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:10.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 -- 172.21.15.60:0/3039744506 shutdown_connections 2024-09-21T10:39:10.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.404+0000 7faf06503640 1 -- 172.21.15.60:0/3039744506 wait complete. 2024-09-21T10:39:10.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faf06503640 1 Processor -- start 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faf06503640 1 -- start start 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faf06503640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 0x7faf000687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faf06503640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000ffcf0 0x7faf0019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faf06503640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0019a9e0 con 0x7faf000feaf0 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faf06503640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0019ab50 con 0x7faf000ffcf0 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faefffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 0x7faf000687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faefffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 0x7faf000687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43652/0 (socket says 172.21.15.60:43652) 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.405+0000 7faefffff640 1 -- 172.21.15.60:0/3392801141 learned_addr learned my addr 172.21.15.60:0/3392801141 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faeff7fe640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000ffcf0 0x7faf0019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefffff640 1 -- 172.21.15.60:0/3392801141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000ffcf0 msgr2=0x7faf0019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefffff640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000ffcf0 0x7faf0019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefffff640 1 -- 172.21.15.60:0/3392801141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009560 con 0x7faf000feaf0 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faeff7fe640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000ffcf0 0x7faf0019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:39:10.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefffff640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 0x7faf000687d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faef000d8d0 tx=0x7faef000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef0009a30 con 0x7faf000feaf0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faef0009b90 con 0x7faf000feaf0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0019ae30 con 0x7faf000feaf0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef000f680 con 0x7faf000feaf0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.406+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0019b2a0 con 0x7faf000feaf0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.407+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0018e690 con 0x7faf000feaf0 2024-09-21T10:39:10.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.408+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faef0009d00 con 0x7faf000feaf0 2024-09-21T10:39:10.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.409+0000 7faefd7fa640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faee806cc60 0x7faee806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:10.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.409+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7faef008c110 con 0x7faf000feaf0 2024-09-21T10:39:10.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.409+0000 7faeff7fe640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faee806cc60 0x7faee806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:10.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.409+0000 7faeff7fe640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faee806cc60 0x7faee806f120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faef4000c00 tx=0x7faef4005a20 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:10.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.413+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faef0056480 con 0x7faf000feaf0 2024-09-21T10:39:10.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.688+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7faf00107700 con 0x7faf000feaf0 2024-09-21T10:39:10.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.689+0000 7faefd7fa640 1 -- 172.21.15.60:0/3392801141 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7faef0059aa0 con 0x7faf000feaf0 2024-09-21T10:39:10.691 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:39:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faee806cc60 msgr2=0x7faee806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faee806cc60 0x7faee806f120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faef4000c00 tx=0x7faef4005a20 comp rx=0 tx=0).stop 2024-09-21T10:39:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 msgr2=0x7faf000687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:10.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 0x7faf000687d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faef000d8d0 tx=0x7faef000dd90 comp rx=0 tx=0).stop 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 shutdown_connections 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7faee806cc60 0x7faee806f120 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf000ffcf0 0x7faf0019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 --2- 172.21.15.60:0/3392801141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf000feaf0 0x7faf000687d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 >> 172.21.15.60:0/3392801141 conn(0x7faf000fa280 msgr2=0x7faf001033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 shutdown_connections 2024-09-21T10:39:10.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:10.691+0000 7faf06503640 1 -- 172.21.15.60:0/3392801141 wait complete. 2024-09-21T10:39:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:10 smithi060 ceph-mon[28215]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:10 smithi060 ceph-mon[28215]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:10 smithi060 ceph-mon[28215]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:10 smithi060 ceph-mon[28215]: pgmap v229: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:10 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3593130315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:39:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:10 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/988597555' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:39:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:10 smithi112 ceph-mon[35117]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:10 smithi112 ceph-mon[35117]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:10 smithi112 ceph-mon[35117]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:10 smithi112 ceph-mon[35117]: pgmap v229: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:10 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3593130315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:39:10.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:10 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/988597555' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:39:11.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:11 smithi060 ceph-mon[28215]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:11.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:11 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3392801141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:39:11.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:11 smithi112 ceph-mon[35117]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:11.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:11 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3392801141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:39:12.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:12 smithi060 ceph-mon[28215]: pgmap v230: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:12.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:12 smithi112 ceph-mon[35117]: pgmap v230: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:14.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:14 smithi060 ceph-mon[28215]: pgmap v231: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:14 smithi112 ceph-mon[35117]: pgmap v231: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:16.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:16 smithi060 ceph-mon[28215]: pgmap v232: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:16 smithi112 ceph-mon[35117]: pgmap v232: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:18.914 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:18 smithi112 ceph-mon[35117]: pgmap v233: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:18.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:18 smithi060 ceph-mon[28215]: pgmap v233: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:20.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:20 smithi060 ceph-mon[28215]: pgmap v234: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:20.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:20 smithi112 ceph-mon[35117]: pgmap v234: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:22.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:22 smithi112 ceph-mon[35117]: pgmap v235: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:22.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:22.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:22 smithi060 ceph-mon[28215]: pgmap v235: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:22.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:24.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:24 smithi060 ceph-mon[28215]: pgmap v236: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:24 smithi112 ceph-mon[35117]: pgmap v236: 65 pgs: 65 active+clean; 584 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:26.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:26 smithi060 ceph-mon[28215]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T10:39:26.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:26 smithi112 ceph-mon[35117]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T10:39:28.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:28 smithi060 ceph-mon[28215]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T10:39:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:28 smithi112 ceph-mon[35117]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T10:39:30.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:30 smithi060 ceph-mon[28215]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T10:39:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:30 smithi112 ceph-mon[35117]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T10:39:32.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:32 smithi060 ceph-mon[28215]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T10:39:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:32 smithi112 ceph-mon[35117]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T10:39:34.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:34 smithi060 ceph-mon[28215]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T10:39:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:34 smithi112 ceph-mon[35117]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T10:39:36.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:36 smithi060 ceph-mon[28215]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T10:39:36.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:36 smithi112 ceph-mon[35117]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-21T10:39:37.843 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:37 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:37 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:38.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:38 smithi060 ceph-mon[28215]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:38.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:38 smithi112 ceph-mon[35117]: pgmap v243: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (unknown) 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: Upgrade: Need to upgrade myself (mgr.smithi060.mulzpr) 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 on smithi112 2024-09-21T10:39:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:39 smithi060 ceph-mon[28215]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (unknown) 2024-09-21T10:39:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T10:39:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:39:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:39:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: Upgrade: Need to upgrade myself (mgr.smithi060.mulzpr) 2024-09-21T10:39:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 on smithi112 2024-09-21T10:39:40.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:39 smithi112 ceph-mon[35117]: pgmap v244: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 -- 172.21.15.60:0/693881952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0770100d90 msgr2=0x7f0770101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 --2- 172.21.15.60:0/693881952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0770100d90 0x7f0770101210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0764009880 tx=0x7f076402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 -- 172.21.15.60:0/693881952 shutdown_connections 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 --2- 172.21.15.60:0/693881952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0770100d90 0x7f0770101210 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 --2- 172.21.15.60:0/693881952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f07700ffb90 0x7f07700fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 -- 172.21.15.60:0/693881952 >> 172.21.15.60:0/693881952 conn(0x7f07700fb320 msgr2=0x7f07700fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 -- 172.21.15.60:0/693881952 shutdown_connections 2024-09-21T10:39:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.780+0000 7f0775709640 1 -- 172.21.15.60:0/693881952 wait complete. 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.781+0000 7f0775709640 1 Processor -- start 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.781+0000 7f0775709640 1 -- start start 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f0775709640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 0x7f0770074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f0775709640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0770100d90 0x7f07700728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f0775709640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0770199260 con 0x7f07700ffb90 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f0775709640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07701993d0 con 0x7f0770100d90 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 0x7f0770074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 0x7f0770074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45344/0 (socket says 172.21.15.60:45344) 2024-09-21T10:39:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076effd640 1 -- 172.21.15.60:0/2851437542 learned_addr learned my addr 172.21.15.60:0/2851437542 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076e7fc640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0770100d90 0x7f07700728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076effd640 1 -- 172.21.15.60:0/2851437542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0770100d90 msgr2=0x7f07700728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076effd640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0770100d90 0x7f07700728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076effd640 1 -- 172.21.15.60:0/2851437542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009560 con 0x7f07700ffb90 2024-09-21T10:39:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.782+0000 7f076e7fc640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0770100d90 0x7f07700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:39:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.783+0000 7f076effd640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 0x7f0770074200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f076000e940 tx=0x7f076000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.783+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0760009700 con 0x7f07700ffb90 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.783+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f076000cc90 con 0x7f07700ffb90 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.783+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0770072de0 con 0x7f07700ffb90 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.784+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0760010430 con 0x7f07700ffb90 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.784+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0770073320 con 0x7f07700ffb90 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.785+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07700fff90 con 0x7f07700ffb90 2024-09-21T10:39:40.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.785+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0760003fe0 con 0x7f07700ffb90 2024-09-21T10:39:40.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.786+0000 7f0757fff640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f075806cc60 0x7f075806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:40.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.786+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0760014070 con 0x7f07700ffb90 2024-09-21T10:39:40.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.786+0000 7f076e7fc640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f075806cc60 0x7f075806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:40.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.787+0000 7f076e7fc640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f075806cc60 0x7f075806f120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0764000c00 tx=0x7f07640314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:40.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.795+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0760056a30 con 0x7f07700ffb90 2024-09-21T10:39:40.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.982+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0770108a20 con 0x7f075806cc60 2024-09-21T10:39:40.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.983+0000 7f0757fff640 1 -- 172.21.15.60:0/2851437542 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f0770108a20 con 0x7f075806cc60 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f075806cc60 msgr2=0x7f075806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f075806cc60 0x7f075806f120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0764000c00 tx=0x7f07640314e0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 msgr2=0x7f0770074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 0x7f0770074200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f076000e940 tx=0x7f076000ee00 comp rx=0 tx=0).stop 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 shutdown_connections 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f075806cc60 0x7f075806f120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0770100d90 0x7f07700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 --2- 172.21.15.60:0/2851437542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07700ffb90 0x7f0770074200 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.986+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 >> 172.21.15.60:0/2851437542 conn(0x7f07700fb320 msgr2=0x7f0770104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.987+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 shutdown_connections 2024-09-21T10:39:40.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:40.987+0000 7f0775709640 1 -- 172.21.15.60:0/2851437542 wait complete. 2024-09-21T10:39:40.998 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.076+0000 7f00e7fd5640 1 -- 172.21.15.60:0/1077739476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00feaf0 msgr2=0x7f00e00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.076+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/1077739476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00feaf0 0x7f00e00feef0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009880 tx=0x7f00dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.076+0000 7f00e7fd5640 1 -- 172.21.15.60:0/1077739476 shutdown_connections 2024-09-21T10:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.076+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/1077739476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00ffcf0 0x7f00e0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.076+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/1077739476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00feaf0 0x7f00e00feef0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.076+0000 7f00e7fd5640 1 -- 172.21.15.60:0/1077739476 >> 172.21.15.60:0/1077739476 conn(0x7f00e00fa280 msgr2=0x7f00e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:41.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.077+0000 7f00e7fd5640 1 -- 172.21.15.60:0/1077739476 shutdown_connections 2024-09-21T10:39:41.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.077+0000 7f00e7fd5640 1 -- 172.21.15.60:0/1077739476 wait complete. 2024-09-21T10:39:41.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e7fd5640 1 Processor -- start 2024-09-21T10:39:41.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e7fd5640 1 -- start start 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e7fd5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 0x7f00e0194560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e7fd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 0x7f00e0194aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e5d71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 0x7f00e0194560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e5570640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 0x7f00e0194aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e5d71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 0x7f00e0194560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:46660/0 (socket says 172.21.15.60:46660) 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e5570640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 0x7f00e0194aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45350/0 (socket says 172.21.15.60:45350) 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e5d71640 1 -- 172.21.15.60:0/2587370723 learned_addr learned my addr 172.21.15.60:0/2587370723 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.078+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0195070 con 0x7f00e00ffcf0 2024-09-21T10:39:41.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.079+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01951e0 con 0x7f00e00feaf0 2024-09-21T10:39:41.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.079+0000 7f00e5d71640 1 -- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 msgr2=0x7f00e0194aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.079+0000 7f00e5d71640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 0x7f00e0194aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.079+0000 7f00e5d71640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009560 con 0x7f00e00feaf0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.079+0000 7f00e5570640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 0x7f00e0194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.079+0000 7f00e5d71640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 0x7f00e0194560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00dc02a9c0 tx=0x7f00dc005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.080+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00dc004aa0 con 0x7f00e00feaf0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.080+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00dc004c00 con 0x7f00e00feaf0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.080+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e0067c30 con 0x7f00e00feaf0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.080+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00dc003a80 con 0x7f00e00feaf0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.080+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e0068120 con 0x7f00e00feaf0 2024-09-21T10:39:41.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.081+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00feef0 con 0x7f00e00feaf0 2024-09-21T10:39:41.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.082+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f00dc042070 con 0x7f00e00feaf0 2024-09-21T10:39:41.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.083+0000 7f00d6ffd640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00cc06cc50 0x7f00cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.083+0000 7f00e5570640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00cc06cc50 0x7f00cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.083+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f00dc0aef40 con 0x7f00e00feaf0 2024-09-21T10:39:41.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.084+0000 7f00e5570640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00cc06cc50 0x7f00cc06f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00e0195a80 tx=0x7f00d0005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:41.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.092+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f00dc0e2e20 con 0x7f00e00feaf0 2024-09-21T10:39:41.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.280+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00e018e250 con 0x7f00cc06cc50 2024-09-21T10:39:41.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.282+0000 7f00d6ffd640 1 -- 172.21.15.60:0/2587370723 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f00e018e250 con 0x7f00cc06cc50 2024-09-21T10:39:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00cc06cc50 msgr2=0x7f00cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00cc06cc50 0x7f00cc06f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00e0195a80 tx=0x7f00d0005f90 comp rx=0 tx=0).stop 2024-09-21T10:39:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 msgr2=0x7f00e0194560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 0x7f00e0194560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00dc02a9c0 tx=0x7f00dc005db0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 shutdown_connections 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f00cc06cc50 0x7f00cc06f110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00e00ffcf0 0x7f00e0194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 --2- 172.21.15.60:0/2587370723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00e00feaf0 0x7f00e0194560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 >> 172.21.15.60:0/2587370723 conn(0x7f00e00fa280 msgr2=0x7f00e0103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 shutdown_connections 2024-09-21T10:39:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.285+0000 7f00e7fd5640 1 -- 172.21.15.60:0/2587370723 wait complete. 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 -- 172.21.15.60:0/2506520184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc50100d90 msgr2=0x7fbc50101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 --2- 172.21.15.60:0/2506520184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc50100d90 0x7fbc50101210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009880 tx=0x7fbc4402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 -- 172.21.15.60:0/2506520184 shutdown_connections 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 --2- 172.21.15.60:0/2506520184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc50100d90 0x7fbc50101210 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 --2- 172.21.15.60:0/2506520184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc500ffb90 0x7fbc500fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 -- 172.21.15.60:0/2506520184 >> 172.21.15.60:0/2506520184 conn(0x7fbc500fb320 msgr2=0x7fbc500fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.374+0000 7fbc56154640 1 -- 172.21.15.60:0/2506520184 shutdown_connections 2024-09-21T10:39:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.375+0000 7fbc56154640 1 -- 172.21.15.60:0/2506520184 wait complete. 2024-09-21T10:39:41.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc56154640 1 Processor -- start 2024-09-21T10:39:41.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc56154640 1 -- start start 2024-09-21T10:39:41.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc56154640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 0x7fbc50195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc56154640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc50100d90 0x7fbc50195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc56154640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50196120 con 0x7fbc500ffb90 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc56154640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50196290 con 0x7fbc50100d90 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.376+0000 7fbc4f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 0x7fbc50195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 0x7fbc50195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45366/0 (socket says 172.21.15.60:45366) 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4f7fe640 1 -- 172.21.15.60:0/3760069188 learned_addr learned my addr 172.21.15.60:0/3760069188 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:41.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4effd640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc50100d90 0x7fbc50195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4f7fe640 1 -- 172.21.15.60:0/3760069188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc50100d90 msgr2=0x7fbc50195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4f7fe640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc50100d90 0x7fbc50195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4f7fe640 1 -- 172.21.15.60:0/3760069188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44009560 con 0x7fbc500ffb90 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4f7fe640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 0x7fbc50195610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000e970 tx=0x7fbc4000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.377+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc40009700 con 0x7fbc500ffb90 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.378+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc4000cc90 con 0x7fbc500ffb90 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.378+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5019ace0 con 0x7fbc500ffb90 2024-09-21T10:39:41.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.378+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc40010430 con 0x7fbc500ffb90 2024-09-21T10:39:41.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.378+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc50072a40 con 0x7fbc500ffb90 2024-09-21T10:39:41.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.379+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5018f710 con 0x7fbc500ffb90 2024-09-21T10:39:41.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.380+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbc40003f90 con 0x7fbc500ffb90 2024-09-21T10:39:41.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.381+0000 7fbc4cff9640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbc3806cc60 0x7fbc3806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.381+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbc40014070 con 0x7fbc500ffb90 2024-09-21T10:39:41.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.381+0000 7fbc4effd640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbc3806cc60 0x7fbc3806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.382+0000 7fbc4effd640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbc3806cc60 0x7fbc3806f120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc44000c00 tx=0x7fbc440314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:41.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.386+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbc40056b60 con 0x7fbc500ffb90 2024-09-21T10:39:41.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.568+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc5002c5e0 con 0x7fbc3806cc60 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.578+0000 7fbc4cff9640 1 -- 172.21.15.60:0/3760069188 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fbc5002c5e0 con 0x7fbc3806cc60 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (5m) 60s ago 7m 24.7M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (7m) 60s ago 7m 7520k - 18.2.4-871-g6a1bdf85 0adab276c97e 6a6a2a8801c8 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (6m) 67s ago 6m 7251k - 18.2.4-871-g6a1bdf85 0adab276c97e 7163dd4d91a2 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (7m) 60s ago 7m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (6m) 67s ago 6m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (5m) 60s ago 7m 82.1M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (81s) 60s ago 80s 19.0M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (87s) 60s ago 86s 11.9M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:39:41.581 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (78s) 67s ago 78s 13.7M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (84s) 67s ago 84s 16.0M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:9283,8765,8443 running (8m) 60s ago 8m 487M - 18.2.4-871-g6a1bdf85 0adab276c97e d9748f7fa031 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (6m) 67s ago 6m 439M - 18.2.4-871-g6a1bdf85 0adab276c97e 644d995876b0 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (8m) 60s ago 9m 45.6M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (6m) 67s ago 6m 35.2M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (7m) 60s ago 7m 15.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (6m) 67s ago 6m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (5m) 60s ago 5m 50.6M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (4m) 60s ago 4m 47.2M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (4m) 60s ago 4m 54.7M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (3m) 67s ago 3m 54.2M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (3m) 67s ago 3m 43.7M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (2m) 67s ago 2m 52.2M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:39:41.582 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (5m) 60s ago 7m 56.4M - 2.43.0 a07b618ecd1d 9edc141eabb8 2024-09-21T10:39:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.581+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbc3806cc60 msgr2=0x7fbc3806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbc3806cc60 0x7fbc3806f120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc44000c00 tx=0x7fbc440314e0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 msgr2=0x7fbc50195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 0x7fbc50195610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000e970 tx=0x7fbc4000ee30 comp rx=0 tx=0).stop 2024-09-21T10:39:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 shutdown_connections 2024-09-21T10:39:41.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbc3806cc60 0x7fbc3806f120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc50100d90 0x7fbc50195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 --2- 172.21.15.60:0/3760069188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500ffb90 0x7fbc50195610 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 >> 172.21.15.60:0/3760069188 conn(0x7fbc500fb320 msgr2=0x7fbc50104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 shutdown_connections 2024-09-21T10:39:41.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.582+0000 7fbc56154640 1 -- 172.21.15.60:0/3760069188 wait complete. 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 -- 172.21.15.60:0/825253894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda48100dd0 msgr2=0x7fda48101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/825253894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda48100dd0 0x7fda48101250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fda34009880 tx=0x7fda3402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 -- 172.21.15.60:0/825253894 shutdown_connections 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/825253894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda48100dd0 0x7fda48101250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/825253894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda480ffbd0 0x7fda480fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 -- 172.21.15.60:0/825253894 >> 172.21.15.60:0/825253894 conn(0x7fda480fb360 msgr2=0x7fda480fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 -- 172.21.15.60:0/825253894 shutdown_connections 2024-09-21T10:39:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.669+0000 7fda4ee5e640 1 -- 172.21.15.60:0/825253894 wait complete. 2024-09-21T10:39:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4ee5e640 1 Processor -- start 2024-09-21T10:39:41.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4ee5e640 1 -- start start 2024-09-21T10:39:41.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4ee5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 0x7fda48074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4ee5e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda48100dd0 0x7fda480728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4ee5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48072de0 con 0x7fda480ffbd0 2024-09-21T10:39:41.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4ee5e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48072f50 con 0x7fda48100dd0 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda4cbfa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 0x7fda48074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.670+0000 7fda47fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda48100dd0 0x7fda480728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.671+0000 7fda4cbfa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 0x7fda48074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45378/0 (socket says 172.21.15.60:45378) 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.671+0000 7fda4cbfa640 1 -- 172.21.15.60:0/1761085332 learned_addr learned my addr 172.21.15.60:0/1761085332 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.671+0000 7fda4cbfa640 1 -- 172.21.15.60:0/1761085332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda48100dd0 msgr2=0x7fda480728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.671+0000 7fda4cbfa640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda48100dd0 0x7fda480728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.671+0000 7fda4cbfa640 1 -- 172.21.15.60:0/1761085332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda34009560 con 0x7fda480ffbd0 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.671+0000 7fda4cbfa640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 0x7fda48074200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00e940 tx=0x7fda3c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.672+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda3c009700 con 0x7fda480ffbd0 2024-09-21T10:39:41.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.672+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda3c00cc90 con 0x7fda480ffbd0 2024-09-21T10:39:41.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.672+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda48073230 con 0x7fda480ffbd0 2024-09-21T10:39:41.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.672+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda3c010430 con 0x7fda480ffbd0 2024-09-21T10:39:41.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.672+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4819d6c0 con 0x7fda480ffbd0 2024-09-21T10:39:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.674+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48109190 con 0x7fda480ffbd0 2024-09-21T10:39:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.674+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fda3c003fe0 con 0x7fda480ffbd0 2024-09-21T10:39:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.675+0000 7fda45ffb640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fda3806cc50 0x7fda3806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.675+0000 7fda47fff640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fda3806cc50 0x7fda3806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.676+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fda3c014070 con 0x7fda480ffbd0 2024-09-21T10:39:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.676+0000 7fda47fff640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fda3806cc50 0x7fda3806f110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda34000c00 tx=0x7fda340314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.680+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda48109190 con 0x7fda480ffbd0 2024-09-21T10:39:41.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.917+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda48109120 con 0x7fda480ffbd0 2024-09-21T10:39:41.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.918+0000 7fda45ffb640 1 -- 172.21.15.60:0/1761085332 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fda3c056a30 con 0x7fda480ffbd0 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:39:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:39:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 14 2024-09-21T10:39:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:39:41.922 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:39:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.920+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fda3806cc50 msgr2=0x7fda3806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.920+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fda3806cc50 0x7fda3806f110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda34000c00 tx=0x7fda340314e0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.920+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 msgr2=0x7fda48074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 0x7fda48074200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00e940 tx=0x7fda3c00ee00 comp rx=0 tx=0).stop 2024-09-21T10:39:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 shutdown_connections 2024-09-21T10:39:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fda3806cc50 0x7fda3806f110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda48100dd0 0x7fda480728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 --2- 172.21.15.60:0/1761085332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda480ffbd0 0x7fda48074200 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 >> 172.21.15.60:0/1761085332 conn(0x7fda480fb360 msgr2=0x7fda48104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.921+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 shutdown_connections 2024-09-21T10:39:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:41.922+0000 7fda4ee5e640 1 -- 172.21.15.60:0/1761085332 wait complete. 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.006+0000 7f9026f4b640 1 -- 172.21.15.60:0/2689058401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200ffcf0 msgr2=0x7f9020100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.006+0000 7f9026f4b640 1 --2- 172.21.15.60:0/2689058401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200ffcf0 0x7f9020100170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f900c009880 tx=0x7f900c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.006+0000 7f9026f4b640 1 -- 172.21.15.60:0/2689058401 shutdown_connections 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.006+0000 7f9026f4b640 1 --2- 172.21.15.60:0/2689058401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200ffcf0 0x7f9020100170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.006+0000 7f9026f4b640 1 --2- 172.21.15.60:0/2689058401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200feaf0 0x7f90200feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.006+0000 7f9026f4b640 1 -- 172.21.15.60:0/2689058401 >> 172.21.15.60:0/2689058401 conn(0x7f90200fa280 msgr2=0x7f90200fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.007+0000 7f9026f4b640 1 -- 172.21.15.60:0/2689058401 shutdown_connections 2024-09-21T10:39:42.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.007+0000 7f9026f4b640 1 -- 172.21.15.60:0/2689058401 wait complete. 2024-09-21T10:39:42.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.007+0000 7f9026f4b640 1 Processor -- start 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f9026f4b640 1 -- start start 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f9026f4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200feaf0 0x7f90201956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f9026f4b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200ffcf0 0x7f9020195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f9026f4b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90201961b0 con 0x7f90200feaf0 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f9026f4b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9020196320 con 0x7f90200ffcf0 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f901ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200ffcf0 0x7f9020195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f901ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200ffcf0 0x7f9020195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:46712/0 (socket says 172.21.15.60:46712) 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f901ffff640 1 -- 172.21.15.60:0/905383400 learned_addr learned my addr 172.21.15.60:0/905383400 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.008+0000 7f9024ce7640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200feaf0 0x7f90201956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f9024ce7640 1 -- 172.21.15.60:0/905383400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200ffcf0 msgr2=0x7f9020195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f9024ce7640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200ffcf0 0x7f9020195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f9024ce7640 1 -- 172.21.15.60:0/905383400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c009560 con 0x7f90200feaf0 2024-09-21T10:39:42.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f9024ce7640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200feaf0 0x7f90201956a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f901400e970 tx=0x7f901400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:42.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901400cc90 con 0x7f90200feaf0 2024-09-21T10:39:42.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90140044f0 con 0x7f90200feaf0 2024-09-21T10:39:42.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.009+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902019adc0 con 0x7f90200feaf0 2024-09-21T10:39:42.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.010+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902019b290 con 0x7f90200feaf0 2024-09-21T10:39:42.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.010+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9014010430 con 0x7f90200feaf0 2024-09-21T10:39:42.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.011+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90200feef0 con 0x7f90200feaf0 2024-09-21T10:39:42.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.012+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9014004000 con 0x7f90200feaf0 2024-09-21T10:39:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.012+0000 7f901dffb640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f901006cc50 0x7f901006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.012+0000 7f901ffff640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f901006cc50 0x7f901006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.013+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9014014070 con 0x7f90200feaf0 2024-09-21T10:39:42.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.013+0000 7f901ffff640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f901006cc50 0x7f901006f110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9020196bc0 tx=0x7f900c0314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.020+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9014056a00 con 0x7f90200feaf0 2024-09-21T10:39:42.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.442+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f902018f790 con 0x7f90200feaf0 2024-09-21T10:39:42.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.442+0000 7f901dffb640 1 -- 172.21.15.60:0/905383400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f901405a020 con 0x7f90200feaf0 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:39:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:39:42.446 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:39:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:39:42.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:42.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:42.448 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:39:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:39:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f901006cc50 msgr2=0x7f901006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f901006cc50 0x7f901006f110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9020196bc0 tx=0x7f900c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200feaf0 msgr2=0x7f90201956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200feaf0 0x7f90201956a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f901400e970 tx=0x7f901400ee30 comp rx=0 tx=0).stop 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 shutdown_connections 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f901006cc50 0x7f901006f110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.445+0000 7f9026f4b640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90200ffcf0 0x7f9020195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.446+0000 7f9026f4b640 1 --2- 172.21.15.60:0/905383400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90200feaf0 0x7f90201956a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.446+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 >> 172.21.15.60:0/905383400 conn(0x7f90200fa280 msgr2=0x7f90201033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.446+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 shutdown_connections 2024-09-21T10:39:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.446+0000 7f9026f4b640 1 -- 172.21.15.60:0/905383400 wait complete. 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.577+0000 7fc5fdc40640 1 -- 172.21.15.60:0/3132345572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 msgr2=0x7fc5f8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.577+0000 7fc5fdc40640 1 --2- 172.21.15.60:0/3132345572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f8100170 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009880 tx=0x7fc5ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.577+0000 7fc5fdc40640 1 -- 172.21.15.60:0/3132345572 shutdown_connections 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.577+0000 7fc5fdc40640 1 --2- 172.21.15.60:0/3132345572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f8100170 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.577+0000 7fc5fdc40640 1 --2- 172.21.15.60:0/3132345572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.577+0000 7fc5fdc40640 1 -- 172.21.15.60:0/3132345572 >> 172.21.15.60:0/3132345572 conn(0x7fc5f80fa280 msgr2=0x7fc5f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.578+0000 7fc5fdc40640 1 -- 172.21.15.60:0/3132345572 shutdown_connections 2024-09-21T10:39:42.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.578+0000 7fc5fdc40640 1 -- 172.21.15.60:0/3132345572 wait complete. 2024-09-21T10:39:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.579+0000 7fc5fdc40640 1 Processor -- start 2024-09-21T10:39:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.579+0000 7fc5fdc40640 1 -- start start 2024-09-21T10:39:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.579+0000 7fc5fdc40640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f8068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5fdc40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:42.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5fdc40640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81962c0 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5fdc40640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f819cd90 con 0x7fc5f80feaf0 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f8068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f8068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:46740/0 (socket says 172.21.15.60:46740) 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f77fe640 1 -- 172.21.15.60:0/2340718069 learned_addr learned my addr 172.21.15.60:0/2340718069 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f6ffd640 1 -- 172.21.15.60:0/2340718069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 msgr2=0x7fc5f8068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f6ffd640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f8068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.580+0000 7fc5f6ffd640 1 -- 172.21.15.60:0/2340718069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009560 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.581+0000 7fc5f77fe640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f8068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:39:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.581+0000 7fc5f6ffd640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f819c850 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009230 tx=0x7fc5ec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.581+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec004aa0 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.581+0000 7fc5fdc40640 1 -- 172.21.15.60:0/2340718069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f819cfc0 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.581+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5ec004c00 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.581+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec003a20 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.582+0000 7fc5fdc40640 1 -- 172.21.15.60:0/2340718069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f819d3d0 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.583+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d8005250 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.584+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc5ec003b80 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.584+0000 7fc5f4ff9640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc5e006cc60 0x7fc5e006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:42.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.585+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc5ec0ad200 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.585+0000 7fc5f77fe640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc5e006cc60 0x7fc5e006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:42.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.586+0000 7fc5f77fe640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc5e006cc60 0x7fc5e006f120 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80058c0 tx=0x7fc5e8005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.593+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc5ec077850 con 0x7fc5f80ffcf0 2024-09-21T10:39:42.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:42 smithi060 ceph-mon[28215]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:42 smithi060 ceph-mon[28215]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:42 smithi060 ceph-mon[28215]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T10:39:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:42 smithi060 ceph-mon[28215]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:42 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1761085332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:39:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:42 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/905383400' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:39:42.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:42 smithi112 ceph-mon[35117]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:42.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:42 smithi112 ceph-mon[35117]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:42.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:42 smithi112 ceph-mon[35117]: pgmap v245: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T10:39:42.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:42 smithi112 ceph-mon[35117]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:42.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:42 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1761085332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:39:42.853 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:42 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/905383400' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:39:42.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.965+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d8000bc0 con 0x7fc5e006cc60 2024-09-21T10:39:42.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.966+0000 7fc5f4ff9640 1 -- 172.21.15.60:0/2340718069 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc5d8000bc0 con 0x7fc5e006cc60 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "0/23 daemons upgraded", 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 image on host smithi112", 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:39:42.969 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc5e006cc60 msgr2=0x7fc5e006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc5e006cc60 0x7fc5e006f120 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80058c0 tx=0x7fc5e8005f90 comp rx=0 tx=0).stop 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 msgr2=0x7fc5f819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f819c850 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009230 tx=0x7fc5ec0055a0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 shutdown_connections 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc5e006cc60 0x7fc5e006f120 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5f80ffcf0 0x7fc5f819c850 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 --2- 172.21.15.60:0/2340718069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f80feaf0 0x7fc5f8068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.969+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 >> 172.21.15.60:0/2340718069 conn(0x7fc5f80fa280 msgr2=0x7fc5f81033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.970+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 shutdown_connections 2024-09-21T10:39:42.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:42.970+0000 7fc5de7fc640 1 -- 172.21.15.60:0/2340718069 wait complete. 2024-09-21T10:39:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 -- 172.21.15.60:0/2594971304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20100680 msgr2=0x7fdb20102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 --2- 172.21.15.60:0/2594971304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20100680 0x7fdb20102a70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb100098b0 tx=0x7fdb1002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 -- 172.21.15.60:0/2594971304 shutdown_connections 2024-09-21T10:39:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 --2- 172.21.15.60:0/2594971304 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20102fb0 0x7fdb201053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 --2- 172.21.15.60:0/2594971304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20100680 0x7fdb20102a70 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb100098b0 tx=0x7fdb1002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 -- 172.21.15.60:0/2594971304 >> 172.21.15.60:0/2594971304 conn(0x7fdb200fa280 msgr2=0x7fdb200fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 -- 172.21.15.60:0/2594971304 shutdown_connections 2024-09-21T10:39:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.064+0000 7fdb267a0640 1 -- 172.21.15.60:0/2594971304 wait complete. 2024-09-21T10:39:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.065+0000 7fdb267a0640 1 Processor -- start 2024-09-21T10:39:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.065+0000 7fdb267a0640 1 -- start start 2024-09-21T10:39:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb267a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20102fb0 0x7fdb20197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb267a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20198070 0x7fdb2019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb267a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201984f0 con 0x7fdb20102fb0 2024-09-21T10:39:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb267a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20198660 con 0x7fdb20198070 2024-09-21T10:39:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb1f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20198070 0x7fdb2019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb1f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20198070 0x7fdb2019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:46760/0 (socket says 172.21.15.60:46760) 2024-09-21T10:39:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1529338174 learned_addr learned my addr 172.21.15.60:0/1529338174 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:39:43.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.066+0000 7fdb1ffff640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20102fb0 0x7fdb20197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:43.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.067+0000 7fdb1ffff640 1 -- 172.21.15.60:0/1529338174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20198070 msgr2=0x7fdb2019d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:43.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.067+0000 7fdb1ffff640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20198070 0x7fdb2019d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.067+0000 7fdb1ffff640 1 -- 172.21.15.60:0/1529338174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10009560 con 0x7fdb20102fb0 2024-09-21T10:39:43.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.068+0000 7fdb1ffff640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20102fb0 0x7fdb20197b30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb10008000 tx=0x7fdb10004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:43.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.068+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb10004430 con 0x7fdb20102fb0 2024-09-21T10:39:43.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.068+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2019d620 con 0x7fdb20102fb0 2024-09-21T10:39:43.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.068+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2019da90 con 0x7fdb20102fb0 2024-09-21T10:39:43.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.068+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb10005d50 con 0x7fdb20102fb0 2024-09-21T10:39:43.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.069+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb10031800 con 0x7fdb20102fb0 2024-09-21T10:39:43.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.070+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c005250 con 0x7fdb20102fb0 2024-09-21T10:39:43.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.072+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdb10031960 con 0x7fdb20102fb0 2024-09-21T10:39:43.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.072+0000 7fdb1d7fa640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fdb0806cc50 0x7fdb0806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:39:43.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.072+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdb100ad1a0 con 0x7fdb20102fb0 2024-09-21T10:39:43.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.073+0000 7fdb1f7fe640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fdb0806cc50 0x7fdb0806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:39:43.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.073+0000 7fdb1f7fe640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fdb0806cc50 0x7fdb0806f110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb20199050 tx=0x7fdb14005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:39:43.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.076+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdb10077510 con 0x7fdb20102fb0 2024-09-21T10:39:43.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.355+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdb0c0050c0 con 0x7fdb20102fb0 2024-09-21T10:39:43.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.356+0000 7fdb1d7fa640 1 -- 172.21.15.60:0/1529338174 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdb10077510 con 0x7fdb20102fb0 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.358+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fdb0806cc50 msgr2=0x7fdb0806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fdb0806cc50 0x7fdb0806f110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb20199050 tx=0x7fdb14005f90 comp rx=0 tx=0).stop 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20102fb0 msgr2=0x7fdb20197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20102fb0 0x7fdb20197b30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb10008000 tx=0x7fdb10004c60 comp rx=0 tx=0).stop 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 shutdown_connections 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fdb0806cc50 0x7fdb0806f110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb20198070 0x7fdb2019d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 --2- 172.21.15.60:0/1529338174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb20102fb0 0x7fdb20197b30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:39:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 >> 172.21.15.60:0/1529338174 conn(0x7fdb200fa280 msgr2=0x7fdb200ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:39:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 shutdown_connections 2024-09-21T10:39:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:39:43.359+0000 7fdb267a0640 1 -- 172.21.15.60:0/1529338174 wait complete. 2024-09-21T10:39:43.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:43 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1529338174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:39:43.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:43 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1529338174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:39:44.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:44 smithi060 ceph-mon[28215]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:44.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:44 smithi060 ceph-mon[28215]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:44.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:44 smithi112 ceph-mon[35117]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:39:44.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:44 smithi112 ceph-mon[35117]: pgmap v246: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:46.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:46 smithi060 ceph-mon[28215]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:46.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:46 smithi112 ceph-mon[35117]: pgmap v247: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:48.809 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:48 smithi112 ceph-mon[35117]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:48.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:48 smithi060 ceph-mon[28215]: pgmap v248: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:50 smithi060 ceph-mon[28215]: pgmap v249: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:50.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:50 smithi112 ceph-mon[35117]: pgmap v249: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:52.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:52 smithi060 ceph-mon[28215]: pgmap v250: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:52.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:52 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:52.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:52 smithi112 ceph-mon[35117]: pgmap v250: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:39:52.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:52 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:39:54.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:54 smithi060 ceph-mon[28215]: pgmap v251: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:54 smithi112 ceph-mon[35117]: pgmap v251: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:56.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:56 smithi060 ceph-mon[28215]: pgmap v252: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:56.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:56 smithi112 ceph-mon[35117]: pgmap v252: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:58.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:39:58 smithi060 ceph-mon[28215]: pgmap v253: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:39:58 smithi112 ceph-mon[35117]: pgmap v253: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:39:59.777 INFO:tasks.workunit.client.1.smithi112.stderr:Updating files: 87% (11155/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr:Note: switching to '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'. 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.689 INFO:tasks.workunit.client.1.smithi112.stderr: git switch -c 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr:Or undo this operation with: 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr: git switch - 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr: 2024-09-21T10:40:00.690 INFO:tasks.workunit.client.1.smithi112.stderr:HEAD is now at 5c1cdc3c470 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-21T10:40:00.695 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T10:40:00.764 INFO:tasks.workunit.client.1.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T10:40:00.766 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T10:40:00.766 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T10:40:00.883 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 92% (11755/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T10:40:00.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:00 smithi060 ceph-mon[28215]: pgmap v254: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:00 smithi060 ceph-mon[28215]: overall HEALTH_OK 2024-09-21T10:40:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:00 smithi112 ceph-mon[35117]: pgmap v254: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:00.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:00 smithi112 ceph-mon[35117]: overall HEALTH_OK 2024-09-21T10:40:01.659 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T10:40:01.760 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr:Note: switching to '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'. 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr: git switch -c 2024-09-21T10:40:01.785 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr:Or undo this operation with: 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr: git switch - 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T10:40:01.786 INFO:tasks.workunit.client.0.smithi060.stderr:HEAD is now at 5c1cdc3c470 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-21T10:40:01.790 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T10:40:01.805 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T10:40:01.807 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T10:40:01.807 INFO:tasks.workunit.client.1.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T10:40:01.828 INFO:tasks.workunit.client.0.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T10:40:01.830 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T10:40:01.830 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T10:40:01.851 INFO:tasks.workunit.client.1.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T10:40:01.855 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:40:01.855 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T10:40:01.912 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-21T10:40:01.913 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T10:40:01.914 DEBUG:teuthology.orchestra.run.smithi112:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-21T10:40:01.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:01 smithi060 ceph-mon[28215]: pgmap v255: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:01.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:01 smithi112 ceph-mon[35117]: pgmap v255: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:01.971 INFO:tasks.workunit.client.1.smithi112.stderr:+ mkdir -p fsstress 2024-09-21T10:40:01.973 INFO:tasks.workunit.client.1.smithi112.stderr:+ pushd fsstress 2024-09-21T10:40:01.973 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T10:40:01.973 INFO:tasks.workunit.client.1.smithi112.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T10:40:02.492 INFO:tasks.workunit.client.1.smithi112.stderr:+ tar xzf ltp-full.tgz 2024-09-21T10:40:02.557 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T10:40:02.630 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T10:40:02.672 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T10:40:02.673 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T10:40:02.674 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T10:40:02.715 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T10:40:02.719 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:40:02.719 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T10:40:02.776 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-21T10:40:02.777 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T10:40:02.777 DEBUG:teuthology.orchestra.run.smithi060:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-21T10:40:02.839 INFO:tasks.workunit.client.0.smithi060.stderr:+ mkdir -p fsstress 2024-09-21T10:40:02.841 INFO:tasks.workunit.client.0.smithi060.stderr:+ pushd fsstress 2024-09-21T10:40:02.841 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T10:40:02.841 INFO:tasks.workunit.client.0.smithi060.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T10:40:04.119 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar xzf ltp-full.tgz 2024-09-21T10:40:04.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:04 smithi060 ceph-mon[28215]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:04.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:04 smithi112 ceph-mon[35117]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:06.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:06 smithi060 ceph-mon[28215]: pgmap v257: 65 pgs: 65 active+clean; 4.6 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-09-21T10:40:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:06 smithi112 ceph-mon[35117]: pgmap v257: 65 pgs: 65 active+clean; 4.6 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-09-21T10:40:07.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:07 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:07.904 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:07 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:08.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:08 smithi060 ceph-mon[28215]: pgmap v258: 65 pgs: 65 active+clean; 8.6 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 682 KiB/s wr, 0 op/s 2024-09-21T10:40:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:08 smithi112 ceph-mon[35117]: pgmap v258: 65 pgs: 65 active+clean; 8.6 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 682 KiB/s wr, 0 op/s 2024-09-21T10:40:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:10 smithi112 ceph-mon[35117]: pgmap v259: 65 pgs: 65 active+clean; 25 MiB data, 257 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 197 op/s 2024-09-21T10:40:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:40:10.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:40:10.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:10 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:10.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:10 smithi060 ceph-mon[28215]: pgmap v259: 65 pgs: 65 active+clean; 25 MiB data, 257 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 197 op/s 2024-09-21T10:40:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:40:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:40:10.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:10 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:11.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:11 smithi112 ceph-mon[35117]: Upgrade: Updating mgr.smithi112.gkunly 2024-09-21T10:40:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:11 smithi112 ceph-mon[35117]: Deploying daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:40:11.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:11 smithi060 ceph-mon[28215]: Upgrade: Updating mgr.smithi112.gkunly 2024-09-21T10:40:11.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:11 smithi060 ceph-mon[28215]: Deploying daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:40:12.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:12 smithi060 ceph-mon[28215]: pgmap v260: 65 pgs: 65 active+clean; 49 MiB data, 328 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s wr, 325 op/s 2024-09-21T10:40:12.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:12 smithi112 ceph-mon[35117]: pgmap v260: 65 pgs: 65 active+clean; 49 MiB data, 328 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s wr, 325 op/s 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 -- 172.21.15.60:0/1145385532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fee30 msgr2=0x7fe73c0ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 --2- 172.21.15.60:0/1145385532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fee30 0x7fe73c0ff290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe728009880 tx=0x7fe72802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 -- 172.21.15.60:0/1145385532 shutdown_connections 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 --2- 172.21.15.60:0/1145385532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fee30 0x7fe73c0ff290 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 --2- 172.21.15.60:0/1145385532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c0fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 -- 172.21.15.60:0/1145385532 >> 172.21.15.60:0/1145385532 conn(0x7fe73c0fa280 msgr2=0x7fe73c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 -- 172.21.15.60:0/1145385532 shutdown_connections 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.460+0000 7fe74306e640 1 -- 172.21.15.60:0/1145385532 wait complete. 2024-09-21T10:40:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.461+0000 7fe74306e640 1 Processor -- start 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.461+0000 7fe74306e640 1 -- start start 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.461+0000 7fe74306e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.461+0000 7fe74306e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fee30 0x7fe73c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.461+0000 7fe74306e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c1983d0 con 0x7fe73c0fe4f0 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.461+0000 7fe74306e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c198540 con 0x7fe73c0fee30 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe740e0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe73bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fee30 0x7fe73c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe740e0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41714/0 (socket says 172.21.15.60:41714) 2024-09-21T10:40:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe740e0a640 1 -- 172.21.15.60:0/1848130037 learned_addr learned my addr 172.21.15.60:0/1848130037 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe73bfff640 1 -- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 msgr2=0x7fe73c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe73bfff640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c1978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe73bfff640 1 -- 172.21.15.60:0/1848130037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728009560 con 0x7fe73c0fee30 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe740e0a640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe73bfff640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fee30 0x7fe73c197e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe72802a9c0 tx=0x7fe7280054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe728004aa0 con 0x7fe73c0fee30 2024-09-21T10:40:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe728004c00 con 0x7fe73c0fee30 2024-09-21T10:40:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c19cf80 con 0x7fe73c0fee30 2024-09-21T10:40:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe728003a80 con 0x7fe73c0fee30 2024-09-21T10:40:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.463+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c19d440 con 0x7fe73c0fee30 2024-09-21T10:40:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.464+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c0fe8f0 con 0x7fe73c0fee30 2024-09-21T10:40:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.465+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe728031c90 con 0x7fe73c0fee30 2024-09-21T10:40:13.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.465+0000 7fe739ffb640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe72c06cc50 0x7fe72c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:13.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.465+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe7280ad3d0 con 0x7fe73c0fee30 2024-09-21T10:40:13.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.465+0000 7fe740e0a640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe72c06cc50 0x7fe72c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:13.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.466+0000 7fe740e0a640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe72c06cc50 0x7fe72c06f110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe730005fd0 tx=0x7fe73000b4a0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.470+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe728077750 con 0x7fe73c0fee30 2024-09-21T10:40:13.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.753+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe73c02c4f0 con 0x7fe72c06cc50 2024-09-21T10:40:13.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.754+0000 7fe739ffb640 1 -- 172.21.15.60:0/1848130037 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe73c02c4f0 con 0x7fe72c06cc50 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe72c06cc50 msgr2=0x7fe72c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe72c06cc50 0x7fe72c06f110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe730005fd0 tx=0x7fe73000b4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fee30 msgr2=0x7fe73c197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fee30 0x7fe73c197e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe72802a9c0 tx=0x7fe7280054f0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 shutdown_connections 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fe72c06cc50 0x7fe72c06f110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe73c0fee30 0x7fe73c197e00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 --2- 172.21.15.60:0/1848130037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73c0fe4f0 0x7fe73c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 >> 172.21.15.60:0/1848130037 conn(0x7fe73c0fa280 msgr2=0x7fe73c106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:13.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 shutdown_connections 2024-09-21T10:40:13.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.757+0000 7fe74306e640 1 -- 172.21.15.60:0/1848130037 wait complete. 2024-09-21T10:40:13.769 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:40:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.882+0000 7f76f6616640 1 -- 172.21.15.60:0/17497420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0074460 msgr2=0x7f76f00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.882+0000 7f76f6616640 1 --2- 172.21.15.60:0/17497420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0074460 0x7f76f00728c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009880 tx=0x7f76e002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.883+0000 7f76f6616640 1 -- 172.21.15.60:0/17497420 shutdown_connections 2024-09-21T10:40:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.883+0000 7f76f6616640 1 --2- 172.21.15.60:0/17497420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0072e00 0x7f76f0073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.883+0000 7f76f6616640 1 --2- 172.21.15.60:0/17497420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0074460 0x7f76f00728c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.883+0000 7f76f6616640 1 -- 172.21.15.60:0/17497420 >> 172.21.15.60:0/17497420 conn(0x7f76f00fb320 msgr2=0x7f76f00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.883+0000 7f76f6616640 1 -- 172.21.15.60:0/17497420 shutdown_connections 2024-09-21T10:40:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.883+0000 7f76f6616640 1 -- 172.21.15.60:0/17497420 wait complete. 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76f6616640 1 Processor -- start 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76f6616640 1 -- start start 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76f6616640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 0x7f76f01977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76f6616640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0074460 0x7f76f0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76f6616640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0198300 con 0x7f76f0072e00 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76f6616640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0198470 con 0x7f76f0074460 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76effff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 0x7f76f01977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76effff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 0x7f76f01977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41738/0 (socket says 172.21.15.60:41738) 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76effff640 1 -- 172.21.15.60:0/210898593 learned_addr learned my addr 172.21.15.60:0/210898593 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.884+0000 7f76ef7fe640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0074460 0x7f76f0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ef7fe640 1 -- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 msgr2=0x7f76f01977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ef7fe640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 0x7f76f01977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:13.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ef7fe640 1 -- 172.21.15.60:0/210898593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0009560 con 0x7f76f0074460 2024-09-21T10:40:13.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76effff640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 0x7f76f01977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ef7fe640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0074460 0x7f76f0197d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76e400d6d0 tx=0x7f76e400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e40051f0 con 0x7f76f0074460 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76e4004c60 con 0x7f76f0074460 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e4009d30 con 0x7f76f0074460 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f019cf10 con 0x7f76f0074460 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.885+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f019d4b0 con 0x7f76f0074460 2024-09-21T10:40:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.887+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f0073260 con 0x7f76f0074460 2024-09-21T10:40:13.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.888+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f76e40046c0 con 0x7f76f0074460 2024-09-21T10:40:13.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.888+0000 7f76ed7fa640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f76d806cc50 0x7f76d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:13.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.889+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f76e408bdc0 con 0x7f76f0074460 2024-09-21T10:40:13.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.889+0000 7f76effff640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f76d806cc50 0x7f76d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:13.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.889+0000 7f76effff640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f76d806cc50 0x7f76d806f110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76e0000c00 tx=0x7f76e00314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:13.893+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f76e4056200 con 0x7f76f0074460 2024-09-21T10:40:14.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.169+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f002c5a0 con 0x7f76d806cc50 2024-09-21T10:40:14.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.170+0000 7f76ed7fa640 1 -- 172.21.15.60:0/210898593 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f76f002c5a0 con 0x7f76d806cc50 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.173+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f76d806cc50 msgr2=0x7f76d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.173+0000 7f76f6616640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f76d806cc50 0x7f76d806f110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f76e0000c00 tx=0x7f76e00314e0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.173+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0074460 msgr2=0x7f76f0197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.173+0000 7f76f6616640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0074460 0x7f76f0197d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76e400d6d0 tx=0x7f76e400db90 comp rx=0 tx=0).stop 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 shutdown_connections 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f76d806cc50 0x7f76d806f110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f76f0074460 0x7f76f0197d30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 --2- 172.21.15.60:0/210898593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f0072e00 0x7f76f01977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 >> 172.21.15.60:0/210898593 conn(0x7f76f00fb320 msgr2=0x7f76f0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 shutdown_connections 2024-09-21T10:40:14.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.174+0000 7f76f6616640 1 -- 172.21.15.60:0/210898593 wait complete. 2024-09-21T10:40:14.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 -- 172.21.15.60:0/3133559364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 msgr2=0x7fee84073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/3133559364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84073260 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee74009880 tx=0x7fee7402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 -- 172.21.15.60:0/3133559364 shutdown_connections 2024-09-21T10:40:14.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/3133559364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84073260 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/3133559364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee84074460 0x7fee840728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 -- 172.21.15.60:0/3133559364 >> 172.21.15.60:0/3133559364 conn(0x7fee840fb2c0 msgr2=0x7fee840fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:14.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 -- 172.21.15.60:0/3133559364 shutdown_connections 2024-09-21T10:40:14.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.272+0000 7fee8c0eb640 1 -- 172.21.15.60:0/3133559364 wait complete. 2024-09-21T10:40:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee8c0eb640 1 Processor -- start 2024-09-21T10:40:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee8c0eb640 1 -- start start 2024-09-21T10:40:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee8c0eb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee8c0eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee84074460 0x7fee84197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:14.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee8c0eb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84198260 con 0x7fee84072e00 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee8c0eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee841983d0 con 0x7fee84074460 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee89e87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee89e87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46706/0 (socket says 172.21.15.60:46706) 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee89e87640 1 -- 172.21.15.60:0/732877672 learned_addr learned my addr 172.21.15.60:0/732877672 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.273+0000 7fee89686640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee84074460 0x7fee84197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee89e87640 1 -- 172.21.15.60:0/732877672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee84074460 msgr2=0x7fee84197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee89e87640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee84074460 0x7fee84197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee89e87640 1 -- 172.21.15.60:0/732877672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009560 con 0x7fee84072e00 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee89e87640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84197750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee8000e9a0 tx=0x7fee8000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee8000cc90 con 0x7fee84072e00 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee8000cdf0 con 0x7fee84072e00 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8419ce70 con 0x7fee84072e00 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee800187f0 con 0x7fee84072e00 2024-09-21T10:40:14.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.274+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8419d3b0 con 0x7fee84072e00 2024-09-21T10:40:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.276+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fee80010c10 con 0x7fee84072e00 2024-09-21T10:40:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.276+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee84073260 con 0x7fee84072e00 2024-09-21T10:40:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.276+0000 7fee7affd640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fee7006cc60 0x7fee7006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.276+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fee80014070 con 0x7fee84072e00 2024-09-21T10:40:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.276+0000 7fee89686640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fee7006cc60 0x7fee7006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.277+0000 7fee89686640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fee7006cc60 0x7fee7006f120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee74000c00 tx=0x7fee740314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:14.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.281+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee80052e20 con 0x7fee84072e00 2024-09-21T10:40:14.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.496+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee8402c550 con 0x7fee7006cc60 2024-09-21T10:40:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.509+0000 7fee7affd640 1 -- 172.21.15.60:0/732877672 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fee8402c550 con 0x7fee7006cc60 2024-09-21T10:40:14.512 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:40:14.512 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (6m) 93s ago 8m 24.7M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:40:14.512 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (8m) 93s ago 8m 7520k - 18.2.4-871-g6a1bdf85 0adab276c97e 6a6a2a8801c8 2024-09-21T10:40:14.512 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (7m) 100s ago 7m 7251k - 18.2.4-871-g6a1bdf85 0adab276c97e 7163dd4d91a2 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (8m) 93s ago 8m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (7m) 100s ago 7m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (6m) 93s ago 7m 82.1M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (114s) 93s ago 113s 19.0M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (2m) 93s ago 119s 11.9M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (111s) 100s ago 111s 13.7M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (117s) 100s ago 117s 16.0M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:9283,8765,8443 running (9m) 93s ago 9m 487M - 18.2.4-871-g6a1bdf85 0adab276c97e d9748f7fa031 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (7m) 100s ago 7m 439M - 18.2.4-871-g6a1bdf85 0adab276c97e 644d995876b0 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (9m) 93s ago 9m 45.6M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (7m) 100s ago 7m 35.2M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 93s ago 8m 15.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:40:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 100s ago 7m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (5m) 93s ago 5m 50.6M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 93s ago 5m 47.2M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (4m) 93s ago 4m 54.7M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (4m) 100s ago 4m 54.2M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (3m) 100s ago 3m 43.7M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (3m) 100s ago 3m 52.2M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:40:14.514 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (5m) 93s ago 7m 56.4M - 2.43.0 a07b618ecd1d 9edc141eabb8 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fee7006cc60 msgr2=0x7fee7006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fee7006cc60 0x7fee7006f120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee74000c00 tx=0x7fee740314e0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 msgr2=0x7fee84197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84197750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fee8000e9a0 tx=0x7fee8000ee60 comp rx=0 tx=0).stop 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 shutdown_connections 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fee7006cc60 0x7fee7006f120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee84074460 0x7fee84197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 --2- 172.21.15.60:0/732877672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84072e00 0x7fee84197750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 >> 172.21.15.60:0/732877672 conn(0x7fee840fb2c0 msgr2=0x7fee84105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 shutdown_connections 2024-09-21T10:40:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.512+0000 7fee8c0eb640 1 -- 172.21.15.60:0/732877672 wait complete. 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 -- 172.21.15.60:0/2224197678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778101d90 msgr2=0x7f6778102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 --2- 172.21.15.60:0/2224197678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778101d90 0x7f6778102190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6774009880 tx=0x7f677402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 -- 172.21.15.60:0/2224197678 shutdown_connections 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 --2- 172.21.15.60:0/2224197678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6778102f90 0x7f6778103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 --2- 172.21.15.60:0/2224197678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778101d90 0x7f6778102190 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 -- 172.21.15.60:0/2224197678 >> 172.21.15.60:0/2224197678 conn(0x7f67780fd520 msgr2=0x7f67780ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 -- 172.21.15.60:0/2224197678 shutdown_connections 2024-09-21T10:40:14.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.604+0000 7f67806e8640 1 -- 172.21.15.60:0/2224197678 wait complete. 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f67806e8640 1 Processor -- start 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f67806e8640 1 -- start start 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f67806e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6778101d90 0x7f6778197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f67806e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 0x7f6778197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f67806e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778198350 con 0x7f6778102f90 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f67806e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67781984c0 con 0x7f6778101d90 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f677dc83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 0x7f6778197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f677dc83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 0x7f6778197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46734/0 (socket says 172.21.15.60:46734) 2024-09-21T10:40:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.605+0000 7f677dc83640 1 -- 172.21.15.60:0/1812087078 learned_addr learned my addr 172.21.15.60:0/1812087078 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f677e484640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6778101d90 0x7f6778197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f677dc83640 1 -- 172.21.15.60:0/1812087078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6778101d90 msgr2=0x7f6778197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f677dc83640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6778101d90 0x7f6778197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f677dc83640 1 -- 172.21.15.60:0/1812087078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774009560 con 0x7f6778102f90 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f677dc83640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 0x7f6778197d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f676800e9a0 tx=0x7f676800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f676800cd50 con 0x7f6778102f90 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677819cf60 con 0x7f6778102f90 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677819d500 con 0x7f6778102f90 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f676800ceb0 con 0x7f6778102f90 2024-09-21T10:40:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.606+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6768010660 con 0x7f6778102f90 2024-09-21T10:40:14.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.608+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f67680107c0 con 0x7f6778102f90 2024-09-21T10:40:14.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.608+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6778102190 con 0x7f6778102f90 2024-09-21T10:40:14.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.609+0000 7f676f7fe640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f676406cc50 0x7f676406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.609+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6768014070 con 0x7f6778102f90 2024-09-21T10:40:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.609+0000 7f677e484640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f676406cc50 0x7f676406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.609+0000 7f677e484640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f676406cc50 0x7f676406f110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6774009230 tx=0x7f67740314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.614+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6768056af0 con 0x7f6778102f90 2024-09-21T10:40:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.927+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6778191930 con 0x7f6778102f90 2024-09-21T10:40:14.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:14 smithi060 ceph-mon[28215]: pgmap v261: 65 pgs: 65 active+clean; 54 MiB data, 380 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s wr, 358 op/s 2024-09-21T10:40:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.928+0000 7f676f7fe640 1 -- 172.21.15.60:0/1812087078 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f676805a110 con 0x7f6778102f90 2024-09-21T10:40:14.930 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:40:14.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:40:14.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 14 2024-09-21T10:40:14.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:40:14.932 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:40:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f676406cc50 msgr2=0x7f676406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f676406cc50 0x7f676406f110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6774009230 tx=0x7f67740314e0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 msgr2=0x7f6778197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 0x7f6778197d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f676800e9a0 tx=0x7f676800eda0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 shutdown_connections 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f676406cc50 0x7f676406f110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6778102f90 0x7f6778197d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 --2- 172.21.15.60:0/1812087078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6778101d90 0x7f6778197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 >> 172.21.15.60:0/1812087078 conn(0x7f67780fd520 msgr2=0x7f67781066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 shutdown_connections 2024-09-21T10:40:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:14.930+0000 7f67806e8640 1 -- 172.21.15.60:0/1812087078 wait complete. 2024-09-21T10:40:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:14 smithi112 ceph-mon[35117]: pgmap v261: 65 pgs: 65 active+clean; 54 MiB data, 380 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s wr, 358 op/s 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 -- 172.21.15.60:0/1181367652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb44103010 msgr2=0x7fbb44105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 --2- 172.21.15.60:0/1181367652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb44103010 0x7fbb44105400 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009880 tx=0x7fbb3802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 -- 172.21.15.60:0/1181367652 shutdown_connections 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 --2- 172.21.15.60:0/1181367652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb44103010 0x7fbb44105400 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 --2- 172.21.15.60:0/1181367652 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb441006e0 0x7fbb44102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 -- 172.21.15.60:0/1181367652 >> 172.21.15.60:0/1181367652 conn(0x7fbb440fa280 msgr2=0x7fbb440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 -- 172.21.15.60:0/1181367652 shutdown_connections 2024-09-21T10:40:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.019+0000 7fbb4a319640 1 -- 172.21.15.60:0/1181367652 wait complete. 2024-09-21T10:40:15.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.020+0000 7fbb4a319640 1 Processor -- start 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.020+0000 7fbb4a319640 1 -- start start 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb4a319640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 0x7fbb44195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb4a319640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb44103010 0x7fbb44195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb4a319640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44196150 con 0x7fbb441006e0 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb4a319640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441962c0 con 0x7fbb44103010 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb43fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 0x7fbb44195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb43fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 0x7fbb44195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46762/0 (socket says 172.21.15.60:46762) 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb43fff640 1 -- 172.21.15.60:0/18449787 learned_addr learned my addr 172.21.15.60:0/18449787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb437fe640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb44103010 0x7fbb44195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb43fff640 1 -- 172.21.15.60:0/18449787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb44103010 msgr2=0x7fbb44195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb43fff640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb44103010 0x7fbb44195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.021+0000 7fbb43fff640 1 -- 172.21.15.60:0/18449787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38009560 con 0x7fbb441006e0 2024-09-21T10:40:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.022+0000 7fbb43fff640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 0x7fbb44195640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400d720 tx=0x7fbb3400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.022+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb340051f0 con 0x7fbb441006e0 2024-09-21T10:40:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.022+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4419ad60 con 0x7fbb441006e0 2024-09-21T10:40:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.022+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb34009ce0 con 0x7fbb441006e0 2024-09-21T10:40:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.022+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb34010460 con 0x7fbb441006e0 2024-09-21T10:40:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.022+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4419b220 con 0x7fbb441006e0 2024-09-21T10:40:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.023+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb44108790 con 0x7fbb441006e0 2024-09-21T10:40:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.024+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbb34005350 con 0x7fbb441006e0 2024-09-21T10:40:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.024+0000 7fbb417fa640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbb2c06cc50 0x7fbb2c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.024+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbb3408bdc0 con 0x7fbb441006e0 2024-09-21T10:40:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.024+0000 7fbb437fe640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbb2c06cc50 0x7fbb2c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.025+0000 7fbb437fe640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbb2c06cc50 0x7fbb2c06f110 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009230 tx=0x7fbb380314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:15.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.031+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbb340561e0 con 0x7fbb441006e0 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.312+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb4419b700 con 0x7fbb441006e0 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.313+0000 7fbb417fa640 1 -- 172.21.15.60:0/18449787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fbb34020750 con 0x7fbb441006e0 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:40:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:40:15.316 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:40:15.317 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:15.318 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbb2c06cc50 msgr2=0x7fbb2c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbb2c06cc50 0x7fbb2c06f110 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009230 tx=0x7fbb380314e0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 msgr2=0x7fbb44195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 0x7fbb44195640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400d720 tx=0x7fbb3400dbe0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 shutdown_connections 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fbb2c06cc50 0x7fbb2c06f110 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb44103010 0x7fbb44195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 --2- 172.21.15.60:0/18449787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb441006e0 0x7fbb44195640 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 >> 172.21.15.60:0/18449787 conn(0x7fbb440fa280 msgr2=0x7fbb440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 shutdown_connections 2024-09-21T10:40:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.316+0000 7fbb4a319640 1 -- 172.21.15.60:0/18449787 wait complete. 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.411+0000 7fc2b9a55640 1 -- 172.21.15.60:0/3993809267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40ffcf0 msgr2=0x7fc2b4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.411+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/3993809267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40ffcf0 0x7fc2b4100170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009880 tx=0x7fc2a802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.411+0000 7fc2b9a55640 1 -- 172.21.15.60:0/3993809267 shutdown_connections 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.411+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/3993809267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40ffcf0 0x7fc2b4100170 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.411+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/3993809267 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2b40feaf0 0x7fc2b40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.411+0000 7fc2b9a55640 1 -- 172.21.15.60:0/3993809267 >> 172.21.15.60:0/3993809267 conn(0x7fc2b40fa280 msgr2=0x7fc2b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.412+0000 7fc2b9a55640 1 -- 172.21.15.60:0/3993809267 shutdown_connections 2024-09-21T10:40:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.412+0000 7fc2b9a55640 1 -- 172.21.15.60:0/3993809267 wait complete. 2024-09-21T10:40:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.412+0000 7fc2b9a55640 1 Processor -- start 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.412+0000 7fc2b9a55640 1 -- start start 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.412+0000 7fc2b9a55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 0x7fc2b4102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.412+0000 7fc2b9a55640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2b40ffcf0 0x7fc2b41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b9a55640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4101610 con 0x7fc2b40feaf0 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b9a55640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4101780 con 0x7fc2b40ffcf0 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 0x7fc2b4102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 0x7fc2b4102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46788/0 (socket says 172.21.15.60:46788) 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 -- 172.21.15.60:0/2050037707 learned_addr learned my addr 172.21.15.60:0/2050037707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b27fc640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2b40ffcf0 0x7fc2b41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 -- 172.21.15.60:0/2050037707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2b40ffcf0 msgr2=0x7fc2b41010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2b40ffcf0 0x7fc2b41010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 -- 172.21.15.60:0/2050037707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009560 con 0x7fc2b40feaf0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b2ffd640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 0x7fc2b4102a80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400d8d0 tx=0x7fc2a400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.413+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a400bea0 con 0x7fc2b40feaf0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.414+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2a4009c00 con 0x7fc2b40feaf0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.414+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b4101a60 con 0x7fc2b40feaf0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.414+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a400f790 con 0x7fc2b40feaf0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.414+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b419d710 con 0x7fc2b40feaf0 2024-09-21T10:40:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.415+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40feef0 con 0x7fc2b40feaf0 2024-09-21T10:40:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.416+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc2a400fa00 con 0x7fc2b40feaf0 2024-09-21T10:40:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.416+0000 7fc2b8a53640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc29c06cc50 0x7fc29c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.416+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc2a408c130 con 0x7fc2b40feaf0 2024-09-21T10:40:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.416+0000 7fc2b27fc640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc29c06cc50 0x7fc29c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.417+0000 7fc2b27fc640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc29c06cc50 0x7fc29c06f110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8000c00 tx=0x7fc2a80314e0 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.423+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2a4056520 con 0x7fc2b40feaf0 2024-09-21T10:40:15.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.642+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 --> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b4068390 con 0x7fc29c06cc50 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.644+0000 7fc2b8a53640 1 -- 172.21.15.60:0/2050037707 <== mgr.14209 v2:172.21.15.60:6800/1365116952 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc2b4068390 con 0x7fc29c06cc50 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "0/23 daemons upgraded", 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T10:40:15.646 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:40:15.647 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:40:15.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc29c06cc50 msgr2=0x7fc29c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc29c06cc50 0x7fc29c06f110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8000c00 tx=0x7fc2a80314e0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 msgr2=0x7fc2b4102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 0x7fc2b4102a80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400d8d0 tx=0x7fc2a400dd90 comp rx=0 tx=0).stop 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 shutdown_connections 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7fc29c06cc50 0x7fc29c06f110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2b40ffcf0 0x7fc2b41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 --2- 172.21.15.60:0/2050037707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2b40feaf0 0x7fc2b4102a80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 >> 172.21.15.60:0/2050037707 conn(0x7fc2b40fa280 msgr2=0x7fc2b4067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 shutdown_connections 2024-09-21T10:40:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.646+0000 7fc2b9a55640 1 -- 172.21.15.60:0/2050037707 wait complete. 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.745+0000 7f599594b640 1 -- 172.21.15.60:0/478305494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 msgr2=0x7f5990106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.745+0000 7f599594b640 1 --2- 172.21.15.60:0/478305494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f5990106a70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5980009880 tx=0x7f598002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.745+0000 7f599594b640 1 -- 172.21.15.60:0/478305494 shutdown_connections 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.745+0000 7f599594b640 1 --2- 172.21.15.60:0/478305494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59901073f0 0x7f5990107870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.745+0000 7f599594b640 1 --2- 172.21.15.60:0/478305494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f5990106a70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.745+0000 7f599594b640 1 -- 172.21.15.60:0/478305494 >> 172.21.15.60:0/478305494 conn(0x7f59900755a0 msgr2=0x7f59900779c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.746+0000 7f599594b640 1 -- 172.21.15.60:0/478305494 shutdown_connections 2024-09-21T10:40:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.746+0000 7f599594b640 1 -- 172.21.15.60:0/478305494 wait complete. 2024-09-21T10:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.746+0000 7f599594b640 1 Processor -- start 2024-09-21T10:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f599594b640 1 -- start start 2024-09-21T10:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f599594b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f599019bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f599594b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59901073f0 0x7f599019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f599594b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599019c750 con 0x7f5990106670 2024-09-21T10:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f599594b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599019c8c0 con 0x7f59901073f0 2024-09-21T10:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f598effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f599019bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f598effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f599019bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46796/0 (socket says 172.21.15.60:46796) 2024-09-21T10:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f598effd640 1 -- 172.21.15.60:0/2841228299 learned_addr learned my addr 172.21.15.60:0/2841228299 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.747+0000 7f598e7fc640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59901073f0 0x7f599019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f598effd640 1 -- 172.21.15.60:0/2841228299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59901073f0 msgr2=0x7f599019c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f598effd640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59901073f0 0x7f599019c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f598effd640 1 -- 172.21.15.60:0/2841228299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980009560 con 0x7f5990106670 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f598effd640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f599019bc40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f598002a9c0 tx=0x7f59800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5980004aa0 con 0x7f5990106670 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59901a12f0 con 0x7f5990106670 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5980005d50 con 0x7f5990106670 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.748+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59800039e0 con 0x7f5990106670 2024-09-21T10:40:15.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.749+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59901a1860 con 0x7f5990106670 2024-09-21T10:40:15.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.750+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599010edc0 con 0x7f5990106670 2024-09-21T10:40:15.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.751+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5980031c00 con 0x7f5990106670 2024-09-21T10:40:15.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.751+0000 7f5994949640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f597806cc50 0x7f597806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:15.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.751+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f59800ad2f0 con 0x7f5990106670 2024-09-21T10:40:15.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.752+0000 7f598e7fc640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f597806cc50 0x7f597806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:15.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.753+0000 7f598e7fc640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f597806cc50 0x7f597806f110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5984009bd0 tx=0x7f5984005f90 comp rx=0 tx=0).ready entity=mgr.14209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:15.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:15.757+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5980077710 con 0x7f5990106670 2024-09-21T10:40:15.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:15 smithi060 ceph-mon[28215]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:15 smithi060 ceph-mon[28215]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:15 smithi060 ceph-mon[28215]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:15 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1812087078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:40:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:15 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/18449787' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:40:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:15 smithi112 ceph-mon[35117]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:15 smithi112 ceph-mon[35117]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:15 smithi112 ceph-mon[35117]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:15.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:15 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1812087078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:40:15.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:15 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/18449787' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:40:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.031+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f599010ef50 con 0x7f5990106670 2024-09-21T10:40:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.032+0000 7f5994949640 1 -- 172.21.15.60:0/2841228299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f598007ad30 con 0x7f5990106670 2024-09-21T10:40:16.034 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:40:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f597806cc50 msgr2=0x7f597806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f597806cc50 0x7f597806f110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5984009bd0 tx=0x7f5984005f90 comp rx=0 tx=0).stop 2024-09-21T10:40:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 msgr2=0x7f599019bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f599019bc40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f598002a9c0 tx=0x7f59800055a0 comp rx=0 tx=0).stop 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 shutdown_connections 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:6800/1365116952,v1:172.21.15.60:6801/1365116952] conn(0x7f597806cc50 0x7f597806f110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59901073f0 0x7f599019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 --2- 172.21.15.60:0/2841228299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5990106670 0x7f599019bc40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 >> 172.21.15.60:0/2841228299 conn(0x7f59900755a0 msgr2=0x7f599010a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 shutdown_connections 2024-09-21T10:40:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:16.034+0000 7f599594b640 1 -- 172.21.15.60:0/2841228299 wait complete. 2024-09-21T10:40:16.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:16 smithi060 ceph-mon[28215]: pgmap v262: 65 pgs: 65 active+clean; 73 MiB data, 437 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 387 op/s 2024-09-21T10:40:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:16 smithi060 ceph-mon[28215]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:16.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:16 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2841228299' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:40:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:16 smithi112 ceph-mon[35117]: pgmap v262: 65 pgs: 65 active+clean; 73 MiB data, 437 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 387 op/s 2024-09-21T10:40:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:16 smithi112 ceph-mon[35117]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:16 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2841228299' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:40:17.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:17 smithi060 ceph-mon[28215]: pgmap v263: 65 pgs: 65 active+clean; 73 MiB data, 441 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s wr, 387 op/s 2024-09-21T10:40:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:17 smithi112 ceph-mon[35117]: pgmap v263: 65 pgs: 65 active+clean; 73 MiB data, 441 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s wr, 387 op/s 2024-09-21T10:40:20.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:20 smithi112 ceph-mon[35117]: pgmap v264: 65 pgs: 65 active+clean; 87 MiB data, 467 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s wr, 464 op/s 2024-09-21T10:40:20.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:20 smithi060 ceph-mon[28215]: pgmap v264: 65 pgs: 65 active+clean; 87 MiB data, 467 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s wr, 464 op/s 2024-09-21T10:40:22.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:22 smithi060 ceph-mon[28215]: pgmap v265: 65 pgs: 65 active+clean; 104 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s wr, 484 op/s 2024-09-21T10:40:22.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:22 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:22 smithi112 ceph-mon[35117]: pgmap v265: 65 pgs: 65 active+clean; 104 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s wr, 484 op/s 2024-09-21T10:40:22.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:22 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:24.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:24 smithi060 ceph-mon[28215]: pgmap v266: 65 pgs: 65 active+clean; 117 MiB data, 590 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s wr, 529 op/s 2024-09-21T10:40:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:24 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:40:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:24 smithi112 ceph-mon[35117]: pgmap v266: 65 pgs: 65 active+clean; 117 MiB data, 590 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s wr, 529 op/s 2024-09-21T10:40:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:24 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:40:26.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:26 smithi060 ceph-mon[28215]: pgmap v267: 65 pgs: 65 active+clean; 135 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s wr, 693 op/s 2024-09-21T10:40:26.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:26 smithi112 ceph-mon[35117]: pgmap v267: 65 pgs: 65 active+clean; 135 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s wr, 693 op/s 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: pgmap v268: 65 pgs: 65 active+clean; 139 MiB data, 698 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s wr, 667 op/s 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: Standby manager daemon smithi112.gkunly restarted 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:28.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:28 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: pgmap v268: 65 pgs: 65 active+clean; 139 MiB data, 698 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s wr, 667 op/s 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly restarted 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:40:28.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:28.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:28 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:29.663 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:29 smithi112 ceph-mon[35117]: mgrmap e20: smithi060.mulzpr(active, since 7m), standbys: smithi112.gkunly 2024-09-21T10:40:29.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:29 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:29.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:29 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:29.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:29 smithi060 ceph-mon[28215]: mgrmap e20: smithi060.mulzpr(active, since 7m), standbys: smithi112.gkunly 2024-09-21T10:40:29.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:29 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:29 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:30.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:30 smithi112 ceph-mon[35117]: pgmap v269: 65 pgs: 65 active+clean; 154 MiB data, 727 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s wr, 676 op/s 2024-09-21T10:40:30.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:30 smithi060 ceph-mon[28215]: pgmap v269: 65 pgs: 65 active+clean; 154 MiB data, 727 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s wr, 676 op/s 2024-09-21T10:40:32.011 INFO:tasks.workunit.client.1.smithi112.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T10:40:32.035 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T10:40:32.035 INFO:tasks.workunit.client.1.smithi112.stderr:+ make 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: pgmap v270: 65 pgs: 65 active+clean; 158 MiB data, 739 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 599 op/s 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:32.624 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr fail", "who": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: Activating manager daemon smithi112.gkunly 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "mgr fail", "who": "smithi060.mulzpr"}]': finished 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: mgrmap e21: smithi112.gkunly(active, starting, since 0.00838683s) 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:40:32.625 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:40:32.626 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:32 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:40:32.834 INFO:tasks.workunit.client.1.smithi112.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: pgmap v270: 65 pgs: 65 active+clean; 158 MiB data, 739 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 599 op/s 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr fail", "who": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: Activating manager daemon smithi112.gkunly 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T10:40:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.14209 172.21.15.60:0/2124988443' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "mgr fail", "who": "smithi060.mulzpr"}]': finished 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: mgrmap e21: smithi112.gkunly(active, starting, since 0.00838683s) 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:40:32.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:40:32.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:40:32.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:40:32.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:32 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:40:33.129 INFO:tasks.workunit.client.1.smithi112.stderr:++ readlink -f fsstress 2024-09-21T10:40:33.130 INFO:tasks.workunit.client.1.smithi112.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T10:40:33.130 INFO:tasks.workunit.client.1.smithi112.stderr:+ popd 2024-09-21T10:40:33.130 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T10:40:33.130 INFO:tasks.workunit.client.1.smithi112.stderr:+ popd 2024-09-21T10:40:33.130 INFO:tasks.workunit.client.1.smithi112.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-21T10:40:33.131 INFO:tasks.workunit.client.1.smithi112.stderr:++ mktemp -d -p . 2024-09-21T10:40:33.132 INFO:tasks.workunit.client.1.smithi112.stderr:+ T=./tmp.20FFPXnV11 2024-09-21T10:40:33.132 INFO:tasks.workunit.client.1.smithi112.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.20FFPXnV11 -l 1 -n 1000 -p 10 -v 2024-09-21T10:40:33.133 INFO:tasks.workunit.client.1.smithi112.stdout:seed = 1726784555 2024-09-21T10:40:33.138 INFO:tasks.workunit.client.1.smithi112.stdout:0/0: mknod c0 0 2024-09-21T10:40:33.138 INFO:tasks.workunit.client.1.smithi112.stdout:0/1: stat c0 0 2024-09-21T10:40:33.138 INFO:tasks.workunit.client.1.smithi112.stdout:0/2: dread - no filename 2024-09-21T10:40:33.138 INFO:tasks.workunit.client.1.smithi112.stdout:0/3: dread - no filename 2024-09-21T10:40:33.140 INFO:tasks.workunit.client.1.smithi112.stdout:1/0: creat f0 x:0 0 0 2024-09-21T10:40:33.140 INFO:tasks.workunit.client.1.smithi112.stdout:1/1: fdatasync f0 0 2024-09-21T10:40:33.140 INFO:tasks.workunit.client.1.smithi112.stdout:1/2: creat f1 x:0 0 0 2024-09-21T10:40:33.141 INFO:tasks.workunit.client.1.smithi112.stdout:0/4: rename c0 to c1 0 2024-09-21T10:40:33.141 INFO:tasks.workunit.client.1.smithi112.stdout:0/5: dwrite - no filename 2024-09-21T10:40:33.141 INFO:tasks.workunit.client.1.smithi112.stdout:0/6: chown c1 1 1 2024-09-21T10:40:33.142 INFO:tasks.workunit.client.1.smithi112.stdout:3/0: dwrite - no filename 2024-09-21T10:40:33.142 INFO:tasks.workunit.client.1.smithi112.stdout:3/1: rename - no filename 2024-09-21T10:40:33.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/0: mkdir d0 0 2024-09-21T10:40:33.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/1: dwrite - no filename 2024-09-21T10:40:33.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/2: chown d0 4687 1 2024-09-21T10:40:33.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/3: truncate - no filename 2024-09-21T10:40:33.143 INFO:tasks.workunit.client.1.smithi112.stdout:2/4: chown d0 101 1 2024-09-21T10:40:33.145 INFO:tasks.workunit.client.1.smithi112.stdout:1/3: rename f0 to f2 0 2024-09-21T10:40:33.145 INFO:tasks.workunit.client.1.smithi112.stdout:1/4: dread - f1 zero size 2024-09-21T10:40:33.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/5: truncate f2 714183 0 2024-09-21T10:40:33.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/6: rmdir - no directory 2024-09-21T10:40:33.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/7: readlink - no filename 2024-09-21T10:40:33.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/8: write f1 [578475,53754] 0 2024-09-21T10:40:33.146 INFO:tasks.workunit.client.1.smithi112.stdout:1/9: creat f3 x:0 0 0 2024-09-21T10:40:33.148 INFO:tasks.workunit.client.1.smithi112.stdout:2/5: creat d0/f1 x:0 0 0 2024-09-21T10:40:33.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/0: readlink - no filename 2024-09-21T10:40:33.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/1: chown . 218 1 2024-09-21T10:40:33.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/2: dwrite - no filename 2024-09-21T10:40:33.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/3: dread - no filename 2024-09-21T10:40:33.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/4: getdents . 0 2024-09-21T10:40:33.151 INFO:tasks.workunit.client.1.smithi112.stdout:4/0: creat f0 x:0 0 0 2024-09-21T10:40:33.153 INFO:tasks.workunit.client.1.smithi112.stdout:6/0: getdents . 0 2024-09-21T10:40:33.153 INFO:tasks.workunit.client.1.smithi112.stdout:6/1: readlink - no filename 2024-09-21T10:40:33.153 INFO:tasks.workunit.client.1.smithi112.stdout:5/5: symlink l0 0 2024-09-21T10:40:33.153 INFO:tasks.workunit.client.1.smithi112.stdout:5/6: dwrite - no filename 2024-09-21T10:40:33.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/0: truncate - no filename 2024-09-21T10:40:33.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/1: write - no filename 2024-09-21T10:40:33.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/2: fdatasync - no filename 2024-09-21T10:40:33.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/3: dread - no filename 2024-09-21T10:40:33.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/4: chown . 45624399 1 2024-09-21T10:40:33.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/5: link - no file 2024-09-21T10:40:33.156 INFO:tasks.workunit.client.1.smithi112.stdout:6/2: symlink l0 0 2024-09-21T10:40:33.157 INFO:tasks.workunit.client.1.smithi112.stdout:5/7: symlink l1 0 2024-09-21T10:40:33.157 INFO:tasks.workunit.client.1.smithi112.stdout:5/8: fdatasync - no filename 2024-09-21T10:40:33.163 INFO:tasks.workunit.client.1.smithi112.stdout:5/9: symlink l2 0 2024-09-21T10:40:33.163 INFO:tasks.workunit.client.1.smithi112.stdout:6/3: creat f1 x:0 0 0 2024-09-21T10:40:33.164 INFO:tasks.workunit.client.1.smithi112.stdout:6/4: creat f2 x:0 0 0 2024-09-21T10:40:33.172 INFO:tasks.workunit.client.1.smithi112.stdout:8/0: creat f0 x:0 0 0 2024-09-21T10:40:33.172 INFO:tasks.workunit.client.1.smithi112.stdout:9/0: dwrite - no filename 2024-09-21T10:40:33.176 INFO:tasks.workunit.client.1.smithi112.stdout:5/10: creat f3 x:0 0 0 2024-09-21T10:40:33.176 INFO:tasks.workunit.client.1.smithi112.stdout:5/11: chown l1 211535542 1 2024-09-21T10:40:33.853 INFO:tasks.workunit.client.1.smithi112.stdout:0/7: rename c1 to c2 0 2024-09-21T10:40:33.856 INFO:tasks.workunit.client.1.smithi112.stdout:1/10: fsync f1 0 2024-09-21T10:40:33.856 INFO:tasks.workunit.client.1.smithi112.stdout:1/11: dread - f3 zero size 2024-09-21T10:40:33.888 INFO:tasks.workunit.client.1.smithi112.stdout:6/5: fsync f2 0 2024-09-21T10:40:33.930 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:33 smithi060 ceph-mon[28215]: Manager daemon smithi112.gkunly is now available 2024-09-21T10:40:33.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:33 smithi112 ceph-mon[35117]: Manager daemon smithi112.gkunly is now available 2024-09-21T10:40:34.063 INFO:tasks.workunit.client.1.smithi112.stdout:4/1: dwrite f0 [0,4194304] 0 2024-09-21T10:40:34.139 INFO:tasks.workunit.client.1.smithi112.stdout:8/1: dwrite f0 [0,4194304] 0 2024-09-21T10:40:34.488 INFO:tasks.workunit.client.1.smithi112.stdout:2/6: dwrite d0/f1 [0,4194304] 0 2024-09-21T10:40:34.488 INFO:tasks.workunit.client.1.smithi112.stdout:2/7: fdatasync d0/f1 0 2024-09-21T10:40:34.527 INFO:tasks.workunit.client.1.smithi112.stdout:1/12: dwrite f2 [0,4194304] 0 2024-09-21T10:40:34.527 INFO:tasks.workunit.client.1.smithi112.stdout:1/13: write f3 [310937,30377] 0 2024-09-21T10:40:34.528 INFO:tasks.workunit.client.1.smithi112.stdout:1/14: write f3 [632679,17343] 0 2024-09-21T10:40:34.548 INFO:tasks.workunit.client.1.smithi112.stdout:1/15: write f1 [499826,85439] 0 2024-09-21T10:40:34.575 INFO:tasks.workunit.client.1.smithi112.stdout:8/2: dread f0 [0,4194304] 0 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: mgrmap e22: smithi112.gkunly(active, since 1.29559s) 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: pgmap v3: 65 pgs: 65 active+clean; 185 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:40:34.790 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:34.791 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:40:34.791 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:40:34.791 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:40:34.791 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/trash_purge_schedule"}]: dispatch 2024-09-21T10:40:34.791 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:34 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/trash_purge_schedule"}]: dispatch 2024-09-21T10:40:34.829 INFO:tasks.workunit.client.1.smithi112.stdout:6/6: dwrite f1 [0,4194304] 0 2024-09-21T10:40:34.877 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: mgrmap e22: smithi112.gkunly(active, since 1.29559s) 2024-09-21T10:40:34.877 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: pgmap v3: 65 pgs: 65 active+clean; 185 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/trash_purge_schedule"}]: dispatch 2024-09-21T10:40:34.878 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:34 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi112.gkunly/trash_purge_schedule"}]: dispatch 2024-09-21T10:40:35.837 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:35 smithi060 ceph-mon[28215]: Checking for cert/key for grafana.smithi060 2024-09-21T10:40:35.837 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:35 smithi060 ceph-mon[28215]: Migrating grafana.smithi060 cert to cert store 2024-09-21T10:40:35.838 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:35 smithi060 ceph-mon[28215]: Migrating grafana.smithi060 key to cert store 2024-09-21T10:40:35.838 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:35 smithi060 ceph-mon[28215]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:40:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:35 smithi112 ceph-mon[35117]: Checking for cert/key for grafana.smithi060 2024-09-21T10:40:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:35 smithi112 ceph-mon[35117]: Migrating grafana.smithi060 cert to cert store 2024-09-21T10:40:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:35 smithi112 ceph-mon[35117]: Migrating grafana.smithi060 key to cert store 2024-09-21T10:40:35.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:35 smithi112 ceph-mon[35117]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:40:36.336 INFO:tasks.workunit.client.1.smithi112.stdout:0/8: mkdir d3 0 2024-09-21T10:40:36.336 INFO:tasks.workunit.client.1.smithi112.stdout:0/9: dread - no filename 2024-09-21T10:40:36.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/8: unlink d0/f1 0 2024-09-21T10:40:36.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/9: creat d0/f2 x:0 0 0 2024-09-21T10:40:36.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/10: truncate d0/f2 488228 0 2024-09-21T10:40:36.900 INFO:tasks.workunit.client.1.smithi112.stdout:2/11: dread d0/f2 [0,4194304] 0 2024-09-21T10:40:36.900 INFO:tasks.workunit.client.1.smithi112.stdout:2/12: write d0/f2 [11992,92087] 0 2024-09-21T10:40:36.900 INFO:tasks.workunit.client.1.smithi112.stdout:2/13: creat d0/f3 x:0 0 0 2024-09-21T10:40:36.901 INFO:tasks.workunit.client.1.smithi112.stdout:2/14: chown d0 10866 1 2024-09-21T10:40:36.901 INFO:tasks.workunit.client.1.smithi112.stdout:2/15: rename d0 to d0/d4 22 2024-09-21T10:40:36.911 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:36 smithi112 ceph-mon[35117]: Deploying cephadm binary to smithi112 2024-09-21T10:40:36.912 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:36 smithi112 ceph-mon[35117]: Deploying cephadm binary to smithi060 2024-09-21T10:40:36.917 INFO:tasks.workunit.client.1.smithi112.stdout:4/2: symlink l1 0 2024-09-21T10:40:36.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:36 smithi060 ceph-mon[28215]: Deploying cephadm binary to smithi112 2024-09-21T10:40:36.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:36 smithi060 ceph-mon[28215]: Deploying cephadm binary to smithi060 2024-09-21T10:40:36.968 INFO:tasks.workunit.client.1.smithi112.stdout:1/16: unlink f1 0 2024-09-21T10:40:36.986 INFO:tasks.workunit.client.1.smithi112.stdout:8/3: symlink l1 0 2024-09-21T10:40:36.986 INFO:tasks.workunit.client.1.smithi112.stdout:8/4: creat f2 x:0 0 0 2024-09-21T10:40:36.989 INFO:tasks.workunit.client.1.smithi112.stdout:8/5: read f0 [3769321,60742] 0 2024-09-21T10:40:37.595 INFO:tasks.workunit.client.1.smithi112.stdout:4/3: dwrite f0 [4194304,4194304] 0 2024-09-21T10:40:37.671 INFO:tasks.workunit.client.1.smithi112.stdout:8/6: write f0 [4224038,24763] 0 2024-09-21T10:40:37.671 INFO:tasks.workunit.client.1.smithi112.stdout:8/7: creat f3 x:0 0 0 2024-09-21T10:40:37.671 INFO:tasks.workunit.client.1.smithi112.stdout:8/8: chown f3 99 1 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: [21/Sep/2024:10:40:35] ENGINE Bus STARTING 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: [21/Sep/2024:10:40:36] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: [21/Sep/2024:10:40:36] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: [21/Sep/2024:10:40:36] ENGINE Bus STARTED 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: [21/Sep/2024:10:40:36] ENGINE Error in HTTPServer.serve 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Traceback (most recent call last): 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._run(expiration_interval) 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:40:37.891 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self.do_handshake() 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: pgmap v5: 65 pgs: 65 active+clean; 185 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:37.892 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:37 smithi060 ceph-mon[28215]: mgrmap e23: smithi112.gkunly(active, since 4s) 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: [21/Sep/2024:10:40:35] ENGINE Bus STARTING 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: [21/Sep/2024:10:40:36] ENGINE Serving on http://172.21.15.112:8765 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: [21/Sep/2024:10:40:36] ENGINE Serving on https://172.21.15.112:7150 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: [21/Sep/2024:10:40:36] ENGINE Bus STARTED 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: [21/Sep/2024:10:40:36] ENGINE Error in HTTPServer.serve 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:40:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:40:37.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: pgmap v5: 65 pgs: 65 active+clean; 185 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:37.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:37 smithi112 ceph-mon[35117]: mgrmap e23: smithi112.gkunly(active, since 4s) 2024-09-21T10:40:38.591 INFO:tasks.workunit.client.1.smithi112.stdout:0/10: mkdir d3/d4 0 2024-09-21T10:40:38.594 INFO:tasks.workunit.client.1.smithi112.stdout:2/16: symlink d0/l5 0 2024-09-21T10:40:38.594 INFO:tasks.workunit.client.1.smithi112.stdout:2/17: truncate d0/f3 63494 0 2024-09-21T10:40:38.594 INFO:tasks.workunit.client.1.smithi112.stdout:2/18: stat d0/f2 0 2024-09-21T10:40:38.594 INFO:tasks.workunit.client.1.smithi112.stdout:1/17: symlink l4 0 2024-09-21T10:40:38.597 INFO:tasks.workunit.client.1.smithi112.stdout:6/7: truncate f1 2062680 0 2024-09-21T10:40:38.597 INFO:tasks.workunit.client.1.smithi112.stdout:6/8: chown l0 32 1 2024-09-21T10:40:38.601 INFO:tasks.workunit.client.1.smithi112.stdout:0/11: creat d3/d4/f5 x:0 0 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/19: unlink d0/f3 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/20: chown d0/f2 56337 1 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/21: write d0/f2 [1371285,22563] 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:1/18: write f2 [2853238,108038] 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:1/19: readlink l4 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/22: creat d0/f6 x:0 0 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/23: write d0/f2 [1889076,57277] 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/24: write d0/f2 [2895025,40403] 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/25: creat d0/f7 x:0 0 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/26: write d0/f7 [890663,50685] 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:2/27: readlink d0/l5 0 2024-09-21T10:40:38.605 INFO:tasks.workunit.client.1.smithi112.stdout:6/9: mknod c3 0 2024-09-21T10:40:38.606 INFO:tasks.workunit.client.1.smithi112.stdout:6/10: dread - f2 zero size 2024-09-21T10:40:38.607 INFO:tasks.workunit.client.1.smithi112.stdout:0/12: symlink d3/d4/l6 0 2024-09-21T10:40:38.607 INFO:tasks.workunit.client.1.smithi112.stdout:0/13: chown d3/d4 396 1 2024-09-21T10:40:38.607 INFO:tasks.workunit.client.1.smithi112.stdout:0/14: creat d3/d4/f7 x:0 0 0 2024-09-21T10:40:38.607 INFO:tasks.workunit.client.1.smithi112.stdout:0/15: fdatasync d3/d4/f7 0 2024-09-21T10:40:38.609 INFO:tasks.workunit.client.1.smithi112.stdout:1/20: link l4 l5 0 2024-09-21T10:40:38.612 INFO:tasks.workunit.client.1.smithi112.stdout:2/28: symlink d0/l8 0 2024-09-21T10:40:38.612 INFO:tasks.workunit.client.1.smithi112.stdout:2/29: creat d0/f9 x:0 0 0 2024-09-21T10:40:38.612 INFO:tasks.workunit.client.1.smithi112.stdout:2/30: write d0/f9 [341116,50746] 0 2024-09-21T10:40:38.613 INFO:tasks.workunit.client.1.smithi112.stdout:6/11: mkdir d4 0 2024-09-21T10:40:38.614 INFO:tasks.workunit.client.1.smithi112.stdout:2/31: fdatasync d0/f9 0 2024-09-21T10:40:38.617 INFO:tasks.workunit.client.1.smithi112.stdout:1/21: symlink l6 0 2024-09-21T10:40:38.619 INFO:tasks.workunit.client.1.smithi112.stdout:2/32: symlink d0/la 0 2024-09-21T10:40:38.619 INFO:tasks.workunit.client.1.smithi112.stdout:2/33: chown d0/f6 784 1 2024-09-21T10:40:38.619 INFO:tasks.workunit.client.1.smithi112.stdout:2/34: creat d0/fb x:0 0 0 2024-09-21T10:40:38.621 INFO:tasks.workunit.client.1.smithi112.stdout:1/22: fsync f2 0 2024-09-21T10:40:38.623 INFO:tasks.workunit.client.1.smithi112.stdout:2/35: unlink d0/la 0 2024-09-21T10:40:38.623 INFO:tasks.workunit.client.1.smithi112.stdout:2/36: write d0/f9 [21870,33032] 0 2024-09-21T10:40:38.624 INFO:tasks.workunit.client.1.smithi112.stdout:2/37: write d0/fb [539412,9351] 0 2024-09-21T10:40:38.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/23: dread f3 [0,4194304] 0 2024-09-21T10:40:38.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/24: rmdir - no directory 2024-09-21T10:40:38.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/25: creat f7 x:0 0 0 2024-09-21T10:40:38.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/26: write f2 [4130110,97698] 0 2024-09-21T10:40:38.627 INFO:tasks.workunit.client.1.smithi112.stdout:0/16: dwrite d3/d4/f5 [0,4194304] 0 2024-09-21T10:40:38.627 INFO:tasks.workunit.client.1.smithi112.stdout:2/38: fdatasync d0/f7 0 2024-09-21T10:40:38.632 INFO:tasks.workunit.client.1.smithi112.stdout:0/17: link c2 d3/c8 0 2024-09-21T10:40:38.633 INFO:tasks.workunit.client.1.smithi112.stdout:2/39: mknod d0/cc 0 2024-09-21T10:40:38.638 INFO:tasks.workunit.client.1.smithi112.stdout:0/18: creat d3/f9 x:0 0 0 2024-09-21T10:40:38.639 INFO:tasks.workunit.client.1.smithi112.stdout:0/19: readlink d3/d4/l6 0 2024-09-21T10:40:38.639 INFO:tasks.workunit.client.1.smithi112.stdout:2/40: mkdir d0/dd 0 2024-09-21T10:40:38.641 INFO:tasks.workunit.client.1.smithi112.stdout:2/41: dread d0/fb [0,4194304] 0 2024-09-21T10:40:38.985 INFO:tasks.workunit.client.1.smithi112.stdout:8/9: getdents . 0 2024-09-21T10:40:38.985 INFO:tasks.workunit.client.1.smithi112.stdout:8/10: dread - f3 zero size 2024-09-21T10:40:38.985 INFO:tasks.workunit.client.1.smithi112.stdout:8/11: truncate f3 132349 0 2024-09-21T10:40:38.985 INFO:tasks.workunit.client.1.smithi112.stdout:8/12: dread - f2 zero size 2024-09-21T10:40:38.987 INFO:tasks.workunit.client.1.smithi112.stdout:4/4: truncate f0 8323834 0 2024-09-21T10:40:38.989 INFO:tasks.workunit.client.1.smithi112.stdout:4/5: unlink l1 0 2024-09-21T10:40:38.992 INFO:tasks.workunit.client.1.smithi112.stdout:0/20: getdents d3/d4 0 2024-09-21T10:40:38.992 INFO:tasks.workunit.client.1.smithi112.stdout:0/21: dread - d3/d4/f7 zero size 2024-09-21T10:40:38.992 INFO:tasks.workunit.client.1.smithi112.stdout:0/22: creat d3/fa x:0 0 0 2024-09-21T10:40:38.994 INFO:tasks.workunit.client.1.smithi112.stdout:7/6: sync 2024-09-21T10:40:38.994 INFO:tasks.workunit.client.1.smithi112.stdout:3/2: sync 2024-09-21T10:40:38.994 INFO:tasks.workunit.client.1.smithi112.stdout:5/12: sync 2024-09-21T10:40:38.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/1: sync 2024-09-21T10:40:38.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/2: link - no file 2024-09-21T10:40:38.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/3: unlink - no file 2024-09-21T10:40:38.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/4: write - no filename 2024-09-21T10:40:38.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/5: dwrite - no filename 2024-09-21T10:40:38.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/6: chown . 4 1 2024-09-21T10:40:38.995 INFO:tasks.workunit.client.1.smithi112.stdout:9/7: chown . 1445 1 2024-09-21T10:40:38.996 INFO:tasks.workunit.client.1.smithi112.stdout:0/23: mknod d3/cb 0 2024-09-21T10:40:38.996 INFO:tasks.workunit.client.1.smithi112.stdout:2/42: fsync d0/f9 0 2024-09-21T10:40:38.997 INFO:tasks.workunit.client.1.smithi112.stdout:7/7: symlink l0 0 2024-09-21T10:40:38.997 INFO:tasks.workunit.client.1.smithi112.stdout:7/8: fsync - no filename 2024-09-21T10:40:38.997 INFO:tasks.workunit.client.1.smithi112.stdout:7/9: dwrite - no filename 2024-09-21T10:40:38.998 INFO:tasks.workunit.client.1.smithi112.stdout:3/3: creat f0 x:0 0 0 2024-09-21T10:40:39.000 INFO:tasks.workunit.client.1.smithi112.stdout:2/43: unlink d0/f7 0 2024-09-21T10:40:39.000 INFO:tasks.workunit.client.1.smithi112.stdout:2/44: truncate d0/f6 454539 0 2024-09-21T10:40:39.002 INFO:tasks.workunit.client.1.smithi112.stdout:2/45: write d0/f6 [41484,43435] 0 2024-09-21T10:40:39.002 INFO:tasks.workunit.client.1.smithi112.stdout:2/46: getdents d0/dd 0 2024-09-21T10:40:39.002 INFO:tasks.workunit.client.1.smithi112.stdout:2/47: fdatasync d0/f2 0 2024-09-21T10:40:39.002 INFO:tasks.workunit.client.1.smithi112.stdout:7/10: mknod c1 0 2024-09-21T10:40:39.002 INFO:tasks.workunit.client.1.smithi112.stdout:7/11: dwrite - no filename 2024-09-21T10:40:39.004 INFO:tasks.workunit.client.1.smithi112.stdout:2/48: link d0/f9 d0/fe 0 2024-09-21T10:40:39.005 INFO:tasks.workunit.client.1.smithi112.stdout:7/12: mknod c2 0 2024-09-21T10:40:39.005 INFO:tasks.workunit.client.1.smithi112.stdout:7/13: chown l0 5465 1 2024-09-21T10:40:39.005 INFO:tasks.workunit.client.1.smithi112.stdout:7/14: fsync - no filename 2024-09-21T10:40:39.005 INFO:tasks.workunit.client.1.smithi112.stdout:7/15: dwrite - no filename 2024-09-21T10:40:39.008 INFO:tasks.workunit.client.1.smithi112.stdout:6/12: dwrite f1 [0,4194304] 0 2024-09-21T10:40:39.008 INFO:tasks.workunit.client.1.smithi112.stdout:2/49: truncate d0/fe 365532 0 2024-09-21T10:40:39.009 INFO:tasks.workunit.client.1.smithi112.stdout:2/50: readlink d0/l5 0 2024-09-21T10:40:39.010 INFO:tasks.workunit.client.1.smithi112.stdout:6/13: mknod d4/c5 0 2024-09-21T10:40:39.010 INFO:tasks.workunit.client.1.smithi112.stdout:6/14: write f2 [402999,124333] 0 2024-09-21T10:40:39.010 INFO:tasks.workunit.client.1.smithi112.stdout:6/15: fdatasync f1 0 2024-09-21T10:40:39.010 INFO:tasks.workunit.client.1.smithi112.stdout:6/16: read f2 [183585,85836] 0 2024-09-21T10:40:39.011 INFO:tasks.workunit.client.1.smithi112.stdout:2/51: mknod d0/dd/cf 0 2024-09-21T10:40:39.012 INFO:tasks.workunit.client.1.smithi112.stdout:6/17: mkdir d4/d6 0 2024-09-21T10:40:39.012 INFO:tasks.workunit.client.1.smithi112.stdout:6/18: rename d4 to d4/d7 22 2024-09-21T10:40:39.013 INFO:tasks.workunit.client.1.smithi112.stdout:6/19: link d4/c5 d4/d6/c8 0 2024-09-21T10:40:39.015 INFO:tasks.workunit.client.1.smithi112.stdout:6/20: symlink d4/d6/l9 0 2024-09-21T10:40:39.015 INFO:tasks.workunit.client.1.smithi112.stdout:8/13: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.019 INFO:tasks.workunit.client.1.smithi112.stdout:8/14: rename l1 to l4 0 2024-09-21T10:40:39.023 INFO:tasks.workunit.client.1.smithi112.stdout:8/15: truncate f0 76335 0 2024-09-21T10:40:39.023 INFO:tasks.workunit.client.1.smithi112.stdout:8/16: write f2 [665226,81799] 0 2024-09-21T10:40:39.023 INFO:tasks.workunit.client.1.smithi112.stdout:8/17: readlink l4 0 2024-09-21T10:40:39.024 INFO:tasks.workunit.client.1.smithi112.stdout:5/13: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.024 INFO:tasks.workunit.client.1.smithi112.stdout:0/24: dwrite d3/fa [0,4194304] 0 2024-09-21T10:40:39.025 INFO:tasks.workunit.client.1.smithi112.stdout:8/18: creat f5 x:0 0 0 2024-09-21T10:40:39.025 INFO:tasks.workunit.client.1.smithi112.stdout:8/19: chown f3 65 1 2024-09-21T10:40:39.028 INFO:tasks.workunit.client.1.smithi112.stdout:6/21: dread f2 [0,4194304] 0 2024-09-21T10:40:39.029 INFO:tasks.workunit.client.1.smithi112.stdout:5/14: link l1 l4 0 2024-09-21T10:40:39.029 INFO:tasks.workunit.client.1.smithi112.stdout:5/15: readlink l2 0 2024-09-21T10:40:39.029 INFO:tasks.workunit.client.1.smithi112.stdout:5/16: chown l0 6452116 1 2024-09-21T10:40:39.033 INFO:tasks.workunit.client.1.smithi112.stdout:0/25: symlink d3/d4/lc 0 2024-09-21T10:40:39.034 INFO:tasks.workunit.client.1.smithi112.stdout:6/22: mkdir d4/d6/da 0 2024-09-21T10:40:39.035 INFO:tasks.workunit.client.1.smithi112.stdout:6/23: readlink d4/d6/l9 0 2024-09-21T10:40:39.036 INFO:tasks.workunit.client.1.smithi112.stdout:5/17: mknod c5 0 2024-09-21T10:40:39.036 INFO:tasks.workunit.client.1.smithi112.stdout:5/18: creat f6 x:0 0 0 2024-09-21T10:40:39.037 INFO:tasks.workunit.client.1.smithi112.stdout:0/26: symlink d3/d4/ld 0 2024-09-21T10:40:39.039 INFO:tasks.workunit.client.1.smithi112.stdout:6/24: creat d4/d6/da/fb x:0 0 0 2024-09-21T10:40:39.041 INFO:tasks.workunit.client.1.smithi112.stdout:0/27: creat d3/d4/fe x:0 0 0 2024-09-21T10:40:39.043 INFO:tasks.workunit.client.1.smithi112.stdout:6/25: mkdir d4/dc 0 2024-09-21T10:40:39.047 INFO:tasks.workunit.client.1.smithi112.stdout:1/27: sync 2024-09-21T10:40:39.047 INFO:tasks.workunit.client.1.smithi112.stdout:1/28: chown l6 1 1 2024-09-21T10:40:39.049 INFO:tasks.workunit.client.1.smithi112.stdout:4/6: getdents . 0 2024-09-21T10:40:39.051 INFO:tasks.workunit.client.1.smithi112.stdout:1/29: mkdir d8 0 2024-09-21T10:40:39.051 INFO:tasks.workunit.client.1.smithi112.stdout:1/30: dread - f7 zero size 2024-09-21T10:40:39.053 INFO:tasks.workunit.client.1.smithi112.stdout:1/31: dread f3 [0,4194304] 0 2024-09-21T10:40:39.053 INFO:tasks.workunit.client.1.smithi112.stdout:1/32: truncate f7 37842 0 2024-09-21T10:40:39.053 INFO:tasks.workunit.client.1.smithi112.stdout:1/33: fsync f3 0 2024-09-21T10:40:39.053 INFO:tasks.workunit.client.1.smithi112.stdout:1/34: write f7 [858723,108509] 0 2024-09-21T10:40:39.057 INFO:tasks.workunit.client.1.smithi112.stdout:0/28: dwrite d3/f9 [0,4194304] 0 2024-09-21T10:40:39.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/52: getdents d0 0 2024-09-21T10:40:39.062 INFO:tasks.workunit.client.1.smithi112.stdout:4/7: dread f0 [0,4194304] 0 2024-09-21T10:40:39.066 INFO:tasks.workunit.client.1.smithi112.stdout:0/29: write d3/f9 [1617084,102323] 0 2024-09-21T10:40:39.068 INFO:tasks.workunit.client.1.smithi112.stdout:4/8: symlink l2 0 2024-09-21T10:40:39.069 INFO:tasks.workunit.client.1.smithi112.stdout:1/35: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.071 INFO:tasks.workunit.client.1.smithi112.stdout:4/9: write f0 [696947,71780] 0 2024-09-21T10:40:39.074 INFO:tasks.workunit.client.1.smithi112.stdout:4/10: fdatasync f0 0 2024-09-21T10:40:39.074 INFO:tasks.workunit.client.1.smithi112.stdout:4/11: fdatasync f0 0 2024-09-21T10:40:39.074 INFO:tasks.workunit.client.1.smithi112.stdout:4/12: write f0 [9209980,122035] 0 2024-09-21T10:40:39.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/36: creat d8/f9 x:0 0 0 2024-09-21T10:40:39.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/37: creat d8/fa x:0 0 0 2024-09-21T10:40:39.082 INFO:tasks.workunit.client.1.smithi112.stdout:8/20: dread f0 [0,4194304] 0 2024-09-21T10:40:39.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/21: fdatasync f5 0 2024-09-21T10:40:39.084 INFO:tasks.workunit.client.1.smithi112.stdout:4/13: mknod c3 0 2024-09-21T10:40:39.087 INFO:tasks.workunit.client.1.smithi112.stdout:1/38: symlink d8/lb 0 2024-09-21T10:40:39.088 INFO:tasks.workunit.client.1.smithi112.stdout:8/22: symlink l6 0 2024-09-21T10:40:39.090 INFO:tasks.workunit.client.1.smithi112.stdout:4/14: creat f4 x:0 0 0 2024-09-21T10:40:39.090 INFO:tasks.workunit.client.1.smithi112.stdout:4/15: dread - f4 zero size 2024-09-21T10:40:39.091 INFO:tasks.workunit.client.1.smithi112.stdout:4/16: creat f5 x:0 0 0 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/39: mknod d8/cc 0 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/40: stat f3 0 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/41: creat d8/fd x:0 0 0 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/42: dread - d8/fa zero size 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/43: chown d8/lb 83557 1 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/44: creat d8/fe x:0 0 0 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/45: truncate d8/fd 598347 0 2024-09-21T10:40:39.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/46: chown f7 119 1 2024-09-21T10:40:39.108 INFO:tasks.workunit.client.1.smithi112.stdout:0/30: rmdir d3/d4 39 2024-09-21T10:40:39.111 INFO:tasks.workunit.client.1.smithi112.stdout:1/47: dwrite d8/fd [0,4194304] 0 2024-09-21T10:40:39.111 INFO:tasks.workunit.client.1.smithi112.stdout:1/48: chown d8/fe 15583607 1 2024-09-21T10:40:39.111 INFO:tasks.workunit.client.1.smithi112.stdout:0/31: fsync d3/f9 0 2024-09-21T10:40:39.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/32: write d3/f9 [3387608,79687] 0 2024-09-21T10:40:39.112 INFO:tasks.workunit.client.1.smithi112.stdout:8/23: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.112 INFO:tasks.workunit.client.1.smithi112.stdout:8/24: write f0 [271785,91275] 0 2024-09-21T10:40:39.112 INFO:tasks.workunit.client.1.smithi112.stdout:8/25: dread - f5 zero size 2024-09-21T10:40:39.112 INFO:tasks.workunit.client.1.smithi112.stdout:8/26: fsync f5 0 2024-09-21T10:40:39.120 INFO:tasks.workunit.client.1.smithi112.stdout:4/17: dwrite f0 [8388608,4194304] 0 2024-09-21T10:40:39.120 INFO:tasks.workunit.client.1.smithi112.stdout:8/27: symlink l7 0 2024-09-21T10:40:39.124 INFO:tasks.workunit.client.1.smithi112.stdout:8/28: mkdir d8 0 2024-09-21T10:40:39.128 INFO:tasks.workunit.client.1.smithi112.stdout:8/29: mkdir d8/d9 0 2024-09-21T10:40:39.133 INFO:tasks.workunit.client.1.smithi112.stdout:0/33: dwrite d3/d4/f7 [0,4194304] 0 2024-09-21T10:40:39.140 INFO:tasks.workunit.client.1.smithi112.stdout:0/34: symlink d3/d4/lf 0 2024-09-21T10:40:39.142 INFO:tasks.workunit.client.1.smithi112.stdout:0/35: mkdir d3/d4/d10 0 2024-09-21T10:40:39.142 INFO:tasks.workunit.client.1.smithi112.stdout:0/36: chown d3/d4/f5 1631351 1 2024-09-21T10:40:39.161 INFO:tasks.workunit.client.1.smithi112.stdout:1/49: fsync d8/fd 0 2024-09-21T10:40:39.162 INFO:tasks.workunit.client.1.smithi112.stdout:1/50: mknod d8/cf 0 2024-09-21T10:40:39.162 INFO:tasks.workunit.client.1.smithi112.stdout:1/51: truncate f7 1199802 0 2024-09-21T10:40:39.184 INFO:tasks.workunit.client.1.smithi112.stdout:4/18: truncate f0 5809327 0 2024-09-21T10:40:39.185 INFO:tasks.workunit.client.1.smithi112.stdout:4/19: mknod c6 0 2024-09-21T10:40:39.185 INFO:tasks.workunit.client.1.smithi112.stdout:4/20: readlink l2 0 2024-09-21T10:40:39.189 INFO:tasks.workunit.client.1.smithi112.stdout:4/21: mknod c7 0 2024-09-21T10:40:39.189 INFO:tasks.workunit.client.1.smithi112.stdout:4/22: creat f8 x:0 0 0 2024-09-21T10:40:39.189 INFO:tasks.workunit.client.1.smithi112.stdout:4/23: creat f9 x:0 0 0 2024-09-21T10:40:39.193 INFO:tasks.workunit.client.1.smithi112.stdout:8/30: truncate f3 2619469 0 2024-09-21T10:40:39.209 INFO:tasks.workunit.client.1.smithi112.stdout:0/37: getdents d3/d4 0 2024-09-21T10:40:39.211 INFO:tasks.workunit.client.1.smithi112.stdout:8/31: dwrite f5 [0,4194304] 0 2024-09-21T10:40:39.211 INFO:tasks.workunit.client.1.smithi112.stdout:4/24: dwrite f5 [0,4194304] 0 2024-09-21T10:40:39.214 INFO:tasks.workunit.client.1.smithi112.stdout:0/38: rename d3/c8 to d3/d4/d10/c11 0 2024-09-21T10:40:39.223 INFO:tasks.workunit.client.1.smithi112.stdout:0/39: write d3/fa [1092617,10989] 0 2024-09-21T10:40:39.226 INFO:tasks.workunit.client.1.smithi112.stdout:8/32: link f0 d8/d9/fa 0 2024-09-21T10:40:39.227 INFO:tasks.workunit.client.1.smithi112.stdout:8/33: dread f0 [0,4194304] 0 2024-09-21T10:40:39.232 INFO:tasks.workunit.client.1.smithi112.stdout:1/52: getdents d8 0 2024-09-21T10:40:39.244 INFO:tasks.workunit.client.1.smithi112.stdout:0/40: truncate d3/f9 3581762 0 2024-09-21T10:40:39.249 INFO:tasks.workunit.client.1.smithi112.stdout:1/53: dwrite d8/fe [0,4194304] 0 2024-09-21T10:40:39.254 INFO:tasks.workunit.client.1.smithi112.stdout:1/54: dread f2 [0,4194304] 0 2024-09-21T10:40:39.254 INFO:tasks.workunit.client.1.smithi112.stdout:1/55: rename d8 to d8/d10 22 2024-09-21T10:40:39.264 INFO:tasks.workunit.client.1.smithi112.stdout:1/56: truncate f2 1940795 0 2024-09-21T10:40:39.267 INFO:tasks.workunit.client.1.smithi112.stdout:1/57: rmdir d8 39 2024-09-21T10:40:39.269 INFO:tasks.workunit.client.1.smithi112.stdout:8/34: write f3 [916655,102649] 0 2024-09-21T10:40:39.269 INFO:tasks.workunit.client.1.smithi112.stdout:1/58: mknod d8/c11 0 2024-09-21T10:40:39.271 INFO:tasks.workunit.client.1.smithi112.stdout:4/25: dwrite f0 [0,4194304] 0 2024-09-21T10:40:39.273 INFO:tasks.workunit.client.1.smithi112.stdout:8/35: creat d8/d9/fb x:0 0 0 2024-09-21T10:40:39.280 INFO:tasks.workunit.client.1.smithi112.stdout:4/26: link c7 ca 0 2024-09-21T10:40:39.283 INFO:tasks.workunit.client.1.smithi112.stdout:8/36: creat d8/fc x:0 0 0 2024-09-21T10:40:39.283 INFO:tasks.workunit.client.1.smithi112.stdout:8/37: write f5 [4258211,57688] 0 2024-09-21T10:40:39.283 INFO:tasks.workunit.client.1.smithi112.stdout:4/27: mknod cb 0 2024-09-21T10:40:39.286 INFO:tasks.workunit.client.1.smithi112.stdout:4/28: truncate f5 1557090 0 2024-09-21T10:40:39.289 INFO:tasks.workunit.client.1.smithi112.stdout:4/29: link c7 cc 0 2024-09-21T10:40:39.290 INFO:tasks.workunit.client.1.smithi112.stdout:4/30: fdatasync f5 0 2024-09-21T10:40:39.292 INFO:tasks.workunit.client.1.smithi112.stdout:5/19: sync 2024-09-21T10:40:39.292 INFO:tasks.workunit.client.1.smithi112.stdout:3/4: sync 2024-09-21T10:40:39.292 INFO:tasks.workunit.client.1.smithi112.stdout:9/8: sync 2024-09-21T10:40:39.292 INFO:tasks.workunit.client.1.smithi112.stdout:7/16: sync 2024-09-21T10:40:39.292 INFO:tasks.workunit.client.1.smithi112.stdout:0/41: write d3/f9 [4389476,47562] 0 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:9/9: dread - no filename 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/5: chown f0 871440 1 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:5/20: write f6 [750575,40533] 0 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:5/21: chown l1 1290 1 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/6: write f0 [504347,118064] 0 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:4/31: symlink ld 0 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:4/32: truncate f0 6200022 0 2024-09-21T10:40:39.293 INFO:tasks.workunit.client.1.smithi112.stdout:4/33: fsync f0 0 2024-09-21T10:40:39.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/17: link l0 l3 0 2024-09-21T10:40:39.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/18: dwrite - no filename 2024-09-21T10:40:39.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/19: truncate - no filename 2024-09-21T10:40:39.298 INFO:tasks.workunit.client.1.smithi112.stdout:9/10: symlink l0 0 2024-09-21T10:40:39.298 INFO:tasks.workunit.client.1.smithi112.stdout:9/11: stat l0 0 2024-09-21T10:40:39.307 INFO:tasks.workunit.client.1.smithi112.stdout:4/34: mkdir de 0 2024-09-21T10:40:39.307 INFO:tasks.workunit.client.1.smithi112.stdout:4/35: read - f9 zero size 2024-09-21T10:40:39.308 INFO:tasks.workunit.client.1.smithi112.stdout:7/20: stat l0 0 2024-09-21T10:40:39.308 INFO:tasks.workunit.client.1.smithi112.stdout:7/21: fsync - no filename 2024-09-21T10:40:39.308 INFO:tasks.workunit.client.1.smithi112.stdout:7/22: chown l0 45 1 2024-09-21T10:40:39.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/23: chown c2 233 1 2024-09-21T10:40:39.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/24: dread - no filename 2024-09-21T10:40:39.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/25: dread - no filename 2024-09-21T10:40:39.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/26: truncate - no filename 2024-09-21T10:40:39.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/12: mkdir d1 0 2024-09-21T10:40:39.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/13: dwrite - no filename 2024-09-21T10:40:39.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/14: dread - no filename 2024-09-21T10:40:39.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/15: fdatasync - no filename 2024-09-21T10:40:39.311 INFO:tasks.workunit.client.1.smithi112.stdout:0/42: dwrite d3/f9 [4194304,4194304] 0 2024-09-21T10:40:39.311 INFO:tasks.workunit.client.1.smithi112.stdout:0/43: chown d3/fa 6 1 2024-09-21T10:40:39.313 INFO:tasks.workunit.client.1.smithi112.stdout:5/22: getdents . 0 2024-09-21T10:40:39.314 INFO:tasks.workunit.client.1.smithi112.stdout:5/23: truncate f3 4273796 0 2024-09-21T10:40:39.314 INFO:tasks.workunit.client.1.smithi112.stdout:5/24: fdatasync f3 0 2024-09-21T10:40:39.317 INFO:tasks.workunit.client.1.smithi112.stdout:4/36: mknod de/cf 0 2024-09-21T10:40:39.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/27: symlink l4 0 2024-09-21T10:40:39.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/28: dread - no filename 2024-09-21T10:40:39.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/29: fsync - no filename 2024-09-21T10:40:39.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/30: write - no filename 2024-09-21T10:40:39.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/31: stat c1 0 2024-09-21T10:40:39.320 INFO:tasks.workunit.client.1.smithi112.stdout:9/16: mkdir d1/d2 0 2024-09-21T10:40:39.323 INFO:tasks.workunit.client.1.smithi112.stdout:5/25: dread f3 [0,4194304] 0 2024-09-21T10:40:39.324 INFO:tasks.workunit.client.1.smithi112.stdout:1/59: rename f2 to d8/f12 0 2024-09-21T10:40:39.327 INFO:tasks.workunit.client.1.smithi112.stdout:4/37: creat de/f10 x:0 0 0 2024-09-21T10:40:39.328 INFO:tasks.workunit.client.1.smithi112.stdout:9/17: symlink d1/d2/l3 0 2024-09-21T10:40:39.331 INFO:tasks.workunit.client.1.smithi112.stdout:5/26: mknod c7 0 2024-09-21T10:40:39.331 INFO:tasks.workunit.client.1.smithi112.stdout:5/27: chown f3 689 1 2024-09-21T10:40:39.331 INFO:tasks.workunit.client.1.smithi112.stdout:0/44: dwrite d3/d4/f5 [0,4194304] 0 2024-09-21T10:40:39.332 INFO:tasks.workunit.client.1.smithi112.stdout:0/45: creat d3/f12 x:0 0 0 2024-09-21T10:40:39.332 INFO:tasks.workunit.client.1.smithi112.stdout:0/46: dread - d3/d4/fe zero size 2024-09-21T10:40:39.332 INFO:tasks.workunit.client.1.smithi112.stdout:1/60: rename d8/lb to d8/l13 0 2024-09-21T10:40:39.336 INFO:tasks.workunit.client.1.smithi112.stdout:9/18: mknod d1/c4 0 2024-09-21T10:40:39.341 INFO:tasks.workunit.client.1.smithi112.stdout:0/47: creat d3/d4/f13 x:0 0 0 2024-09-21T10:40:39.342 INFO:tasks.workunit.client.1.smithi112.stdout:1/61: write f3 [1305816,85563] 0 2024-09-21T10:40:39.348 INFO:tasks.workunit.client.1.smithi112.stdout:0/48: creat d3/d4/d10/f14 x:0 0 0 2024-09-21T10:40:39.349 INFO:tasks.workunit.client.1.smithi112.stdout:5/28: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.351 INFO:tasks.workunit.client.1.smithi112.stdout:5/29: dread f6 [0,4194304] 0 2024-09-21T10:40:39.351 INFO:tasks.workunit.client.1.smithi112.stdout:5/30: readlink l2 0 2024-09-21T10:40:39.351 INFO:tasks.workunit.client.1.smithi112.stdout:5/31: fsync f6 0 2024-09-21T10:40:39.351 INFO:tasks.workunit.client.1.smithi112.stdout:5/32: fdatasync f3 0 2024-09-21T10:40:39.351 INFO:tasks.workunit.client.1.smithi112.stdout:0/49: mkdir d3/d4/d15 0 2024-09-21T10:40:39.354 INFO:tasks.workunit.client.1.smithi112.stdout:5/33: symlink l8 0 2024-09-21T10:40:39.360 INFO:tasks.workunit.client.1.smithi112.stdout:3/7: truncate f0 347767 0 2024-09-21T10:40:39.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/26: sync 2024-09-21T10:40:39.372 INFO:tasks.workunit.client.1.smithi112.stdout:2/53: sync 2024-09-21T10:40:39.372 INFO:tasks.workunit.client.1.smithi112.stdout:2/54: write d0/f6 [1260436,2049] 0 2024-09-21T10:40:39.374 INFO:tasks.workunit.client.1.smithi112.stdout:4/38: getdents de 0 2024-09-21T10:40:39.374 INFO:tasks.workunit.client.1.smithi112.stdout:4/39: dread - f4 zero size 2024-09-21T10:40:39.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/34: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.375 INFO:tasks.workunit.client.1.smithi112.stdout:1/62: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/19: getdents d1/d2 0 2024-09-21T10:40:39.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/20: dwrite - no filename 2024-09-21T10:40:39.379 INFO:tasks.workunit.client.1.smithi112.stdout:6/27: mkdir d4/dc/dd 0 2024-09-21T10:40:39.379 INFO:tasks.workunit.client.1.smithi112.stdout:6/28: fdatasync f2 0 2024-09-21T10:40:39.380 INFO:tasks.workunit.client.1.smithi112.stdout:6/29: truncate d4/d6/da/fb 750721 0 2024-09-21T10:40:39.382 INFO:tasks.workunit.client.1.smithi112.stdout:2/55: creat d0/f10 x:0 0 0 2024-09-21T10:40:39.382 INFO:tasks.workunit.client.1.smithi112.stdout:2/56: fdatasync d0/f2 0 2024-09-21T10:40:39.382 INFO:tasks.workunit.client.1.smithi112.stdout:2/57: creat d0/f11 x:0 0 0 2024-09-21T10:40:39.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/40: creat de/f11 x:0 0 0 2024-09-21T10:40:39.388 INFO:tasks.workunit.client.1.smithi112.stdout:1/63: link d8/f12 d8/f14 0 2024-09-21T10:40:39.390 INFO:tasks.workunit.client.1.smithi112.stdout:9/21: creat d1/d2/f5 x:0 0 0 2024-09-21T10:40:39.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/30: creat d4/dc/dd/fe x:0 0 0 2024-09-21T10:40:39.395 INFO:tasks.workunit.client.1.smithi112.stdout:4/41: creat de/f12 x:0 0 0 2024-09-21T10:40:39.397 INFO:tasks.workunit.client.1.smithi112.stdout:1/64: rmdir d8 39 2024-09-21T10:40:39.397 INFO:tasks.workunit.client.1.smithi112.stdout:5/35: dwrite f3 [4194304,4194304] 0 2024-09-21T10:40:39.398 INFO:tasks.workunit.client.1.smithi112.stdout:5/36: chown c7 11409 1 2024-09-21T10:40:39.398 INFO:tasks.workunit.client.1.smithi112.stdout:5/37: truncate f6 1093775 0 2024-09-21T10:40:39.398 INFO:tasks.workunit.client.1.smithi112.stdout:6/31: rmdir d4 39 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:0/50: getdents d3/d4/d10 0 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:0/51: chown d3/d4/f13 253558 1 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:0/52: fdatasync d3/d4/f5 0 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:0/53: chown d3/d4 12465 1 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:5/38: dread f6 [0,4194304] 0 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:5/39: readlink l1 0 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:2/58: dwrite d0/f10 [0,4194304] 0 2024-09-21T10:40:39.400 INFO:tasks.workunit.client.1.smithi112.stdout:2/59: fdatasync d0/f11 0 2024-09-21T10:40:39.401 INFO:tasks.workunit.client.1.smithi112.stdout:2/60: chown d0/dd/cf 105672 1 2024-09-21T10:40:39.402 INFO:tasks.workunit.client.1.smithi112.stdout:1/65: creat d8/f15 x:0 0 0 2024-09-21T10:40:39.405 INFO:tasks.workunit.client.1.smithi112.stdout:4/42: mknod de/c13 0 2024-09-21T10:40:39.405 INFO:tasks.workunit.client.1.smithi112.stdout:4/43: read - f8 zero size 2024-09-21T10:40:39.405 INFO:tasks.workunit.client.1.smithi112.stdout:4/44: fdatasync f4 0 2024-09-21T10:40:39.405 INFO:tasks.workunit.client.1.smithi112.stdout:4/45: chown c6 547194 1 2024-09-21T10:40:39.405 INFO:tasks.workunit.client.1.smithi112.stdout:5/40: mkdir d9 0 2024-09-21T10:40:39.413 INFO:tasks.workunit.client.1.smithi112.stdout:3/8: dread f0 [0,4194304] 0 2024-09-21T10:40:39.413 INFO:tasks.workunit.client.1.smithi112.stdout:3/9: creat f1 x:0 0 0 2024-09-21T10:40:39.413 INFO:tasks.workunit.client.1.smithi112.stdout:3/10: write f0 [980034,82330] 0 2024-09-21T10:40:39.415 INFO:tasks.workunit.client.1.smithi112.stdout:1/66: symlink d8/l16 0 2024-09-21T10:40:39.415 INFO:tasks.workunit.client.1.smithi112.stdout:1/67: creat d8/f17 x:0 0 0 2024-09-21T10:40:39.416 INFO:tasks.workunit.client.1.smithi112.stdout:6/32: rmdir d4/d6/da 39 2024-09-21T10:40:39.418 INFO:tasks.workunit.client.1.smithi112.stdout:4/46: creat de/f14 x:0 0 0 2024-09-21T10:40:39.419 INFO:tasks.workunit.client.1.smithi112.stdout:5/41: read f3 [302081,70674] 0 2024-09-21T10:40:39.419 INFO:tasks.workunit.client.1.smithi112.stdout:5/42: write f6 [2137910,47853] 0 2024-09-21T10:40:39.424 INFO:tasks.workunit.client.1.smithi112.stdout:6/33: symlink d4/d6/lf 0 2024-09-21T10:40:39.424 INFO:tasks.workunit.client.1.smithi112.stdout:6/34: readlink l0 0 2024-09-21T10:40:39.425 INFO:tasks.workunit.client.1.smithi112.stdout:6/35: dread d4/d6/da/fb [0,4194304] 0 2024-09-21T10:40:39.426 INFO:tasks.workunit.client.1.smithi112.stdout:4/47: unlink l2 0 2024-09-21T10:40:39.426 INFO:tasks.workunit.client.1.smithi112.stdout:4/48: write f8 [902701,97924] 0 2024-09-21T10:40:39.428 INFO:tasks.workunit.client.1.smithi112.stdout:1/68: write d8/fd [3088357,56014] 0 2024-09-21T10:40:39.428 INFO:tasks.workunit.client.1.smithi112.stdout:1/69: creat d8/f18 x:0 0 0 2024-09-21T10:40:39.428 INFO:tasks.workunit.client.1.smithi112.stdout:2/61: dwrite d0/fb [0,4194304] 0 2024-09-21T10:40:39.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/54: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:40:39.447 INFO:tasks.workunit.client.1.smithi112.stdout:6/36: dwrite d4/dc/dd/fe [0,4194304] 0 2024-09-21T10:40:39.447 INFO:tasks.workunit.client.1.smithi112.stdout:6/37: truncate f2 950170 0 2024-09-21T10:40:39.447 INFO:tasks.workunit.client.1.smithi112.stdout:6/38: stat d4 0 2024-09-21T10:40:39.447 INFO:tasks.workunit.client.1.smithi112.stdout:6/39: readlink l0 0 2024-09-21T10:40:39.448 INFO:tasks.workunit.client.1.smithi112.stdout:1/70: dwrite d8/f12 [0,4194304] 0 2024-09-21T10:40:39.448 INFO:tasks.workunit.client.1.smithi112.stdout:1/71: dread - d8/f9 zero size 2024-09-21T10:40:39.452 INFO:tasks.workunit.client.1.smithi112.stdout:2/62: mkdir d0/d12 0 2024-09-21T10:40:39.453 INFO:tasks.workunit.client.1.smithi112.stdout:2/63: write d0/f6 [1110783,128108] 0 2024-09-21T10:40:39.456 INFO:tasks.workunit.client.1.smithi112.stdout:0/55: rename d3/cb to d3/d4/d10/c16 0 2024-09-21T10:40:39.456 INFO:tasks.workunit.client.1.smithi112.stdout:0/56: truncate d3/d4/d10/f14 1004361 0 2024-09-21T10:40:39.466 INFO:tasks.workunit.client.1.smithi112.stdout:1/72: dwrite d8/f9 [0,4194304] 0 2024-09-21T10:40:39.466 INFO:tasks.workunit.client.1.smithi112.stdout:1/73: chown f7 0 1 2024-09-21T10:40:39.466 INFO:tasks.workunit.client.1.smithi112.stdout:1/74: creat d8/f19 x:0 0 0 2024-09-21T10:40:39.469 INFO:tasks.workunit.client.1.smithi112.stdout:2/64: mkdir d0/d12/d13 0 2024-09-21T10:40:39.472 INFO:tasks.workunit.client.1.smithi112.stdout:6/40: rename f2 to d4/d6/f10 0 2024-09-21T10:40:39.474 INFO:tasks.workunit.client.1.smithi112.stdout:0/57: rmdir d3/d4/d10 39 2024-09-21T10:40:39.475 INFO:tasks.workunit.client.1.smithi112.stdout:0/58: fsync d3/d4/f7 0 2024-09-21T10:40:39.475 INFO:tasks.workunit.client.1.smithi112.stdout:0/59: dread - d3/d4/fe zero size 2024-09-21T10:40:39.475 INFO:tasks.workunit.client.1.smithi112.stdout:3/11: getdents . 0 2024-09-21T10:40:39.476 INFO:tasks.workunit.client.1.smithi112.stdout:2/65: dread d0/fb [0,4194304] 0 2024-09-21T10:40:39.478 INFO:tasks.workunit.client.1.smithi112.stdout:4/49: link de/f12 de/f15 0 2024-09-21T10:40:39.485 INFO:tasks.workunit.client.1.smithi112.stdout:1/75: mkdir d8/d1a 0 2024-09-21T10:40:39.497 INFO:tasks.workunit.client.1.smithi112.stdout:0/60: unlink d3/fa 0 2024-09-21T10:40:39.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/12: mkdir d2 0 2024-09-21T10:40:39.502 INFO:tasks.workunit.client.1.smithi112.stdout:2/66: symlink d0/d12/d13/l14 0 2024-09-21T10:40:39.502 INFO:tasks.workunit.client.1.smithi112.stdout:2/67: stat d0/dd/cf 0 2024-09-21T10:40:39.507 INFO:tasks.workunit.client.1.smithi112.stdout:8/38: sync 2024-09-21T10:40:39.515 INFO:tasks.workunit.client.1.smithi112.stdout:0/61: dwrite d3/d4/fe [0,4194304] 0 2024-09-21T10:40:39.518 INFO:tasks.workunit.client.1.smithi112.stdout:4/50: symlink de/l16 0 2024-09-21T10:40:39.519 INFO:tasks.workunit.client.1.smithi112.stdout:4/51: chown cc 12708483 1 2024-09-21T10:40:39.520 INFO:tasks.workunit.client.1.smithi112.stdout:4/52: write f8 [547063,12008] 0 2024-09-21T10:40:39.522 INFO:tasks.workunit.client.1.smithi112.stdout:2/68: dwrite d0/f11 [0,4194304] 0 2024-09-21T10:40:39.522 INFO:tasks.workunit.client.1.smithi112.stdout:2/69: fsync d0/f10 0 2024-09-21T10:40:39.522 INFO:tasks.workunit.client.1.smithi112.stdout:8/39: mkdir d8/d9/dd 0 2024-09-21T10:40:39.522 INFO:tasks.workunit.client.1.smithi112.stdout:8/40: write f0 [110043,38990] 0 2024-09-21T10:40:39.530 INFO:tasks.workunit.client.1.smithi112.stdout:6/41: fsync d4/d6/f10 0 2024-09-21T10:40:39.530 INFO:tasks.workunit.client.1.smithi112.stdout:6/42: write d4/d6/da/fb [1780213,16290] 0 2024-09-21T10:40:39.533 INFO:tasks.workunit.client.1.smithi112.stdout:3/13: dwrite f0 [0,4194304] 0 2024-09-21T10:40:39.544 INFO:tasks.workunit.client.1.smithi112.stdout:1/76: getdents d8 0 2024-09-21T10:40:39.547 INFO:tasks.workunit.client.1.smithi112.stdout:8/41: link l6 d8/le 0 2024-09-21T10:40:39.547 INFO:tasks.workunit.client.1.smithi112.stdout:8/42: stat f2 0 2024-09-21T10:40:39.547 INFO:tasks.workunit.client.1.smithi112.stdout:8/43: write f3 [1712916,70728] 0 2024-09-21T10:40:39.549 INFO:tasks.workunit.client.1.smithi112.stdout:6/43: mkdir d4/d6/da/d11 0 2024-09-21T10:40:39.549 INFO:tasks.workunit.client.1.smithi112.stdout:6/44: chown d4/d6/f10 52291 1 2024-09-21T10:40:39.550 INFO:tasks.workunit.client.1.smithi112.stdout:3/14: dwrite f0 [0,4194304] 0 2024-09-21T10:40:39.551 INFO:tasks.workunit.client.1.smithi112.stdout:0/62: truncate d3/d4/d10/f14 690960 0 2024-09-21T10:40:39.561 INFO:tasks.workunit.client.1.smithi112.stdout:3/15: write f0 [1156781,10155] 0 2024-09-21T10:40:39.561 INFO:tasks.workunit.client.1.smithi112.stdout:3/16: readlink - no filename 2024-09-21T10:40:39.563 INFO:tasks.workunit.client.1.smithi112.stdout:4/53: rename c7 to de/c17 0 2024-09-21T10:40:39.563 INFO:tasks.workunit.client.1.smithi112.stdout:4/54: fsync f5 0 2024-09-21T10:40:39.563 INFO:tasks.workunit.client.1.smithi112.stdout:4/55: readlink de/l16 0 2024-09-21T10:40:39.563 INFO:tasks.workunit.client.1.smithi112.stdout:0/63: read d3/f9 [8050079,56453] 0 2024-09-21T10:40:39.564 INFO:tasks.workunit.client.1.smithi112.stdout:1/77: symlink d8/l1b 0 2024-09-21T10:40:39.564 INFO:tasks.workunit.client.1.smithi112.stdout:1/78: fsync d8/f17 0 2024-09-21T10:40:39.564 INFO:tasks.workunit.client.1.smithi112.stdout:1/79: stat d8/l1b 0 2024-09-21T10:40:39.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/32: sync 2024-09-21T10:40:39.568 INFO:tasks.workunit.client.1.smithi112.stdout:8/44: mknod d8/d9/dd/cf 0 2024-09-21T10:40:39.569 INFO:tasks.workunit.client.1.smithi112.stdout:6/45: creat d4/d6/da/f12 x:0 0 0 2024-09-21T10:40:39.569 INFO:tasks.workunit.client.1.smithi112.stdout:6/46: write d4/d6/f10 [32669,9553] 0 2024-09-21T10:40:39.572 INFO:tasks.workunit.client.1.smithi112.stdout:3/17: stat f1 0 2024-09-21T10:40:39.577 INFO:tasks.workunit.client.1.smithi112.stdout:1/80: mknod d8/d1a/c1c 0 2024-09-21T10:40:39.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/33: unlink l3 0 2024-09-21T10:40:39.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/34: stat c1 0 2024-09-21T10:40:39.581 INFO:tasks.workunit.client.1.smithi112.stdout:6/47: rmdir d4/d6 39 2024-09-21T10:40:39.581 INFO:tasks.workunit.client.1.smithi112.stdout:6/48: readlink l0 0 2024-09-21T10:40:39.583 INFO:tasks.workunit.client.1.smithi112.stdout:2/70: truncate d0/f11 2694191 0 2024-09-21T10:40:39.588 INFO:tasks.workunit.client.1.smithi112.stdout:8/45: dwrite f3 [0,4194304] 0 2024-09-21T10:40:39.595 INFO:tasks.workunit.client.1.smithi112.stdout:3/18: mknod d2/c3 0 2024-09-21T10:40:39.595 INFO:tasks.workunit.client.1.smithi112.stdout:3/19: write f1 [768200,95691] 0 2024-09-21T10:40:39.597 INFO:tasks.workunit.client.1.smithi112.stdout:4/56: mkdir de/d18 0 2024-09-21T10:40:39.597 INFO:tasks.workunit.client.1.smithi112.stdout:4/57: read - f9 zero size 2024-09-21T10:40:39.597 INFO:tasks.workunit.client.1.smithi112.stdout:4/58: dread - de/f14 zero size 2024-09-21T10:40:39.600 INFO:tasks.workunit.client.1.smithi112.stdout:0/64: link d3/d4/fe d3/d4/d15/f17 0 2024-09-21T10:40:39.600 INFO:tasks.workunit.client.1.smithi112.stdout:0/65: chown d3/d4/ld 127 1 2024-09-21T10:40:39.602 INFO:tasks.workunit.client.1.smithi112.stdout:2/71: dwrite d0/fe [0,4194304] 0 2024-09-21T10:40:39.602 INFO:tasks.workunit.client.1.smithi112.stdout:6/49: dwrite f1 [4194304,4194304] 0 2024-09-21T10:40:39.602 INFO:tasks.workunit.client.1.smithi112.stdout:1/81: symlink d8/d1a/l1d 0 2024-09-21T10:40:39.602 INFO:tasks.workunit.client.1.smithi112.stdout:1/82: fdatasync d8/f9 0 2024-09-21T10:40:39.603 INFO:tasks.workunit.client.1.smithi112.stdout:7/35: creat f5 x:0 0 0 2024-09-21T10:40:39.603 INFO:tasks.workunit.client.1.smithi112.stdout:7/36: truncate f5 367323 0 2024-09-21T10:40:39.603 INFO:tasks.workunit.client.1.smithi112.stdout:7/37: truncate f5 685046 0 2024-09-21T10:40:39.604 INFO:tasks.workunit.client.1.smithi112.stdout:7/38: creat f6 x:0 0 0 2024-09-21T10:40:39.604 INFO:tasks.workunit.client.1.smithi112.stdout:8/46: symlink d8/d9/l10 0 2024-09-21T10:40:39.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/59: fdatasync de/f10 0 2024-09-21T10:40:39.607 INFO:tasks.workunit.client.1.smithi112.stdout:0/66: mkdir d3/d18 0 2024-09-21T10:40:39.607 INFO:tasks.workunit.client.1.smithi112.stdout:0/67: fsync d3/d4/f7 0 2024-09-21T10:40:39.613 INFO:tasks.workunit.client.1.smithi112.stdout:2/72: truncate d0/fb 1039376 0 2024-09-21T10:40:39.624 INFO:tasks.workunit.client.1.smithi112.stdout:1/83: creat d8/d1a/f1e x:0 0 0 2024-09-21T10:40:39.625 INFO:tasks.workunit.client.1.smithi112.stdout:0/68: dwrite d3/f9 [4194304,4194304] 0 2024-09-21T10:40:39.625 INFO:tasks.workunit.client.1.smithi112.stdout:0/69: truncate d3/d4/f13 525379 0 2024-09-21T10:40:39.627 INFO:tasks.workunit.client.1.smithi112.stdout:7/39: mkdir d7 0 2024-09-21T10:40:39.632 INFO:tasks.workunit.client.1.smithi112.stdout:2/73: truncate d0/f2 55878 0 2024-09-21T10:40:39.636 INFO:tasks.workunit.client.1.smithi112.stdout:1/84: creat d8/f1f x:0 0 0 2024-09-21T10:40:39.637 INFO:tasks.workunit.client.1.smithi112.stdout:7/40: symlink d7/l8 0 2024-09-21T10:40:39.640 INFO:tasks.workunit.client.1.smithi112.stdout:6/50: rename d4/dc/dd to d4/d6/d13 0 2024-09-21T10:40:39.641 INFO:tasks.workunit.client.1.smithi112.stdout:6/51: write d4/d6/da/f12 [618563,53883] 0 2024-09-21T10:40:39.641 INFO:tasks.workunit.client.1.smithi112.stdout:1/85: mkdir d8/d20 0 2024-09-21T10:40:39.641 INFO:tasks.workunit.client.1.smithi112.stdout:1/86: write f3 [4801422,23897] 0 2024-09-21T10:40:39.642 INFO:tasks.workunit.client.1.smithi112.stdout:1/87: chown d8/f14 202 1 2024-09-21T10:40:39.642 INFO:tasks.workunit.client.1.smithi112.stdout:1/88: write d8/f19 [908755,128529] 0 2024-09-21T10:40:39.643 INFO:tasks.workunit.client.1.smithi112.stdout:8/47: rename d8/d9/l10 to d8/l11 0 2024-09-21T10:40:39.643 INFO:tasks.workunit.client.1.smithi112.stdout:8/48: chown d8/d9/dd 3505325 1 2024-09-21T10:40:39.645 INFO:tasks.workunit.client.1.smithi112.stdout:6/52: mkdir d4/d6/da/d14 0 2024-09-21T10:40:39.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/89: mknod d8/d1a/c21 0 2024-09-21T10:40:39.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/90: write d8/f19 [1666783,18643] 0 2024-09-21T10:40:39.652 INFO:tasks.workunit.client.1.smithi112.stdout:8/49: read f3 [922904,101159] 0 2024-09-21T10:40:39.654 INFO:tasks.workunit.client.1.smithi112.stdout:5/43: sync 2024-09-21T10:40:39.654 INFO:tasks.workunit.client.1.smithi112.stdout:9/22: sync 2024-09-21T10:40:39.656 INFO:tasks.workunit.client.1.smithi112.stdout:1/91: write d8/f9 [3233482,31858] 0 2024-09-21T10:40:39.656 INFO:tasks.workunit.client.1.smithi112.stdout:5/44: write f6 [1073667,118385] 0 2024-09-21T10:40:39.656 INFO:tasks.workunit.client.1.smithi112.stdout:5/45: write f3 [8897451,14423] 0 2024-09-21T10:40:39.656 INFO:tasks.workunit.client.1.smithi112.stdout:0/70: dwrite d3/d4/f7 [0,4194304] 0 2024-09-21T10:40:39.656 INFO:tasks.workunit.client.1.smithi112.stdout:6/53: creat d4/d6/f15 x:0 0 0 2024-09-21T10:40:39.657 INFO:tasks.workunit.client.1.smithi112.stdout:4/60: rename f4 to de/d18/f19 0 2024-09-21T10:40:39.658 INFO:tasks.workunit.client.1.smithi112.stdout:5/46: fdatasync f3 0 2024-09-21T10:40:39.658 INFO:tasks.workunit.client.1.smithi112.stdout:5/47: chown l0 0 1 2024-09-21T10:40:39.660 INFO:tasks.workunit.client.1.smithi112.stdout:8/50: creat d8/d9/dd/f12 x:0 0 0 2024-09-21T10:40:39.666 INFO:tasks.workunit.client.1.smithi112.stdout:9/23: symlink d1/l6 0 2024-09-21T10:40:39.668 INFO:tasks.workunit.client.1.smithi112.stdout:0/71: write d3/d4/f7 [1903701,112609] 0 2024-09-21T10:40:39.674 INFO:tasks.workunit.client.1.smithi112.stdout:6/54: mknod d4/d6/da/d11/c16 0 2024-09-21T10:40:39.677 INFO:tasks.workunit.client.1.smithi112.stdout:7/41: rename l4 to d7/l9 0 2024-09-21T10:40:39.684 INFO:tasks.workunit.client.1.smithi112.stdout:6/55: dread f1 [4194304,4194304] 0 2024-09-21T10:40:39.686 INFO:tasks.workunit.client.1.smithi112.stdout:0/72: mknod d3/c19 0 2024-09-21T10:40:39.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/48: dwrite f6 [0,4194304] 0 2024-09-21T10:40:39.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/49: fdatasync f6 0 2024-09-21T10:40:39.694 INFO:tasks.workunit.client.1.smithi112.stdout:4/61: getdents de/d18 0 2024-09-21T10:40:39.695 INFO:tasks.workunit.client.1.smithi112.stdout:7/42: dwrite f5 [0,4194304] 0 2024-09-21T10:40:39.695 INFO:tasks.workunit.client.1.smithi112.stdout:7/43: read - f6 zero size 2024-09-21T10:40:39.696 INFO:tasks.workunit.client.1.smithi112.stdout:9/24: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:39.696 INFO:tasks.workunit.client.1.smithi112.stdout:5/50: dread f6 [0,4194304] 0 2024-09-21T10:40:39.696 INFO:tasks.workunit.client.1.smithi112.stdout:5/51: stat f3 0 2024-09-21T10:40:39.696 INFO:tasks.workunit.client.1.smithi112.stdout:9/25: chown d1/c4 3 1 2024-09-21T10:40:39.697 INFO:tasks.workunit.client.1.smithi112.stdout:1/92: rmdir d8 39 2024-09-21T10:40:39.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: pgmap v6: 65 pgs: 65 active+clean; 185 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:39.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: mgrmap e24: smithi112.gkunly(active, since 6s) 2024-09-21T10:40:39.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: Standby manager daemon smithi060.mulzpr started 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/crt"}]: dispatch 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/key"}]: dispatch 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:39 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.700 INFO:tasks.workunit.client.1.smithi112.stdout:6/56: rename d4/d6/c8 to d4/d6/da/d14/c17 0 2024-09-21T10:40:39.703 INFO:tasks.workunit.client.1.smithi112.stdout:0/73: rename d3/d4/d15 to d3/d4/d1a 0 2024-09-21T10:40:39.703 INFO:tasks.workunit.client.1.smithi112.stdout:0/74: chown d3/d4/d10/c11 11353 1 2024-09-21T10:40:39.703 INFO:tasks.workunit.client.1.smithi112.stdout:0/75: creat d3/f1b x:0 0 0 2024-09-21T10:40:39.711 INFO:tasks.workunit.client.1.smithi112.stdout:7/44: mknod d7/ca 0 2024-09-21T10:40:39.718 INFO:tasks.workunit.client.1.smithi112.stdout:9/26: readlink d1/d2/l3 0 2024-09-21T10:40:39.719 INFO:tasks.workunit.client.1.smithi112.stdout:9/27: chown d1/d2/f5 990720128 1 2024-09-21T10:40:39.721 INFO:tasks.workunit.client.1.smithi112.stdout:1/93: rename d8/d1a/c1c to d8/d1a/c22 0 2024-09-21T10:40:39.727 INFO:tasks.workunit.client.1.smithi112.stdout:4/62: rename c6 to de/d18/c1a 0 2024-09-21T10:40:39.727 INFO:tasks.workunit.client.1.smithi112.stdout:6/57: dwrite d4/d6/f15 [0,4194304] 0 2024-09-21T10:40:39.727 INFO:tasks.workunit.client.1.smithi112.stdout:9/28: write d1/d2/f5 [3614485,93099] 0 2024-09-21T10:40:39.728 INFO:tasks.workunit.client.1.smithi112.stdout:6/58: readlink d4/d6/lf 0 2024-09-21T10:40:39.729 INFO:tasks.workunit.client.1.smithi112.stdout:6/59: write d4/d6/da/f12 [398599,57882] 0 2024-09-21T10:40:39.729 INFO:tasks.workunit.client.1.smithi112.stdout:6/60: stat d4/d6/f10 0 2024-09-21T10:40:39.729 INFO:tasks.workunit.client.1.smithi112.stdout:6/61: readlink d4/d6/l9 0 2024-09-21T10:40:39.731 INFO:tasks.workunit.client.1.smithi112.stdout:7/45: mknod d7/cb 0 2024-09-21T10:40:39.734 INFO:tasks.workunit.client.1.smithi112.stdout:2/74: truncate d0/fb 870337 0 2024-09-21T10:40:39.737 INFO:tasks.workunit.client.1.smithi112.stdout:6/62: write d4/d6/f15 [2363592,68652] 0 2024-09-21T10:40:39.737 INFO:tasks.workunit.client.1.smithi112.stdout:1/94: rename d8/c11 to d8/c23 0 2024-09-21T10:40:39.740 INFO:tasks.workunit.client.1.smithi112.stdout:6/63: dread f1 [4194304,4194304] 0 2024-09-21T10:40:39.740 INFO:tasks.workunit.client.1.smithi112.stdout:0/76: rename d3/d4/d10/f14 to d3/d4/f1c 0 2024-09-21T10:40:39.744 INFO:tasks.workunit.client.1.smithi112.stdout:4/63: link c3 de/d18/c1b 0 2024-09-21T10:40:39.744 INFO:tasks.workunit.client.1.smithi112.stdout:6/64: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:39.744 INFO:tasks.workunit.client.1.smithi112.stdout:4/64: fdatasync de/f10 0 2024-09-21T10:40:39.744 INFO:tasks.workunit.client.1.smithi112.stdout:4/65: write de/f14 [303997,9255] 0 2024-09-21T10:40:39.753 INFO:tasks.workunit.client.1.smithi112.stdout:9/29: rmdir d1 39 2024-09-21T10:40:39.753 INFO:tasks.workunit.client.1.smithi112.stdout:9/30: chown d1/d2/f5 30778 1 2024-09-21T10:40:39.756 INFO:tasks.workunit.client.1.smithi112.stdout:7/46: mknod d7/cc 0 2024-09-21T10:40:39.757 INFO:tasks.workunit.client.1.smithi112.stdout:2/75: creat d0/d12/f15 x:0 0 0 2024-09-21T10:40:39.758 INFO:tasks.workunit.client.1.smithi112.stdout:6/65: dwrite d4/d6/da/fb [0,4194304] 0 2024-09-21T10:40:39.758 INFO:tasks.workunit.client.1.smithi112.stdout:6/66: chown d4/d6/f15 0 1 2024-09-21T10:40:39.759 INFO:tasks.workunit.client.1.smithi112.stdout:1/95: link d8/f15 d8/f24 0 2024-09-21T10:40:39.759 INFO:tasks.workunit.client.1.smithi112.stdout:1/96: chown l4 3 1 2024-09-21T10:40:39.759 INFO:tasks.workunit.client.1.smithi112.stdout:1/97: chown d8/d1a/c22 440 1 2024-09-21T10:40:39.760 INFO:tasks.workunit.client.1.smithi112.stdout:0/77: truncate d3/d4/f1c 459104 0 2024-09-21T10:40:39.761 INFO:tasks.workunit.client.1.smithi112.stdout:2/76: mknod d0/d12/c16 0 2024-09-21T10:40:39.766 INFO:tasks.workunit.client.1.smithi112.stdout:0/78: dread d3/d4/f7 [0,4194304] 0 2024-09-21T10:40:39.766 INFO:tasks.workunit.client.1.smithi112.stdout:0/79: readlink d3/d4/l6 0 2024-09-21T10:40:39.766 INFO:tasks.workunit.client.1.smithi112.stdout:0/80: creat d3/d4/f1d x:0 0 0 2024-09-21T10:40:39.767 INFO:tasks.workunit.client.1.smithi112.stdout:1/98: mknod d8/c25 0 2024-09-21T10:40:39.767 INFO:tasks.workunit.client.1.smithi112.stdout:7/47: read f5 [3326654,112608] 0 2024-09-21T10:40:39.767 INFO:tasks.workunit.client.1.smithi112.stdout:7/48: dread - f6 zero size 2024-09-21T10:40:39.768 INFO:tasks.workunit.client.1.smithi112.stdout:2/77: truncate d0/f11 2623015 0 2024-09-21T10:40:39.768 INFO:tasks.workunit.client.1.smithi112.stdout:2/78: fsync d0/f9 0 2024-09-21T10:40:39.769 INFO:tasks.workunit.client.1.smithi112.stdout:9/31: fdatasync d1/d2/f5 0 2024-09-21T10:40:39.769 INFO:tasks.workunit.client.1.smithi112.stdout:9/32: stat d1 0 2024-09-21T10:40:39.770 INFO:tasks.workunit.client.1.smithi112.stdout:6/67: write d4/d6/da/fb [3164394,92794] 0 2024-09-21T10:40:39.770 INFO:tasks.workunit.client.1.smithi112.stdout:6/68: creat d4/d6/da/f18 x:0 0 0 2024-09-21T10:40:39.770 INFO:tasks.workunit.client.1.smithi112.stdout:4/66: dwrite de/d18/f19 [0,4194304] 0 2024-09-21T10:40:39.772 INFO:tasks.workunit.client.1.smithi112.stdout:7/49: link f5 d7/fd 0 2024-09-21T10:40:39.772 INFO:tasks.workunit.client.1.smithi112.stdout:7/50: write f5 [682959,69516] 0 2024-09-21T10:40:39.772 INFO:tasks.workunit.client.1.smithi112.stdout:7/51: read d7/fd [1075454,105158] 0 2024-09-21T10:40:39.781 INFO:tasks.workunit.client.1.smithi112.stdout:3/20: sync 2024-09-21T10:40:39.782 INFO:tasks.workunit.client.1.smithi112.stdout:1/99: write d8/fe [880308,101600] 0 2024-09-21T10:40:39.783 INFO:tasks.workunit.client.1.smithi112.stdout:2/79: dread d0/fe [0,4194304] 0 2024-09-21T10:40:39.783 INFO:tasks.workunit.client.1.smithi112.stdout:2/80: chown d0 47282500 1 2024-09-21T10:40:39.783 INFO:tasks.workunit.client.1.smithi112.stdout:2/81: fdatasync d0/d12/f15 0 2024-09-21T10:40:39.785 INFO:tasks.workunit.client.1.smithi112.stdout:7/52: dread d7/fd [0,4194304] 0 2024-09-21T10:40:39.785 INFO:tasks.workunit.client.1.smithi112.stdout:7/53: chown f6 7 1 2024-09-21T10:40:39.788 INFO:tasks.workunit.client.1.smithi112.stdout:0/81: dwrite d3/d4/f5 [0,4194304] 0 2024-09-21T10:40:39.790 INFO:tasks.workunit.client.1.smithi112.stdout:9/33: link d1/l6 d1/d2/l7 0 2024-09-21T10:40:39.793 INFO:tasks.workunit.client.1.smithi112.stdout:3/21: rename d2/c3 to d2/c4 0 2024-09-21T10:40:39.793 INFO:tasks.workunit.client.1.smithi112.stdout:3/22: rename d2 to d2/d5 22 2024-09-21T10:40:39.795 INFO:tasks.workunit.client.1.smithi112.stdout:6/69: dwrite d4/d6/da/fb [0,4194304] 0 2024-09-21T10:40:39.798 INFO:tasks.workunit.client.1.smithi112.stdout:1/100: mknod d8/d1a/c26 0 2024-09-21T10:40:39.798 INFO:tasks.workunit.client.1.smithi112.stdout:1/101: write d8/fe [2162494,102564] 0 2024-09-21T10:40:39.798 INFO:tasks.workunit.client.1.smithi112.stdout:1/102: chown l6 1506 1 2024-09-21T10:40:39.798 INFO:tasks.workunit.client.1.smithi112.stdout:1/103: stat d8/l16 0 2024-09-21T10:40:39.800 INFO:tasks.workunit.client.1.smithi112.stdout:7/54: symlink d7/le 0 2024-09-21T10:40:39.800 INFO:tasks.workunit.client.1.smithi112.stdout:7/55: chown f5 101 1 2024-09-21T10:40:39.800 INFO:tasks.workunit.client.1.smithi112.stdout:7/56: write f6 [343045,39045] 0 2024-09-21T10:40:39.802 INFO:tasks.workunit.client.1.smithi112.stdout:4/67: mknod de/c1c 0 2024-09-21T10:40:39.805 INFO:tasks.workunit.client.1.smithi112.stdout:0/82: symlink d3/d4/l1e 0 2024-09-21T10:40:39.805 INFO:tasks.workunit.client.1.smithi112.stdout:0/83: chown d3/d4/l1e 9 1 2024-09-21T10:40:39.807 INFO:tasks.workunit.client.1.smithi112.stdout:1/104: write d8/f12 [1925955,45255] 0 2024-09-21T10:40:39.809 INFO:tasks.workunit.client.1.smithi112.stdout:3/23: dwrite f1 [0,4194304] 0 2024-09-21T10:40:39.810 INFO:tasks.workunit.client.1.smithi112.stdout:6/70: mkdir d4/d6/d13/d19 0 2024-09-21T10:40:39.814 INFO:tasks.workunit.client.1.smithi112.stdout:7/57: rename d7/fd to d7/ff 0 2024-09-21T10:40:39.816 INFO:tasks.workunit.client.1.smithi112.stdout:4/68: mkdir de/d18/d1d 0 2024-09-21T10:40:39.818 INFO:tasks.workunit.client.1.smithi112.stdout:7/58: dread f5 [0,4194304] 0 2024-09-21T10:40:39.818 INFO:tasks.workunit.client.1.smithi112.stdout:7/59: chown d7/l8 1 1 2024-09-21T10:40:39.818 INFO:tasks.workunit.client.1.smithi112.stdout:7/60: read f5 [3119458,56403] 0 2024-09-21T10:40:39.818 INFO:tasks.workunit.client.1.smithi112.stdout:7/61: chown c2 2 1 2024-09-21T10:40:39.818 INFO:tasks.workunit.client.1.smithi112.stdout:7/62: fdatasync d7/ff 0 2024-09-21T10:40:39.819 INFO:tasks.workunit.client.1.smithi112.stdout:0/84: symlink d3/d4/l1f 0 2024-09-21T10:40:39.819 INFO:tasks.workunit.client.1.smithi112.stdout:0/85: creat d3/f20 x:0 0 0 2024-09-21T10:40:39.823 INFO:tasks.workunit.client.1.smithi112.stdout:1/105: creat d8/f27 x:0 0 0 2024-09-21T10:40:39.823 INFO:tasks.workunit.client.1.smithi112.stdout:8/51: sync 2024-09-21T10:40:39.824 INFO:tasks.workunit.client.1.smithi112.stdout:2/82: dwrite d0/f11 [0,4194304] 0 2024-09-21T10:40:39.831 INFO:tasks.workunit.client.1.smithi112.stdout:3/24: creat d2/f6 x:0 0 0 2024-09-21T10:40:39.831 INFO:tasks.workunit.client.1.smithi112.stdout:3/25: chown f1 8 1 2024-09-21T10:40:39.832 INFO:tasks.workunit.client.1.smithi112.stdout:9/34: rmdir d1/d2 39 2024-09-21T10:40:39.833 INFO:tasks.workunit.client.1.smithi112.stdout:9/35: chown d1/d2/l3 54576125 1 2024-09-21T10:40:39.836 INFO:tasks.workunit.client.1.smithi112.stdout:6/71: truncate f1 7139506 0 2024-09-21T10:40:39.839 INFO:tasks.workunit.client.1.smithi112.stdout:7/63: creat d7/f10 x:0 0 0 2024-09-21T10:40:39.845 INFO:tasks.workunit.client.1.smithi112.stdout:1/106: unlink d8/f27 0 2024-09-21T10:40:39.845 INFO:tasks.workunit.client.1.smithi112.stdout:3/26: dread f1 [0,4194304] 0 2024-09-21T10:40:39.845 INFO:tasks.workunit.client.1.smithi112.stdout:3/27: creat d2/f7 x:0 0 0 2024-09-21T10:40:39.845 INFO:tasks.workunit.client.1.smithi112.stdout:3/28: dread - d2/f7 zero size 2024-09-21T10:40:39.849 INFO:tasks.workunit.client.1.smithi112.stdout:5/52: sync 2024-09-21T10:40:39.849 INFO:tasks.workunit.client.1.smithi112.stdout:6/72: dread d4/d6/d13/fe [0,4194304] 0 2024-09-21T10:40:39.849 INFO:tasks.workunit.client.1.smithi112.stdout:0/86: dwrite d3/d4/f1d [0,4194304] 0 2024-09-21T10:40:39.849 INFO:tasks.workunit.client.1.smithi112.stdout:0/87: truncate d3/d4/f1d 5197476 0 2024-09-21T10:40:39.851 INFO:tasks.workunit.client.1.smithi112.stdout:2/83: creat d0/d12/d13/f17 x:0 0 0 2024-09-21T10:40:39.851 INFO:tasks.workunit.client.1.smithi112.stdout:8/52: dwrite d8/d9/fa [0,4194304] 0 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/53: dread - d8/d9/dd/f12 zero size 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/54: fsync d8/fc 0 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/55: write d8/d9/dd/f12 [354357,66622] 0 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/56: fdatasync d8/d9/fb 0 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/57: creat d8/d9/f13 x:0 0 0 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/58: chown f2 80352700 1 2024-09-21T10:40:39.852 INFO:tasks.workunit.client.1.smithi112.stdout:7/64: symlink d7/l11 0 2024-09-21T10:40:39.855 INFO:tasks.workunit.client.1.smithi112.stdout:5/53: dread f3 [0,4194304] 0 2024-09-21T10:40:39.856 INFO:tasks.workunit.client.1.smithi112.stdout:1/107: rename l4 to d8/d20/l28 0 2024-09-21T10:40:39.860 INFO:tasks.workunit.client.1.smithi112.stdout:2/84: dread d0/f9 [0,4194304] 0 2024-09-21T10:40:39.860 INFO:tasks.workunit.client.1.smithi112.stdout:0/88: write d3/d4/f5 [2611666,84336] 0 2024-09-21T10:40:39.864 INFO:tasks.workunit.client.1.smithi112.stdout:8/59: dread f0 [0,4194304] 0 2024-09-21T10:40:39.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/73: getdents d4 0 2024-09-21T10:40:39.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/74: truncate d4/d6/da/f18 560366 0 2024-09-21T10:40:39.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/75: fdatasync d4/d6/da/f12 0 2024-09-21T10:40:39.865 INFO:tasks.workunit.client.1.smithi112.stdout:6/76: fdatasync d4/d6/da/fb 0 2024-09-21T10:40:39.867 INFO:tasks.workunit.client.1.smithi112.stdout:5/54: write f6 [2433060,108881] 0 2024-09-21T10:40:39.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/65: symlink d7/l12 0 2024-09-21T10:40:39.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/66: fsync d7/ff 0 2024-09-21T10:40:39.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/67: chown d7/le 243224342 1 2024-09-21T10:40:39.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/68: creat d7/f13 x:0 0 0 2024-09-21T10:40:39.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/69: dread - d7/f13 zero size 2024-09-21T10:40:39.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/70: creat d7/f14 x:0 0 0 2024-09-21T10:40:39.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/29: dwrite d2/f7 [0,4194304] 0 2024-09-21T10:40:39.874 INFO:tasks.workunit.client.1.smithi112.stdout:9/36: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:39.881 INFO:tasks.workunit.client.1.smithi112.stdout:2/85: mknod d0/d12/d13/c18 0 2024-09-21T10:40:39.887 INFO:tasks.workunit.client.1.smithi112.stdout:2/86: dread d0/f9 [0,4194304] 0 2024-09-21T10:40:39.887 INFO:tasks.workunit.client.1.smithi112.stdout:2/87: chown d0/d12/c16 1582204 1 2024-09-21T10:40:39.887 INFO:tasks.workunit.client.1.smithi112.stdout:6/77: mkdir d4/dc/d1a 0 2024-09-21T10:40:39.887 INFO:tasks.workunit.client.1.smithi112.stdout:1/108: dwrite d8/fe [4194304,4194304] 0 2024-09-21T10:40:39.887 INFO:tasks.workunit.client.1.smithi112.stdout:3/30: write d2/f7 [2865091,94876] 0 2024-09-21T10:40:39.891 INFO:tasks.workunit.client.1.smithi112.stdout:5/55: mknod d9/ca 0 2024-09-21T10:40:39.891 INFO:tasks.workunit.client.1.smithi112.stdout:5/56: chown f3 1 1 2024-09-21T10:40:39.891 INFO:tasks.workunit.client.1.smithi112.stdout:0/89: dwrite d3/d4/f1d [0,4194304] 0 2024-09-21T10:40:39.893 INFO:tasks.workunit.client.1.smithi112.stdout:2/88: dread d0/f6 [0,4194304] 0 2024-09-21T10:40:39.906 INFO:tasks.workunit.client.1.smithi112.stdout:7/71: dwrite d7/f13 [0,4194304] 0 2024-09-21T10:40:39.906 INFO:tasks.workunit.client.1.smithi112.stdout:6/78: mknod d4/d6/da/d11/c1b 0 2024-09-21T10:40:39.907 INFO:tasks.workunit.client.1.smithi112.stdout:6/79: fsync d4/d6/da/fb 0 2024-09-21T10:40:39.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/90: dread d3/f9 [4194304,4194304] 0 2024-09-21T10:40:39.907 INFO:tasks.workunit.client.1.smithi112.stdout:6/80: chown d4/d6/da/fb 4 1 2024-09-21T10:40:39.908 INFO:tasks.workunit.client.1.smithi112.stdout:3/31: mknod d2/c8 0 2024-09-21T10:40:39.909 INFO:tasks.workunit.client.1.smithi112.stdout:9/37: mkdir d1/d2/d8 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/109: dwrite d8/f15 [0,4194304] 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/110: stat d8/fd 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/111: readlink l6 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/112: readlink l6 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/113: write d8/f1f [1044914,42997] 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/114: write d8/f1f [1418287,105502] 0 2024-09-21T10:40:39.916 INFO:tasks.workunit.client.1.smithi112.stdout:8/60: rmdir d8/d9 39 2024-09-21T10:40:39.917 INFO:tasks.workunit.client.1.smithi112.stdout:8/61: chown l6 30778 1 2024-09-21T10:40:39.917 INFO:tasks.workunit.client.1.smithi112.stdout:2/89: dwrite d0/fb [0,4194304] 0 2024-09-21T10:40:39.917 INFO:tasks.workunit.client.1.smithi112.stdout:2/90: creat d0/f19 x:0 0 0 2024-09-21T10:40:39.918 INFO:tasks.workunit.client.1.smithi112.stdout:9/38: write d1/d2/f5 [1600379,4284] 0 2024-09-21T10:40:39.919 INFO:tasks.workunit.client.1.smithi112.stdout:5/57: dwrite f3 [4194304,4194304] 0 2024-09-21T10:40:39.919 INFO:tasks.workunit.client.1.smithi112.stdout:6/81: rename l0 to d4/d6/d13/l1c 0 2024-09-21T10:40:39.922 INFO:tasks.workunit.client.1.smithi112.stdout:3/32: link d2/f7 d2/f9 0 2024-09-21T10:40:39.926 INFO:tasks.workunit.client.1.smithi112.stdout:3/33: read f1 [2546543,58620] 0 2024-09-21T10:40:39.926 INFO:tasks.workunit.client.1.smithi112.stdout:3/34: chown d2/f6 57624476 1 2024-09-21T10:40:39.928 INFO:tasks.workunit.client.1.smithi112.stdout:3/35: fdatasync d2/f7 0 2024-09-21T10:40:39.928 INFO:tasks.workunit.client.1.smithi112.stdout:3/36: creat d2/fa x:0 0 0 2024-09-21T10:40:39.929 INFO:tasks.workunit.client.1.smithi112.stdout:8/62: truncate f5 1647819 0 2024-09-21T10:40:39.929 INFO:tasks.workunit.client.1.smithi112.stdout:8/63: dread - d8/d9/fb zero size 2024-09-21T10:40:39.929 INFO:tasks.workunit.client.1.smithi112.stdout:8/64: creat d8/f14 x:0 0 0 2024-09-21T10:40:39.933 INFO:tasks.workunit.client.1.smithi112.stdout:8/65: write f0 [2041212,59652] 0 2024-09-21T10:40:39.933 INFO:tasks.workunit.client.1.smithi112.stdout:8/66: write d8/f14 [383787,115014] 0 2024-09-21T10:40:39.933 INFO:tasks.workunit.client.1.smithi112.stdout:7/72: fsync d7/f14 0 2024-09-21T10:40:39.938 INFO:tasks.workunit.client.1.smithi112.stdout:0/91: rmdir d3 39 2024-09-21T10:40:39.944 INFO:tasks.workunit.client.1.smithi112.stdout:9/39: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: pgmap v6: 65 pgs: 65 active+clean; 185 MiB data, 816 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:40:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: mgrmap e24: smithi112.gkunly(active, since 6s) 2024-09-21T10:40:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: Standby manager daemon smithi060.mulzpr started 2024-09-21T10:40:39.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/crt"}]: dispatch 2024-09-21T10:40:39.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:40:39.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/key"}]: dispatch 2024-09-21T10:40:39.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/914348534' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:40:39.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:39 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:39.965 INFO:tasks.workunit.client.1.smithi112.stdout:6/82: link c3 d4/dc/d1a/c1d 0 2024-09-21T10:40:39.965 INFO:tasks.workunit.client.1.smithi112.stdout:6/83: fsync d4/d6/d13/fe 0 2024-09-21T10:40:39.966 INFO:tasks.workunit.client.1.smithi112.stdout:1/115: rename d8/f19 to d8/d20/f29 0 2024-09-21T10:40:39.968 INFO:tasks.workunit.client.1.smithi112.stdout:9/40: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:39.968 INFO:tasks.workunit.client.1.smithi112.stdout:3/37: mknod d2/cb 0 2024-09-21T10:40:39.972 INFO:tasks.workunit.client.1.smithi112.stdout:8/67: mknod d8/d9/dd/c15 0 2024-09-21T10:40:39.973 INFO:tasks.workunit.client.1.smithi112.stdout:2/91: rmdir d0/d12/d13 39 2024-09-21T10:40:39.975 INFO:tasks.workunit.client.1.smithi112.stdout:7/73: symlink d7/l15 0 2024-09-21T10:40:39.975 INFO:tasks.workunit.client.1.smithi112.stdout:7/74: write d7/f10 [357854,114989] 0 2024-09-21T10:40:39.976 INFO:tasks.workunit.client.1.smithi112.stdout:8/68: dread d8/d9/dd/f12 [0,4194304] 0 2024-09-21T10:40:39.976 INFO:tasks.workunit.client.1.smithi112.stdout:7/75: creat d7/f16 x:0 0 0 2024-09-21T10:40:39.976 INFO:tasks.workunit.client.1.smithi112.stdout:7/76: creat d7/f17 x:0 0 0 2024-09-21T10:40:39.977 INFO:tasks.workunit.client.1.smithi112.stdout:0/92: unlink d3/d4/f7 0 2024-09-21T10:40:39.977 INFO:tasks.workunit.client.1.smithi112.stdout:0/93: chown d3/f12 35539 1 2024-09-21T10:40:39.981 INFO:tasks.workunit.client.1.smithi112.stdout:6/84: mknod d4/d6/d13/c1e 0 2024-09-21T10:40:39.981 INFO:tasks.workunit.client.1.smithi112.stdout:6/85: chown d4/d6/da 109 1 2024-09-21T10:40:39.983 INFO:tasks.workunit.client.1.smithi112.stdout:5/58: rename f6 to d9/fb 0 2024-09-21T10:40:39.985 INFO:tasks.workunit.client.1.smithi112.stdout:1/116: mknod d8/d1a/c2a 0 2024-09-21T10:40:39.986 INFO:tasks.workunit.client.1.smithi112.stdout:1/117: read d8/d20/f29 [1193900,52813] 0 2024-09-21T10:40:39.986 INFO:tasks.workunit.client.1.smithi112.stdout:1/118: chown d8/d1a/c22 50117352 1 2024-09-21T10:40:39.988 INFO:tasks.workunit.client.1.smithi112.stdout:3/38: unlink d2/cb 0 2024-09-21T10:40:39.993 INFO:tasks.workunit.client.1.smithi112.stdout:2/92: creat d0/d12/d13/f1a x:0 0 0 2024-09-21T10:40:39.994 INFO:tasks.workunit.client.1.smithi112.stdout:5/59: dread d9/fb [0,4194304] 0 2024-09-21T10:40:39.994 INFO:tasks.workunit.client.1.smithi112.stdout:5/60: write f3 [1589610,86887] 0 2024-09-21T10:40:39.994 INFO:tasks.workunit.client.1.smithi112.stdout:7/77: dwrite f5 [0,4194304] 0 2024-09-21T10:40:39.996 INFO:tasks.workunit.client.1.smithi112.stdout:7/78: dread f6 [0,4194304] 0 2024-09-21T10:40:39.996 INFO:tasks.workunit.client.1.smithi112.stdout:7/79: chown d7/l15 23326 1 2024-09-21T10:40:39.999 INFO:tasks.workunit.client.1.smithi112.stdout:4/69: sync 2024-09-21T10:40:40.001 INFO:tasks.workunit.client.1.smithi112.stdout:0/94: mkdir d3/d4/d1a/d21 0 2024-09-21T10:40:40.001 INFO:tasks.workunit.client.1.smithi112.stdout:0/95: chown d3/d4/d10/c16 617273092 1 2024-09-21T10:40:40.003 INFO:tasks.workunit.client.1.smithi112.stdout:6/86: mkdir d4/d6/da/d11/d1f 0 2024-09-21T10:40:40.003 INFO:tasks.workunit.client.1.smithi112.stdout:6/87: chown d4/dc/d1a/c1d 995373090 1 2024-09-21T10:40:40.003 INFO:tasks.workunit.client.1.smithi112.stdout:6/88: chown d4/d6/da/d14/c17 27851441 1 2024-09-21T10:40:40.005 INFO:tasks.workunit.client.1.smithi112.stdout:9/41: rename d1/d2/d8 to d1/d9 0 2024-09-21T10:40:40.007 INFO:tasks.workunit.client.1.smithi112.stdout:1/119: symlink d8/d20/l2b 0 2024-09-21T10:40:40.008 INFO:tasks.workunit.client.1.smithi112.stdout:3/39: rename d2/f6 to d2/fc 0 2024-09-21T10:40:40.009 INFO:tasks.workunit.client.1.smithi112.stdout:0/96: dread d3/d4/fe [0,4194304] 0 2024-09-21T10:40:40.011 INFO:tasks.workunit.client.1.smithi112.stdout:5/61: dwrite d9/fb [0,4194304] 0 2024-09-21T10:40:40.015 INFO:tasks.workunit.client.1.smithi112.stdout:8/69: getdents d8 0 2024-09-21T10:40:40.019 INFO:tasks.workunit.client.1.smithi112.stdout:7/80: rename d7/cb to d7/c18 0 2024-09-21T10:40:40.021 INFO:tasks.workunit.client.1.smithi112.stdout:8/70: fdatasync f0 0 2024-09-21T10:40:40.027 INFO:tasks.workunit.client.1.smithi112.stdout:6/89: mkdir d4/d6/da/d14/d20 0 2024-09-21T10:40:40.027 INFO:tasks.workunit.client.1.smithi112.stdout:6/90: chown d4/d6/d13/fe 5 1 2024-09-21T10:40:40.031 INFO:tasks.workunit.client.1.smithi112.stdout:3/40: dwrite f0 [0,4194304] 0 2024-09-21T10:40:40.031 INFO:tasks.workunit.client.1.smithi112.stdout:1/120: creat d8/d1a/f2c x:0 0 0 2024-09-21T10:40:40.033 INFO:tasks.workunit.client.1.smithi112.stdout:0/97: creat d3/d18/f22 x:0 0 0 2024-09-21T10:40:40.035 INFO:tasks.workunit.client.1.smithi112.stdout:2/93: getdents d0/d12/d13 0 2024-09-21T10:40:40.038 INFO:tasks.workunit.client.1.smithi112.stdout:8/71: unlink f5 0 2024-09-21T10:40:40.039 INFO:tasks.workunit.client.1.smithi112.stdout:8/72: dread - d8/d9/fb zero size 2024-09-21T10:40:40.039 INFO:tasks.workunit.client.1.smithi112.stdout:4/70: getdents de 0 2024-09-21T10:40:40.043 INFO:tasks.workunit.client.1.smithi112.stdout:1/121: symlink d8/l2d 0 2024-09-21T10:40:40.044 INFO:tasks.workunit.client.1.smithi112.stdout:1/122: truncate d8/f1f 2219402 0 2024-09-21T10:40:40.044 INFO:tasks.workunit.client.1.smithi112.stdout:1/123: write d8/f9 [2236353,63809] 0 2024-09-21T10:40:40.044 INFO:tasks.workunit.client.1.smithi112.stdout:1/124: dread - d8/d1a/f2c zero size 2024-09-21T10:40:40.044 INFO:tasks.workunit.client.1.smithi112.stdout:1/125: readlink d8/d20/l28 0 2024-09-21T10:40:40.045 INFO:tasks.workunit.client.1.smithi112.stdout:8/73: creat d8/d9/dd/f16 x:0 0 0 2024-09-21T10:40:40.045 INFO:tasks.workunit.client.1.smithi112.stdout:8/74: write f0 [746103,70427] 0 2024-09-21T10:40:40.046 INFO:tasks.workunit.client.1.smithi112.stdout:4/71: truncate f5 1351822 0 2024-09-21T10:40:40.047 INFO:tasks.workunit.client.1.smithi112.stdout:1/126: mknod d8/d1a/c2e 0 2024-09-21T10:40:40.048 INFO:tasks.workunit.client.1.smithi112.stdout:9/42: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:40.049 INFO:tasks.workunit.client.1.smithi112.stdout:8/75: rename d8/d9/dd/c15 to d8/c17 0 2024-09-21T10:40:40.049 INFO:tasks.workunit.client.1.smithi112.stdout:5/62: dwrite d9/fb [0,4194304] 0 2024-09-21T10:40:40.049 INFO:tasks.workunit.client.1.smithi112.stdout:5/63: write f3 [46889,111160] 0 2024-09-21T10:40:40.052 INFO:tasks.workunit.client.1.smithi112.stdout:6/91: dwrite d4/d6/d13/fe [0,4194304] 0 2024-09-21T10:40:40.058 INFO:tasks.workunit.client.1.smithi112.stdout:9/43: write d1/d2/f5 [1000079,41243] 0 2024-09-21T10:40:40.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/76: mkdir d8/d18 0 2024-09-21T10:40:40.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/77: write d8/d9/f13 [5699,118851] 0 2024-09-21T10:40:40.059 INFO:tasks.workunit.client.1.smithi112.stdout:1/127: write d8/fe [4578435,112466] 0 2024-09-21T10:40:40.061 INFO:tasks.workunit.client.1.smithi112.stdout:5/64: rename l8 to d9/lc 0 2024-09-21T10:40:40.061 INFO:tasks.workunit.client.1.smithi112.stdout:5/65: chown d9/lc 20 1 2024-09-21T10:40:40.062 INFO:tasks.workunit.client.1.smithi112.stdout:3/41: fsync d2/fc 0 2024-09-21T10:40:40.062 INFO:tasks.workunit.client.1.smithi112.stdout:3/42: chown d2/f9 11695 1 2024-09-21T10:40:40.066 INFO:tasks.workunit.client.1.smithi112.stdout:2/94: dwrite d0/f10 [4194304,4194304] 0 2024-09-21T10:40:40.066 INFO:tasks.workunit.client.1.smithi112.stdout:6/92: dread d4/d6/f15 [0,4194304] 0 2024-09-21T10:40:40.067 INFO:tasks.workunit.client.1.smithi112.stdout:6/93: chown d4/d6/da/fb 26537310 1 2024-09-21T10:40:40.074 INFO:tasks.workunit.client.1.smithi112.stdout:3/43: dread f1 [0,4194304] 0 2024-09-21T10:40:40.074 INFO:tasks.workunit.client.1.smithi112.stdout:2/95: mkdir d0/d12/d1b 0 2024-09-21T10:40:40.077 INFO:tasks.workunit.client.1.smithi112.stdout:3/44: truncate f1 2052798 0 2024-09-21T10:40:40.080 INFO:tasks.workunit.client.1.smithi112.stdout:2/96: rename d0/l8 to d0/d12/d13/l1c 0 2024-09-21T10:40:40.080 INFO:tasks.workunit.client.1.smithi112.stdout:2/97: creat d0/f1d x:0 0 0 2024-09-21T10:40:40.080 INFO:tasks.workunit.client.1.smithi112.stdout:9/44: dread d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:40.081 INFO:tasks.workunit.client.1.smithi112.stdout:0/98: dwrite d3/d4/f5 [0,4194304] 0 2024-09-21T10:40:40.081 INFO:tasks.workunit.client.1.smithi112.stdout:0/99: readlink d3/d4/lc 0 2024-09-21T10:40:40.082 INFO:tasks.workunit.client.1.smithi112.stdout:6/94: dread f1 [0,4194304] 0 2024-09-21T10:40:40.084 INFO:tasks.workunit.client.1.smithi112.stdout:2/98: creat d0/d12/d1b/f1e x:0 0 0 2024-09-21T10:40:40.089 INFO:tasks.workunit.client.1.smithi112.stdout:2/99: rename d0/cc to d0/c1f 0 2024-09-21T10:40:40.089 INFO:tasks.workunit.client.1.smithi112.stdout:2/100: creat d0/d12/d1b/f20 x:0 0 0 2024-09-21T10:40:40.091 INFO:tasks.workunit.client.1.smithi112.stdout:1/128: dwrite d8/f24 [0,4194304] 0 2024-09-21T10:40:40.092 INFO:tasks.workunit.client.1.smithi112.stdout:8/78: dwrite d8/f14 [0,4194304] 0 2024-09-21T10:40:40.094 INFO:tasks.workunit.client.1.smithi112.stdout:1/129: mknod d8/d20/c2f 0 2024-09-21T10:40:40.097 INFO:tasks.workunit.client.1.smithi112.stdout:0/100: write d3/d4/f5 [1523218,11523] 0 2024-09-21T10:40:40.098 INFO:tasks.workunit.client.1.smithi112.stdout:5/66: dwrite d9/fb [0,4194304] 0 2024-09-21T10:40:40.098 INFO:tasks.workunit.client.1.smithi112.stdout:5/67: readlink l0 0 2024-09-21T10:40:40.098 INFO:tasks.workunit.client.1.smithi112.stdout:5/68: chown d9/fb 4474 1 2024-09-21T10:40:40.106 INFO:tasks.workunit.client.1.smithi112.stdout:8/79: creat d8/f19 x:0 0 0 2024-09-21T10:40:40.108 INFO:tasks.workunit.client.1.smithi112.stdout:5/69: dread d9/fb [0,4194304] 0 2024-09-21T10:40:40.109 INFO:tasks.workunit.client.1.smithi112.stdout:1/130: rename d8/d20/l28 to d8/l30 0 2024-09-21T10:40:40.113 INFO:tasks.workunit.client.1.smithi112.stdout:9/45: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:40.115 INFO:tasks.workunit.client.1.smithi112.stdout:2/101: dwrite d0/d12/f15 [0,4194304] 0 2024-09-21T10:40:40.116 INFO:tasks.workunit.client.1.smithi112.stdout:1/131: mkdir d8/d1a/d31 0 2024-09-21T10:40:40.120 INFO:tasks.workunit.client.1.smithi112.stdout:9/46: creat d1/d2/fa x:0 0 0 2024-09-21T10:40:40.122 INFO:tasks.workunit.client.1.smithi112.stdout:0/101: dwrite d3/f9 [0,4194304] 0 2024-09-21T10:40:40.123 INFO:tasks.workunit.client.1.smithi112.stdout:5/70: dwrite d9/fb [4194304,4194304] 0 2024-09-21T10:40:40.127 INFO:tasks.workunit.client.1.smithi112.stdout:2/102: creat d0/dd/f21 x:0 0 0 2024-09-21T10:40:40.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/132: creat d8/d20/f32 x:0 0 0 2024-09-21T10:40:40.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/133: fdatasync d8/f14 0 2024-09-21T10:40:40.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/134: chown d8 4400 1 2024-09-21T10:40:40.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/135: write d8/fa [485382,25046] 0 2024-09-21T10:40:40.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/136: write d8/d1a/f1e [744825,21186] 0 2024-09-21T10:40:40.130 INFO:tasks.workunit.client.1.smithi112.stdout:9/47: symlink d1/lb 0 2024-09-21T10:40:40.130 INFO:tasks.workunit.client.1.smithi112.stdout:9/48: write d1/d2/f5 [4377622,61153] 0 2024-09-21T10:40:40.131 INFO:tasks.workunit.client.1.smithi112.stdout:0/102: mkdir d3/d23 0 2024-09-21T10:40:40.133 INFO:tasks.workunit.client.1.smithi112.stdout:5/71: mknod d9/cd 0 2024-09-21T10:40:40.134 INFO:tasks.workunit.client.1.smithi112.stdout:2/103: truncate d0/fe 2148064 0 2024-09-21T10:40:40.138 INFO:tasks.workunit.client.1.smithi112.stdout:9/49: rmdir d1/d9 0 2024-09-21T10:40:40.140 INFO:tasks.workunit.client.1.smithi112.stdout:5/72: creat d9/fe x:0 0 0 2024-09-21T10:40:40.140 INFO:tasks.workunit.client.1.smithi112.stdout:5/73: creat d9/ff x:0 0 0 2024-09-21T10:40:40.140 INFO:tasks.workunit.client.1.smithi112.stdout:5/74: write d9/ff [804359,66449] 0 2024-09-21T10:40:40.145 INFO:tasks.workunit.client.1.smithi112.stdout:0/103: dwrite d3/d18/f22 [0,4194304] 0 2024-09-21T10:40:40.146 INFO:tasks.workunit.client.1.smithi112.stdout:9/50: write d1/d2/f5 [27027,23076] 0 2024-09-21T10:40:40.146 INFO:tasks.workunit.client.1.smithi112.stdout:9/51: chown d1/d2/f5 2858162 1 2024-09-21T10:40:40.147 INFO:tasks.workunit.client.1.smithi112.stdout:8/80: rmdir d8 39 2024-09-21T10:40:40.148 INFO:tasks.workunit.client.1.smithi112.stdout:9/52: fsync d1/d2/f5 0 2024-09-21T10:40:40.149 INFO:tasks.workunit.client.1.smithi112.stdout:1/137: getdents d8 0 2024-09-21T10:40:40.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/75: dread d9/ff [0,4194304] 0 2024-09-21T10:40:40.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/76: readlink l2 0 2024-09-21T10:40:40.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/77: write f3 [672318,94842] 0 2024-09-21T10:40:40.151 INFO:tasks.workunit.client.1.smithi112.stdout:0/104: creat d3/d4/d10/f24 x:0 0 0 2024-09-21T10:40:40.152 INFO:tasks.workunit.client.1.smithi112.stdout:8/81: mkdir d8/d9/dd/d1a 0 2024-09-21T10:40:40.157 INFO:tasks.workunit.client.1.smithi112.stdout:8/82: creat d8/d9/f1b x:0 0 0 2024-09-21T10:40:40.157 INFO:tasks.workunit.client.1.smithi112.stdout:8/83: write f2 [1712622,32006] 0 2024-09-21T10:40:40.157 INFO:tasks.workunit.client.1.smithi112.stdout:8/84: chown l7 24481823 1 2024-09-21T10:40:40.159 INFO:tasks.workunit.client.1.smithi112.stdout:1/138: dread d8/f15 [0,4194304] 0 2024-09-21T10:40:40.162 INFO:tasks.workunit.client.1.smithi112.stdout:8/85: creat d8/d18/f1c x:0 0 0 2024-09-21T10:40:40.164 INFO:tasks.workunit.client.1.smithi112.stdout:8/86: unlink l7 0 2024-09-21T10:40:40.165 INFO:tasks.workunit.client.1.smithi112.stdout:1/139: dread d8/fd [0,4194304] 0 2024-09-21T10:40:40.167 INFO:tasks.workunit.client.1.smithi112.stdout:8/87: creat d8/d9/dd/f1d x:0 0 0 2024-09-21T10:40:40.168 INFO:tasks.workunit.client.1.smithi112.stdout:1/140: mknod d8/d1a/d31/c33 0 2024-09-21T10:40:40.171 INFO:tasks.workunit.client.1.smithi112.stdout:8/88: rmdir d8 39 2024-09-21T10:40:40.171 INFO:tasks.workunit.client.1.smithi112.stdout:9/53: dwrite d1/d2/f5 [4194304,4194304] 0 2024-09-21T10:40:40.171 INFO:tasks.workunit.client.1.smithi112.stdout:0/105: dwrite d3/d4/f13 [0,4194304] 0 2024-09-21T10:40:40.173 INFO:tasks.workunit.client.1.smithi112.stdout:8/89: symlink d8/d18/l1e 0 2024-09-21T10:40:40.173 INFO:tasks.workunit.client.1.smithi112.stdout:8/90: dread - d8/d18/f1c zero size 2024-09-21T10:40:40.174 INFO:tasks.workunit.client.1.smithi112.stdout:1/141: dread d8/fa [0,4194304] 0 2024-09-21T10:40:40.174 INFO:tasks.workunit.client.1.smithi112.stdout:1/142: chown d8/fe 159612 1 2024-09-21T10:40:40.175 INFO:tasks.workunit.client.1.smithi112.stdout:9/54: symlink d1/lc 0 2024-09-21T10:40:40.178 INFO:tasks.workunit.client.1.smithi112.stdout:5/78: getdents d9 0 2024-09-21T10:40:40.178 INFO:tasks.workunit.client.1.smithi112.stdout:5/79: write f3 [9903530,84141] 0 2024-09-21T10:40:40.180 INFO:tasks.workunit.client.1.smithi112.stdout:0/106: symlink d3/d18/l25 0 2024-09-21T10:40:40.182 INFO:tasks.workunit.client.1.smithi112.stdout:8/91: symlink d8/d9/dd/d1a/l1f 0 2024-09-21T10:40:40.182 INFO:tasks.workunit.client.1.smithi112.stdout:8/92: creat d8/d9/dd/f20 x:0 0 0 2024-09-21T10:40:40.183 INFO:tasks.workunit.client.1.smithi112.stdout:1/143: creat d8/d1a/d31/f34 x:0 0 0 2024-09-21T10:40:40.186 INFO:tasks.workunit.client.1.smithi112.stdout:0/107: write d3/f12 [982641,116400] 0 2024-09-21T10:40:40.186 INFO:tasks.workunit.client.1.smithi112.stdout:0/108: fdatasync d3/f9 0 2024-09-21T10:40:40.187 INFO:tasks.workunit.client.1.smithi112.stdout:5/80: creat d9/f10 x:0 0 0 2024-09-21T10:40:40.187 INFO:tasks.workunit.client.1.smithi112.stdout:5/81: creat d9/f11 x:0 0 0 2024-09-21T10:40:40.187 INFO:tasks.workunit.client.1.smithi112.stdout:5/82: creat d9/f12 x:0 0 0 2024-09-21T10:40:40.191 INFO:tasks.workunit.client.1.smithi112.stdout:1/144: symlink d8/l35 0 2024-09-21T10:40:40.194 INFO:tasks.workunit.client.1.smithi112.stdout:9/55: rename d1/d2/l7 to d1/d2/ld 0 2024-09-21T10:40:40.194 INFO:tasks.workunit.client.1.smithi112.stdout:9/56: write d1/d2/fa [353174,127158] 0 2024-09-21T10:40:40.199 INFO:tasks.workunit.client.1.smithi112.stdout:0/109: link d3/d4/d10/f24 d3/d23/f26 0 2024-09-21T10:40:40.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/83: mknod d9/c13 0 2024-09-21T10:40:40.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/84: chown d9 359 1 2024-09-21T10:40:40.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/85: read - d9/f12 zero size 2024-09-21T10:40:40.208 INFO:tasks.workunit.client.1.smithi112.stdout:1/145: mknod d8/d1a/c36 0 2024-09-21T10:40:40.209 INFO:tasks.workunit.client.1.smithi112.stdout:9/57: dwrite d1/d2/f5 [4194304,4194304] 0 2024-09-21T10:40:40.212 INFO:tasks.workunit.client.1.smithi112.stdout:0/110: write d3/d4/f13 [520251,55130] 0 2024-09-21T10:40:40.212 INFO:tasks.workunit.client.1.smithi112.stdout:0/111: fsync d3/d18/f22 0 2024-09-21T10:40:40.214 INFO:tasks.workunit.client.1.smithi112.stdout:1/146: mkdir d8/d1a/d31/d37 0 2024-09-21T10:40:40.214 INFO:tasks.workunit.client.1.smithi112.stdout:1/147: dread - d8/d1a/f2c zero size 2024-09-21T10:40:40.226 INFO:tasks.workunit.client.1.smithi112.stdout:9/58: dwrite d1/d2/f5 [4194304,4194304] 0 2024-09-21T10:40:40.228 INFO:tasks.workunit.client.1.smithi112.stdout:9/59: symlink d1/d2/le 0 2024-09-21T10:40:40.230 INFO:tasks.workunit.client.1.smithi112.stdout:9/60: unlink d1/d2/fa 0 2024-09-21T10:40:40.236 INFO:tasks.workunit.client.1.smithi112.stdout:0/112: dwrite d3/f1b [0,4194304] 0 2024-09-21T10:40:40.236 INFO:tasks.workunit.client.1.smithi112.stdout:0/113: readlink d3/d4/l1f 0 2024-09-21T10:40:40.236 INFO:tasks.workunit.client.1.smithi112.stdout:0/114: getdents d3/d4/d1a/d21 0 2024-09-21T10:40:40.238 INFO:tasks.workunit.client.1.smithi112.stdout:0/115: mknod d3/d23/c27 0 2024-09-21T10:40:40.239 INFO:tasks.workunit.client.1.smithi112.stdout:9/61: write d1/d2/f5 [4263793,14217] 0 2024-09-21T10:40:40.239 INFO:tasks.workunit.client.1.smithi112.stdout:9/62: write d1/d2/f5 [361183,129804] 0 2024-09-21T10:40:40.313 INFO:tasks.workunit.client.1.smithi112.stdout:2/104: dread d0/f9 [0,4194304] 0 2024-09-21T10:40:40.313 INFO:tasks.workunit.client.1.smithi112.stdout:2/105: write d0/d12/d13/f17 [658024,92176] 0 2024-09-21T10:40:40.313 INFO:tasks.workunit.client.1.smithi112.stdout:2/106: chown d0/d12/f15 983 1 2024-09-21T10:40:40.315 INFO:tasks.workunit.client.1.smithi112.stdout:2/107: truncate d0/d12/f15 926717 0 2024-09-21T10:40:40.317 INFO:tasks.workunit.client.1.smithi112.stdout:2/108: dread d0/f9 [0,4194304] 0 2024-09-21T10:40:40.318 INFO:tasks.workunit.client.1.smithi112.stdout:1/148: dwrite d8/fd [4194304,4194304] 0 2024-09-21T10:40:40.320 INFO:tasks.workunit.client.1.smithi112.stdout:2/109: creat d0/d12/d13/f22 x:0 0 0 2024-09-21T10:40:40.323 INFO:tasks.workunit.client.1.smithi112.stdout:1/149: creat d8/f38 x:0 0 0 2024-09-21T10:40:40.323 INFO:tasks.workunit.client.1.smithi112.stdout:1/150: creat d8/d1a/f39 x:0 0 0 2024-09-21T10:40:40.325 INFO:tasks.workunit.client.1.smithi112.stdout:2/110: link d0/d12/c16 d0/d12/d1b/c23 0 2024-09-21T10:40:40.327 INFO:tasks.workunit.client.1.smithi112.stdout:8/93: getdents d8/d9/dd 0 2024-09-21T10:40:40.330 INFO:tasks.workunit.client.1.smithi112.stdout:8/94: dread d8/d9/fa [0,4194304] 0 2024-09-21T10:40:40.331 INFO:tasks.workunit.client.1.smithi112.stdout:8/95: chown d8/l11 10989098 1 2024-09-21T10:40:40.331 INFO:tasks.workunit.client.1.smithi112.stdout:8/96: chown d8/d18/l1e 1355171467 1 2024-09-21T10:40:40.334 INFO:tasks.workunit.client.1.smithi112.stdout:9/63: rename d1/d2/ld to d1/lf 0 2024-09-21T10:40:40.338 INFO:tasks.workunit.client.1.smithi112.stdout:1/151: dwrite d8/d1a/f1e [0,4194304] 0 2024-09-21T10:40:40.339 INFO:tasks.workunit.client.1.smithi112.stdout:2/111: rename d0/d12/d13/l14 to d0/l24 0 2024-09-21T10:40:40.339 INFO:tasks.workunit.client.1.smithi112.stdout:2/112: readlink d0/l24 0 2024-09-21T10:40:40.340 INFO:tasks.workunit.client.1.smithi112.stdout:9/64: rename d1/lb to d1/l10 0 2024-09-21T10:40:40.348 INFO:tasks.workunit.client.1.smithi112.stdout:1/152: rename d8/d1a/f39 to d8/f3a 0 2024-09-21T10:40:40.348 INFO:tasks.workunit.client.1.smithi112.stdout:1/153: stat d8/l35 0 2024-09-21T10:40:40.348 INFO:tasks.workunit.client.1.smithi112.stdout:9/65: rmdir d1 39 2024-09-21T10:40:40.349 INFO:tasks.workunit.client.1.smithi112.stdout:5/86: getdents d9 0 2024-09-21T10:40:40.350 INFO:tasks.workunit.client.1.smithi112.stdout:5/87: readlink d9/lc 0 2024-09-21T10:40:40.354 INFO:tasks.workunit.client.1.smithi112.stdout:5/88: unlink d9/fb 0 2024-09-21T10:40:40.356 INFO:tasks.workunit.client.1.smithi112.stdout:5/89: stat d9/f11 0 2024-09-21T10:40:40.358 INFO:tasks.workunit.client.1.smithi112.stdout:8/97: dwrite d8/d9/dd/f16 [0,4194304] 0 2024-09-21T10:40:40.358 INFO:tasks.workunit.client.1.smithi112.stdout:8/98: chown d8/d18/l1e 153046 1 2024-09-21T10:40:40.358 INFO:tasks.workunit.client.1.smithi112.stdout:8/99: fsync d8/d18/f1c 0 2024-09-21T10:40:40.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/90: dread - d9/f10 zero size 2024-09-21T10:40:40.358 INFO:tasks.workunit.client.1.smithi112.stdout:2/113: dwrite d0/f2 [0,4194304] 0 2024-09-21T10:40:40.358 INFO:tasks.workunit.client.1.smithi112.stdout:8/100: write d8/d9/dd/f12 [179690,80141] 0 2024-09-21T10:40:40.362 INFO:tasks.workunit.client.1.smithi112.stdout:5/91: creat d9/f14 x:0 0 0 2024-09-21T10:40:40.369 INFO:tasks.workunit.client.1.smithi112.stdout:8/101: mknod d8/d9/dd/d1a/c21 0 2024-09-21T10:40:40.369 INFO:tasks.workunit.client.1.smithi112.stdout:8/102: write d8/d9/fb [766893,58239] 0 2024-09-21T10:40:40.372 INFO:tasks.workunit.client.1.smithi112.stdout:8/103: symlink d8/d9/dd/l22 0 2024-09-21T10:40:40.374 INFO:tasks.workunit.client.1.smithi112.stdout:2/114: dwrite d0/f11 [0,4194304] 0 2024-09-21T10:40:40.374 INFO:tasks.workunit.client.1.smithi112.stdout:2/115: creat d0/f25 x:0 0 0 2024-09-21T10:40:40.374 INFO:tasks.workunit.client.1.smithi112.stdout:2/116: write d0/dd/f21 [91187,58324] 0 2024-09-21T10:40:40.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/92: mkdir d9/d15 0 2024-09-21T10:40:40.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/93: getdents d9/d15 0 2024-09-21T10:40:40.376 INFO:tasks.workunit.client.1.smithi112.stdout:2/117: dread d0/fe [0,4194304] 0 2024-09-21T10:40:40.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/104: write d8/f14 [580468,7265] 0 2024-09-21T10:40:40.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/105: truncate d8/d9/dd/f20 475935 0 2024-09-21T10:40:40.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/94: creat d9/d15/f16 x:0 0 0 2024-09-21T10:40:40.384 INFO:tasks.workunit.client.1.smithi112.stdout:5/95: stat d9/f14 0 2024-09-21T10:40:40.386 INFO:tasks.workunit.client.1.smithi112.stdout:8/106: rename d8/d9/dd/f12 to d8/d18/f23 0 2024-09-21T10:40:40.387 INFO:tasks.workunit.client.1.smithi112.stdout:8/107: fdatasync d8/d9/fa 0 2024-09-21T10:40:40.387 INFO:tasks.workunit.client.1.smithi112.stdout:8/108: fdatasync d8/d9/dd/f16 0 2024-09-21T10:40:40.390 INFO:tasks.workunit.client.1.smithi112.stdout:8/109: unlink d8/d9/f1b 0 2024-09-21T10:40:40.391 INFO:tasks.workunit.client.1.smithi112.stdout:8/110: write d8/d9/dd/f1d [594242,3936] 0 2024-09-21T10:40:40.391 INFO:tasks.workunit.client.1.smithi112.stdout:8/111: creat d8/d18/f24 x:0 0 0 2024-09-21T10:40:40.391 INFO:tasks.workunit.client.1.smithi112.stdout:8/112: read d8/f14 [1577395,125618] 0 2024-09-21T10:40:40.394 INFO:tasks.workunit.client.1.smithi112.stdout:8/113: rename d8/f19 to d8/d9/f25 0 2024-09-21T10:40:40.395 INFO:tasks.workunit.client.1.smithi112.stdout:0/116: truncate d3/d4/f13 602941 0 2024-09-21T10:40:40.399 INFO:tasks.workunit.client.1.smithi112.stdout:2/118: dwrite d0/d12/d13/f22 [0,4194304] 0 2024-09-21T10:40:40.400 INFO:tasks.workunit.client.1.smithi112.stdout:5/96: dwrite d9/d15/f16 [0,4194304] 0 2024-09-21T10:40:40.401 INFO:tasks.workunit.client.1.smithi112.stdout:8/114: dread d8/d9/fb [0,4194304] 0 2024-09-21T10:40:40.410 INFO:tasks.workunit.client.1.smithi112.stdout:5/97: unlink d9/lc 0 2024-09-21T10:40:40.441 INFO:tasks.workunit.client.1.smithi112.stdout:9/66: truncate d1/d2/f5 4159646 0 2024-09-21T10:40:40.441 INFO:tasks.workunit.client.1.smithi112.stdout:9/67: chown d1/c4 22286274 1 2024-09-21T10:40:40.443 INFO:tasks.workunit.client.1.smithi112.stdout:9/68: creat d1/d2/f11 x:0 0 0 2024-09-21T10:40:40.446 INFO:tasks.workunit.client.1.smithi112.stdout:9/69: mkdir d1/d2/d12 0 2024-09-21T10:40:40.448 INFO:tasks.workunit.client.1.smithi112.stdout:9/70: mknod d1/d2/d12/c13 0 2024-09-21T10:40:40.450 INFO:tasks.workunit.client.1.smithi112.stdout:9/71: mknod d1/d2/d12/c14 0 2024-09-21T10:40:40.452 INFO:tasks.workunit.client.1.smithi112.stdout:9/72: rmdir d1 39 2024-09-21T10:40:40.534 INFO:tasks.workunit.client.1.smithi112.stdout:9/73: getdents d1 0 2024-09-21T10:40:40.534 INFO:tasks.workunit.client.1.smithi112.stdout:9/74: write d1/d2/f11 [554992,61849] 0 2024-09-21T10:40:40.536 INFO:tasks.workunit.client.1.smithi112.stdout:2/119: rename d0/d12/d13 to d0/d12/d26 0 2024-09-21T10:40:40.539 INFO:tasks.workunit.client.1.smithi112.stdout:1/154: fsync d8/f3a 0 2024-09-21T10:40:40.542 INFO:tasks.workunit.client.1.smithi112.stdout:9/75: mkdir d1/d2/d15 0 2024-09-21T10:40:40.553 INFO:tasks.workunit.client.1.smithi112.stdout:1/155: dwrite d8/d1a/d31/f34 [0,4194304] 0 2024-09-21T10:40:40.553 INFO:tasks.workunit.client.1.smithi112.stdout:1/156: creat d8/d1a/f3b x:0 0 0 2024-09-21T10:40:40.559 INFO:tasks.workunit.client.1.smithi112.stdout:1/157: unlink f7 0 2024-09-21T10:40:40.565 INFO:tasks.workunit.client.1.smithi112.stdout:1/158: rename d8/l13 to d8/l3c 0 2024-09-21T10:40:40.565 INFO:tasks.workunit.client.1.smithi112.stdout:1/159: dread - d8/f17 zero size 2024-09-21T10:40:40.568 INFO:tasks.workunit.client.1.smithi112.stdout:1/160: link d8/l2d d8/d1a/d31/d37/l3d 0 2024-09-21T10:40:40.573 INFO:tasks.workunit.client.1.smithi112.stdout:8/115: getdents d8/d9/dd 0 2024-09-21T10:40:40.580 INFO:tasks.workunit.client.1.smithi112.stdout:1/161: dwrite d8/d1a/f2c [0,4194304] 0 2024-09-21T10:40:40.580 INFO:tasks.workunit.client.1.smithi112.stdout:1/162: dread - d8/f17 zero size 2024-09-21T10:40:40.580 INFO:tasks.workunit.client.1.smithi112.stdout:8/116: dread f2 [0,4194304] 0 2024-09-21T10:40:40.582 INFO:tasks.workunit.client.1.smithi112.stdout:0/117: read d3/d4/f13 [23463,69139] 0 2024-09-21T10:40:40.587 INFO:tasks.workunit.client.1.smithi112.stdout:1/163: truncate d8/f15 3139702 0 2024-09-21T10:40:40.589 INFO:tasks.workunit.client.1.smithi112.stdout:1/164: write f3 [4776990,70019] 0 2024-09-21T10:40:40.590 INFO:tasks.workunit.client.1.smithi112.stdout:0/118: link d3/d4/d10/c11 d3/d4/d1a/d21/c28 0 2024-09-21T10:40:40.590 INFO:tasks.workunit.client.1.smithi112.stdout:0/119: stat d3 0 2024-09-21T10:40:40.591 INFO:tasks.workunit.client.1.smithi112.stdout:0/120: dread d3/d4/f13 [0,4194304] 0 2024-09-21T10:40:40.593 INFO:tasks.workunit.client.1.smithi112.stdout:0/121: creat d3/d23/f29 x:0 0 0 2024-09-21T10:40:40.596 INFO:tasks.workunit.client.1.smithi112.stdout:8/117: dwrite d8/d9/f13 [0,4194304] 0 2024-09-21T10:40:40.599 INFO:tasks.workunit.client.1.smithi112.stdout:8/118: write d8/d9/dd/f1d [269628,89258] 0 2024-09-21T10:40:40.605 INFO:tasks.workunit.client.1.smithi112.stdout:8/119: unlink d8/d18/l1e 0 2024-09-21T10:40:40.607 INFO:tasks.workunit.client.1.smithi112.stdout:8/120: creat d8/d9/dd/d1a/f26 x:0 0 0 2024-09-21T10:40:40.609 INFO:tasks.workunit.client.1.smithi112.stdout:0/122: dwrite d3/f20 [0,4194304] 0 2024-09-21T10:40:40.610 INFO:tasks.workunit.client.1.smithi112.stdout:8/121: dread d8/d9/fb [0,4194304] 0 2024-09-21T10:40:40.615 INFO:tasks.workunit.client.1.smithi112.stdout:0/123: rename d3/d4/d1a/d21/c28 to d3/d23/c2a 0 2024-09-21T10:40:40.616 INFO:tasks.workunit.client.1.smithi112.stdout:0/124: write d3/d4/f1c [62452,70096] 0 2024-09-21T10:40:40.616 INFO:tasks.workunit.client.1.smithi112.stdout:0/125: write d3/d23/f26 [460778,4849] 0 2024-09-21T10:40:40.616 INFO:tasks.workunit.client.1.smithi112.stdout:0/126: write d3/d4/f5 [1599751,93350] 0 2024-09-21T10:40:40.618 INFO:tasks.workunit.client.1.smithi112.stdout:8/122: rename f0 to d8/d18/f27 0 2024-09-21T10:40:40.618 INFO:tasks.workunit.client.1.smithi112.stdout:8/123: getdents d8/d9/dd 0 2024-09-21T10:40:40.620 INFO:tasks.workunit.client.1.smithi112.stdout:8/124: mknod d8/d9/dd/c28 0 2024-09-21T10:40:40.622 INFO:tasks.workunit.client.1.smithi112.stdout:0/127: write d3/d18/f22 [3021943,84788] 0 2024-09-21T10:40:40.623 INFO:tasks.workunit.client.1.smithi112.stdout:8/125: link d8/d9/dd/cf d8/d9/dd/c29 0 2024-09-21T10:40:40.627 INFO:tasks.workunit.client.1.smithi112.stdout:0/128: dread d3/d4/d10/f24 [0,4194304] 0 2024-09-21T10:40:40.627 INFO:tasks.workunit.client.1.smithi112.stdout:0/129: truncate d3/d4/d1a/f17 5188064 0 2024-09-21T10:40:40.633 INFO:tasks.workunit.client.1.smithi112.stdout:0/130: rename d3/f9 to d3/f2b 0 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:9/76: write d1/d2/f5 [1150405,26083] 0 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/72: sync 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:7/81: sync 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:6/95: sync 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:3/45: sync 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:7/82: chown d7 512420019 1 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/73: chown de/c1c 198 1 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:7/83: write d7/f13 [4733180,100431] 0 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:7/84: creat d7/f19 x:0 0 0 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:7/85: creat d7/f1a x:0 0 0 2024-09-21T10:40:40.640 INFO:tasks.workunit.client.1.smithi112.stdout:7/86: chown d7/f13 463 1 2024-09-21T10:40:40.643 INFO:tasks.workunit.client.1.smithi112.stdout:3/46: link d2/fa d2/fd 0 2024-09-21T10:40:40.645 INFO:tasks.workunit.client.1.smithi112.stdout:6/96: mknod d4/d6/da/d14/c21 0 2024-09-21T10:40:40.646 INFO:tasks.workunit.client.1.smithi112.stdout:4/74: symlink de/d18/l1e 0 2024-09-21T10:40:40.647 INFO:tasks.workunit.client.1.smithi112.stdout:3/47: dread d2/f7 [0,4194304] 0 2024-09-21T10:40:40.649 INFO:tasks.workunit.client.1.smithi112.stdout:7/87: write d7/ff [4050540,47185] 0 2024-09-21T10:40:40.651 INFO:tasks.workunit.client.1.smithi112.stdout:6/97: rmdir d4/d6/da/d14/d20 0 2024-09-21T10:40:40.651 INFO:tasks.workunit.client.1.smithi112.stdout:3/48: dread d2/f9 [0,4194304] 0 2024-09-21T10:40:40.651 INFO:tasks.workunit.client.1.smithi112.stdout:0/131: dwrite d3/d4/f1d [0,4194304] 0 2024-09-21T10:40:40.651 INFO:tasks.workunit.client.1.smithi112.stdout:0/132: chown d3/d4/d1a/d21 280 1 2024-09-21T10:40:40.653 INFO:tasks.workunit.client.1.smithi112.stdout:4/75: stat ca 0 2024-09-21T10:40:40.655 INFO:tasks.workunit.client.1.smithi112.stdout:7/88: symlink d7/l1b 0 2024-09-21T10:40:40.656 INFO:tasks.workunit.client.1.smithi112.stdout:7/89: creat d7/f1c x:0 0 0 2024-09-21T10:40:40.657 INFO:tasks.workunit.client.1.smithi112.stdout:6/98: mkdir d4/d6/da/d11/d1f/d22 0 2024-09-21T10:40:40.659 INFO:tasks.workunit.client.1.smithi112.stdout:3/49: rename d2/f9 to d2/fe 0 2024-09-21T10:40:40.661 INFO:tasks.workunit.client.1.smithi112.stdout:0/133: rename d3/d4/l1f to d3/d4/d1a/l2c 0 2024-09-21T10:40:40.661 INFO:tasks.workunit.client.1.smithi112.stdout:0/134: chown d3/c19 109659557 1 2024-09-21T10:40:40.663 INFO:tasks.workunit.client.1.smithi112.stdout:4/76: symlink de/l1f 0 2024-09-21T10:40:40.665 INFO:tasks.workunit.client.1.smithi112.stdout:6/99: unlink d4/d6/da/f18 0 2024-09-21T10:40:40.666 INFO:tasks.workunit.client.1.smithi112.stdout:6/100: chown d4/d6/d13 0 1 2024-09-21T10:40:40.666 INFO:tasks.workunit.client.1.smithi112.stdout:6/101: chown d4/d6/da/d14/c17 16 1 2024-09-21T10:40:40.666 INFO:tasks.workunit.client.1.smithi112.stdout:6/102: write d4/d6/f10 [366367,85968] 0 2024-09-21T10:40:40.669 INFO:tasks.workunit.client.1.smithi112.stdout:4/77: symlink de/l20 0 2024-09-21T10:40:40.671 INFO:tasks.workunit.client.1.smithi112.stdout:6/103: mknod d4/dc/d1a/c23 0 2024-09-21T10:40:40.671 INFO:tasks.workunit.client.1.smithi112.stdout:6/104: stat d4/d6/l9 0 2024-09-21T10:40:40.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/78: creat de/d18/f21 x:0 0 0 2024-09-21T10:40:40.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/79: fsync de/f15 0 2024-09-21T10:40:40.673 INFO:tasks.workunit.client.1.smithi112.stdout:4/80: write de/d18/f21 [556086,102139] 0 2024-09-21T10:40:40.675 INFO:tasks.workunit.client.1.smithi112.stdout:6/105: symlink d4/d6/d13/d19/l24 0 2024-09-21T10:40:40.677 INFO:tasks.workunit.client.1.smithi112.stdout:4/81: dread f5 [0,4194304] 0 2024-09-21T10:40:40.677 INFO:tasks.workunit.client.1.smithi112.stdout:4/82: truncate de/f11 157079 0 2024-09-21T10:40:40.677 INFO:tasks.workunit.client.1.smithi112.stdout:6/106: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:40.677 INFO:tasks.workunit.client.1.smithi112.stdout:6/107: chown d4/d6/da/d11/d1f 2096 1 2024-09-21T10:40:40.677 INFO:tasks.workunit.client.1.smithi112.stdout:6/108: chown d4/c5 119885579 1 2024-09-21T10:40:40.678 INFO:tasks.workunit.client.1.smithi112.stdout:4/83: mknod de/c22 0 2024-09-21T10:40:40.680 INFO:tasks.workunit.client.1.smithi112.stdout:6/109: read f1 [2648285,93661] 0 2024-09-21T10:40:40.682 INFO:tasks.workunit.client.1.smithi112.stdout:6/110: mknod d4/d6/da/d11/d1f/c25 0 2024-09-21T10:40:40.683 INFO:tasks.workunit.client.1.smithi112.stdout:4/84: dread de/d18/f21 [0,4194304] 0 2024-09-21T10:40:40.684 INFO:tasks.workunit.client.1.smithi112.stdout:6/111: creat d4/d6/da/d11/d1f/d22/f26 x:0 0 0 2024-09-21T10:40:40.687 INFO:tasks.workunit.client.1.smithi112.stdout:6/112: creat d4/d6/da/d14/f27 x:0 0 0 2024-09-21T10:40:40.689 INFO:tasks.workunit.client.1.smithi112.stdout:6/113: symlink d4/d6/l28 0 2024-09-21T10:40:40.689 INFO:tasks.workunit.client.1.smithi112.stdout:4/85: dread f0 [0,4194304] 0 2024-09-21T10:40:40.689 INFO:tasks.workunit.client.1.smithi112.stdout:4/86: readlink de/l20 0 2024-09-21T10:40:40.690 INFO:tasks.workunit.client.1.smithi112.stdout:4/87: chown f9 467806 1 2024-09-21T10:40:40.691 INFO:tasks.workunit.client.1.smithi112.stdout:4/88: dread f5 [0,4194304] 0 2024-09-21T10:40:40.691 INFO:tasks.workunit.client.1.smithi112.stdout:4/89: fsync f0 0 2024-09-21T10:40:40.691 INFO:tasks.workunit.client.1.smithi112.stdout:4/90: truncate de/f15 305872 0 2024-09-21T10:40:40.691 INFO:tasks.workunit.client.1.smithi112.stdout:6/114: mknod d4/d6/c29 0 2024-09-21T10:40:40.692 INFO:tasks.workunit.client.1.smithi112.stdout:6/115: readlink d4/d6/lf 0 2024-09-21T10:40:40.694 INFO:tasks.workunit.client.1.smithi112.stdout:4/91: symlink de/d18/l23 0 2024-09-21T10:40:40.694 INFO:tasks.workunit.client.1.smithi112.stdout:6/116: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:40.694 INFO:tasks.workunit.client.1.smithi112.stdout:4/92: write de/f10 [1041465,102171] 0 2024-09-21T10:40:40.694 INFO:tasks.workunit.client.1.smithi112.stdout:4/93: readlink de/d18/l1e 0 2024-09-21T10:40:40.695 INFO:tasks.workunit.client.1.smithi112.stdout:6/117: link d4/d6/da/d14/c17 d4/d6/da/c2a 0 2024-09-21T10:40:40.695 INFO:tasks.workunit.client.1.smithi112.stdout:6/118: write d4/d6/da/d14/f27 [670384,17772] 0 2024-09-21T10:40:40.696 INFO:tasks.workunit.client.1.smithi112.stdout:6/119: write d4/d6/da/f12 [207669,55898] 0 2024-09-21T10:40:40.697 INFO:tasks.workunit.client.1.smithi112.stdout:4/94: creat de/f24 x:0 0 0 2024-09-21T10:40:40.697 INFO:tasks.workunit.client.1.smithi112.stdout:4/95: creat de/d18/f25 x:0 0 0 2024-09-21T10:40:40.697 INFO:tasks.workunit.client.1.smithi112.stdout:4/96: stat de/l16 0 2024-09-21T10:40:40.701 INFO:tasks.workunit.client.1.smithi112.stdout:6/120: symlink d4/d6/da/l2b 0 2024-09-21T10:40:40.701 INFO:tasks.workunit.client.1.smithi112.stdout:6/121: write d4/d6/da/d14/f27 [920593,59776] 0 2024-09-21T10:40:40.701 INFO:tasks.workunit.client.1.smithi112.stdout:6/122: creat d4/d6/da/f2c x:0 0 0 2024-09-21T10:40:40.701 INFO:tasks.workunit.client.1.smithi112.stdout:6/123: write d4/d6/f10 [1334900,93056] 0 2024-09-21T10:40:40.704 INFO:tasks.workunit.client.1.smithi112.stdout:4/97: truncate f8 147950 0 2024-09-21T10:40:40.704 INFO:tasks.workunit.client.1.smithi112.stdout:4/98: write de/d18/f25 [281790,108466] 0 2024-09-21T10:40:40.704 INFO:tasks.workunit.client.1.smithi112.stdout:4/99: fsync f9 0 2024-09-21T10:40:40.709 INFO:tasks.workunit.client.1.smithi112.stdout:4/100: dread de/f10 [0,4194304] 0 2024-09-21T10:40:40.736 INFO:tasks.workunit.client.1.smithi112.stdout:6/124: mknod d4/dc/d1a/c2d 0 2024-09-21T10:40:40.738 INFO:tasks.workunit.client.1.smithi112.stdout:4/101: link de/f10 de/d18/f26 0 2024-09-21T10:40:40.739 INFO:tasks.workunit.client.1.smithi112.stdout:4/102: read de/f10 [489519,74413] 0 2024-09-21T10:40:40.764 INFO:tasks.workunit.client.1.smithi112.stdout:2/120: truncate d0/f11 750226 0 2024-09-21T10:40:40.764 INFO:tasks.workunit.client.1.smithi112.stdout:2/121: creat d0/d12/d1b/f27 x:0 0 0 2024-09-21T10:40:40.781 INFO:tasks.workunit.client.1.smithi112.stdout:2/122: dwrite d0/d12/d26/f17 [0,4194304] 0 2024-09-21T10:40:40.788 INFO:tasks.workunit.client.1.smithi112.stdout:2/123: link d0/f25 d0/d12/f28 0 2024-09-21T10:40:40.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/165: dread d8/f24 [0,4194304] 0 2024-09-21T10:40:40.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/166: write d8/fa [865996,57655] 0 2024-09-21T10:40:40.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/167: creat d8/d1a/d31/f3e x:0 0 0 2024-09-21T10:40:40.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/168: creat d8/d20/f3f x:0 0 0 2024-09-21T10:40:40.808 INFO:tasks.workunit.client.1.smithi112.stdout:1/169: chown d8/d1a 1 1 2024-09-21T10:40:40.822 INFO:tasks.workunit.client.1.smithi112.stdout:1/170: dwrite d8/f17 [0,4194304] 0 2024-09-21T10:40:40.822 INFO:tasks.workunit.client.1.smithi112.stdout:1/171: read - d8/d1a/f3b zero size 2024-09-21T10:40:40.829 INFO:tasks.workunit.client.1.smithi112.stdout:0/135: rename d3/d23/c2a to d3/d4/d1a/d21/c2d 0 2024-09-21T10:40:40.830 INFO:tasks.workunit.client.1.smithi112.stdout:0/136: read d3/d23/f26 [48168,23998] 0 2024-09-21T10:40:40.830 INFO:tasks.workunit.client.1.smithi112.stdout:0/137: stat d3/d4/l1e 0 2024-09-21T10:40:40.831 INFO:tasks.workunit.client.1.smithi112.stdout:1/172: rename d8/f12 to d8/f40 0 2024-09-21T10:40:40.834 INFO:tasks.workunit.client.1.smithi112.stdout:2/124: rename d0/d12/f15 to d0/dd/f29 0 2024-09-21T10:40:40.835 INFO:tasks.workunit.client.1.smithi112.stdout:0/138: mknod d3/d4/c2e 0 2024-09-21T10:40:40.837 INFO:tasks.workunit.client.1.smithi112.stdout:1/173: unlink d8/cf 0 2024-09-21T10:40:40.839 INFO:tasks.workunit.client.1.smithi112.stdout:2/125: unlink d0/d12/c16 0 2024-09-21T10:40:40.840 INFO:tasks.workunit.client.1.smithi112.stdout:0/139: symlink d3/d23/l2f 0 2024-09-21T10:40:40.841 INFO:tasks.workunit.client.1.smithi112.stdout:1/174: symlink d8/d1a/l41 0 2024-09-21T10:40:40.843 INFO:tasks.workunit.client.1.smithi112.stdout:1/175: symlink d8/d1a/l42 0 2024-09-21T10:40:40.848 INFO:tasks.workunit.client.1.smithi112.stdout:2/126: dread d0/d12/d26/f17 [0,4194304] 0 2024-09-21T10:40:40.848 INFO:tasks.workunit.client.1.smithi112.stdout:2/127: chown d0/f2 678760 1 2024-09-21T10:40:40.868 INFO:tasks.workunit.client.1.smithi112.stdout:3/50: fsync d2/fe 0 2024-09-21T10:40:40.871 INFO:tasks.workunit.client.1.smithi112.stdout:3/51: rename d2/f7 to d2/ff 0 2024-09-21T10:40:40.871 INFO:tasks.workunit.client.1.smithi112.stdout:3/52: chown d2/fd 312 1 2024-09-21T10:40:40.871 INFO:tasks.workunit.client.1.smithi112.stdout:3/53: fdatasync d2/fa 0 2024-09-21T10:40:40.871 INFO:tasks.workunit.client.1.smithi112.stdout:3/54: creat d2/f10 x:0 0 0 2024-09-21T10:40:40.903 INFO:tasks.workunit.client.1.smithi112.stdout:6/125: fsync d4/d6/da/f2c 0 2024-09-21T10:40:40.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/126: creat d4/d6/d13/d19/f2e x:0 0 0 2024-09-21T10:40:40.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/127: fsync d4/d6/da/d14/f27 0 2024-09-21T10:40:40.909 INFO:tasks.workunit.client.1.smithi112.stdout:6/128: mknod d4/c2f 0 2024-09-21T10:40:40.909 INFO:tasks.workunit.client.1.smithi112.stdout:6/129: dread - d4/d6/da/d11/d1f/d22/f26 zero size 2024-09-21T10:40:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:40 smithi112 ceph-mon[35117]: mgrmap e25: smithi112.gkunly(active, since 7s), standbys: smithi060.mulzpr 2024-09-21T10:40:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:40 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:40:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:40 smithi112 ceph-mon[35117]: pgmap v7: 65 pgs: 65 active+clean; 266 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 808 op/s 2024-09-21T10:40:40.968 INFO:tasks.workunit.client.1.smithi112.stdout:4/103: dwrite f8 [0,4194304] 0 2024-09-21T10:40:40.968 INFO:tasks.workunit.client.1.smithi112.stdout:4/104: chown de/l16 2015 1 2024-09-21T10:40:40.969 INFO:tasks.workunit.client.1.smithi112.stdout:3/55: dwrite d2/f10 [0,4194304] 0 2024-09-21T10:40:40.969 INFO:tasks.workunit.client.1.smithi112.stdout:3/56: dread - d2/fd zero size 2024-09-21T10:40:40.976 INFO:tasks.workunit.client.1.smithi112.stdout:5/98: sync 2024-09-21T10:40:40.976 INFO:tasks.workunit.client.1.smithi112.stdout:4/105: mknod de/d18/c27 0 2024-09-21T10:40:40.979 INFO:tasks.workunit.client.1.smithi112.stdout:6/130: dwrite d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:40.980 INFO:tasks.workunit.client.1.smithi112.stdout:3/57: unlink d2/fd 0 2024-09-21T10:40:40.982 INFO:tasks.workunit.client.1.smithi112.stdout:2/128: dread d0/f11 [0,4194304] 0 2024-09-21T10:40:40.983 INFO:tasks.workunit.client.1.smithi112.stdout:4/106: link ca de/d18/c28 0 2024-09-21T10:40:40.983 INFO:tasks.workunit.client.1.smithi112.stdout:4/107: write de/d18/f25 [1302697,26509] 0 2024-09-21T10:40:40.983 INFO:tasks.workunit.client.1.smithi112.stdout:4/108: chown de/cf 1441312 1 2024-09-21T10:40:40.987 INFO:tasks.workunit.client.1.smithi112.stdout:5/99: dread f3 [4194304,4194304] 0 2024-09-21T10:40:40.988 INFO:tasks.workunit.client.1.smithi112.stdout:6/131: dread d4/d6/d13/fe [0,4194304] 0 2024-09-21T10:40:40.995 INFO:tasks.workunit.client.1.smithi112.stdout:3/58: mknod d2/c11 0 2024-09-21T10:40:40.995 INFO:tasks.workunit.client.1.smithi112.stdout:3/59: chown f1 51 1 2024-09-21T10:40:40.996 INFO:tasks.workunit.client.1.smithi112.stdout:4/109: mknod de/d18/d1d/c29 0 2024-09-21T10:40:40.997 INFO:tasks.workunit.client.1.smithi112.stdout:4/110: dread de/f14 [0,4194304] 0 2024-09-21T10:40:40.997 INFO:tasks.workunit.client.1.smithi112.stdout:4/111: chown de/l20 32269 1 2024-09-21T10:40:41.007 INFO:tasks.workunit.client.1.smithi112.stdout:5/100: rename l4 to d9/d15/l17 0 2024-09-21T10:40:41.007 INFO:tasks.workunit.client.1.smithi112.stdout:5/101: fsync d9/d15/f16 0 2024-09-21T10:40:41.008 INFO:tasks.workunit.client.1.smithi112.stdout:6/132: symlink d4/d6/da/l30 0 2024-09-21T10:40:41.008 INFO:tasks.workunit.client.1.smithi112.stdout:3/60: truncate d2/fe 4009826 0 2024-09-21T10:40:41.008 INFO:tasks.workunit.client.1.smithi112.stdout:3/61: chown d2/f10 990312990 1 2024-09-21T10:40:41.009 INFO:tasks.workunit.client.1.smithi112.stdout:4/112: mkdir de/d2a 0 2024-09-21T10:40:41.011 INFO:tasks.workunit.client.1.smithi112.stdout:5/102: truncate d9/f12 326276 0 2024-09-21T10:40:41.015 INFO:tasks.workunit.client.1.smithi112.stdout:6/133: mkdir d4/dc/d1a/d31 0 2024-09-21T10:40:41.015 INFO:tasks.workunit.client.1.smithi112.stdout:5/103: write d9/fe [406330,8302] 0 2024-09-21T10:40:41.015 INFO:tasks.workunit.client.1.smithi112.stdout:5/104: chown d9/f10 6069 1 2024-09-21T10:40:41.018 INFO:tasks.workunit.client.1.smithi112.stdout:6/134: getdents d4/dc 0 2024-09-21T10:40:41.018 INFO:tasks.workunit.client.1.smithi112.stdout:6/135: fsync d4/d6/da/f2c 0 2024-09-21T10:40:41.018 INFO:tasks.workunit.client.1.smithi112.stdout:6/136: read - d4/d6/d13/d19/f2e zero size 2024-09-21T10:40:41.018 INFO:tasks.workunit.client.1.smithi112.stdout:6/137: truncate d4/d6/da/f12 1434145 0 2024-09-21T10:40:41.019 INFO:tasks.workunit.client.1.smithi112.stdout:5/105: mkdir d9/d15/d18 0 2024-09-21T10:40:41.022 INFO:tasks.workunit.client.1.smithi112.stdout:6/138: symlink d4/d6/da/d14/l32 0 2024-09-21T10:40:41.022 INFO:tasks.workunit.client.1.smithi112.stdout:6/139: creat d4/d6/da/d11/d1f/d22/f33 x:0 0 0 2024-09-21T10:40:41.023 INFO:tasks.workunit.client.1.smithi112.stdout:1/176: rmdir d8/d1a/d31 39 2024-09-21T10:40:41.023 INFO:tasks.workunit.client.1.smithi112.stdout:4/113: dwrite de/f24 [0,4194304] 0 2024-09-21T10:40:41.023 INFO:tasks.workunit.client.1.smithi112.stdout:5/106: chown d9/ff 4282 1 2024-09-21T10:40:41.027 INFO:tasks.workunit.client.1.smithi112.stdout:6/140: mkdir d4/d6/d13/d19/d34 0 2024-09-21T10:40:41.034 INFO:tasks.workunit.client.1.smithi112.stdout:4/114: mkdir de/d2a/d2b 0 2024-09-21T10:40:41.034 INFO:tasks.workunit.client.1.smithi112.stdout:4/115: chown c3 12405217 1 2024-09-21T10:40:41.035 INFO:tasks.workunit.client.1.smithi112.stdout:4/116: dread de/f11 [0,4194304] 0 2024-09-21T10:40:41.035 INFO:tasks.workunit.client.1.smithi112.stdout:5/107: symlink d9/d15/l19 0 2024-09-21T10:40:41.037 INFO:tasks.workunit.client.1.smithi112.stdout:6/141: mknod d4/d6/da/d11/d1f/d22/c35 0 2024-09-21T10:40:41.040 INFO:tasks.workunit.client.1.smithi112.stdout:4/117: symlink de/d2a/l2c 0 2024-09-21T10:40:41.042 INFO:tasks.workunit.client.1.smithi112.stdout:7/90: sync 2024-09-21T10:40:41.042 INFO:tasks.workunit.client.1.smithi112.stdout:8/126: sync 2024-09-21T10:40:41.042 INFO:tasks.workunit.client.1.smithi112.stdout:9/77: sync 2024-09-21T10:40:41.044 INFO:tasks.workunit.client.1.smithi112.stdout:6/142: truncate d4/d6/f15 3749908 0 2024-09-21T10:40:41.053 INFO:tasks.workunit.client.1.smithi112.stdout:1/177: getdents d8 0 2024-09-21T10:40:41.053 INFO:tasks.workunit.client.1.smithi112.stdout:1/178: truncate d8/f1f 2300003 0 2024-09-21T10:40:41.054 INFO:tasks.workunit.client.1.smithi112.stdout:4/118: link de/c13 de/d2a/d2b/c2d 0 2024-09-21T10:40:41.056 INFO:tasks.workunit.client.1.smithi112.stdout:8/127: truncate d8/f14 2047958 0 2024-09-21T10:40:41.058 INFO:tasks.workunit.client.1.smithi112.stdout:7/91: mknod d7/c1d 0 2024-09-21T10:40:41.058 INFO:tasks.workunit.client.1.smithi112.stdout:7/92: creat d7/f1e x:0 0 0 2024-09-21T10:40:41.060 INFO:tasks.workunit.client.1.smithi112.stdout:9/78: mkdir d1/d2/d12/d16 0 2024-09-21T10:40:41.061 INFO:tasks.workunit.client.1.smithi112.stdout:7/93: dread d7/f10 [0,4194304] 0 2024-09-21T10:40:41.063 INFO:tasks.workunit.client.1.smithi112.stdout:1/179: symlink d8/d1a/l43 0 2024-09-21T10:40:41.072 INFO:tasks.workunit.client.1.smithi112.stdout:7/94: unlink c1 0 2024-09-21T10:40:41.074 INFO:tasks.workunit.client.1.smithi112.stdout:1/180: getdents d8/d1a/d31 0 2024-09-21T10:40:41.076 INFO:tasks.workunit.client.1.smithi112.stdout:9/79: rename d1/d2/d12/c13 to d1/d2/c17 0 2024-09-21T10:40:41.078 INFO:tasks.workunit.client.1.smithi112.stdout:7/95: mknod d7/c1f 0 2024-09-21T10:40:41.078 INFO:tasks.workunit.client.1.smithi112.stdout:7/96: write d7/f1c [707889,50275] 0 2024-09-21T10:40:41.079 INFO:tasks.workunit.client.1.smithi112.stdout:1/181: truncate d8/fe 8285012 0 2024-09-21T10:40:41.080 INFO:tasks.workunit.client.1.smithi112.stdout:1/182: stat d8/d1a/f1e 0 2024-09-21T10:40:41.080 INFO:tasks.workunit.client.1.smithi112.stdout:1/183: write d8/f9 [4179946,30512] 0 2024-09-21T10:40:41.081 INFO:tasks.workunit.client.1.smithi112.stdout:9/80: symlink d1/l18 0 2024-09-21T10:40:41.083 INFO:tasks.workunit.client.1.smithi112.stdout:7/97: rename d7/c1d to d7/c20 0 2024-09-21T10:40:41.083 INFO:tasks.workunit.client.1.smithi112.stdout:7/98: fsync d7/f13 0 2024-09-21T10:40:41.083 INFO:tasks.workunit.client.1.smithi112.stdout:7/99: dread - d7/f17 zero size 2024-09-21T10:40:41.084 INFO:tasks.workunit.client.1.smithi112.stdout:6/143: dwrite d4/d6/d13/d19/f2e [0,4194304] 0 2024-09-21T10:40:41.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/128: dwrite d8/d18/f24 [0,4194304] 0 2024-09-21T10:40:41.085 INFO:tasks.workunit.client.1.smithi112.stdout:4/119: dwrite de/f24 [0,4194304] 0 2024-09-21T10:40:41.085 INFO:tasks.workunit.client.1.smithi112.stdout:4/120: fsync de/d18/f25 0 2024-09-21T10:40:41.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/129: write d8/d9/fb [1258718,128778] 0 2024-09-21T10:40:41.085 INFO:tasks.workunit.client.1.smithi112.stdout:9/81: link d1/l10 d1/d2/d12/d16/l19 0 2024-09-21T10:40:41.087 INFO:tasks.workunit.client.1.smithi112.stdout:7/100: symlink d7/l21 0 2024-09-21T10:40:41.093 INFO:tasks.workunit.client.1.smithi112.stdout:6/144: dread d4/d6/d13/d19/f2e [0,4194304] 0 2024-09-21T10:40:41.093 INFO:tasks.workunit.client.1.smithi112.stdout:6/145: write d4/d6/f10 [2296359,88123] 0 2024-09-21T10:40:41.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/184: dwrite d8/d1a/f2c [0,4194304] 0 2024-09-21T10:40:41.099 INFO:tasks.workunit.client.1.smithi112.stdout:8/130: mkdir d8/d9/dd/d2a 0 2024-09-21T10:40:41.101 INFO:tasks.workunit.client.1.smithi112.stdout:7/101: mkdir d7/d22 0 2024-09-21T10:40:41.109 INFO:tasks.workunit.client.1.smithi112.stdout:6/146: mknod d4/dc/c36 0 2024-09-21T10:40:41.113 INFO:tasks.workunit.client.1.smithi112.stdout:1/185: rename d8/l35 to d8/d20/l44 0 2024-09-21T10:40:41.115 INFO:tasks.workunit.client.1.smithi112.stdout:8/131: mkdir d8/d9/dd/d2b 0 2024-09-21T10:40:41.115 INFO:tasks.workunit.client.1.smithi112.stdout:7/102: dwrite d7/f1c [0,4194304] 0 2024-09-21T10:40:41.116 INFO:tasks.workunit.client.1.smithi112.stdout:9/82: symlink d1/d2/l1a 0 2024-09-21T10:40:41.120 INFO:tasks.workunit.client.1.smithi112.stdout:7/103: creat d7/d22/f23 x:0 0 0 2024-09-21T10:40:41.121 INFO:tasks.workunit.client.1.smithi112.stdout:9/83: rmdir d1/d2/d12 39 2024-09-21T10:40:41.124 INFO:tasks.workunit.client.1.smithi112.stdout:9/84: creat d1/f1b x:0 0 0 2024-09-21T10:40:41.126 INFO:tasks.workunit.client.1.smithi112.stdout:6/147: dwrite d4/d6/f10 [0,4194304] 0 2024-09-21T10:40:41.126 INFO:tasks.workunit.client.1.smithi112.stdout:6/148: dread - d4/d6/da/d11/d1f/d22/f26 zero size 2024-09-21T10:40:41.129 INFO:tasks.workunit.client.1.smithi112.stdout:6/149: dread d4/d6/d13/fe [0,4194304] 0 2024-09-21T10:40:41.129 INFO:tasks.workunit.client.1.smithi112.stdout:6/150: readlink d4/d6/da/l30 0 2024-09-21T10:40:41.129 INFO:tasks.workunit.client.1.smithi112.stdout:6/151: chown d4/d6/da/d11/d1f/d22/f33 119 1 2024-09-21T10:40:41.135 INFO:tasks.workunit.client.1.smithi112.stdout:7/104: dwrite d7/d22/f23 [0,4194304] 0 2024-09-21T10:40:41.135 INFO:tasks.workunit.client.1.smithi112.stdout:7/105: chown d7/l12 3114393 1 2024-09-21T10:40:41.135 INFO:tasks.workunit.client.1.smithi112.stdout:6/152: write d4/d6/d13/d19/f2e [1421809,115305] 0 2024-09-21T10:40:41.136 INFO:tasks.workunit.client.1.smithi112.stdout:6/153: chown d4/dc/d1a/c23 15466 1 2024-09-21T10:40:41.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:40 smithi060 ceph-mon[28215]: mgrmap e25: smithi112.gkunly(active, since 7s), standbys: smithi060.mulzpr 2024-09-21T10:40:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:40 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:40:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:40 smithi060 ceph-mon[28215]: pgmap v7: 65 pgs: 65 active+clean; 266 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 808 op/s 2024-09-21T10:40:41.228 INFO:tasks.workunit.client.1.smithi112.stdout:3/62: write d2/ff [2580261,97269] 0 2024-09-21T10:40:41.228 INFO:tasks.workunit.client.1.smithi112.stdout:3/63: write d2/fe [2101885,35923] 0 2024-09-21T10:40:41.228 INFO:tasks.workunit.client.1.smithi112.stdout:3/64: creat d2/f12 x:0 0 0 2024-09-21T10:40:41.228 INFO:tasks.workunit.client.1.smithi112.stdout:3/65: read - d2/fc zero size 2024-09-21T10:40:41.228 INFO:tasks.workunit.client.1.smithi112.stdout:3/66: creat d2/f13 x:0 0 0 2024-09-21T10:40:41.232 INFO:tasks.workunit.client.1.smithi112.stdout:3/67: link d2/fa d2/f14 0 2024-09-21T10:40:41.234 INFO:tasks.workunit.client.1.smithi112.stdout:3/68: mknod d2/c15 0 2024-09-21T10:40:41.234 INFO:tasks.workunit.client.1.smithi112.stdout:3/69: creat d2/f16 x:0 0 0 2024-09-21T10:40:41.242 INFO:tasks.workunit.client.1.smithi112.stdout:6/154: rename d4/d6/d13 to d4/d6/da/d11/d37 0 2024-09-21T10:40:41.242 INFO:tasks.workunit.client.1.smithi112.stdout:6/155: chown d4/d6/f10 1140 1 2024-09-21T10:40:41.255 INFO:tasks.workunit.client.1.smithi112.stdout:3/70: dwrite d2/f14 [0,4194304] 0 2024-09-21T10:40:41.260 INFO:tasks.workunit.client.1.smithi112.stdout:6/156: dwrite d4/d6/da/f2c [0,4194304] 0 2024-09-21T10:40:41.265 INFO:tasks.workunit.client.1.smithi112.stdout:5/108: truncate d9/f12 239031 0 2024-09-21T10:40:41.265 INFO:tasks.workunit.client.1.smithi112.stdout:6/157: mknod d4/d6/da/d11/d37/c38 0 2024-09-21T10:40:41.268 INFO:tasks.workunit.client.1.smithi112.stdout:5/109: mknod d9/d15/c1a 0 2024-09-21T10:40:41.270 INFO:tasks.workunit.client.1.smithi112.stdout:6/158: mkdir d4/dc/d1a/d31/d39 0 2024-09-21T10:40:41.272 INFO:tasks.workunit.client.1.smithi112.stdout:5/110: creat d9/f1b x:0 0 0 2024-09-21T10:40:41.272 INFO:tasks.workunit.client.1.smithi112.stdout:5/111: chown d9/d15/f16 32083 1 2024-09-21T10:40:41.274 INFO:tasks.workunit.client.1.smithi112.stdout:3/71: dwrite d2/ff [0,4194304] 0 2024-09-21T10:40:41.286 INFO:tasks.workunit.client.1.smithi112.stdout:5/112: write d9/d15/f16 [74431,120103] 0 2024-09-21T10:40:41.286 INFO:tasks.workunit.client.1.smithi112.stdout:5/113: write d9/ff [666500,30280] 0 2024-09-21T10:40:41.292 INFO:tasks.workunit.client.1.smithi112.stdout:3/72: dwrite d2/ff [4194304,4194304] 0 2024-09-21T10:40:41.293 INFO:tasks.workunit.client.1.smithi112.stdout:6/159: dwrite f1 [0,4194304] 0 2024-09-21T10:40:41.295 INFO:tasks.workunit.client.1.smithi112.stdout:9/85: rename d1/d2/d12 to d1/d2/d1c 0 2024-09-21T10:40:41.298 INFO:tasks.workunit.client.1.smithi112.stdout:3/73: unlink d2/fc 0 2024-09-21T10:40:41.301 INFO:tasks.workunit.client.1.smithi112.stdout:6/160: link d4/c5 d4/d6/da/d11/d37/d19/c3a 0 2024-09-21T10:40:41.304 INFO:tasks.workunit.client.1.smithi112.stdout:9/86: rename d1/d2/l3 to d1/d2/d1c/d16/l1d 0 2024-09-21T10:40:41.306 INFO:tasks.workunit.client.1.smithi112.stdout:3/74: rename d2/f12 to d2/f17 0 2024-09-21T10:40:41.307 INFO:tasks.workunit.client.1.smithi112.stdout:6/161: mknod d4/d6/da/d11/d1f/c3b 0 2024-09-21T10:40:41.309 INFO:tasks.workunit.client.1.smithi112.stdout:6/162: truncate d4/d6/da/d14/f27 3998257 0 2024-09-21T10:40:41.312 INFO:tasks.workunit.client.1.smithi112.stdout:6/163: mkdir d4/dc/d1a/d31/d3c 0 2024-09-21T10:40:41.314 INFO:tasks.workunit.client.1.smithi112.stdout:3/75: write d2/fe [6624546,27387] 0 2024-09-21T10:40:41.314 INFO:tasks.workunit.client.1.smithi112.stdout:3/76: creat d2/f18 x:0 0 0 2024-09-21T10:40:41.314 INFO:tasks.workunit.client.1.smithi112.stdout:3/77: creat d2/f19 x:0 0 0 2024-09-21T10:40:41.314 INFO:tasks.workunit.client.1.smithi112.stdout:3/78: truncate d2/f18 338152 0 2024-09-21T10:40:41.319 INFO:tasks.workunit.client.1.smithi112.stdout:3/79: mknod d2/c1a 0 2024-09-21T10:40:41.319 INFO:tasks.workunit.client.1.smithi112.stdout:3/80: write f1 [1128145,129675] 0 2024-09-21T10:40:41.319 INFO:tasks.workunit.client.1.smithi112.stdout:3/81: chown d2/c8 0 1 2024-09-21T10:40:41.322 INFO:tasks.workunit.client.1.smithi112.stdout:3/82: link f0 d2/f1b 0 2024-09-21T10:40:41.325 INFO:tasks.workunit.client.1.smithi112.stdout:3/83: rename d2/f16 to d2/f1c 0 2024-09-21T10:40:41.325 INFO:tasks.workunit.client.1.smithi112.stdout:3/84: write d2/f19 [185721,24624] 0 2024-09-21T10:40:41.328 INFO:tasks.workunit.client.1.smithi112.stdout:1/186: truncate d8/d1a/f2c 2298038 0 2024-09-21T10:40:41.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/87: dwrite d1/d2/f11 [0,4194304] 0 2024-09-21T10:40:41.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/88: chown d1/d2/d1c/d16 163588608 1 2024-09-21T10:40:41.329 INFO:tasks.workunit.client.1.smithi112.stdout:6/164: dwrite f1 [4194304,4194304] 0 2024-09-21T10:40:41.329 INFO:tasks.workunit.client.1.smithi112.stdout:6/165: read d4/d6/f15 [867448,76644] 0 2024-09-21T10:40:41.331 INFO:tasks.workunit.client.1.smithi112.stdout:1/187: mkdir d8/d45 0 2024-09-21T10:40:41.331 INFO:tasks.workunit.client.1.smithi112.stdout:1/188: chown d8/d20/f32 4658 1 2024-09-21T10:40:41.331 INFO:tasks.workunit.client.1.smithi112.stdout:1/189: fdatasync d8/f24 0 2024-09-21T10:40:41.333 INFO:tasks.workunit.client.1.smithi112.stdout:8/132: getdents d8/d9/dd 0 2024-09-21T10:40:41.339 INFO:tasks.workunit.client.1.smithi112.stdout:7/106: rmdir d7/d22 39 2024-09-21T10:40:41.342 INFO:tasks.workunit.client.1.smithi112.stdout:1/190: creat d8/d1a/d31/d37/f46 x:0 0 0 2024-09-21T10:40:41.345 INFO:tasks.workunit.client.1.smithi112.stdout:1/191: write d8/f24 [467302,109099] 0 2024-09-21T10:40:41.346 INFO:tasks.workunit.client.1.smithi112.stdout:9/89: rename d1/d2/f11 to d1/d2/f1e 0 2024-09-21T10:40:41.347 INFO:tasks.workunit.client.1.smithi112.stdout:6/166: dread d4/d6/da/f2c [0,4194304] 0 2024-09-21T10:40:41.348 INFO:tasks.workunit.client.1.smithi112.stdout:7/107: mknod d7/d22/c24 0 2024-09-21T10:40:41.348 INFO:tasks.workunit.client.1.smithi112.stdout:7/108: fsync d7/f17 0 2024-09-21T10:40:41.351 INFO:tasks.workunit.client.1.smithi112.stdout:1/192: dread d8/f9 [0,4194304] 0 2024-09-21T10:40:41.351 INFO:tasks.workunit.client.1.smithi112.stdout:1/193: fsync d8/d20/f3f 0 2024-09-21T10:40:41.351 INFO:tasks.workunit.client.1.smithi112.stdout:1/194: creat d8/d1a/d31/d37/f47 x:0 0 0 2024-09-21T10:40:41.351 INFO:tasks.workunit.client.1.smithi112.stdout:7/109: symlink d7/d22/l25 0 2024-09-21T10:40:41.352 INFO:tasks.workunit.client.1.smithi112.stdout:9/90: getdents d1 0 2024-09-21T10:40:41.352 INFO:tasks.workunit.client.1.smithi112.stdout:9/91: chown d1/d2/l1a 3960 1 2024-09-21T10:40:41.355 INFO:tasks.workunit.client.1.smithi112.stdout:7/110: rename d7/f17 to d7/f26 0 2024-09-21T10:40:41.357 INFO:tasks.workunit.client.1.smithi112.stdout:9/92: creat d1/d2/d1c/d16/f1f x:0 0 0 2024-09-21T10:40:41.357 INFO:tasks.workunit.client.1.smithi112.stdout:9/93: chown d1/d2/d1c/d16/l19 1969192 1 2024-09-21T10:40:41.357 INFO:tasks.workunit.client.1.smithi112.stdout:9/94: fdatasync d1/d2/d1c/d16/f1f 0 2024-09-21T10:40:41.357 INFO:tasks.workunit.client.1.smithi112.stdout:9/95: chown d1/lf 7799 1 2024-09-21T10:40:41.357 INFO:tasks.workunit.client.1.smithi112.stdout:9/96: truncate d1/d2/d1c/d16/f1f 828921 0 2024-09-21T10:40:41.358 INFO:tasks.workunit.client.1.smithi112.stdout:1/195: getdents d8/d20 0 2024-09-21T10:40:41.359 INFO:tasks.workunit.client.1.smithi112.stdout:8/133: dwrite d8/f14 [0,4194304] 0 2024-09-21T10:40:41.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/111: rename d7/d22/c24 to d7/c27 0 2024-09-21T10:40:41.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/112: chown d7/f1e 24155118 1 2024-09-21T10:40:41.360 INFO:tasks.workunit.client.1.smithi112.stdout:9/97: creat d1/d2/f20 x:0 0 0 2024-09-21T10:40:41.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/196: symlink d8/l48 0 2024-09-21T10:40:41.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/197: creat d8/d1a/f49 x:0 0 0 2024-09-21T10:40:41.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/198: stat d8/d1a 0 2024-09-21T10:40:41.362 INFO:tasks.workunit.client.1.smithi112.stdout:6/167: read f1 [5691496,64763] 0 2024-09-21T10:40:41.362 INFO:tasks.workunit.client.1.smithi112.stdout:8/134: creat d8/d9/dd/f2c x:0 0 0 2024-09-21T10:40:41.364 INFO:tasks.workunit.client.1.smithi112.stdout:9/98: creat d1/d2/d15/f21 x:0 0 0 2024-09-21T10:40:41.364 INFO:tasks.workunit.client.1.smithi112.stdout:9/99: write d1/d2/d15/f21 [857871,41839] 0 2024-09-21T10:40:41.364 INFO:tasks.workunit.client.1.smithi112.stdout:9/100: write d1/d2/f20 [624151,94373] 0 2024-09-21T10:40:41.366 INFO:tasks.workunit.client.1.smithi112.stdout:1/199: creat d8/d20/f4a x:0 0 0 2024-09-21T10:40:41.366 INFO:tasks.workunit.client.1.smithi112.stdout:1/200: write d8/d20/f32 [466809,58350] 0 2024-09-21T10:40:41.367 INFO:tasks.workunit.client.1.smithi112.stdout:6/168: link d4/d6/da/d11/d37/d19/l24 d4/d6/da/l3d 0 2024-09-21T10:40:41.368 INFO:tasks.workunit.client.1.smithi112.stdout:6/169: chown d4/d6/da/l30 0 1 2024-09-21T10:40:41.368 INFO:tasks.workunit.client.1.smithi112.stdout:6/170: truncate d4/d6/da/d11/d1f/d22/f26 247421 0 2024-09-21T10:40:41.368 INFO:tasks.workunit.client.1.smithi112.stdout:7/113: write d7/d22/f23 [564079,18663] 0 2024-09-21T10:40:41.369 INFO:tasks.workunit.client.1.smithi112.stdout:1/201: dread d8/d20/f29 [0,4194304] 0 2024-09-21T10:40:41.369 INFO:tasks.workunit.client.1.smithi112.stdout:1/202: truncate d8/f18 150213 0 2024-09-21T10:40:41.369 INFO:tasks.workunit.client.1.smithi112.stdout:8/135: truncate d8/d9/f13 1937485 0 2024-09-21T10:40:41.369 INFO:tasks.workunit.client.1.smithi112.stdout:1/203: dread - d8/d1a/f3b zero size 2024-09-21T10:40:41.374 INFO:tasks.workunit.client.1.smithi112.stdout:1/204: link d8/d1a/l1d d8/d1a/l4b 0 2024-09-21T10:40:41.377 INFO:tasks.workunit.client.1.smithi112.stdout:8/136: creat d8/d9/dd/d2a/f2d x:0 0 0 2024-09-21T10:40:41.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/137: creat d8/d9/dd/d2b/f2e x:0 0 0 2024-09-21T10:40:41.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/138: truncate d8/d9/dd/d2a/f2d 852117 0 2024-09-21T10:40:41.392 INFO:tasks.workunit.client.1.smithi112.stdout:1/205: dwrite d8/d20/f3f [0,4194304] 0 2024-09-21T10:40:41.392 INFO:tasks.workunit.client.1.smithi112.stdout:8/139: dread d8/f14 [0,4194304] 0 2024-09-21T10:40:41.392 INFO:tasks.workunit.client.1.smithi112.stdout:8/140: fsync f3 0 2024-09-21T10:40:41.399 INFO:tasks.workunit.client.1.smithi112.stdout:1/206: symlink d8/d20/l4c 0 2024-09-21T10:40:41.402 INFO:tasks.workunit.client.1.smithi112.stdout:8/141: rename d8/d9/dd/d2a/f2d to d8/d9/dd/f2f 0 2024-09-21T10:40:41.402 INFO:tasks.workunit.client.1.smithi112.stdout:8/142: creat d8/d9/dd/d2a/f30 x:0 0 0 2024-09-21T10:40:41.404 INFO:tasks.workunit.client.1.smithi112.stdout:1/207: link d8/d1a/c21 d8/c4d 0 2024-09-21T10:40:41.405 INFO:tasks.workunit.client.1.smithi112.stdout:8/143: dread d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:41.405 INFO:tasks.workunit.client.1.smithi112.stdout:8/144: write d8/d9/dd/f1d [1526340,86536] 0 2024-09-21T10:40:41.409 INFO:tasks.workunit.client.1.smithi112.stdout:1/208: creat d8/d1a/d31/f4e x:0 0 0 2024-09-21T10:40:41.410 INFO:tasks.workunit.client.1.smithi112.stdout:8/145: dread f3 [0,4194304] 0 2024-09-21T10:40:41.413 INFO:tasks.workunit.client.1.smithi112.stdout:1/209: dread d8/f40 [0,4194304] 0 2024-09-21T10:40:41.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/114: read d9/f12 [159807,86858] 0 2024-09-21T10:40:41.510 INFO:tasks.workunit.client.1.smithi112.stdout:5/115: dread d9/f12 [0,4194304] 0 2024-09-21T10:40:41.512 INFO:tasks.workunit.client.1.smithi112.stdout:5/116: creat d9/f1c x:0 0 0 2024-09-21T10:40:41.512 INFO:tasks.workunit.client.1.smithi112.stdout:5/117: fdatasync f3 0 2024-09-21T10:40:41.516 INFO:tasks.workunit.client.1.smithi112.stdout:5/118: mkdir d9/d15/d1d 0 2024-09-21T10:40:41.518 INFO:tasks.workunit.client.1.smithi112.stdout:5/119: creat d9/f1e x:0 0 0 2024-09-21T10:40:41.518 INFO:tasks.workunit.client.1.smithi112.stdout:5/120: write d9/f1c [196895,119103] 0 2024-09-21T10:40:41.520 INFO:tasks.workunit.client.1.smithi112.stdout:5/121: creat d9/d15/d1d/f1f x:0 0 0 2024-09-21T10:40:41.535 INFO:tasks.workunit.client.1.smithi112.stdout:6/171: getdents d4/d6/da/d11/d1f 0 2024-09-21T10:40:41.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/172: mkdir d4/d3e 0 2024-09-21T10:40:41.538 INFO:tasks.workunit.client.1.smithi112.stdout:6/173: fsync d4/d6/da/d11/d1f/d22/f26 0 2024-09-21T10:40:41.540 INFO:tasks.workunit.client.1.smithi112.stdout:6/174: creat d4/dc/f3f x:0 0 0 2024-09-21T10:40:41.540 INFO:tasks.workunit.client.1.smithi112.stdout:6/175: write f1 [7157480,29684] 0 2024-09-21T10:40:41.547 INFO:tasks.workunit.client.1.smithi112.stdout:6/176: read d4/d6/da/fb [4169965,82146] 0 2024-09-21T10:40:41.551 INFO:tasks.workunit.client.1.smithi112.stdout:4/121: sync 2024-09-21T10:40:41.551 INFO:tasks.workunit.client.1.smithi112.stdout:0/140: sync 2024-09-21T10:40:41.551 INFO:tasks.workunit.client.1.smithi112.stdout:2/129: sync 2024-09-21T10:40:41.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/130: fdatasync d0/d12/d1b/f20 0 2024-09-21T10:40:41.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/131: creat d0/f2a x:0 0 0 2024-09-21T10:40:41.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/132: truncate d0/f19 29783 0 2024-09-21T10:40:41.554 INFO:tasks.workunit.client.1.smithi112.stdout:4/122: dread de/f14 [0,4194304] 0 2024-09-21T10:40:41.557 INFO:tasks.workunit.client.1.smithi112.stdout:2/133: rename d0/l24 to d0/l2b 0 2024-09-21T10:40:41.558 INFO:tasks.workunit.client.1.smithi112.stdout:4/123: dread de/d18/f26 [0,4194304] 0 2024-09-21T10:40:41.561 INFO:tasks.workunit.client.1.smithi112.stdout:4/124: truncate de/d18/f26 35554 0 2024-09-21T10:40:41.563 INFO:tasks.workunit.client.1.smithi112.stdout:2/134: getdents d0/dd 0 2024-09-21T10:40:41.565 INFO:tasks.workunit.client.1.smithi112.stdout:4/125: getdents de/d18/d1d 0 2024-09-21T10:40:41.565 INFO:tasks.workunit.client.1.smithi112.stdout:4/126: write de/f11 [368811,83599] 0 2024-09-21T10:40:41.571 INFO:tasks.workunit.client.1.smithi112.stdout:0/141: dwrite d3/d4/d10/f24 [0,4194304] 0 2024-09-21T10:40:41.571 INFO:tasks.workunit.client.1.smithi112.stdout:0/142: fdatasync d3/f2b 0 2024-09-21T10:40:41.571 INFO:tasks.workunit.client.1.smithi112.stdout:0/143: fsync d3/d4/d1a/f17 0 2024-09-21T10:40:41.572 INFO:tasks.workunit.client.0.smithi060.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T10:40:41.572 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T10:40:41.572 INFO:tasks.workunit.client.0.smithi060.stderr:+ make 2024-09-21T10:40:41.572 INFO:tasks.workunit.client.1.smithi112.stdout:1/210: rmdir d8/d1a/d31/d37 39 2024-09-21T10:40:41.577 INFO:tasks.workunit.client.1.smithi112.stdout:0/144: unlink d3/f12 0 2024-09-21T10:40:41.577 INFO:tasks.workunit.client.1.smithi112.stdout:0/145: write d3/d4/f13 [136235,101491] 0 2024-09-21T10:40:41.579 INFO:tasks.workunit.client.1.smithi112.stdout:1/211: unlink d8/fa 0 2024-09-21T10:40:41.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/114: rmdir d7 39 2024-09-21T10:40:41.582 INFO:tasks.workunit.client.1.smithi112.stdout:7/115: creat d7/d22/f28 x:0 0 0 2024-09-21T10:40:41.584 INFO:tasks.workunit.client.1.smithi112.stdout:2/135: dwrite d0/d12/d26/f1a [0,4194304] 0 2024-09-21T10:40:41.585 INFO:tasks.workunit.client.1.smithi112.stdout:0/146: write d3/d4/d10/f24 [304475,127911] 0 2024-09-21T10:40:41.589 INFO:tasks.workunit.client.1.smithi112.stdout:1/212: dread d8/d20/f3f [0,4194304] 0 2024-09-21T10:40:41.590 INFO:tasks.workunit.client.1.smithi112.stdout:1/213: getdents d8/d45 0 2024-09-21T10:40:41.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/214: link l5 d8/l4f 0 2024-09-21T10:40:41.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/215: chown d8/f3a 3561 1 2024-09-21T10:40:41.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/216: read d8/d20/f32 [489410,107429] 0 2024-09-21T10:40:41.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/217: truncate d8/d20/f4a 117116 0 2024-09-21T10:40:41.601 INFO:tasks.workunit.client.1.smithi112.stdout:9/101: truncate d1/d2/d1c/d16/f1f 677747 0 2024-09-21T10:40:41.604 INFO:tasks.workunit.client.1.smithi112.stdout:9/102: creat d1/d2/d1c/d16/f22 x:0 0 0 2024-09-21T10:40:41.606 INFO:tasks.workunit.client.1.smithi112.stdout:9/103: creat d1/d2/d1c/f23 x:0 0 0 2024-09-21T10:40:41.608 INFO:tasks.workunit.client.1.smithi112.stdout:9/104: symlink d1/l24 0 2024-09-21T10:40:41.610 INFO:tasks.workunit.client.1.smithi112.stdout:9/105: mknod d1/d2/d1c/c25 0 2024-09-21T10:40:41.610 INFO:tasks.workunit.client.1.smithi112.stdout:9/106: creat d1/d2/d1c/f26 x:0 0 0 2024-09-21T10:40:41.610 INFO:tasks.workunit.client.1.smithi112.stdout:9/107: readlink d1/lf 0 2024-09-21T10:40:41.612 INFO:tasks.workunit.client.1.smithi112.stdout:9/108: mkdir d1/d2/d27 0 2024-09-21T10:40:41.612 INFO:tasks.workunit.client.1.smithi112.stdout:9/109: chown d1/d2/d1c/f26 39893 1 2024-09-21T10:40:41.618 INFO:tasks.workunit.client.1.smithi112.stdout:8/146: rmdir d8/d9/dd/d2a 39 2024-09-21T10:40:41.620 INFO:tasks.workunit.client.1.smithi112.stdout:8/147: mkdir d8/d9/dd/d2b/d31 0 2024-09-21T10:40:41.620 INFO:tasks.workunit.client.1.smithi112.stdout:8/148: fsync d8/d9/dd/d1a/f26 0 2024-09-21T10:40:41.620 INFO:tasks.workunit.client.1.smithi112.stdout:8/149: stat d8/d9/dd/d2b/f2e 0 2024-09-21T10:40:41.622 INFO:tasks.workunit.client.1.smithi112.stdout:8/150: unlink d8/d9/dd/l22 0 2024-09-21T10:40:41.622 INFO:tasks.workunit.client.1.smithi112.stdout:8/151: creat d8/d9/dd/d1a/f32 x:0 0 0 2024-09-21T10:40:41.623 INFO:tasks.workunit.client.1.smithi112.stdout:8/152: symlink d8/d9/dd/l33 0 2024-09-21T10:40:41.625 INFO:tasks.workunit.client.1.smithi112.stdout:8/153: dread d8/d9/dd/f2f [0,4194304] 0 2024-09-21T10:40:41.625 INFO:tasks.workunit.client.1.smithi112.stdout:8/154: chown d8/d9 29280 1 2024-09-21T10:40:41.626 INFO:tasks.workunit.client.1.smithi112.stdout:8/155: mknod d8/c34 0 2024-09-21T10:40:41.627 INFO:tasks.workunit.client.1.smithi112.stdout:8/156: mknod d8/d9/c35 0 2024-09-21T10:40:41.657 INFO:tasks.workunit.client.1.smithi112.stdout:6/177: dwrite d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:41.657 INFO:tasks.workunit.client.1.smithi112.stdout:6/178: creat d4/d6/f40 x:0 0 0 2024-09-21T10:40:41.658 INFO:tasks.workunit.client.1.smithi112.stdout:4/127: dwrite de/d18/f21 [0,4194304] 0 2024-09-21T10:40:41.658 INFO:tasks.workunit.client.1.smithi112.stdout:4/128: chown f0 749017 1 2024-09-21T10:40:41.658 INFO:tasks.workunit.client.1.smithi112.stdout:4/129: chown f8 0 1 2024-09-21T10:40:41.659 INFO:tasks.workunit.client.1.smithi112.stdout:6/179: symlink d4/d6/da/d11/d37/l41 0 2024-09-21T10:40:41.661 INFO:tasks.workunit.client.1.smithi112.stdout:4/130: mkdir de/d2e 0 2024-09-21T10:40:41.665 INFO:tasks.workunit.client.1.smithi112.stdout:4/131: rename de/d18/d1d to de/d2a/d2b/d2f 0 2024-09-21T10:40:41.665 INFO:tasks.workunit.client.1.smithi112.stdout:1/218: dwrite d8/f15 [0,4194304] 0 2024-09-21T10:40:41.665 INFO:tasks.workunit.client.1.smithi112.stdout:9/110: dwrite d1/d2/f20 [0,4194304] 0 2024-09-21T10:40:41.667 INFO:tasks.workunit.client.1.smithi112.stdout:1/219: rename d8/d20/c2f to d8/d1a/d31/c50 0 2024-09-21T10:40:41.671 INFO:tasks.workunit.client.1.smithi112.stdout:1/220: mknod d8/d45/c51 0 2024-09-21T10:40:41.671 INFO:tasks.workunit.client.1.smithi112.stdout:9/111: rmdir d1/d2/d15 39 2024-09-21T10:40:41.673 INFO:tasks.workunit.client.1.smithi112.stdout:1/221: symlink d8/d1a/l52 0 2024-09-21T10:40:41.674 INFO:tasks.workunit.client.1.smithi112.stdout:4/132: dread de/f24 [0,4194304] 0 2024-09-21T10:40:41.674 INFO:tasks.workunit.client.1.smithi112.stdout:9/112: symlink d1/d2/d1c/d16/l28 0 2024-09-21T10:40:41.675 INFO:tasks.workunit.client.1.smithi112.stdout:4/133: truncate f5 864924 0 2024-09-21T10:40:41.677 INFO:tasks.workunit.client.1.smithi112.stdout:9/113: link d1/l24 d1/d2/l29 0 2024-09-21T10:40:41.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/222: dread d8/d20/f3f [0,4194304] 0 2024-09-21T10:40:41.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/223: dread - d8/f38 zero size 2024-09-21T10:40:41.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/224: fsync d8/fd 0 2024-09-21T10:40:41.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/225: stat d8/d1a/c2a 0 2024-09-21T10:40:41.679 INFO:tasks.workunit.client.1.smithi112.stdout:9/114: unlink d1/d2/d1c/c25 0 2024-09-21T10:40:41.679 INFO:tasks.workunit.client.1.smithi112.stdout:9/115: write d1/d2/d1c/f26 [809317,91727] 0 2024-09-21T10:40:41.680 INFO:tasks.workunit.client.1.smithi112.stdout:9/116: stat d1/d2/d1c/d16/l1d 0 2024-09-21T10:40:41.680 INFO:tasks.workunit.client.1.smithi112.stdout:9/117: chown d1/lf 10701644 1 2024-09-21T10:40:41.680 INFO:tasks.workunit.client.1.smithi112.stdout:9/118: readlink d1/d2/d1c/d16/l28 0 2024-09-21T10:40:41.680 INFO:tasks.workunit.client.1.smithi112.stdout:9/119: truncate d1/d2/d1c/f23 24190 0 2024-09-21T10:40:41.681 INFO:tasks.workunit.client.1.smithi112.stdout:9/120: rmdir d1 39 2024-09-21T10:40:41.689 INFO:tasks.workunit.client.1.smithi112.stdout:9/121: write d1/d2/f20 [389098,101958] 0 2024-09-21T10:40:41.690 INFO:tasks.workunit.client.1.smithi112.stdout:9/122: truncate d1/d2/f1e 3729335 0 2024-09-21T10:40:41.691 INFO:tasks.workunit.client.1.smithi112.stdout:9/123: mknod d1/d2/d1c/c2a 0 2024-09-21T10:40:41.694 INFO:tasks.workunit.client.1.smithi112.stdout:9/124: fdatasync d1/d2/d1c/f26 0 2024-09-21T10:40:41.694 INFO:tasks.workunit.client.1.smithi112.stdout:0/147: write d3/d23/f26 [5189862,50425] 0 2024-09-21T10:40:41.695 INFO:tasks.workunit.client.1.smithi112.stdout:0/148: creat d3/d4/d1a/d21/f30 x:0 0 0 2024-09-21T10:40:41.697 INFO:tasks.workunit.client.1.smithi112.stdout:0/149: rename d3/d4/lc to d3/d4/d1a/l31 0 2024-09-21T10:40:41.698 INFO:tasks.workunit.client.1.smithi112.stdout:0/150: chown d3/d4/l1e 5 1 2024-09-21T10:40:41.698 INFO:tasks.workunit.client.1.smithi112.stdout:0/151: chown d3/d4/lf 1156856415 1 2024-09-21T10:40:41.698 INFO:tasks.workunit.client.1.smithi112.stdout:0/152: write d3/f1b [4645661,84325] 0 2024-09-21T10:40:41.711 INFO:tasks.workunit.client.1.smithi112.stdout:4/134: dwrite de/f10 [0,4194304] 0 2024-09-21T10:40:41.711 INFO:tasks.workunit.client.1.smithi112.stdout:4/135: chown de 3831940 1 2024-09-21T10:40:41.714 INFO:tasks.workunit.client.1.smithi112.stdout:4/136: creat de/d2a/d2b/f30 x:0 0 0 2024-09-21T10:40:41.715 INFO:tasks.workunit.client.1.smithi112.stdout:0/153: dread d3/d4/f1c [0,4194304] 0 2024-09-21T10:40:41.715 INFO:tasks.workunit.client.1.smithi112.stdout:4/137: mkdir de/d2a/d31 0 2024-09-21T10:40:41.716 INFO:tasks.workunit.client.1.smithi112.stdout:0/154: mknod d3/d4/d1a/c32 0 2024-09-21T10:40:41.716 INFO:tasks.workunit.client.1.smithi112.stdout:0/155: fsync d3/d18/f22 0 2024-09-21T10:40:41.717 INFO:tasks.workunit.client.1.smithi112.stdout:4/138: creat de/d2e/f32 x:0 0 0 2024-09-21T10:40:41.718 INFO:tasks.workunit.client.1.smithi112.stdout:9/125: dwrite d1/d2/f20 [0,4194304] 0 2024-09-21T10:40:41.718 INFO:tasks.workunit.client.1.smithi112.stdout:9/126: chown d1/l10 79207623 1 2024-09-21T10:40:41.726 INFO:tasks.workunit.client.1.smithi112.stdout:9/127: dread d1/d2/f20 [0,4194304] 0 2024-09-21T10:40:41.727 INFO:tasks.workunit.client.1.smithi112.stdout:9/128: symlink d1/d2/d1c/l2b 0 2024-09-21T10:40:41.728 INFO:tasks.workunit.client.1.smithi112.stdout:9/129: getdents d1 0 2024-09-21T10:40:41.729 INFO:tasks.workunit.client.1.smithi112.stdout:6/180: truncate f1 2919386 0 2024-09-21T10:40:41.729 INFO:tasks.workunit.client.1.smithi112.stdout:6/181: read - d4/d6/f40 zero size 2024-09-21T10:40:41.730 INFO:tasks.workunit.client.1.smithi112.stdout:6/182: symlink d4/dc/d1a/d31/d3c/l42 0 2024-09-21T10:40:41.730 INFO:tasks.workunit.client.1.smithi112.stdout:6/183: readlink d4/d6/l9 0 2024-09-21T10:40:41.730 INFO:tasks.workunit.client.1.smithi112.stdout:6/184: getdents d4/d3e 0 2024-09-21T10:40:41.731 INFO:tasks.workunit.client.1.smithi112.stdout:3/85: sync 2024-09-21T10:40:41.731 INFO:tasks.workunit.client.1.smithi112.stdout:6/185: mknod d4/d3e/c43 0 2024-09-21T10:40:41.732 INFO:tasks.workunit.client.1.smithi112.stdout:3/86: unlink d2/f10 0 2024-09-21T10:40:41.732 INFO:tasks.workunit.client.1.smithi112.stdout:3/87: creat d2/f1d x:0 0 0 2024-09-21T10:40:41.737 INFO:tasks.workunit.client.1.smithi112.stdout:6/186: symlink d4/dc/d1a/d31/d39/l44 0 2024-09-21T10:40:41.737 INFO:tasks.workunit.client.1.smithi112.stdout:3/88: mknod d2/c1e 0 2024-09-21T10:40:41.738 INFO:tasks.workunit.client.1.smithi112.stdout:6/187: symlink d4/dc/d1a/d31/l45 0 2024-09-21T10:40:41.739 INFO:tasks.workunit.client.1.smithi112.stdout:6/188: creat d4/d6/da/f46 x:0 0 0 2024-09-21T10:40:41.744 INFO:tasks.workunit.client.1.smithi112.stdout:0/156: truncate d3/f1b 2083961 0 2024-09-21T10:40:41.750 INFO:tasks.workunit.client.1.smithi112.stdout:4/139: rename de/d2a/d2b to de/d33 0 2024-09-21T10:40:41.753 INFO:tasks.workunit.client.1.smithi112.stdout:0/157: rename d3/d18/l25 to d3/d4/l33 0 2024-09-21T10:40:41.753 INFO:tasks.workunit.client.1.smithi112.stdout:0/158: chown d3/f2b 36179 1 2024-09-21T10:40:41.753 INFO:tasks.workunit.client.1.smithi112.stdout:0/159: fsync d3/d4/d1a/d21/f30 0 2024-09-21T10:40:41.753 INFO:tasks.workunit.client.1.smithi112.stdout:0/160: write d3/d23/f26 [322223,35274] 0 2024-09-21T10:40:41.755 INFO:tasks.workunit.client.1.smithi112.stdout:0/161: rename d3/d4/d1a/l31 to d3/d4/d1a/l34 0 2024-09-21T10:40:41.755 INFO:tasks.workunit.client.1.smithi112.stdout:0/162: creat d3/d4/d10/f35 x:0 0 0 2024-09-21T10:40:41.755 INFO:tasks.workunit.client.0.smithi060.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T10:40:41.759 INFO:tasks.workunit.client.1.smithi112.stdout:6/189: dwrite d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:41.759 INFO:tasks.workunit.client.1.smithi112.stdout:6/190: creat d4/d6/da/f47 x:0 0 0 2024-09-21T10:40:41.760 INFO:tasks.workunit.client.1.smithi112.stdout:0/163: write d3/d23/f26 [4990270,69409] 0 2024-09-21T10:40:41.763 INFO:tasks.workunit.client.1.smithi112.stdout:6/191: creat d4/d6/da/d11/d37/d19/d34/f48 x:0 0 0 2024-09-21T10:40:41.768 INFO:tasks.workunit.client.1.smithi112.stdout:0/164: getdents d3/d4 0 2024-09-21T10:40:41.768 INFO:tasks.workunit.client.1.smithi112.stdout:3/89: dwrite d2/f1c [0,4194304] 0 2024-09-21T10:40:41.768 INFO:tasks.workunit.client.1.smithi112.stdout:3/90: chown d2/c8 220 1 2024-09-21T10:40:41.769 INFO:tasks.workunit.client.1.smithi112.stdout:3/91: read d2/fe [8156206,85509] 0 2024-09-21T10:40:41.770 INFO:tasks.workunit.client.1.smithi112.stdout:4/140: dwrite f9 [0,4194304] 0 2024-09-21T10:40:41.775 INFO:tasks.workunit.client.1.smithi112.stdout:3/92: mkdir d2/d1f 0 2024-09-21T10:40:41.775 INFO:tasks.workunit.client.1.smithi112.stdout:3/93: write d2/f13 [47780,60420] 0 2024-09-21T10:40:41.779 INFO:tasks.workunit.client.1.smithi112.stdout:4/141: truncate de/d18/f19 1289783 0 2024-09-21T10:40:41.779 INFO:tasks.workunit.client.1.smithi112.stdout:4/142: chown de/d2e/f32 198 1 2024-09-21T10:40:41.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/143: mkdir de/d34 0 2024-09-21T10:40:41.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/144: write de/f14 [1092589,37723] 0 2024-09-21T10:40:41.782 INFO:tasks.workunit.client.1.smithi112.stdout:6/192: dwrite d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:41.785 INFO:tasks.workunit.client.1.smithi112.stdout:6/193: mkdir d4/d6/da/d14/d49 0 2024-09-21T10:40:41.785 INFO:tasks.workunit.client.1.smithi112.stdout:6/194: chown d4/d6/da/c2a 0 1 2024-09-21T10:40:41.785 INFO:tasks.workunit.client.1.smithi112.stdout:6/195: readlink d4/d6/lf 0 2024-09-21T10:40:41.785 INFO:tasks.workunit.client.1.smithi112.stdout:6/196: dread - d4/d6/f40 zero size 2024-09-21T10:40:41.786 INFO:tasks.workunit.client.1.smithi112.stdout:6/197: mknod d4/d6/da/c4a 0 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:6/198: creat d4/dc/f4b x:0 0 0 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:6/199: write d4/d6/da/fb [3209651,91458] 0 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:3/94: dread d2/f1c [0,4194304] 0 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:3/95: write d2/f19 [459914,40135] 0 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:3/96: fsync d2/f1d 0 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:3/97: chown d2/c8 18 1 2024-09-21T10:40:41.787 INFO:tasks.workunit.client.1.smithi112.stdout:3/98: fsync f1 0 2024-09-21T10:40:41.789 INFO:tasks.workunit.client.1.smithi112.stdout:3/99: mknod d2/c20 0 2024-09-21T10:40:41.791 INFO:tasks.workunit.client.1.smithi112.stdout:3/100: mkdir d2/d1f/d21 0 2024-09-21T10:40:41.792 INFO:tasks.workunit.client.1.smithi112.stdout:3/101: mkdir d2/d22 0 2024-09-21T10:40:41.792 INFO:tasks.workunit.client.1.smithi112.stdout:3/102: write f1 [338061,99666] 0 2024-09-21T10:40:41.794 INFO:tasks.workunit.client.1.smithi112.stdout:3/103: creat d2/d1f/d21/f23 x:0 0 0 2024-09-21T10:40:41.794 INFO:tasks.workunit.client.1.smithi112.stdout:3/104: symlink d2/d1f/l24 0 2024-09-21T10:40:41.795 INFO:tasks.workunit.client.1.smithi112.stdout:3/105: dread - d2/f1d zero size 2024-09-21T10:40:41.795 INFO:tasks.workunit.client.1.smithi112.stdout:3/106: creat d2/d1f/f25 x:0 0 0 2024-09-21T10:40:41.795 INFO:tasks.workunit.client.1.smithi112.stdout:3/107: truncate d2/f17 958753 0 2024-09-21T10:40:41.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/108: readlink d2/d1f/l24 0 2024-09-21T10:40:41.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/109: chown d2/f18 1 1 2024-09-21T10:40:41.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/110: stat d2/f14 0 2024-09-21T10:40:41.796 INFO:tasks.workunit.client.1.smithi112.stdout:3/111: write d2/d1f/d21/f23 [811381,26427] 0 2024-09-21T10:40:41.797 INFO:tasks.workunit.client.1.smithi112.stdout:3/112: symlink d2/d22/l26 0 2024-09-21T10:40:41.797 INFO:tasks.workunit.client.1.smithi112.stdout:3/113: write d2/f18 [96534,116450] 0 2024-09-21T10:40:41.797 INFO:tasks.workunit.client.1.smithi112.stdout:3/114: creat d2/f27 x:0 0 0 2024-09-21T10:40:41.797 INFO:tasks.workunit.client.1.smithi112.stdout:4/145: dwrite de/f11 [0,4194304] 0 2024-09-21T10:40:41.800 INFO:tasks.workunit.client.1.smithi112.stdout:4/146: mkdir de/d33/d2f/d35 0 2024-09-21T10:40:41.808 INFO:tasks.workunit.client.1.smithi112.stdout:0/165: dwrite d3/d4/d10/f35 [0,4194304] 0 2024-09-21T10:40:41.811 INFO:tasks.workunit.client.1.smithi112.stdout:6/200: dwrite d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:41.811 INFO:tasks.workunit.client.1.smithi112.stdout:0/166: symlink d3/d4/d1a/d21/l36 0 2024-09-21T10:40:41.813 INFO:tasks.workunit.client.1.smithi112.stdout:6/201: creat d4/d3e/f4c x:0 0 0 2024-09-21T10:40:41.813 INFO:tasks.workunit.client.1.smithi112.stdout:6/202: readlink d4/d6/lf 0 2024-09-21T10:40:41.813 INFO:tasks.workunit.client.1.smithi112.stdout:6/203: chown d4/d3e/c43 102710 1 2024-09-21T10:40:41.814 INFO:tasks.workunit.client.1.smithi112.stdout:0/167: mkdir d3/d18/d37 0 2024-09-21T10:40:41.815 INFO:tasks.workunit.client.1.smithi112.stdout:4/147: dwrite de/d2e/f32 [0,4194304] 0 2024-09-21T10:40:41.816 INFO:tasks.workunit.client.1.smithi112.stdout:6/204: getdents d4/dc 0 2024-09-21T10:40:41.816 INFO:tasks.workunit.client.1.smithi112.stdout:0/168: dread d3/d4/f13 [0,4194304] 0 2024-09-21T10:40:41.819 INFO:tasks.workunit.client.1.smithi112.stdout:6/205: symlink d4/d6/da/d11/d37/d19/l4d 0 2024-09-21T10:40:41.819 INFO:tasks.workunit.client.1.smithi112.stdout:6/206: fdatasync d4/dc/f3f 0 2024-09-21T10:40:41.819 INFO:tasks.workunit.client.1.smithi112.stdout:6/207: rename d4/d6/da/d11 to d4/d6/da/d11/d1f/d4e 22 2024-09-21T10:40:41.820 INFO:tasks.workunit.client.1.smithi112.stdout:0/169: dread d3/d4/f1c [0,4194304] 0 2024-09-21T10:40:41.821 INFO:tasks.workunit.client.1.smithi112.stdout:0/170: chown d3/d18/f22 20371458 1 2024-09-21T10:40:41.821 INFO:tasks.workunit.client.1.smithi112.stdout:0/171: stat d3/d18/f22 0 2024-09-21T10:40:41.821 INFO:tasks.workunit.client.1.smithi112.stdout:0/172: chown d3/d23/f29 41218 1 2024-09-21T10:40:41.822 INFO:tasks.workunit.client.1.smithi112.stdout:7/116: sync 2024-09-21T10:40:41.822 INFO:tasks.workunit.client.1.smithi112.stdout:5/122: sync 2024-09-21T10:40:41.822 INFO:tasks.workunit.client.1.smithi112.stdout:7/117: write d7/d22/f28 [696026,93233] 0 2024-09-21T10:40:41.824 INFO:tasks.workunit.client.1.smithi112.stdout:0/173: dread d3/d4/f1c [0,4194304] 0 2024-09-21T10:40:41.824 INFO:tasks.workunit.client.1.smithi112.stdout:0/174: chown d3/d4/l6 27284506 1 2024-09-21T10:40:41.824 INFO:tasks.workunit.client.1.smithi112.stdout:5/123: mkdir d9/d15/d18/d20 0 2024-09-21T10:40:41.827 INFO:tasks.workunit.client.1.smithi112.stdout:5/124: rename d9/f10 to d9/d15/d1d/f21 0 2024-09-21T10:40:41.828 INFO:tasks.workunit.client.1.smithi112.stdout:5/125: truncate d9/f1c 176651 0 2024-09-21T10:40:41.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/126: symlink d9/d15/d18/l22 0 2024-09-21T10:40:41.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/127: write d9/ff [1398782,76202] 0 2024-09-21T10:40:41.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/128: creat d9/d15/d1d/f23 x:0 0 0 2024-09-21T10:40:41.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/129: fdatasync d9/f1e 0 2024-09-21T10:40:41.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/130: creat d9/d15/f24 x:0 0 0 2024-09-21T10:40:41.831 INFO:tasks.workunit.client.1.smithi112.stdout:5/131: dread - d9/d15/d1d/f23 zero size 2024-09-21T10:40:41.833 INFO:tasks.workunit.client.1.smithi112.stdout:5/132: symlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:41.833 INFO:tasks.workunit.client.1.smithi112.stdout:7/118: dread d7/f1c [0,4194304] 0 2024-09-21T10:40:41.834 INFO:tasks.workunit.client.1.smithi112.stdout:7/119: chown d7/l12 65237723 1 2024-09-21T10:40:41.849 INFO:tasks.workunit.client.1.smithi112.stdout:6/208: dwrite d4/dc/f3f [0,4194304] 0 2024-09-21T10:40:41.850 INFO:tasks.workunit.client.1.smithi112.stdout:6/209: read - d4/d6/da/f46 zero size 2024-09-21T10:40:41.851 INFO:tasks.workunit.client.1.smithi112.stdout:4/148: dwrite f0 [4194304,4194304] 0 2024-09-21T10:40:41.851 INFO:tasks.workunit.client.1.smithi112.stdout:6/210: mkdir d4/d4f 0 2024-09-21T10:40:41.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/211: mknod d4/d6/da/d11/d37/c50 0 2024-09-21T10:40:41.853 INFO:tasks.workunit.client.1.smithi112.stdout:0/175: dwrite d3/d4/d1a/f17 [0,4194304] 0 2024-09-21T10:40:41.854 INFO:tasks.workunit.client.1.smithi112.stdout:7/120: dwrite f5 [4194304,4194304] 0 2024-09-21T10:40:41.854 INFO:tasks.workunit.client.1.smithi112.stdout:7/121: dread - d7/f26 zero size 2024-09-21T10:40:41.854 INFO:tasks.workunit.client.1.smithi112.stdout:7/122: stat d7/ca 0 2024-09-21T10:40:41.859 INFO:tasks.workunit.client.1.smithi112.stdout:5/133: truncate d9/f1c 950087 0 2024-09-21T10:40:41.859 INFO:tasks.workunit.client.1.smithi112.stdout:5/134: write f3 [1675810,59897] 0 2024-09-21T10:40:41.859 INFO:tasks.workunit.client.1.smithi112.stdout:5/135: dread - d9/d15/f24 zero size 2024-09-21T10:40:41.861 INFO:tasks.workunit.client.1.smithi112.stdout:7/123: mknod d7/d22/c29 0 2024-09-21T10:40:41.862 INFO:tasks.workunit.client.1.smithi112.stdout:6/212: dread d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:41.862 INFO:tasks.workunit.client.1.smithi112.stdout:7/124: read d7/d22/f28 [53545,58820] 0 2024-09-21T10:40:41.866 INFO:tasks.workunit.client.1.smithi112.stdout:5/136: symlink d9/d15/d1d/l26 0 2024-09-21T10:40:41.867 INFO:tasks.workunit.client.1.smithi112.stdout:6/213: symlink d4/d6/da/d11/d37/d19/d34/l51 0 2024-09-21T10:40:41.872 INFO:tasks.workunit.client.1.smithi112.stdout:6/214: rename d4/d6/f10 to d4/dc/d1a/d31/d3c/f52 0 2024-09-21T10:40:41.872 INFO:tasks.workunit.client.1.smithi112.stdout:6/215: read d4/d6/f15 [1095541,24896] 0 2024-09-21T10:40:41.873 INFO:tasks.workunit.client.1.smithi112.stdout:4/149: dwrite de/f11 [0,4194304] 0 2024-09-21T10:40:41.874 INFO:tasks.workunit.client.1.smithi112.stdout:5/137: mkdir d9/d27 0 2024-09-21T10:40:41.875 INFO:tasks.workunit.client.1.smithi112.stdout:5/138: fdatasync d9/fe 0 2024-09-21T10:40:41.875 INFO:tasks.workunit.client.1.smithi112.stdout:5/139: write d9/d15/f16 [3018546,84801] 0 2024-09-21T10:40:41.875 INFO:tasks.workunit.client.1.smithi112.stdout:5/140: readlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:41.875 INFO:tasks.workunit.client.1.smithi112.stdout:5/141: write d9/f1e [197237,49285] 0 2024-09-21T10:40:41.875 INFO:tasks.workunit.client.1.smithi112.stdout:5/142: stat l0 0 2024-09-21T10:40:41.876 INFO:tasks.workunit.client.1.smithi112.stdout:4/150: creat de/d33/d2f/d35/f36 x:0 0 0 2024-09-21T10:40:41.876 INFO:tasks.workunit.client.1.smithi112.stdout:7/125: rmdir d7/d22 39 2024-09-21T10:40:41.876 INFO:tasks.workunit.client.1.smithi112.stdout:7/126: write d7/f19 [805065,49443] 0 2024-09-21T10:40:41.877 INFO:tasks.workunit.client.1.smithi112.stdout:7/127: stat d7/f26 0 2024-09-21T10:40:41.877 INFO:tasks.workunit.client.1.smithi112.stdout:0/176: dwrite d3/f20 [0,4194304] 0 2024-09-21T10:40:41.877 INFO:tasks.workunit.client.1.smithi112.stdout:0/177: write d3/d23/f29 [293476,32332] 0 2024-09-21T10:40:41.880 INFO:tasks.workunit.client.1.smithi112.stdout:7/128: mknod d7/c2a 0 2024-09-21T10:40:41.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/129: mknod d7/d22/c2b 0 2024-09-21T10:40:41.896 INFO:tasks.workunit.client.1.smithi112.stdout:5/143: dwrite d9/f11 [0,4194304] 0 2024-09-21T10:40:41.910 INFO:tasks.workunit.client.1.smithi112.stdout:5/144: dwrite d9/d15/d1d/f1f [0,4194304] 0 2024-09-21T10:40:41.911 INFO:tasks.workunit.client.1.smithi112.stdout:5/145: mknod d9/d15/c28 0 2024-09-21T10:40:41.914 INFO:tasks.workunit.client.1.smithi112.stdout:5/146: dread d9/ff [0,4194304] 0 2024-09-21T10:40:41.915 INFO:tasks.workunit.client.1.smithi112.stdout:5/147: write d9/d15/f16 [2455894,30693] 0 2024-09-21T10:40:41.915 INFO:tasks.workunit.client.1.smithi112.stdout:5/148: fsync d9/d15/d1d/f1f 0 2024-09-21T10:40:41.973 INFO:tasks.workunit.client.1.smithi112.stdout:8/157: sync 2024-09-21T10:40:41.973 INFO:tasks.workunit.client.1.smithi112.stdout:2/136: sync 2024-09-21T10:40:41.974 INFO:tasks.workunit.client.1.smithi112.stdout:8/158: getdents d8/d9/dd/d2a 0 2024-09-21T10:40:41.976 INFO:tasks.workunit.client.1.smithi112.stdout:2/137: getdents d0/d12 0 2024-09-21T10:40:41.976 INFO:tasks.workunit.client.1.smithi112.stdout:2/138: read - d0/d12/d1b/f27 zero size 2024-09-21T10:40:41.977 INFO:tasks.workunit.client.1.smithi112.stdout:2/139: dread - d0/f2a zero size 2024-09-21T10:40:41.977 INFO:tasks.workunit.client.1.smithi112.stdout:2/140: chown d0/f19 986 1 2024-09-21T10:40:41.978 INFO:tasks.workunit.client.1.smithi112.stdout:2/141: mknod d0/c2c 0 2024-09-21T10:40:41.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/115: sync 2024-09-21T10:40:41.983 INFO:tasks.workunit.client.1.smithi112.stdout:1/226: sync 2024-09-21T10:40:41.983 INFO:tasks.workunit.client.1.smithi112.stdout:9/130: sync 2024-09-21T10:40:41.983 INFO:tasks.workunit.client.1.smithi112.stdout:3/116: write d2/d1f/f25 [325032,76202] 0 2024-09-21T10:40:41.984 INFO:tasks.workunit.client.1.smithi112.stdout:1/227: mkdir d8/d1a/d53 0 2024-09-21T10:40:41.987 INFO:tasks.workunit.client.1.smithi112.stdout:1/228: unlink d8/d1a/f49 0 2024-09-21T10:40:41.989 INFO:tasks.workunit.client.1.smithi112.stdout:9/131: rmdir d1/d2 39 2024-09-21T10:40:41.991 INFO:tasks.workunit.client.1.smithi112.stdout:1/229: mkdir d8/d54 0 2024-09-21T10:40:41.993 INFO:tasks.workunit.client.1.smithi112.stdout:1/230: rename d8/d1a/l42 to d8/d1a/d31/d37/l55 0 2024-09-21T10:40:42.003 INFO:tasks.workunit.client.1.smithi112.stdout:1/231: read d8/d1a/f1e [136216,102810] 0 2024-09-21T10:40:42.003 INFO:tasks.workunit.client.1.smithi112.stdout:1/232: chown d8/d1a/l41 2598 1 2024-09-21T10:40:42.004 INFO:tasks.workunit.client.1.smithi112.stdout:1/233: rmdir d8/d1a/d31/d37 39 2024-09-21T10:40:42.005 INFO:tasks.workunit.client.1.smithi112.stdout:1/234: unlink d8/d1a/d31/f34 0 2024-09-21T10:40:42.005 INFO:tasks.workunit.client.1.smithi112.stdout:1/235: stat d8/fe 0 2024-09-21T10:40:42.006 INFO:tasks.workunit.client.1.smithi112.stdout:1/236: creat d8/d1a/d31/d37/f56 x:0 0 0 2024-09-21T10:40:42.007 INFO:tasks.workunit.client.1.smithi112.stdout:1/237: unlink l6 0 2024-09-21T10:40:42.007 INFO:tasks.workunit.client.1.smithi112.stdout:1/238: chown d8/d20/f29 6 1 2024-09-21T10:40:42.007 INFO:tasks.workunit.client.1.smithi112.stdout:1/239: chown d8/d1a/d31/c50 13198568 1 2024-09-21T10:40:42.007 INFO:tasks.workunit.client.1.smithi112.stdout:1/240: mkdir d8/d1a/d53/d57 0 2024-09-21T10:40:42.008 INFO:tasks.workunit.client.1.smithi112.stdout:4/151: dwrite de/f14 [0,4194304] 0 2024-09-21T10:40:42.008 INFO:tasks.workunit.client.1.smithi112.stdout:7/130: dwrite d7/f16 [0,4194304] 0 2024-09-21T10:40:42.008 INFO:tasks.workunit.client.1.smithi112.stdout:7/131: write d7/d22/f23 [489471,74181] 0 2024-09-21T10:40:42.008 INFO:tasks.workunit.client.1.smithi112.stdout:7/132: write d7/f19 [1236573,73472] 0 2024-09-21T10:40:42.010 INFO:tasks.workunit.client.1.smithi112.stdout:4/152: rename de/c13 to de/d34/c37 0 2024-09-21T10:40:42.010 INFO:tasks.workunit.client.1.smithi112.stdout:4/153: read de/f12 [271773,85809] 0 2024-09-21T10:40:42.012 INFO:tasks.workunit.client.1.smithi112.stdout:7/133: rmdir d7 39 2024-09-21T10:40:42.012 INFO:tasks.workunit.client.1.smithi112.stdout:7/134: dread - d7/f26 zero size 2024-09-21T10:40:42.012 INFO:tasks.workunit.client.1.smithi112.stdout:7/135: chown d7/c20 46249938 1 2024-09-21T10:40:42.012 INFO:tasks.workunit.client.1.smithi112.stdout:0/178: dwrite d3/d23/f26 [4194304,4194304] 0 2024-09-21T10:40:42.013 INFO:tasks.workunit.client.1.smithi112.stdout:4/154: getdents de/d2a 0 2024-09-21T10:40:42.014 INFO:tasks.workunit.client.1.smithi112.stdout:2/142: dwrite d0/f6 [0,4194304] 0 2024-09-21T10:40:42.014 INFO:tasks.workunit.client.1.smithi112.stdout:9/132: dwrite d1/d2/f20 [0,4194304] 0 2024-09-21T10:40:42.014 INFO:tasks.workunit.client.1.smithi112.stdout:3/117: dwrite d2/fa [0,4194304] 0 2024-09-21T10:40:42.014 INFO:tasks.workunit.client.1.smithi112.stdout:7/136: rename d7/cc to d7/d22/c2c 0 2024-09-21T10:40:42.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/179: creat d3/d4/f38 x:0 0 0 2024-09-21T10:40:42.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/180: creat d3/d4/f39 x:0 0 0 2024-09-21T10:40:42.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/181: fsync d3/d4/f1d 0 2024-09-21T10:40:42.016 INFO:tasks.workunit.client.1.smithi112.stdout:5/149: getdents d9/d15 0 2024-09-21T10:40:42.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/155: creat de/d33/f38 x:0 0 0 2024-09-21T10:40:42.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/156: readlink de/d2a/l2c 0 2024-09-21T10:40:42.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/157: write de/f15 [766208,42996] 0 2024-09-21T10:40:42.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/158: write de/f12 [832072,104108] 0 2024-09-21T10:40:42.018 INFO:tasks.workunit.client.1.smithi112.stdout:4/159: truncate de/f15 1626833 0 2024-09-21T10:40:42.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/133: symlink d1/d2/d27/l2c 0 2024-09-21T10:40:42.025 INFO:tasks.workunit.client.1.smithi112.stdout:7/137: dread d7/f13 [0,4194304] 0 2024-09-21T10:40:42.025 INFO:tasks.workunit.client.1.smithi112.stdout:7/138: chown d7/d22/f28 135153472 1 2024-09-21T10:40:42.025 INFO:tasks.workunit.client.1.smithi112.stdout:3/118: dread d2/fe [0,4194304] 0 2024-09-21T10:40:42.027 INFO:tasks.workunit.client.1.smithi112.stdout:2/143: dread d0/f10 [0,4194304] 0 2024-09-21T10:40:42.027 INFO:tasks.workunit.client.1.smithi112.stdout:2/144: chown d0/d12/d1b/f20 1997246066 1 2024-09-21T10:40:42.028 INFO:tasks.workunit.client.1.smithi112.stdout:2/145: readlink d0/l5 0 2024-09-21T10:40:42.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/182: mknod d3/d18/d37/c3a 0 2024-09-21T10:40:42.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/183: creat d3/d18/f3b x:0 0 0 2024-09-21T10:40:42.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/184: creat d3/d4/d10/f3c x:0 0 0 2024-09-21T10:40:42.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/185: write d3/d4/f1d [5565674,43324] 0 2024-09-21T10:40:42.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/186: fdatasync d3/d4/fe 0 2024-09-21T10:40:42.030 INFO:tasks.workunit.client.1.smithi112.stdout:4/160: truncate de/d2e/f32 790080 0 2024-09-21T10:40:42.030 INFO:tasks.workunit.client.1.smithi112.stdout:4/161: fdatasync de/d18/f25 0 2024-09-21T10:40:42.030 INFO:tasks.workunit.client.1.smithi112.stdout:9/134: truncate d1/d2/d15/f21 856710 0 2024-09-21T10:40:42.032 INFO:tasks.workunit.client.1.smithi112.stdout:5/150: dwrite d9/fe [0,4194304] 0 2024-09-21T10:40:42.035 INFO:tasks.workunit.client.1.smithi112.stdout:0/187: unlink d3/d4/f1c 0 2024-09-21T10:40:42.037 INFO:tasks.workunit.client.1.smithi112.stdout:9/135: truncate d1/d2/d1c/f26 846947 0 2024-09-21T10:40:42.042 INFO:tasks.workunit.client.1.smithi112.stdout:0/188: mknod d3/d18/c3d 0 2024-09-21T10:40:42.042 INFO:tasks.workunit.client.1.smithi112.stdout:2/146: write d0/d12/d26/f17 [1987643,52987] 0 2024-09-21T10:40:42.042 INFO:tasks.workunit.client.1.smithi112.stdout:2/147: creat d0/f2d x:0 0 0 2024-09-21T10:40:42.043 INFO:tasks.workunit.client.1.smithi112.stdout:9/136: creat d1/d2/d1c/f2d x:0 0 0 2024-09-21T10:40:42.046 INFO:tasks.workunit.client.1.smithi112.stdout:2/148: creat d0/dd/f2e x:0 0 0 2024-09-21T10:40:42.049 INFO:tasks.workunit.client.1.smithi112.stdout:9/137: fsync d1/d2/d15/f21 0 2024-09-21T10:40:42.053 INFO:tasks.workunit.client.1.smithi112.stdout:9/138: rename d1/d2/d1c/d16/l28 to d1/d2/l2e 0 2024-09-21T10:40:42.055 INFO:tasks.workunit.client.1.smithi112.stdout:9/139: creat d1/d2/d27/f2f x:0 0 0 2024-09-21T10:40:42.055 INFO:tasks.workunit.client.1.smithi112.stdout:9/140: chown d1/d2/d1c/l2b 97426537 1 2024-09-21T10:40:42.055 INFO:tasks.workunit.client.1.smithi112.stdout:9/141: chown d1/d2/f20 107840787 1 2024-09-21T10:40:42.055 INFO:tasks.workunit.client.1.smithi112.stdout:9/142: write d1/d2/d15/f21 [891357,120560] 0 2024-09-21T10:40:42.056 INFO:tasks.workunit.client.1.smithi112.stdout:9/143: truncate d1/d2/f20 2660144 0 2024-09-21T10:40:42.060 INFO:tasks.workunit.client.1.smithi112.stdout:3/119: dwrite d2/f19 [0,4194304] 0 2024-09-21T10:40:42.060 INFO:tasks.workunit.client.1.smithi112.stdout:2/149: write d0/f6 [2569392,49335] 0 2024-09-21T10:40:42.060 INFO:tasks.workunit.client.1.smithi112.stdout:2/150: stat d0/f1d 0 2024-09-21T10:40:42.060 INFO:tasks.workunit.client.1.smithi112.stdout:2/151: truncate d0/f2d 102397 0 2024-09-21T10:40:42.060 INFO:tasks.workunit.client.1.smithi112.stdout:2/152: creat d0/f2f x:0 0 0 2024-09-21T10:40:42.060 INFO:tasks.workunit.client.1.smithi112.stdout:5/151: dwrite d9/d15/f24 [0,4194304] 0 2024-09-21T10:40:42.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/120: write d2/d1f/f25 [216443,17345] 0 2024-09-21T10:40:42.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/121: fsync d2/f1c 0 2024-09-21T10:40:42.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/122: readlink d2/d1f/l24 0 2024-09-21T10:40:42.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/123: fdatasync d2/f1c 0 2024-09-21T10:40:42.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/189: dwrite d3/f2b [8388608,4194304] 0 2024-09-21T10:40:42.064 INFO:tasks.workunit.client.1.smithi112.stdout:5/152: creat d9/d15/d18/f29 x:0 0 0 2024-09-21T10:40:42.066 INFO:tasks.workunit.client.1.smithi112.stdout:3/124: unlink d2/d1f/d21/f23 0 2024-09-21T10:40:42.068 INFO:tasks.workunit.client.1.smithi112.stdout:0/190: unlink d3/d4/d1a/d21/l36 0 2024-09-21T10:40:42.068 INFO:tasks.workunit.client.1.smithi112.stdout:0/191: write d3/d18/f22 [4176414,54580] 0 2024-09-21T10:40:42.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/153: getdents d0/dd 0 2024-09-21T10:40:42.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/154: write d0/dd/f21 [236722,128838] 0 2024-09-21T10:40:42.070 INFO:tasks.workunit.client.1.smithi112.stdout:2/155: dread d0/f19 [0,4194304] 0 2024-09-21T10:40:42.071 INFO:tasks.workunit.client.1.smithi112.stdout:2/156: chown d0/fb 2480 1 2024-09-21T10:40:42.071 INFO:tasks.workunit.client.1.smithi112.stdout:5/153: creat d9/d15/f2a x:0 0 0 2024-09-21T10:40:42.071 INFO:tasks.workunit.client.1.smithi112.stdout:5/154: fsync d9/ff 0 2024-09-21T10:40:42.071 INFO:tasks.workunit.client.1.smithi112.stdout:5/155: fdatasync d9/f11 0 2024-09-21T10:40:42.072 INFO:tasks.workunit.client.1.smithi112.stdout:5/156: dread d9/f1e [0,4194304] 0 2024-09-21T10:40:42.074 INFO:tasks.workunit.client.1.smithi112.stdout:0/192: rename d3/d4/c2e to d3/d4/d1a/c3e 0 2024-09-21T10:40:42.078 INFO:tasks.workunit.client.1.smithi112.stdout:2/157: creat d0/dd/f30 x:0 0 0 2024-09-21T10:40:42.082 INFO:tasks.workunit.client.1.smithi112.stdout:2/158: rename d0/l5 to d0/d12/d26/l31 0 2024-09-21T10:40:42.082 INFO:tasks.workunit.client.1.smithi112.stdout:2/159: dread - d0/f2f zero size 2024-09-21T10:40:42.086 INFO:tasks.workunit.client.1.smithi112.stdout:2/160: mknod d0/dd/c32 0 2024-09-21T10:40:42.086 INFO:tasks.workunit.client.1.smithi112.stdout:3/125: dwrite d2/f1b [0,4194304] 0 2024-09-21T10:40:42.088 INFO:tasks.workunit.client.1.smithi112.stdout:2/161: truncate d0/f10 3270162 0 2024-09-21T10:40:42.088 INFO:tasks.workunit.client.1.smithi112.stdout:2/162: read - d0/dd/f30 zero size 2024-09-21T10:40:42.090 INFO:tasks.workunit.client.1.smithi112.stdout:3/126: mknod d2/c28 0 2024-09-21T10:40:42.092 INFO:tasks.workunit.client.1.smithi112.stdout:2/163: mkdir d0/dd/d33 0 2024-09-21T10:40:42.094 INFO:tasks.workunit.client.1.smithi112.stdout:3/127: rename d2/f1c to d2/d22/f29 0 2024-09-21T10:40:42.094 INFO:tasks.workunit.client.1.smithi112.stdout:3/128: chown d2/c4 3280499 1 2024-09-21T10:40:42.094 INFO:tasks.workunit.client.1.smithi112.stdout:3/129: write d2/f17 [1661948,27104] 0 2024-09-21T10:40:42.096 INFO:tasks.workunit.client.1.smithi112.stdout:3/130: mkdir d2/d1f/d21/d2a 0 2024-09-21T10:40:42.096 INFO:tasks.workunit.client.1.smithi112.stdout:3/131: write d2/d1f/f25 [1172033,110581] 0 2024-09-21T10:40:42.097 INFO:tasks.workunit.client.1.smithi112.stdout:3/132: chown d2/d1f/d21 11160 1 2024-09-21T10:40:42.099 INFO:tasks.workunit.client.1.smithi112.stdout:5/157: dwrite d9/d15/d1d/f23 [0,4194304] 0 2024-09-21T10:40:42.103 INFO:tasks.workunit.client.1.smithi112.stdout:5/158: chown d9/c13 914717 1 2024-09-21T10:40:42.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/159: mknod d9/d15/d18/c2b 0 2024-09-21T10:40:42.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/160: chown d9/d15/d1d 28133955 1 2024-09-21T10:40:42.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/161: readlink d9/d15/d1d/l26 0 2024-09-21T10:40:42.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/162: chown d9/f1e 9351415 1 2024-09-21T10:40:42.105 INFO:tasks.workunit.client.1.smithi112.stdout:5/163: write d9/d15/d18/f29 [306570,127220] 0 2024-09-21T10:40:42.114 INFO:tasks.workunit.client.1.smithi112.stdout:5/164: dread d9/d15/d1d/f1f [0,4194304] 0 2024-09-21T10:40:42.114 INFO:tasks.workunit.client.1.smithi112.stdout:5/165: truncate d9/d15/d1d/f1f 3708985 0 2024-09-21T10:40:42.114 INFO:tasks.workunit.client.1.smithi112.stdout:5/166: write d9/d15/d18/f29 [1453290,4421] 0 2024-09-21T10:40:42.114 INFO:tasks.workunit.client.1.smithi112.stdout:5/167: mknod d9/d15/d18/c2c 0 2024-09-21T10:40:42.115 INFO:tasks.workunit.client.1.smithi112.stdout:5/168: rename d9/f14 to d9/d27/f2d 0 2024-09-21T10:40:42.116 INFO:tasks.workunit.client.0.smithi060.stderr:++ readlink -f fsstress 2024-09-21T10:40:42.118 INFO:tasks.workunit.client.0.smithi060.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T10:40:42.118 INFO:tasks.workunit.client.0.smithi060.stderr:+ popd 2024-09-21T10:40:42.118 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T10:40:42.118 INFO:tasks.workunit.client.0.smithi060.stderr:+ popd 2024-09-21T10:40:42.119 INFO:tasks.workunit.client.0.smithi060.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-21T10:40:42.119 INFO:tasks.workunit.client.0.smithi060.stderr:++ mktemp -d -p . 2024-09-21T10:40:42.120 INFO:tasks.workunit.client.0.smithi060.stderr:+ T=./tmp.JwzZRotgXu 2024-09-21T10:40:42.120 INFO:tasks.workunit.client.0.smithi060.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.JwzZRotgXu -l 1 -n 1000 -p 10 -v 2024-09-21T10:40:42.122 INFO:tasks.workunit.client.0.smithi060.stdout:seed = 1726970875 2024-09-21T10:40:42.124 INFO:tasks.workunit.client.0.smithi060.stdout:0/0: rmdir - no directory 2024-09-21T10:40:42.124 INFO:tasks.workunit.client.0.smithi060.stdout:0/1: unlink - no file 2024-09-21T10:40:42.126 INFO:tasks.workunit.client.0.smithi060.stdout:0/2: creat f0 x:0 0 0 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:2/0: dread - no filename 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:2/1: dread - no filename 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:2/2: write - no filename 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:2/3: fsync - no filename 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:2/4: dread - no filename 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:1/0: symlink l0 0 2024-09-21T10:40:42.127 INFO:tasks.workunit.client.0.smithi060.stdout:1/1: dwrite - no filename 2024-09-21T10:40:42.128 INFO:tasks.workunit.client.0.smithi060.stdout:3/0: rmdir - no directory 2024-09-21T10:40:42.128 INFO:tasks.workunit.client.0.smithi060.stdout:2/5: mknod c0 0 2024-09-21T10:40:42.128 INFO:tasks.workunit.client.0.smithi060.stdout:2/6: dwrite - no filename 2024-09-21T10:40:42.129 INFO:tasks.workunit.client.0.smithi060.stdout:1/2: mknod c1 0 2024-09-21T10:40:42.129 INFO:tasks.workunit.client.0.smithi060.stdout:1/3: readlink l0 0 2024-09-21T10:40:42.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/0: rmdir - no directory 2024-09-21T10:40:42.130 INFO:tasks.workunit.client.0.smithi060.stdout:3/1: mkdir d0 0 2024-09-21T10:40:42.130 INFO:tasks.workunit.client.0.smithi060.stdout:2/7: mknod c1 0 2024-09-21T10:40:42.131 INFO:tasks.workunit.client.0.smithi060.stdout:2/8: fsync - no filename 2024-09-21T10:40:42.131 INFO:tasks.workunit.client.0.smithi060.stdout:2/9: fdatasync - no filename 2024-09-21T10:40:42.131 INFO:tasks.workunit.client.1.smithi112.stdout:5/169: dwrite d9/f1c [0,4194304] 0 2024-09-21T10:40:42.132 INFO:tasks.workunit.client.0.smithi060.stdout:1/4: unlink l0 0 2024-09-21T10:40:42.132 INFO:tasks.workunit.client.0.smithi060.stdout:1/5: dwrite - no filename 2024-09-21T10:40:42.133 INFO:tasks.workunit.client.0.smithi060.stdout:4/1: mkdir d0 0 2024-09-21T10:40:42.135 INFO:tasks.workunit.client.0.smithi060.stdout:2/10: creat f2 x:0 0 0 2024-09-21T10:40:42.135 INFO:tasks.workunit.client.0.smithi060.stdout:2/11: rmdir - no directory 2024-09-21T10:40:42.136 INFO:tasks.workunit.client.0.smithi060.stdout:1/6: mknod c2 0 2024-09-21T10:40:42.136 INFO:tasks.workunit.client.0.smithi060.stdout:1/7: readlink - no filename 2024-09-21T10:40:42.137 INFO:tasks.workunit.client.0.smithi060.stdout:1/8: rmdir - no directory 2024-09-21T10:40:42.141 INFO:tasks.workunit.client.0.smithi060.stdout:2/12: mkdir d3 0 2024-09-21T10:40:42.141 INFO:tasks.workunit.client.0.smithi060.stdout:1/9: creat f3 x:0 0 0 2024-09-21T10:40:42.143 INFO:tasks.workunit.client.1.smithi112.stdout:5/170: rmdir d9/d15/d18 39 2024-09-21T10:40:42.143 INFO:tasks.workunit.client.1.smithi112.stdout:5/171: creat d9/d15/f2e x:0 0 0 2024-09-21T10:40:42.150 INFO:tasks.workunit.client.1.smithi112.stdout:5/172: unlink d9/d15/d18/l22 0 2024-09-21T10:40:42.233 INFO:tasks.workunit.client.1.smithi112.stdout:8/159: sync 2024-09-21T10:40:42.235 INFO:tasks.workunit.client.1.smithi112.stdout:8/160: mknod d8/d9/dd/d1a/c36 0 2024-09-21T10:40:42.240 INFO:tasks.workunit.client.1.smithi112.stdout:8/161: unlink d8/c34 0 2024-09-21T10:40:42.242 INFO:tasks.workunit.client.1.smithi112.stdout:8/162: truncate d8/f14 1276719 0 2024-09-21T10:40:42.245 INFO:tasks.workunit.client.1.smithi112.stdout:8/163: symlink d8/d9/dd/d2b/l37 0 2024-09-21T10:40:42.252 INFO:tasks.workunit.client.1.smithi112.stdout:8/164: unlink f2 0 2024-09-21T10:40:42.261 INFO:tasks.workunit.client.1.smithi112.stdout:6/216: sync 2024-09-21T10:40:42.264 INFO:tasks.workunit.client.1.smithi112.stdout:6/217: creat d4/dc/d1a/d31/d3c/f53 x:0 0 0 2024-09-21T10:40:42.268 INFO:tasks.workunit.client.1.smithi112.stdout:6/218: link d4/d6/da/d14/c17 d4/dc/d1a/d31/c54 0 2024-09-21T10:40:42.270 INFO:tasks.workunit.client.1.smithi112.stdout:6/219: creat d4/d6/da/d11/d1f/f55 x:0 0 0 2024-09-21T10:40:42.272 INFO:tasks.workunit.client.1.smithi112.stdout:6/220: mkdir d4/dc/d1a/d31/d56 0 2024-09-21T10:40:42.272 INFO:tasks.workunit.client.1.smithi112.stdout:6/221: fsync d4/d6/da/d14/f27 0 2024-09-21T10:40:42.272 INFO:tasks.workunit.client.1.smithi112.stdout:6/222: chown d4/d6/da/c2a 5389614 1 2024-09-21T10:40:42.493 INFO:tasks.workunit.client.1.smithi112.stdout:6/223: symlink d4/d4f/l57 0 2024-09-21T10:40:42.497 INFO:tasks.workunit.client.1.smithi112.stdout:6/224: dread d4/d6/da/d11/d37/fe [0,4194304] 0 2024-09-21T10:40:42.503 INFO:tasks.workunit.client.1.smithi112.stdout:6/225: unlink d4/d6/da/d11/d37/d19/c3a 0 2024-09-21T10:40:42.503 INFO:tasks.workunit.client.1.smithi112.stdout:6/226: creat d4/d6/da/d11/d1f/d22/f58 x:0 0 0 2024-09-21T10:40:42.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/165: dwrite d8/d9/dd/f1d [0,4194304] 0 2024-09-21T10:40:42.503 INFO:tasks.workunit.client.1.smithi112.stdout:6/227: write d4/d6/da/d11/d37/d19/f2e [3990020,15537] 0 2024-09-21T10:40:42.508 INFO:tasks.workunit.client.1.smithi112.stdout:7/139: sync 2024-09-21T10:40:42.508 INFO:tasks.workunit.client.1.smithi112.stdout:1/241: sync 2024-09-21T10:40:42.527 INFO:tasks.workunit.client.1.smithi112.stdout:6/228: mknod d4/d6/da/d11/d37/d19/d34/c59 0 2024-09-21T10:40:42.527 INFO:tasks.workunit.client.1.smithi112.stdout:6/229: write d4/d6/da/f47 [914654,55039] 0 2024-09-21T10:40:42.534 INFO:tasks.workunit.client.1.smithi112.stdout:5/173: dread d9/f1c [0,4194304] 0 2024-09-21T10:40:42.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/140: unlink d7/l1b 0 2024-09-21T10:40:42.544 INFO:tasks.workunit.client.1.smithi112.stdout:6/230: creat d4/dc/d1a/f5a x:0 0 0 2024-09-21T10:40:42.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/141: symlink d7/d22/l2d 0 2024-09-21T10:40:42.549 INFO:tasks.workunit.client.1.smithi112.stdout:5/174: rmdir d9/d15/d1d 39 2024-09-21T10:40:42.553 INFO:tasks.workunit.client.1.smithi112.stdout:7/142: dread f5 [0,4194304] 0 2024-09-21T10:40:42.556 INFO:tasks.workunit.client.1.smithi112.stdout:5/175: symlink d9/d15/d18/l2f 0 2024-09-21T10:40:42.556 INFO:tasks.workunit.client.1.smithi112.stdout:5/176: stat d9/d15/d1d/l26 0 2024-09-21T10:40:42.556 INFO:tasks.workunit.client.1.smithi112.stdout:5/177: creat d9/d15/f30 x:0 0 0 2024-09-21T10:40:42.560 INFO:tasks.workunit.client.1.smithi112.stdout:7/143: dread d7/ff [4194304,4194304] 0 2024-09-21T10:40:42.563 INFO:tasks.workunit.client.1.smithi112.stdout:5/178: creat d9/d15/d18/f31 x:0 0 0 2024-09-21T10:40:42.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/144: dread d7/f10 [0,4194304] 0 2024-09-21T10:40:42.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/145: write d7/f14 [256232,54828] 0 2024-09-21T10:40:42.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/146: write f6 [410174,53813] 0 2024-09-21T10:40:42.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/147: fsync d7/f1e 0 2024-09-21T10:40:42.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/148: truncate f6 512506 0 2024-09-21T10:40:42.570 INFO:tasks.workunit.client.1.smithi112.stdout:5/179: creat d9/d15/d1d/f32 x:0 0 0 2024-09-21T10:40:42.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/180: stat d9/d15/d1d/l26 0 2024-09-21T10:40:42.574 INFO:tasks.workunit.client.1.smithi112.stdout:5/181: mknod d9/d27/c33 0 2024-09-21T10:40:42.580 INFO:tasks.workunit.client.1.smithi112.stdout:5/182: dread d9/f11 [0,4194304] 0 2024-09-21T10:40:42.584 INFO:tasks.workunit.client.1.smithi112.stdout:5/183: unlink d9/d15/d18/l2f 0 2024-09-21T10:40:42.587 INFO:tasks.workunit.client.1.smithi112.stdout:8/166: dwrite d8/d9/f25 [0,4194304] 0 2024-09-21T10:40:42.587 INFO:tasks.workunit.client.1.smithi112.stdout:1/242: dwrite d8/f24 [0,4194304] 0 2024-09-21T10:40:42.588 INFO:tasks.workunit.client.1.smithi112.stdout:1/243: fdatasync f3 0 2024-09-21T10:40:42.588 INFO:tasks.workunit.client.1.smithi112.stdout:1/244: fsync d8/f9 0 2024-09-21T10:40:42.588 INFO:tasks.workunit.client.1.smithi112.stdout:5/184: creat d9/d15/d18/d20/f34 x:0 0 0 2024-09-21T10:40:42.591 INFO:tasks.workunit.client.1.smithi112.stdout:5/185: write d9/f11 [3257164,87316] 0 2024-09-21T10:40:42.603 INFO:tasks.workunit.client.1.smithi112.stdout:1/245: rename f3 to d8/d20/f58 0 2024-09-21T10:40:42.609 INFO:tasks.workunit.client.0.smithi060.stdout:6/0: fdatasync - no filename 2024-09-21T10:40:42.609 INFO:tasks.workunit.client.0.smithi060.stdout:7/0: dread - no filename 2024-09-21T10:40:42.609 INFO:tasks.workunit.client.0.smithi060.stdout:7/1: dread - no filename 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:7/2: truncate - no filename 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:7/3: dread - no filename 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:9/0: fsync - no filename 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:7/4: chown . 5889 1 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:9/1: getdents . 0 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:9/2: rename - no filename 2024-09-21T10:40:42.610 INFO:tasks.workunit.client.0.smithi060.stdout:5/0: write - no filename 2024-09-21T10:40:42.611 INFO:tasks.workunit.client.0.smithi060.stdout:5/1: write - no filename 2024-09-21T10:40:42.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/186: dwrite f3 [4194304,4194304] 0 2024-09-21T10:40:42.612 INFO:tasks.workunit.client.1.smithi112.stdout:5/187: creat d9/d15/f35 x:0 0 0 2024-09-21T10:40:42.617 INFO:tasks.workunit.client.1.smithi112.stdout:8/167: rmdir d8/d9 39 2024-09-21T10:40:42.617 INFO:tasks.workunit.client.1.smithi112.stdout:8/168: chown d8/d9/dd/f2f 48051 1 2024-09-21T10:40:42.619 INFO:tasks.workunit.client.1.smithi112.stdout:1/246: rename d8/fd to d8/d45/f59 0 2024-09-21T10:40:42.625 INFO:tasks.workunit.client.1.smithi112.stdout:8/169: truncate d8/d9/fb 599924 0 2024-09-21T10:40:42.628 INFO:tasks.workunit.client.1.smithi112.stdout:1/247: link d8/d1a/c36 d8/d1a/d53/d57/c5a 0 2024-09-21T10:40:42.629 INFO:tasks.workunit.client.1.smithi112.stdout:1/248: chown d8/cc 192 1 2024-09-21T10:40:42.629 INFO:tasks.workunit.client.1.smithi112.stdout:1/249: creat d8/d20/f5b x:0 0 0 2024-09-21T10:40:42.632 INFO:tasks.workunit.client.1.smithi112.stdout:8/170: mknod d8/d9/dd/d2b/d31/c38 0 2024-09-21T10:40:42.640 INFO:tasks.workunit.client.1.smithi112.stdout:1/250: creat d8/d1a/d53/f5c x:0 0 0 2024-09-21T10:40:42.643 INFO:tasks.workunit.client.1.smithi112.stdout:5/188: rename d9/cd to d9/c36 0 2024-09-21T10:40:42.643 INFO:tasks.workunit.client.1.smithi112.stdout:5/189: chown d9/d15/d18/d20/l25 1823 1 2024-09-21T10:40:42.646 INFO:tasks.workunit.client.1.smithi112.stdout:1/251: creat d8/d54/f5d x:0 0 0 2024-09-21T10:40:42.646 INFO:tasks.workunit.client.1.smithi112.stdout:1/252: chown d8/d1a/d31/c33 53221 1 2024-09-21T10:40:42.646 INFO:tasks.workunit.client.1.smithi112.stdout:1/253: readlink d8/d1a/l43 0 2024-09-21T10:40:42.646 INFO:tasks.workunit.client.1.smithi112.stdout:1/254: creat d8/d1a/d31/d37/f5e x:0 0 0 2024-09-21T10:40:42.647 INFO:tasks.workunit.client.1.smithi112.stdout:5/190: symlink d9/d15/d18/d20/l37 0 2024-09-21T10:40:42.647 INFO:tasks.workunit.client.1.smithi112.stdout:5/191: stat l2 0 2024-09-21T10:40:42.649 INFO:tasks.workunit.client.1.smithi112.stdout:1/255: rmdir d8/d45 39 2024-09-21T10:40:42.649 INFO:tasks.workunit.client.1.smithi112.stdout:1/256: write d8/d20/f4a [974342,114147] 0 2024-09-21T10:40:42.649 INFO:tasks.workunit.client.1.smithi112.stdout:1/257: creat d8/d20/f5f x:0 0 0 2024-09-21T10:40:42.649 INFO:tasks.workunit.client.1.smithi112.stdout:1/258: dread - d8/f38 zero size 2024-09-21T10:40:42.651 INFO:tasks.workunit.client.1.smithi112.stdout:5/192: rename d9/d15/d1d/f23 to d9/d15/d18/f38 0 2024-09-21T10:40:42.651 INFO:tasks.workunit.client.1.smithi112.stdout:5/193: dread - d9/d15/d1d/f21 zero size 2024-09-21T10:40:42.651 INFO:tasks.workunit.client.1.smithi112.stdout:5/194: creat d9/d15/d18/f39 x:0 0 0 2024-09-21T10:40:42.651 INFO:tasks.workunit.client.1.smithi112.stdout:5/195: truncate d9/d15/f2a 339309 0 2024-09-21T10:40:42.652 INFO:tasks.workunit.client.1.smithi112.stdout:8/171: dwrite d8/d9/f25 [4194304,4194304] 0 2024-09-21T10:40:42.655 INFO:tasks.workunit.client.1.smithi112.stdout:5/196: rename d9/d27 to d9/d15/d18/d3a 0 2024-09-21T10:40:42.655 INFO:tasks.workunit.client.1.smithi112.stdout:5/197: fdatasync d9/d15/d1d/f21 0 2024-09-21T10:40:42.658 INFO:tasks.workunit.client.1.smithi112.stdout:1/259: getdents d8/d1a 0 2024-09-21T10:40:42.658 INFO:tasks.workunit.client.1.smithi112.stdout:1/260: readlink d8/l16 0 2024-09-21T10:40:42.658 INFO:tasks.workunit.client.1.smithi112.stdout:1/261: fsync d8/d1a/f1e 0 2024-09-21T10:40:42.659 INFO:tasks.workunit.client.1.smithi112.stdout:1/262: write d8/f1f [382079,82304] 0 2024-09-21T10:40:42.659 INFO:tasks.workunit.client.1.smithi112.stdout:1/263: dread - d8/d20/f5b zero size 2024-09-21T10:40:42.661 INFO:tasks.workunit.client.1.smithi112.stdout:1/264: rmdir d8/d1a/d53/d57 39 2024-09-21T10:40:42.661 INFO:tasks.workunit.client.1.smithi112.stdout:1/265: dread - d8/d1a/d31/d37/f47 zero size 2024-09-21T10:40:42.662 INFO:tasks.workunit.client.1.smithi112.stdout:1/266: write d8/d1a/d31/d37/f5e [728911,104404] 0 2024-09-21T10:40:42.669 INFO:tasks.workunit.client.1.smithi112.stdout:5/198: dwrite d9/f1c [4194304,4194304] 0 2024-09-21T10:40:42.670 INFO:tasks.workunit.client.1.smithi112.stdout:8/172: write d8/d9/fb [62962,20861] 0 2024-09-21T10:40:42.674 INFO:tasks.workunit.client.1.smithi112.stdout:5/199: rename l2 to d9/d15/d18/d3a/l3b 0 2024-09-21T10:40:42.677 INFO:tasks.workunit.client.1.smithi112.stdout:5/200: mknod d9/d15/d18/d20/c3c 0 2024-09-21T10:40:42.681 INFO:tasks.workunit.client.1.smithi112.stdout:5/201: mknod d9/d15/d18/d3a/c3d 0 2024-09-21T10:40:42.682 INFO:tasks.workunit.client.1.smithi112.stdout:5/202: creat d9/d15/f3e x:0 0 0 2024-09-21T10:40:42.682 INFO:tasks.workunit.client.1.smithi112.stdout:5/203: stat d9/d15/d1d 0 2024-09-21T10:40:42.694 INFO:tasks.workunit.client.1.smithi112.stdout:8/173: dwrite d8/f14 [0,4194304] 0 2024-09-21T10:40:42.694 INFO:tasks.workunit.client.1.smithi112.stdout:8/174: chown d8/d9/dd/c29 1 1 2024-09-21T10:40:42.694 INFO:tasks.workunit.client.1.smithi112.stdout:8/175: stat d8/d9/f13 0 2024-09-21T10:40:42.694 INFO:tasks.workunit.client.1.smithi112.stdout:8/176: chown d8/fc 13 1 2024-09-21T10:40:42.696 INFO:tasks.workunit.client.1.smithi112.stdout:8/177: creat d8/d9/dd/d2b/d31/f39 x:0 0 0 2024-09-21T10:40:42.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/178: symlink d8/d9/dd/d2b/l3a 0 2024-09-21T10:40:42.701 INFO:tasks.workunit.client.1.smithi112.stdout:8/179: dread d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:42.704 INFO:tasks.workunit.client.1.smithi112.stdout:8/180: symlink d8/d9/dd/d1a/l3b 0 2024-09-21T10:40:42.704 INFO:tasks.workunit.client.1.smithi112.stdout:8/181: write d8/d9/dd/d2b/f2e [132132,34094] 0 2024-09-21T10:40:42.705 INFO:tasks.workunit.client.1.smithi112.stdout:5/204: dwrite d9/d15/f16 [4194304,4194304] 0 2024-09-21T10:40:42.708 INFO:tasks.workunit.client.0.smithi060.stdout:4/2: creat d0/f1 x:0 0 0 2024-09-21T10:40:42.710 INFO:tasks.workunit.client.1.smithi112.stdout:5/205: symlink d9/d15/d18/l3f 0 2024-09-21T10:40:42.711 INFO:tasks.workunit.client.1.smithi112.stdout:5/206: creat d9/d15/f40 x:0 0 0 2024-09-21T10:40:42.711 INFO:tasks.workunit.client.1.smithi112.stdout:5/207: readlink l0 0 2024-09-21T10:40:42.712 INFO:tasks.workunit.client.0.smithi060.stdout:6/1: creat f0 x:0 0 0 2024-09-21T10:40:42.712 INFO:tasks.workunit.client.1.smithi112.stdout:5/208: dread d9/f12 [0,4194304] 0 2024-09-21T10:40:42.712 INFO:tasks.workunit.client.1.smithi112.stdout:5/209: write d9/d15/d18/d3a/f2d [314431,48382] 0 2024-09-21T10:40:42.713 INFO:tasks.workunit.client.1.smithi112.stdout:5/210: fsync d9/d15/d18/f31 0 2024-09-21T10:40:42.714 INFO:tasks.workunit.client.0.smithi060.stdout:7/5: creat f0 x:0 0 0 2024-09-21T10:40:42.714 INFO:tasks.workunit.client.0.smithi060.stdout:7/6: creat f1 x:0 0 0 2024-09-21T10:40:42.715 INFO:tasks.workunit.client.0.smithi060.stdout:9/3: creat f0 x:0 0 0 2024-09-21T10:40:42.715 INFO:tasks.workunit.client.0.smithi060.stdout:9/4: truncate f0 695744 0 2024-09-21T10:40:42.716 INFO:tasks.workunit.client.0.smithi060.stdout:8/0: mknod c0 0 2024-09-21T10:40:42.716 INFO:tasks.workunit.client.0.smithi060.stdout:8/1: dwrite - no filename 2024-09-21T10:40:42.717 INFO:tasks.workunit.client.0.smithi060.stdout:8/2: write - no filename 2024-09-21T10:40:42.717 INFO:tasks.workunit.client.0.smithi060.stdout:5/2: mknod c0 0 2024-09-21T10:40:42.718 INFO:tasks.workunit.client.0.smithi060.stdout:5/3: chown c0 976 1 2024-09-21T10:40:42.720 INFO:tasks.workunit.client.0.smithi060.stdout:4/3: link d0/f1 d0/f2 0 2024-09-21T10:40:42.721 INFO:tasks.workunit.client.0.smithi060.stdout:6/2: symlink l1 0 2024-09-21T10:40:42.721 INFO:tasks.workunit.client.0.smithi060.stdout:6/3: write f0 [989882,89714] 0 2024-09-21T10:40:42.726 INFO:tasks.workunit.client.0.smithi060.stdout:9/5: symlink l1 0 2024-09-21T10:40:42.726 INFO:tasks.workunit.client.0.smithi060.stdout:9/6: creat f2 x:0 0 0 2024-09-21T10:40:42.726 INFO:tasks.workunit.client.0.smithi060.stdout:8/3: creat f1 x:0 0 0 2024-09-21T10:40:42.726 INFO:tasks.workunit.client.0.smithi060.stdout:8/4: write f1 [130533,17813] 0 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:8/182: dwrite d8/d9/f25 [0,4194304] 0 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:8/183: fsync d8/d9/dd/f2c 0 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:0/193: sync 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:4/162: sync 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:9/144: sync 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:2/164: sync 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:3/133: sync 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:3/134: chown d2/fe 1382 1 2024-09-21T10:40:42.727 INFO:tasks.workunit.client.1.smithi112.stdout:2/165: truncate d0/f19 878007 0 2024-09-21T10:40:42.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/7: mkdir d3 0 2024-09-21T10:40:42.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/8: chown d3 2 1 2024-09-21T10:40:42.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/9: rename d3 to d3/d4 22 2024-09-21T10:40:42.731 INFO:tasks.workunit.client.1.smithi112.stdout:8/184: mkdir d8/d9/d3c 0 2024-09-21T10:40:42.731 INFO:tasks.workunit.client.1.smithi112.stdout:8/185: chown d8/f14 7295 1 2024-09-21T10:40:42.731 INFO:tasks.workunit.client.1.smithi112.stdout:4/163: mkdir de/d2a/d31/d39 0 2024-09-21T10:40:42.733 INFO:tasks.workunit.client.0.smithi060.stdout:7/7: dwrite f0 [0,4194304] 0 2024-09-21T10:40:42.733 INFO:tasks.workunit.client.0.smithi060.stdout:7/8: dread - f1 zero size 2024-09-21T10:40:42.733 INFO:tasks.workunit.client.0.smithi060.stdout:9/10: symlink d3/l5 0 2024-09-21T10:40:42.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/145: mkdir d1/d2/d1c/d16/d30 0 2024-09-21T10:40:42.735 INFO:tasks.workunit.client.0.smithi060.stdout:8/5: fdatasync f1 0 2024-09-21T10:40:42.735 INFO:tasks.workunit.client.0.smithi060.stdout:8/6: fdatasync f1 0 2024-09-21T10:40:42.736 INFO:tasks.workunit.client.1.smithi112.stdout:8/186: creat d8/f3d x:0 0 0 2024-09-21T10:40:42.736 INFO:tasks.workunit.client.1.smithi112.stdout:0/194: dread d3/f20 [0,4194304] 0 2024-09-21T10:40:42.737 INFO:tasks.workunit.client.1.smithi112.stdout:3/135: write d2/f14 [3766012,1579] 0 2024-09-21T10:40:42.738 INFO:tasks.workunit.client.1.smithi112.stdout:4/164: unlink f9 0 2024-09-21T10:40:42.738 INFO:tasks.workunit.client.0.smithi060.stdout:9/11: symlink d3/l6 0 2024-09-21T10:40:42.740 INFO:tasks.workunit.client.1.smithi112.stdout:9/146: link d1/d2/l1a d1/d2/d1c/l31 0 2024-09-21T10:40:42.741 INFO:tasks.workunit.client.1.smithi112.stdout:8/187: symlink d8/l3e 0 2024-09-21T10:40:42.743 INFO:tasks.workunit.client.1.smithi112.stdout:0/195: link d3/d4/fe d3/d23/f3f 0 2024-09-21T10:40:42.743 INFO:tasks.workunit.client.1.smithi112.stdout:3/136: read d2/d22/f29 [2758856,18974] 0 2024-09-21T10:40:42.743 INFO:tasks.workunit.client.1.smithi112.stdout:3/137: stat d2/c28 0 2024-09-21T10:40:42.747 INFO:tasks.workunit.client.1.smithi112.stdout:4/165: unlink de/cf 0 2024-09-21T10:40:42.749 INFO:tasks.workunit.client.0.smithi060.stdout:7/9: write f0 [666432,112367] 0 2024-09-21T10:40:42.749 INFO:tasks.workunit.client.1.smithi112.stdout:9/147: unlink d1/d2/d1c/f26 0 2024-09-21T10:40:42.750 INFO:tasks.workunit.client.1.smithi112.stdout:9/148: dread - d1/d2/d1c/f2d zero size 2024-09-21T10:40:42.750 INFO:tasks.workunit.client.1.smithi112.stdout:9/149: write d1/d2/d27/f2f [842608,123149] 0 2024-09-21T10:40:42.751 INFO:tasks.workunit.client.1.smithi112.stdout:8/188: symlink d8/d9/dd/d2b/d31/l3f 0 2024-09-21T10:40:42.752 INFO:tasks.workunit.client.1.smithi112.stdout:0/196: truncate d3/d18/f22 2486557 0 2024-09-21T10:40:42.754 INFO:tasks.workunit.client.1.smithi112.stdout:3/138: symlink d2/d1f/d21/l2b 0 2024-09-21T10:40:42.755 INFO:tasks.workunit.client.1.smithi112.stdout:9/150: rename d1/d2/d1c/c2a to d1/c32 0 2024-09-21T10:40:42.756 INFO:tasks.workunit.client.1.smithi112.stdout:0/197: mknod d3/d4/d1a/d21/c40 0 2024-09-21T10:40:42.757 INFO:tasks.workunit.client.1.smithi112.stdout:3/139: link d2/d22/f29 d2/d1f/f2c 0 2024-09-21T10:40:42.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/151: truncate d1/d2/f5 1578159 0 2024-09-21T10:40:42.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/152: creat d1/d2/d1c/f33 x:0 0 0 2024-09-21T10:40:42.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/153: chown d1/d2/f20 1565 1 2024-09-21T10:40:42.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/154: readlink d1/d2/d1c/l2b 0 2024-09-21T10:40:42.758 INFO:tasks.workunit.client.1.smithi112.stdout:0/198: link c2 d3/d18/c41 0 2024-09-21T10:40:42.758 INFO:tasks.workunit.client.1.smithi112.stdout:0/199: creat d3/d18/f42 x:0 0 0 2024-09-21T10:40:42.758 INFO:tasks.workunit.client.1.smithi112.stdout:3/140: mknod d2/c2d 0 2024-09-21T10:40:42.760 INFO:tasks.workunit.client.1.smithi112.stdout:4/166: dread de/f14 [0,4194304] 0 2024-09-21T10:40:42.762 INFO:tasks.workunit.client.1.smithi112.stdout:0/200: mkdir d3/d4/d43 0 2024-09-21T10:40:42.763 INFO:tasks.workunit.client.1.smithi112.stdout:3/141: symlink d2/d1f/l2e 0 2024-09-21T10:40:42.763 INFO:tasks.workunit.client.1.smithi112.stdout:9/155: mknod d1/d2/c34 0 2024-09-21T10:40:42.764 INFO:tasks.workunit.client.1.smithi112.stdout:9/156: read d1/d2/d1c/d16/f1f [28357,100] 0 2024-09-21T10:40:42.764 INFO:tasks.workunit.client.1.smithi112.stdout:4/167: mkdir de/d18/d3a 0 2024-09-21T10:40:42.764 INFO:tasks.workunit.client.1.smithi112.stdout:4/168: fsync de/f12 0 2024-09-21T10:40:42.765 INFO:tasks.workunit.client.1.smithi112.stdout:9/157: mknod d1/d2/d15/c35 0 2024-09-21T10:40:42.766 INFO:tasks.workunit.client.1.smithi112.stdout:3/142: write d2/f17 [1464473,40862] 0 2024-09-21T10:40:42.766 INFO:tasks.workunit.client.1.smithi112.stdout:9/158: creat d1/f36 x:0 0 0 2024-09-21T10:40:42.766 INFO:tasks.workunit.client.0.smithi060.stdout:4/4: dwrite d0/f1 [0,4194304] 0 2024-09-21T10:40:42.767 INFO:tasks.workunit.client.1.smithi112.stdout:2/166: dwrite d0/f2d [0,4194304] 0 2024-09-21T10:40:42.767 INFO:tasks.workunit.client.1.smithi112.stdout:4/169: getdents de/d2e 0 2024-09-21T10:40:42.767 INFO:tasks.workunit.client.1.smithi112.stdout:4/170: creat de/d33/d2f/d35/f3b x:0 0 0 2024-09-21T10:40:42.767 INFO:tasks.workunit.client.1.smithi112.stdout:4/171: stat de/f11 0 2024-09-21T10:40:42.767 INFO:tasks.workunit.client.0.smithi060.stdout:6/4: dwrite f0 [0,4194304] 0 2024-09-21T10:40:42.768 INFO:tasks.workunit.client.1.smithi112.stdout:3/143: mkdir d2/d2f 0 2024-09-21T10:40:42.771 INFO:tasks.workunit.client.0.smithi060.stdout:8/7: dwrite f1 [0,4194304] 0 2024-09-21T10:40:42.772 INFO:tasks.workunit.client.1.smithi112.stdout:0/201: write d3/f2b [5870855,124758] 0 2024-09-21T10:40:42.772 INFO:tasks.workunit.client.1.smithi112.stdout:0/202: fdatasync d3/d4/f38 0 2024-09-21T10:40:42.772 INFO:tasks.workunit.client.1.smithi112.stdout:0/203: read - d3/d18/f3b zero size 2024-09-21T10:40:42.774 INFO:tasks.workunit.client.1.smithi112.stdout:8/189: dwrite d8/d9/fb [0,4194304] 0 2024-09-21T10:40:42.774 INFO:tasks.workunit.client.0.smithi060.stdout:7/10: fsync f0 0 2024-09-21T10:40:42.776 INFO:tasks.workunit.client.0.smithi060.stdout:9/12: fsync f0 0 2024-09-21T10:40:42.776 INFO:tasks.workunit.client.0.smithi060.stdout:4/5: dread d0/f1 [0,4194304] 0 2024-09-21T10:40:42.778 INFO:tasks.workunit.client.1.smithi112.stdout:2/167: symlink d0/dd/d33/l34 0 2024-09-21T10:40:42.778 INFO:tasks.workunit.client.1.smithi112.stdout:2/168: read d0/f6 [2149338,87636] 0 2024-09-21T10:40:42.782 INFO:tasks.workunit.client.1.smithi112.stdout:4/172: truncate de/d18/f25 61701 0 2024-09-21T10:40:42.785 INFO:tasks.workunit.client.0.smithi060.stdout:8/8: dread f1 [0,4194304] 0 2024-09-21T10:40:42.786 INFO:tasks.workunit.client.0.smithi060.stdout:7/11: fsync f1 0 2024-09-21T10:40:42.786 INFO:tasks.workunit.client.0.smithi060.stdout:7/12: chown f1 31128 1 2024-09-21T10:40:42.786 INFO:tasks.workunit.client.0.smithi060.stdout:7/13: chown f0 2132 1 2024-09-21T10:40:42.786 INFO:tasks.workunit.client.0.smithi060.stdout:7/14: dread - f1 zero size 2024-09-21T10:40:42.786 INFO:tasks.workunit.client.0.smithi060.stdout:7/15: write f1 [719712,120165] 0 2024-09-21T10:40:42.788 INFO:tasks.workunit.client.0.smithi060.stdout:9/13: symlink d3/l7 0 2024-09-21T10:40:42.790 INFO:tasks.workunit.client.1.smithi112.stdout:8/190: symlink d8/d9/l40 0 2024-09-21T10:40:42.791 INFO:tasks.workunit.client.0.smithi060.stdout:4/6: mkdir d0/d3 0 2024-09-21T10:40:42.791 INFO:tasks.workunit.client.0.smithi060.stdout:4/7: chown d0 1164 1 2024-09-21T10:40:42.793 INFO:tasks.workunit.client.1.smithi112.stdout:2/169: creat d0/d12/d26/f35 x:0 0 0 2024-09-21T10:40:42.793 INFO:tasks.workunit.client.1.smithi112.stdout:2/170: fdatasync d0/f25 0 2024-09-21T10:40:42.796 INFO:tasks.workunit.client.0.smithi060.stdout:6/5: rename f0 to f2 0 2024-09-21T10:40:42.796 INFO:tasks.workunit.client.0.smithi060.stdout:6/6: stat l1 0 2024-09-21T10:40:42.796 INFO:tasks.workunit.client.0.smithi060.stdout:4/8: dread d0/f1 [0,4194304] 0 2024-09-21T10:40:42.798 INFO:tasks.workunit.client.0.smithi060.stdout:8/9: mkdir d2 0 2024-09-21T10:40:42.799 INFO:tasks.workunit.client.1.smithi112.stdout:8/191: rename d8/f3d to d8/d9/dd/d2b/d31/f41 0 2024-09-21T10:40:42.800 INFO:tasks.workunit.client.0.smithi060.stdout:7/16: symlink l2 0 2024-09-21T10:40:42.800 INFO:tasks.workunit.client.0.smithi060.stdout:7/17: creat f3 x:0 0 0 2024-09-21T10:40:42.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/171: unlink d0/d12/d1b/f20 0 2024-09-21T10:40:42.802 INFO:tasks.workunit.client.1.smithi112.stdout:4/173: dwrite de/f10 [0,4194304] 0 2024-09-21T10:40:42.802 INFO:tasks.workunit.client.0.smithi060.stdout:8/10: read f1 [2568093,76038] 0 2024-09-21T10:40:42.803 INFO:tasks.workunit.client.1.smithi112.stdout:4/174: dread f5 [0,4194304] 0 2024-09-21T10:40:42.804 INFO:tasks.workunit.client.0.smithi060.stdout:9/14: mknod d3/c8 0 2024-09-21T10:40:42.804 INFO:tasks.workunit.client.1.smithi112.stdout:8/192: rmdir d8/d9 39 2024-09-21T10:40:42.805 INFO:tasks.workunit.client.1.smithi112.stdout:8/193: readlink d8/d9/dd/d2b/l3a 0 2024-09-21T10:40:42.805 INFO:tasks.workunit.client.0.smithi060.stdout:9/15: dread f0 [0,4194304] 0 2024-09-21T10:40:42.805 INFO:tasks.workunit.client.0.smithi060.stdout:9/16: dread f0 [0,4194304] 0 2024-09-21T10:40:42.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/7: unlink l1 0 2024-09-21T10:40:42.809 INFO:tasks.workunit.client.1.smithi112.stdout:2/172: creat d0/d12/d1b/f36 x:0 0 0 2024-09-21T10:40:42.812 INFO:tasks.workunit.client.1.smithi112.stdout:3/144: truncate d2/f14 1759785 0 2024-09-21T10:40:42.815 INFO:tasks.workunit.client.1.smithi112.stdout:8/194: getdents d8/d9/dd 0 2024-09-21T10:40:42.817 INFO:tasks.workunit.client.1.smithi112.stdout:2/173: link d0/d12/d26/f17 d0/dd/d33/f37 0 2024-09-21T10:40:42.817 INFO:tasks.workunit.client.1.smithi112.stdout:2/174: stat d0/d12 0 2024-09-21T10:40:42.819 INFO:tasks.workunit.client.0.smithi060.stdout:8/11: creat d2/f3 x:0 0 0 2024-09-21T10:40:42.819 INFO:tasks.workunit.client.0.smithi060.stdout:8/12: chown d2 1186850 1 2024-09-21T10:40:42.820 INFO:tasks.workunit.client.1.smithi112.stdout:3/145: rename d2/f27 to d2/d2f/f30 0 2024-09-21T10:40:42.821 INFO:tasks.workunit.client.1.smithi112.stdout:3/146: readlink d2/d1f/l24 0 2024-09-21T10:40:42.822 INFO:tasks.workunit.client.1.smithi112.stdout:8/195: stat d8/c17 0 2024-09-21T10:40:42.822 INFO:tasks.workunit.client.1.smithi112.stdout:8/196: fdatasync d8/d18/f24 0 2024-09-21T10:40:42.824 INFO:tasks.workunit.client.0.smithi060.stdout:6/8: dwrite f2 [0,4194304] 0 2024-09-21T10:40:42.824 INFO:tasks.workunit.client.0.smithi060.stdout:6/9: readlink - no filename 2024-09-21T10:40:42.824 INFO:tasks.workunit.client.1.smithi112.stdout:2/175: mkdir d0/d12/d26/d38 0 2024-09-21T10:40:42.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/17: truncate f0 543801 0 2024-09-21T10:40:42.831 INFO:tasks.workunit.client.1.smithi112.stdout:8/197: dread d8/f14 [0,4194304] 0 2024-09-21T10:40:42.832 INFO:tasks.workunit.client.0.smithi060.stdout:9/18: creat d3/f9 x:0 0 0 2024-09-21T10:40:42.832 INFO:tasks.workunit.client.0.smithi060.stdout:9/19: dread - d3/f9 zero size 2024-09-21T10:40:42.835 INFO:tasks.workunit.client.1.smithi112.stdout:3/147: rename d2/d1f/d21 to d2/d22/d31 0 2024-09-21T10:40:42.835 INFO:tasks.workunit.client.1.smithi112.stdout:3/148: write d2/f18 [483176,72128] 0 2024-09-21T10:40:42.836 INFO:tasks.workunit.client.1.smithi112.stdout:3/149: symlink d2/d22/d31/d2a/l32 0 2024-09-21T10:40:42.836 INFO:tasks.workunit.client.1.smithi112.stdout:3/150: fdatasync f1 0 2024-09-21T10:40:42.837 INFO:tasks.workunit.client.1.smithi112.stdout:3/151: chown d2/d1f 3876 1 2024-09-21T10:40:42.837 INFO:tasks.workunit.client.0.smithi060.stdout:4/9: truncate d0/f2 1587880 0 2024-09-21T10:40:42.838 INFO:tasks.workunit.client.0.smithi060.stdout:6/10: dread f2 [0,4194304] 0 2024-09-21T10:40:42.840 INFO:tasks.workunit.client.1.smithi112.stdout:2/176: dwrite d0/d12/d1b/f36 [0,4194304] 0 2024-09-21T10:40:42.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/177: unlink d0/fb 0 2024-09-21T10:40:42.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/178: stat d0/f11 0 2024-09-21T10:40:42.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/179: write d0/d12/d26/f17 [3592540,55594] 0 2024-09-21T10:40:42.850 INFO:tasks.workunit.client.0.smithi060.stdout:8/13: truncate f1 2374516 0 2024-09-21T10:40:42.850 INFO:tasks.workunit.client.0.smithi060.stdout:8/14: readlink - no filename 2024-09-21T10:40:42.853 INFO:tasks.workunit.client.0.smithi060.stdout:6/11: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:42.879 INFO:tasks.workunit.client.1.smithi112.stdout:2/180: dwrite d0/f6 [4194304,4194304] 0 2024-09-21T10:40:42.880 INFO:tasks.workunit.client.1.smithi112.stdout:2/181: creat d0/d12/f39 x:0 0 0 2024-09-21T10:40:42.881 INFO:tasks.workunit.client.1.smithi112.stdout:2/182: truncate d0/d12/d1b/f36 3558029 0 2024-09-21T10:40:42.881 INFO:tasks.workunit.client.1.smithi112.stdout:2/183: chown d0/d12/d26/l1c 2674396 1 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:6/12: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:9/20: dwrite f0 [0,4194304] 0 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:8/15: dread f1 [0,4194304] 0 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:9/21: truncate d3/f9 874595 0 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:9/22: chown d3/c8 2337 1 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:9/23: creat d3/fa x:0 0 0 2024-09-21T10:40:42.883 INFO:tasks.workunit.client.0.smithi060.stdout:9/24: creat d3/fb x:0 0 0 2024-09-21T10:40:42.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/16: symlink d2/l4 0 2024-09-21T10:40:42.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/17: write f1 [1407008,18028] 0 2024-09-21T10:40:42.890 INFO:tasks.workunit.client.0.smithi060.stdout:8/18: chown d2/f3 133 1 2024-09-21T10:40:42.890 INFO:tasks.workunit.client.0.smithi060.stdout:8/19: creat d2/f5 x:0 0 0 2024-09-21T10:40:42.892 INFO:tasks.workunit.client.0.smithi060.stdout:4/10: truncate d0/f1 1494266 0 2024-09-21T10:40:42.892 INFO:tasks.workunit.client.0.smithi060.stdout:4/11: chown d0/f1 22221 1 2024-09-21T10:40:42.892 INFO:tasks.workunit.client.0.smithi060.stdout:4/12: rmdir d0/d3 0 2024-09-21T10:40:42.897 INFO:tasks.workunit.client.1.smithi112.stdout:2/184: dread d0/f2 [0,4194304] 0 2024-09-21T10:40:42.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/185: getdents d0/d12 0 2024-09-21T10:40:42.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/186: write d0/f11 [1721308,92426] 0 2024-09-21T10:40:42.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/187: symlink d0/l3a 0 2024-09-21T10:40:42.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/188: creat d0/dd/f3b x:0 0 0 2024-09-21T10:40:42.907 INFO:tasks.workunit.client.0.smithi060.stdout:9/25: dwrite d3/fa [0,4194304] 0 2024-09-21T10:40:42.910 INFO:tasks.workunit.client.0.smithi060.stdout:9/26: rename f0 to d3/fc 0 2024-09-21T10:40:42.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/27: mknod d3/cd 0 2024-09-21T10:40:42.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/28: chown d3 330 1 2024-09-21T10:40:42.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/29: creat d3/fe x:0 0 0 2024-09-21T10:40:42.911 INFO:tasks.workunit.client.1.smithi112.stdout:2/189: getdents d0/dd 0 2024-09-21T10:40:42.924 INFO:tasks.workunit.client.0.smithi060.stdout:4/13: dwrite d0/f1 [0,4194304] 0 2024-09-21T10:40:42.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/20: dwrite d2/f3 [0,4194304] 0 2024-09-21T10:40:42.926 INFO:tasks.workunit.client.0.smithi060.stdout:4/14: link d0/f1 d0/f4 0 2024-09-21T10:40:42.926 INFO:tasks.workunit.client.1.smithi112.stdout:9/159: dwrite d1/d2/d1c/f2d [0,4194304] 0 2024-09-21T10:40:42.928 INFO:tasks.workunit.client.0.smithi060.stdout:9/30: truncate d3/fa 1029825 0 2024-09-21T10:40:42.928 INFO:tasks.workunit.client.0.smithi060.stdout:9/31: creat d3/ff x:0 0 0 2024-09-21T10:40:42.928 INFO:tasks.workunit.client.0.smithi060.stdout:9/32: fsync d3/f9 0 2024-09-21T10:40:42.928 INFO:tasks.workunit.client.0.smithi060.stdout:9/33: creat d3/f10 x:0 0 0 2024-09-21T10:40:42.930 INFO:tasks.workunit.client.0.smithi060.stdout:8/21: symlink d2/l6 0 2024-09-21T10:40:42.932 INFO:tasks.workunit.client.0.smithi060.stdout:4/15: mkdir d0/d5 0 2024-09-21T10:40:42.934 INFO:tasks.workunit.client.1.smithi112.stdout:9/160: mkdir d1/d2/d27/d37 0 2024-09-21T10:40:42.936 INFO:tasks.workunit.client.1.smithi112.stdout:0/204: dwrite d3/f20 [0,4194304] 0 2024-09-21T10:40:42.936 INFO:tasks.workunit.client.1.smithi112.stdout:0/205: stat d3/d4/lf 0 2024-09-21T10:40:42.936 INFO:tasks.workunit.client.1.smithi112.stdout:0/206: stat d3/d23/f29 0 2024-09-21T10:40:42.937 INFO:tasks.workunit.client.1.smithi112.stdout:8/198: write d8/d9/fb [697102,73793] 0 2024-09-21T10:40:42.937 INFO:tasks.workunit.client.1.smithi112.stdout:8/199: write d8/d18/f27 [801271,57479] 0 2024-09-21T10:40:42.939 INFO:tasks.workunit.client.0.smithi060.stdout:9/34: mknod d3/c11 0 2024-09-21T10:40:42.941 INFO:tasks.workunit.client.0.smithi060.stdout:4/16: write d0/f2 [2776356,106484] 0 2024-09-21T10:40:42.941 INFO:tasks.workunit.client.0.smithi060.stdout:4/17: creat d0/f6 x:0 0 0 2024-09-21T10:40:42.942 INFO:tasks.workunit.client.1.smithi112.stdout:4/175: dread de/f11 [0,4194304] 0 2024-09-21T10:40:42.944 INFO:tasks.workunit.client.1.smithi112.stdout:8/200: dread f3 [0,4194304] 0 2024-09-21T10:40:42.977 INFO:tasks.workunit.client.1.smithi112.stdout:9/161: dwrite d1/d2/d15/f21 [0,4194304] 0 2024-09-21T10:40:42.979 INFO:tasks.workunit.client.0.smithi060.stdout:8/22: unlink d2/f5 0 2024-09-21T10:40:42.982 INFO:tasks.workunit.client.1.smithi112.stdout:3/152: dread d2/f1b [0,4194304] 0 2024-09-21T10:40:42.982 INFO:tasks.workunit.client.1.smithi112.stdout:0/207: creat d3/d4/d43/f44 x:0 0 0 2024-09-21T10:40:42.983 INFO:tasks.workunit.client.0.smithi060.stdout:9/35: mknod d3/c12 0 2024-09-21T10:40:42.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/190: write d0/d12/d26/f1a [2808978,18719] 0 2024-09-21T10:40:42.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/191: getdents d0/d12/d26/d38 0 2024-09-21T10:40:42.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/192: dread - d0/dd/f30 zero size 2024-09-21T10:40:42.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/193: dread - d0/f2f zero size 2024-09-21T10:40:42.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/194: write d0/d12/f28 [761374,25173] 0 2024-09-21T10:40:42.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/195: chown d0/fe 0 1 2024-09-21T10:40:42.988 INFO:tasks.workunit.client.0.smithi060.stdout:8/23: mknod d2/c7 0 2024-09-21T10:40:42.988 INFO:tasks.workunit.client.0.smithi060.stdout:8/24: write f1 [2168873,81288] 0 2024-09-21T10:40:42.988 INFO:tasks.workunit.client.0.smithi060.stdout:8/25: fdatasync d2/f3 0 2024-09-21T10:40:42.989 INFO:tasks.workunit.client.1.smithi112.stdout:3/153: dread f0 [0,4194304] 0 2024-09-21T10:40:42.993 INFO:tasks.workunit.client.1.smithi112.stdout:4/176: mkdir de/d33/d3c 0 2024-09-21T10:40:42.993 INFO:tasks.workunit.client.1.smithi112.stdout:4/177: fdatasync de/d33/f38 0 2024-09-21T10:40:42.993 INFO:tasks.workunit.client.0.smithi060.stdout:4/18: getdents d0 0 2024-09-21T10:40:42.996 INFO:tasks.workunit.client.1.smithi112.stdout:0/208: mkdir d3/d18/d45 0 2024-09-21T10:40:42.997 INFO:tasks.workunit.client.1.smithi112.stdout:2/196: creat d0/d12/d1b/f3c x:0 0 0 2024-09-21T10:40:42.997 INFO:tasks.workunit.client.1.smithi112.stdout:2/197: write d0/dd/f2e [774717,79856] 0 2024-09-21T10:40:42.999 INFO:tasks.workunit.client.1.smithi112.stdout:3/154: mkdir d2/d2f/d33 0 2024-09-21T10:40:42.999 INFO:tasks.workunit.client.1.smithi112.stdout:3/155: write d2/d1f/f2c [2882341,73863] 0 2024-09-21T10:40:42.999 INFO:tasks.workunit.client.1.smithi112.stdout:0/209: mkdir d3/d4/d1a/d21/d46 0 2024-09-21T10:40:43.002 INFO:tasks.workunit.client.1.smithi112.stdout:0/210: link d3/d4/d10/c16 d3/d4/d10/c47 0 2024-09-21T10:40:43.002 INFO:tasks.workunit.client.1.smithi112.stdout:0/211: dread - d3/d18/f3b zero size 2024-09-21T10:40:43.002 INFO:tasks.workunit.client.1.smithi112.stdout:0/212: creat d3/d18/f48 x:0 0 0 2024-09-21T10:40:43.002 INFO:tasks.workunit.client.1.smithi112.stdout:4/178: dread de/f24 [0,4194304] 0 2024-09-21T10:40:43.003 INFO:tasks.workunit.client.1.smithi112.stdout:3/156: read f0 [3738137,41072] 0 2024-09-21T10:40:43.003 INFO:tasks.workunit.client.1.smithi112.stdout:0/213: mknod d3/d23/c49 0 2024-09-21T10:40:43.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/179: rename de/d18/d3a to de/d2a/d3d 0 2024-09-21T10:40:43.006 INFO:tasks.workunit.client.1.smithi112.stdout:0/214: mkdir d3/d4a 0 2024-09-21T10:40:43.008 INFO:tasks.workunit.client.1.smithi112.stdout:0/215: truncate d3/d23/f26 6185543 0 2024-09-21T10:40:43.008 INFO:tasks.workunit.client.1.smithi112.stdout:3/157: dread f0 [0,4194304] 0 2024-09-21T10:40:43.009 INFO:tasks.workunit.client.1.smithi112.stdout:4/180: dread de/f14 [0,4194304] 0 2024-09-21T10:40:43.009 INFO:tasks.workunit.client.1.smithi112.stdout:0/216: mknod d3/d4/c4b 0 2024-09-21T10:40:43.009 INFO:tasks.workunit.client.1.smithi112.stdout:0/217: fdatasync d3/d4/d10/f3c 0 2024-09-21T10:40:43.011 INFO:tasks.workunit.client.1.smithi112.stdout:4/181: rmdir de/d2a/d31/d39 0 2024-09-21T10:40:43.011 INFO:tasks.workunit.client.1.smithi112.stdout:4/182: dread - de/d33/f38 zero size 2024-09-21T10:40:43.012 INFO:tasks.workunit.client.1.smithi112.stdout:2/198: fdatasync d0/dd/f2e 0 2024-09-21T10:40:43.012 INFO:tasks.workunit.client.1.smithi112.stdout:2/199: chown d0/f10 33 1 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/218: mknod d3/d18/c4c 0 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/219: truncate d3/d4/f38 542323 0 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/220: write d3/d4/f1d [5819142,83401] 0 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/221: creat d3/d4/d1a/d21/f4d x:0 0 0 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/222: chown d3/d23 14968285 1 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:0/223: readlink d3/d23/l2f 0 2024-09-21T10:40:43.013 INFO:tasks.workunit.client.1.smithi112.stdout:4/183: mkdir de/d2a/d3d/d3e 0 2024-09-21T10:40:43.014 INFO:tasks.workunit.client.1.smithi112.stdout:4/184: creat de/d18/f3f x:0 0 0 2024-09-21T10:40:43.014 INFO:tasks.workunit.client.1.smithi112.stdout:4/185: truncate de/d18/f3f 183202 0 2024-09-21T10:40:43.015 INFO:tasks.workunit.client.1.smithi112.stdout:2/200: creat d0/d12/f3d x:0 0 0 2024-09-21T10:40:43.017 INFO:tasks.workunit.client.1.smithi112.stdout:2/201: fdatasync d0/d12/f28 0 2024-09-21T10:40:43.017 INFO:tasks.workunit.client.1.smithi112.stdout:2/202: readlink d0/d12/d26/l1c 0 2024-09-21T10:40:43.017 INFO:tasks.workunit.client.1.smithi112.stdout:2/203: chown d0/d12/d1b/f3c 0 1 2024-09-21T10:40:43.020 INFO:tasks.workunit.client.1.smithi112.stdout:4/186: mkdir de/d34/d40 0 2024-09-21T10:40:43.020 INFO:tasks.workunit.client.1.smithi112.stdout:2/204: write d0/dd/f29 [20200,73659] 0 2024-09-21T10:40:43.020 INFO:tasks.workunit.client.1.smithi112.stdout:2/205: dread - d0/d12/f3d zero size 2024-09-21T10:40:43.022 INFO:tasks.workunit.client.1.smithi112.stdout:4/187: symlink de/d2a/d3d/d3e/l41 0 2024-09-21T10:40:43.023 INFO:tasks.workunit.client.1.smithi112.stdout:2/206: creat d0/dd/d33/f3e x:0 0 0 2024-09-21T10:40:43.024 INFO:tasks.workunit.client.1.smithi112.stdout:3/158: dwrite d2/ff [4194304,4194304] 0 2024-09-21T10:40:43.025 INFO:tasks.workunit.client.1.smithi112.stdout:4/188: rename de/d18/f19 to de/d2a/d3d/f42 0 2024-09-21T10:40:43.027 INFO:tasks.workunit.client.1.smithi112.stdout:2/207: dread d0/f25 [0,4194304] 0 2024-09-21T10:40:43.028 INFO:tasks.workunit.client.1.smithi112.stdout:3/159: mknod d2/c34 0 2024-09-21T10:40:43.030 INFO:tasks.workunit.client.1.smithi112.stdout:4/189: rmdir de/d33/d3c 0 2024-09-21T10:40:43.032 INFO:tasks.workunit.client.1.smithi112.stdout:2/208: rename d0/d12/d1b/f36 to d0/d12/d26/d38/f3f 0 2024-09-21T10:40:43.034 INFO:tasks.workunit.client.1.smithi112.stdout:4/190: mknod de/d2a/d3d/c43 0 2024-09-21T10:40:43.034 INFO:tasks.workunit.client.1.smithi112.stdout:4/191: fsync de/f15 0 2024-09-21T10:40:43.037 INFO:tasks.workunit.client.1.smithi112.stdout:2/209: rename d0/dd/d33/f3e to d0/dd/d33/f40 0 2024-09-21T10:40:43.040 INFO:tasks.workunit.client.1.smithi112.stdout:2/210: truncate d0/dd/d33/f37 3038290 0 2024-09-21T10:40:43.045 INFO:tasks.workunit.client.1.smithi112.stdout:7/149: sync 2024-09-21T10:40:43.045 INFO:tasks.workunit.client.1.smithi112.stdout:1/267: sync 2024-09-21T10:40:43.045 INFO:tasks.workunit.client.1.smithi112.stdout:6/231: sync 2024-09-21T10:40:43.045 INFO:tasks.workunit.client.1.smithi112.stdout:1/268: chown d8/fe 164435130 1 2024-09-21T10:40:43.045 INFO:tasks.workunit.client.1.smithi112.stdout:6/232: fdatasync d4/d6/da/d11/d37/d19/f2e 0 2024-09-21T10:40:43.046 INFO:tasks.workunit.client.1.smithi112.stdout:5/211: sync 2024-09-21T10:40:43.047 INFO:tasks.workunit.client.1.smithi112.stdout:7/150: creat d7/d22/f2e x:0 0 0 2024-09-21T10:40:43.048 INFO:tasks.workunit.client.1.smithi112.stdout:6/233: rename d4/d6/da/d11/c1b to d4/d6/da/d11/d1f/d22/c5b 0 2024-09-21T10:40:43.048 INFO:tasks.workunit.client.1.smithi112.stdout:6/234: chown d4/d6/da/d11/d37/d19/l24 2047525968 1 2024-09-21T10:40:43.049 INFO:tasks.workunit.client.1.smithi112.stdout:6/235: readlink d4/d6/da/l30 0 2024-09-21T10:40:43.049 INFO:tasks.workunit.client.1.smithi112.stdout:6/236: dread - d4/d3e/f4c zero size 2024-09-21T10:40:43.049 INFO:tasks.workunit.client.1.smithi112.stdout:6/237: write d4/d6/da/d11/d1f/d22/f58 [720270,60087] 0 2024-09-21T10:40:43.049 INFO:tasks.workunit.client.1.smithi112.stdout:6/238: truncate d4/d6/f40 19001 0 2024-09-21T10:40:43.049 INFO:tasks.workunit.client.1.smithi112.stdout:5/212: mknod d9/d15/d1d/c41 0 2024-09-21T10:40:43.049 INFO:tasks.workunit.client.1.smithi112.stdout:5/213: write d9/f1b [536811,77183] 0 2024-09-21T10:40:43.050 INFO:tasks.workunit.client.1.smithi112.stdout:7/151: mknod d7/d22/c2f 0 2024-09-21T10:40:43.050 INFO:tasks.workunit.client.1.smithi112.stdout:5/214: dread d9/f12 [0,4194304] 0 2024-09-21T10:40:43.050 INFO:tasks.workunit.client.1.smithi112.stdout:5/215: readlink d9/d15/l19 0 2024-09-21T10:40:43.051 INFO:tasks.workunit.client.1.smithi112.stdout:5/216: chown l0 105798399 1 2024-09-21T10:40:43.051 INFO:tasks.workunit.client.1.smithi112.stdout:5/217: write d9/d15/d18/f39 [81814,36847] 0 2024-09-21T10:40:43.051 INFO:tasks.workunit.client.1.smithi112.stdout:7/152: symlink d7/d22/l30 0 2024-09-21T10:40:43.051 INFO:tasks.workunit.client.1.smithi112.stdout:7/153: creat d7/d22/f31 x:0 0 0 2024-09-21T10:40:43.052 INFO:tasks.workunit.client.1.smithi112.stdout:7/154: write f6 [770388,24837] 0 2024-09-21T10:40:43.053 INFO:tasks.workunit.client.1.smithi112.stdout:7/155: symlink d7/l32 0 2024-09-21T10:40:43.057 INFO:tasks.workunit.client.1.smithi112.stdout:3/160: truncate d2/ff 3054105 0 2024-09-21T10:40:43.057 INFO:tasks.workunit.client.1.smithi112.stdout:3/161: truncate d2/d2f/f30 314808 0 2024-09-21T10:40:43.062 INFO:tasks.workunit.client.1.smithi112.stdout:7/156: dread d7/f1c [0,4194304] 0 2024-09-21T10:40:43.063 INFO:tasks.workunit.client.1.smithi112.stdout:7/157: rename d7/f16 to d7/d22/f33 0 2024-09-21T10:40:43.079 INFO:tasks.workunit.client.1.smithi112.stdout:7/158: dread d7/d22/f23 [0,4194304] 0 2024-09-21T10:40:43.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/269: dwrite d8/d45/f59 [0,4194304] 0 2024-09-21T10:40:43.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/270: creat d8/d1a/d53/f60 x:0 0 0 2024-09-21T10:40:43.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/271: chown d8/f14 535 1 2024-09-21T10:40:43.081 INFO:tasks.workunit.client.1.smithi112.stdout:6/239: dwrite d4/dc/d1a/d31/d3c/f52 [0,4194304] 0 2024-09-21T10:40:43.081 INFO:tasks.workunit.client.1.smithi112.stdout:6/240: readlink d4/d6/lf 0 2024-09-21T10:40:43.083 INFO:tasks.workunit.client.1.smithi112.stdout:1/272: unlink d8/f14 0 2024-09-21T10:40:43.085 INFO:tasks.workunit.client.1.smithi112.stdout:6/241: symlink d4/dc/d1a/d31/l5c 0 2024-09-21T10:40:43.086 INFO:tasks.workunit.client.1.smithi112.stdout:1/273: truncate d8/f9 3209680 0 2024-09-21T10:40:43.087 INFO:tasks.workunit.client.1.smithi112.stdout:6/242: rename d4/dc/d1a/f5a to d4/d4f/f5d 0 2024-09-21T10:40:43.088 INFO:tasks.workunit.client.1.smithi112.stdout:1/274: symlink d8/d1a/d53/d57/l61 0 2024-09-21T10:40:43.088 INFO:tasks.workunit.client.1.smithi112.stdout:1/275: fdatasync d8/f18 0 2024-09-21T10:40:43.089 INFO:tasks.workunit.client.1.smithi112.stdout:6/243: getdents d4/d6/da/d11 0 2024-09-21T10:40:43.090 INFO:tasks.workunit.client.1.smithi112.stdout:1/276: creat d8/d1a/f62 x:0 0 0 2024-09-21T10:40:43.090 INFO:tasks.workunit.client.1.smithi112.stdout:1/277: truncate d8/f3a 933869 0 2024-09-21T10:40:43.091 INFO:tasks.workunit.client.1.smithi112.stdout:1/278: rename d8/d20/f3f to d8/f63 0 2024-09-21T10:40:43.092 INFO:tasks.workunit.client.1.smithi112.stdout:1/279: write d8/f63 [5020059,84104] 0 2024-09-21T10:40:43.093 INFO:tasks.workunit.client.1.smithi112.stdout:1/280: mknod d8/d20/c64 0 2024-09-21T10:40:43.095 INFO:tasks.workunit.client.1.smithi112.stdout:1/281: getdents d8/d1a/d53 0 2024-09-21T10:40:43.095 INFO:tasks.workunit.client.1.smithi112.stdout:1/282: fdatasync d8/f15 0 2024-09-21T10:40:43.095 INFO:tasks.workunit.client.1.smithi112.stdout:1/283: fsync d8/d1a/d31/d37/f5e 0 2024-09-21T10:40:43.095 INFO:tasks.workunit.client.1.smithi112.stdout:1/284: chown d8/d1a/d31/c50 7 1 2024-09-21T10:40:43.096 INFO:tasks.workunit.client.1.smithi112.stdout:1/285: link d8/d20/f5b d8/f65 0 2024-09-21T10:40:43.097 INFO:tasks.workunit.client.1.smithi112.stdout:1/286: unlink d8/d1a/l41 0 2024-09-21T10:40:43.098 INFO:tasks.workunit.client.1.smithi112.stdout:1/287: mkdir d8/d1a/d31/d66 0 2024-09-21T10:40:43.098 INFO:tasks.workunit.client.1.smithi112.stdout:1/288: creat d8/d1a/f67 x:0 0 0 2024-09-21T10:40:43.107 INFO:tasks.workunit.client.1.smithi112.stdout:6/244: dwrite d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:43.116 INFO:tasks.workunit.client.1.smithi112.stdout:1/289: dwrite d8/d1a/d31/f3e [0,4194304] 0 2024-09-21T10:40:43.118 INFO:tasks.workunit.client.1.smithi112.stdout:6/245: dread d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:43.118 INFO:tasks.workunit.client.1.smithi112.stdout:1/290: link d8/d1a/f3b d8/d1a/d31/f68 0 2024-09-21T10:40:43.120 INFO:tasks.workunit.client.1.smithi112.stdout:1/291: mknod d8/d1a/c69 0 2024-09-21T10:40:43.120 INFO:tasks.workunit.client.1.smithi112.stdout:1/292: write d8/d1a/d31/d37/f5e [1269123,34632] 0 2024-09-21T10:40:43.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/293: truncate d8/d1a/f1e 912109 0 2024-09-21T10:40:43.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/294: fdatasync d8/d1a/f1e 0 2024-09-21T10:40:43.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/295: readlink d8/d1a/l43 0 2024-09-21T10:40:43.122 INFO:tasks.workunit.client.1.smithi112.stdout:1/296: mknod d8/d45/c6a 0 2024-09-21T10:40:43.123 INFO:tasks.workunit.client.1.smithi112.stdout:1/297: stat d8/d20/f5b 0 2024-09-21T10:40:43.123 INFO:tasks.workunit.client.1.smithi112.stdout:1/298: fsync d8/f17 0 2024-09-21T10:40:43.126 INFO:tasks.workunit.client.1.smithi112.stdout:6/246: read d4/dc/f3f [1944131,119526] 0 2024-09-21T10:40:43.466 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:43 smithi112 ceph-mon[35117]: pgmap v8: 65 pgs: 65 active+clean; 266 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 9.2 MiB/s wr, 620 op/s 2024-09-21T10:40:43.466 INFO:tasks.workunit.client.1.smithi112.stdout:0/224: dread d3/d4/d10/f24 [4194304,4194304] 0 2024-09-21T10:40:43.468 INFO:tasks.workunit.client.1.smithi112.stdout:0/225: mkdir d3/d4a/d4e 0 2024-09-21T10:40:43.468 INFO:tasks.workunit.client.1.smithi112.stdout:0/226: readlink d3/d4/d1a/l2c 0 2024-09-21T10:40:43.469 INFO:tasks.workunit.client.1.smithi112.stdout:2/211: dwrite d0/dd/f30 [0,4194304] 0 2024-09-21T10:40:43.469 INFO:tasks.workunit.client.1.smithi112.stdout:2/212: creat d0/d12/f41 x:0 0 0 2024-09-21T10:40:43.470 INFO:tasks.workunit.client.1.smithi112.stdout:4/192: dwrite de/f12 [0,4194304] 0 2024-09-21T10:40:43.470 INFO:tasks.workunit.client.1.smithi112.stdout:0/227: unlink d3/d18/f48 0 2024-09-21T10:40:43.470 INFO:tasks.workunit.client.1.smithi112.stdout:0/228: readlink d3/d4/ld 0 2024-09-21T10:40:43.475 INFO:tasks.workunit.client.1.smithi112.stdout:5/218: dwrite d9/d15/f16 [0,4194304] 0 2024-09-21T10:40:43.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/229: mkdir d3/d4/d1a/d21/d4f 0 2024-09-21T10:40:43.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/230: chown d3/d18/f3b 102699514 1 2024-09-21T10:40:43.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/231: write d3/d4/d10/f24 [981403,40686] 0 2024-09-21T10:40:43.479 INFO:tasks.workunit.client.1.smithi112.stdout:5/219: rename d9/d15/d18/c2c to d9/d15/d18/d20/c42 0 2024-09-21T10:40:43.480 INFO:tasks.workunit.client.1.smithi112.stdout:0/232: creat d3/f50 x:0 0 0 2024-09-21T10:40:43.480 INFO:tasks.workunit.client.1.smithi112.stdout:0/233: read - d3/d4/f39 zero size 2024-09-21T10:40:43.483 INFO:tasks.workunit.client.1.smithi112.stdout:5/220: dread f3 [8388608,4194304] 0 2024-09-21T10:40:43.486 INFO:tasks.workunit.client.1.smithi112.stdout:0/234: symlink d3/d4/d43/l51 0 2024-09-21T10:40:43.488 INFO:tasks.workunit.client.1.smithi112.stdout:0/235: rename d3/d18/d37 to d3/d18/d52 0 2024-09-21T10:40:43.489 INFO:tasks.workunit.client.1.smithi112.stdout:6/247: dwrite d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:43.491 INFO:tasks.workunit.client.1.smithi112.stdout:0/236: mknod d3/d4/d10/c53 0 2024-09-21T10:40:43.491 INFO:tasks.workunit.client.1.smithi112.stdout:0/237: readlink d3/d4/l1e 0 2024-09-21T10:40:43.491 INFO:tasks.workunit.client.1.smithi112.stdout:0/238: creat d3/d23/f54 x:0 0 0 2024-09-21T10:40:43.494 INFO:tasks.workunit.client.1.smithi112.stdout:0/239: mkdir d3/d18/d52/d55 0 2024-09-21T10:40:43.494 INFO:tasks.workunit.client.1.smithi112.stdout:0/240: write d3/d4/f5 [1581915,69177] 0 2024-09-21T10:40:43.494 INFO:tasks.workunit.client.1.smithi112.stdout:0/241: truncate d3/d4/d1a/d21/f30 896937 0 2024-09-21T10:40:43.494 INFO:tasks.workunit.client.1.smithi112.stdout:0/242: mkdir d3/d4/d1a/d21/d56 0 2024-09-21T10:40:43.495 INFO:tasks.workunit.client.1.smithi112.stdout:0/243: read - d3/d4/f39 zero size 2024-09-21T10:40:43.495 INFO:tasks.workunit.client.1.smithi112.stdout:0/244: mkdir d3/d4/d1a/d21/d4f/d57 0 2024-09-21T10:40:43.496 INFO:tasks.workunit.client.1.smithi112.stdout:0/245: creat d3/d4/d1a/d21/d46/f58 x:0 0 0 2024-09-21T10:40:43.508 INFO:tasks.workunit.client.1.smithi112.stdout:4/193: dwrite de/d33/f30 [0,4194304] 0 2024-09-21T10:40:43.509 INFO:tasks.workunit.client.1.smithi112.stdout:7/159: dwrite d7/f14 [0,4194304] 0 2024-09-21T10:40:43.509 INFO:tasks.workunit.client.1.smithi112.stdout:7/160: fdatasync f5 0 2024-09-21T10:40:43.510 INFO:tasks.workunit.client.1.smithi112.stdout:7/161: stat d7/l21 0 2024-09-21T10:40:43.510 INFO:tasks.workunit.client.1.smithi112.stdout:0/246: dread d3/d4/fe [0,4194304] 0 2024-09-21T10:40:43.510 INFO:tasks.workunit.client.1.smithi112.stdout:0/247: creat d3/d4/d43/f59 x:0 0 0 2024-09-21T10:40:43.511 INFO:tasks.workunit.client.1.smithi112.stdout:0/248: dread d3/d4/fe [4194304,4194304] 0 2024-09-21T10:40:43.511 INFO:tasks.workunit.client.1.smithi112.stdout:0/249: chown d3/d4/d1a/l34 324 1 2024-09-21T10:40:43.512 INFO:tasks.workunit.client.1.smithi112.stdout:4/194: write de/d2e/f32 [727320,92191] 0 2024-09-21T10:40:43.512 INFO:tasks.workunit.client.1.smithi112.stdout:4/195: fdatasync de/f24 0 2024-09-21T10:40:43.513 INFO:tasks.workunit.client.1.smithi112.stdout:7/162: link d7/d22/f33 d7/f34 0 2024-09-21T10:40:43.516 INFO:tasks.workunit.client.1.smithi112.stdout:4/196: dread de/f14 [0,4194304] 0 2024-09-21T10:40:43.521 INFO:tasks.workunit.client.1.smithi112.stdout:1/299: dwrite d8/fe [0,4194304] 0 2024-09-21T10:40:43.524 INFO:tasks.workunit.client.1.smithi112.stdout:2/213: dwrite d0/dd/f2e [0,4194304] 0 2024-09-21T10:40:43.524 INFO:tasks.workunit.client.1.smithi112.stdout:5/221: dwrite d9/d15/d18/d20/f34 [0,4194304] 0 2024-09-21T10:40:43.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/248: dwrite d4/d6/da/f46 [0,4194304] 0 2024-09-21T10:40:43.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/249: write d4/d6/da/d11/d37/d19/d34/f48 [664942,61104] 0 2024-09-21T10:40:43.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/250: chown d4/d4f 333 1 2024-09-21T10:40:43.528 INFO:tasks.workunit.client.1.smithi112.stdout:4/197: dread de/f15 [0,4194304] 0 2024-09-21T10:40:43.528 INFO:tasks.workunit.client.1.smithi112.stdout:4/198: dread - de/d33/d2f/d35/f36 zero size 2024-09-21T10:40:43.528 INFO:tasks.workunit.client.1.smithi112.stdout:4/199: fdatasync f8 0 2024-09-21T10:40:43.530 INFO:tasks.workunit.client.1.smithi112.stdout:0/250: dwrite d3/f1b [0,4194304] 0 2024-09-21T10:40:43.530 INFO:tasks.workunit.client.1.smithi112.stdout:0/251: readlink d3/d4/ld 0 2024-09-21T10:40:43.530 INFO:tasks.workunit.client.1.smithi112.stdout:0/252: dread - d3/d4/d43/f59 zero size 2024-09-21T10:40:43.533 INFO:tasks.workunit.client.1.smithi112.stdout:5/222: link d9/d15/c1a d9/d15/d18/d20/c43 0 2024-09-21T10:40:43.536 INFO:tasks.workunit.client.1.smithi112.stdout:6/251: link d4/d6/da/d11/d37/d19/d34/f48 d4/d6/da/d11/d37/f5e 0 2024-09-21T10:40:43.537 INFO:tasks.workunit.client.1.smithi112.stdout:1/300: getdents d8/d20 0 2024-09-21T10:40:43.538 INFO:tasks.workunit.client.1.smithi112.stdout:1/301: read - d8/d1a/d31/d37/f47 zero size 2024-09-21T10:40:43.539 INFO:tasks.workunit.client.1.smithi112.stdout:4/200: symlink de/d34/d40/l44 0 2024-09-21T10:40:43.544 INFO:tasks.workunit.client.1.smithi112.stdout:6/252: rename d4/d6/da/d11/d37/c38 to d4/d6/da/d11/d37/d19/d34/c5f 0 2024-09-21T10:40:43.544 INFO:tasks.workunit.client.1.smithi112.stdout:6/253: chown d4/d6/da/d14/c21 3838 1 2024-09-21T10:40:43.546 INFO:tasks.workunit.client.1.smithi112.stdout:1/302: mknod d8/d1a/d53/d57/c6b 0 2024-09-21T10:40:43.548 INFO:tasks.workunit.client.1.smithi112.stdout:2/214: dwrite d0/d12/f39 [0,4194304] 0 2024-09-21T10:40:43.550 INFO:tasks.workunit.client.1.smithi112.stdout:4/201: write de/f10 [921402,15676] 0 2024-09-21T10:40:43.550 INFO:tasks.workunit.client.1.smithi112.stdout:2/215: dread d0/f19 [0,4194304] 0 2024-09-21T10:40:43.554 INFO:tasks.workunit.client.1.smithi112.stdout:2/216: creat d0/dd/f42 x:0 0 0 2024-09-21T10:40:43.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/253: dwrite d3/d4/d43/f44 [0,4194304] 0 2024-09-21T10:40:43.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/254: fsync d3/f50 0 2024-09-21T10:40:43.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/255: dread - d3/d18/f42 zero size 2024-09-21T10:40:43.557 INFO:tasks.workunit.client.1.smithi112.stdout:5/223: dwrite d9/d15/d18/f31 [0,4194304] 0 2024-09-21T10:40:43.557 INFO:tasks.workunit.client.1.smithi112.stdout:5/224: write d9/d15/d18/d3a/f2d [1110545,43988] 0 2024-09-21T10:40:43.558 INFO:tasks.workunit.client.1.smithi112.stdout:6/254: dread d4/d6/da/d11/d37/f5e [0,4194304] 0 2024-09-21T10:40:43.558 INFO:tasks.workunit.client.1.smithi112.stdout:6/255: chown d4/d6/da/d11/d37/d19/f2e 4180 1 2024-09-21T10:40:43.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/256: getdents d3/d18/d52 0 2024-09-21T10:40:43.560 INFO:tasks.workunit.client.1.smithi112.stdout:0/257: chown d3/d4/d1a/d21/d46/f58 16832 1 2024-09-21T10:40:43.561 INFO:tasks.workunit.client.1.smithi112.stdout:2/217: dread d0/d12/d26/f17 [0,4194304] 0 2024-09-21T10:40:43.564 INFO:tasks.workunit.client.1.smithi112.stdout:5/225: rename d9/d15/f30 to d9/d15/d18/d3a/f44 0 2024-09-21T10:40:43.565 INFO:tasks.workunit.client.1.smithi112.stdout:0/258: symlink d3/d4a/d4e/l5a 0 2024-09-21T10:40:43.567 INFO:tasks.workunit.client.1.smithi112.stdout:5/226: mknod d9/d15/d18/d20/c45 0 2024-09-21T10:40:43.569 INFO:tasks.workunit.client.1.smithi112.stdout:0/259: symlink d3/d4/d10/l5b 0 2024-09-21T10:40:43.570 INFO:tasks.workunit.client.1.smithi112.stdout:2/218: symlink d0/d12/d1b/l43 0 2024-09-21T10:40:43.575 INFO:tasks.workunit.client.1.smithi112.stdout:4/202: dwrite de/f10 [0,4194304] 0 2024-09-21T10:40:43.579 INFO:tasks.workunit.client.1.smithi112.stdout:2/219: mknod d0/d12/d1b/c44 0 2024-09-21T10:40:43.581 INFO:tasks.workunit.client.1.smithi112.stdout:2/220: unlink d0/d12/f3d 0 2024-09-21T10:40:43.581 INFO:tasks.workunit.client.1.smithi112.stdout:2/221: mknod d0/d12/c45 0 2024-09-21T10:40:43.584 INFO:tasks.workunit.client.1.smithi112.stdout:0/260: write d3/f2b [906800,71964] 0 2024-09-21T10:40:43.584 INFO:tasks.workunit.client.1.smithi112.stdout:0/261: dread - d3/d4/f39 zero size 2024-09-21T10:40:43.584 INFO:tasks.workunit.client.1.smithi112.stdout:2/222: dread d0/f10 [0,4194304] 0 2024-09-21T10:40:43.585 INFO:tasks.workunit.client.1.smithi112.stdout:0/262: rmdir d3/d4/d1a/d21/d56 0 2024-09-21T10:40:43.585 INFO:tasks.workunit.client.1.smithi112.stdout:1/303: dwrite d8/f65 [0,4194304] 0 2024-09-21T10:40:43.586 INFO:tasks.workunit.client.1.smithi112.stdout:1/304: fdatasync d8/d1a/d31/f3e 0 2024-09-21T10:40:43.586 INFO:tasks.workunit.client.1.smithi112.stdout:1/305: write d8/d54/f5d [415979,83516] 0 2024-09-21T10:40:43.586 INFO:tasks.workunit.client.1.smithi112.stdout:1/306: write d8/d1a/f1e [350648,116953] 0 2024-09-21T10:40:43.586 INFO:tasks.workunit.client.1.smithi112.stdout:1/307: truncate d8/d1a/d31/d37/f47 827358 0 2024-09-21T10:40:43.586 INFO:tasks.workunit.client.1.smithi112.stdout:2/223: mkdir d0/d12/d46 0 2024-09-21T10:40:43.586 INFO:tasks.workunit.client.1.smithi112.stdout:2/224: readlink d0/l2b 0 2024-09-21T10:40:43.587 INFO:tasks.workunit.client.1.smithi112.stdout:0/263: creat d3/d4a/d4e/f5c x:0 0 0 2024-09-21T10:40:43.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/163: dwrite d7/f14 [4194304,4194304] 0 2024-09-21T10:40:43.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/164: dread - d7/d22/f2e zero size 2024-09-21T10:40:43.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/165: write d7/f19 [1690549,38214] 0 2024-09-21T10:40:43.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/166: creat d7/d22/f35 x:0 0 0 2024-09-21T10:40:43.587 INFO:tasks.workunit.client.1.smithi112.stdout:7/167: chown d7/l15 1559 1 2024-09-21T10:40:43.588 INFO:tasks.workunit.client.1.smithi112.stdout:1/308: rename d8/d1a/d31/d37/f56 to d8/d1a/d53/d57/f6c 0 2024-09-21T10:40:43.589 INFO:tasks.workunit.client.1.smithi112.stdout:2/225: mkdir d0/dd/d47 0 2024-09-21T10:40:43.591 INFO:tasks.workunit.client.1.smithi112.stdout:7/168: symlink d7/d22/l36 0 2024-09-21T10:40:43.591 INFO:tasks.workunit.client.1.smithi112.stdout:7/169: fdatasync d7/ff 0 2024-09-21T10:40:43.592 INFO:tasks.workunit.client.1.smithi112.stdout:1/309: mkdir d8/d54/d6d 0 2024-09-21T10:40:43.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/310: unlink l5 0 2024-09-21T10:40:43.593 INFO:tasks.workunit.client.1.smithi112.stdout:1/311: creat d8/d1a/d53/d57/f6e x:0 0 0 2024-09-21T10:40:43.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/312: rmdir d8/d45 39 2024-09-21T10:40:43.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/313: getdents d8/d1a/d31/d66 0 2024-09-21T10:40:43.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/314: chown d8/d1a 1 1 2024-09-21T10:40:43.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/315: mknod d8/d54/d6d/c6f 0 2024-09-21T10:40:43.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/162: sync 2024-09-21T10:40:43.647 INFO:tasks.workunit.client.1.smithi112.stdout:8/201: sync 2024-09-21T10:40:43.647 INFO:tasks.workunit.client.1.smithi112.stdout:3/162: sync 2024-09-21T10:40:43.647 INFO:tasks.workunit.client.1.smithi112.stdout:3/163: creat d2/d1f/f35 x:0 0 0 2024-09-21T10:40:43.648 INFO:tasks.workunit.client.1.smithi112.stdout:6/256: dwrite d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:43.648 INFO:tasks.workunit.client.1.smithi112.stdout:6/257: creat d4/d6/da/f60 x:0 0 0 2024-09-21T10:40:43.649 INFO:tasks.workunit.client.1.smithi112.stdout:6/258: creat d4/dc/d1a/f61 x:0 0 0 2024-09-21T10:40:43.656 INFO:tasks.workunit.client.1.smithi112.stdout:7/170: dwrite d7/f34 [0,4194304] 0 2024-09-21T10:40:43.659 INFO:tasks.workunit.client.1.smithi112.stdout:7/171: symlink d7/d22/l37 0 2024-09-21T10:40:43.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/163: dwrite d1/d2/f20 [0,4194304] 0 2024-09-21T10:40:43.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/164: chown d1/d2/d1c/c14 572492 1 2024-09-21T10:40:43.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/165: write d1/f1b [818772,61719] 0 2024-09-21T10:40:43.669 INFO:tasks.workunit.client.1.smithi112.stdout:9/166: fdatasync d1/d2/f5 0 2024-09-21T10:40:43.675 INFO:tasks.workunit.client.1.smithi112.stdout:8/202: dwrite d8/fc [0,4194304] 0 2024-09-21T10:40:43.679 INFO:tasks.workunit.client.1.smithi112.stdout:3/164: dwrite d2/f1d [0,4194304] 0 2024-09-21T10:40:43.679 INFO:tasks.workunit.client.1.smithi112.stdout:3/165: truncate d2/d2f/f30 897459 0 2024-09-21T10:40:43.680 INFO:tasks.workunit.client.1.smithi112.stdout:3/166: rename d2/f13 to d2/d22/d31/f36 0 2024-09-21T10:40:43.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/167: rename d2/d2f/d33 to d2/d22/d31/d37 0 2024-09-21T10:40:43.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/168: chown f0 1307 1 2024-09-21T10:40:43.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/169: chown d2/f18 114114 1 2024-09-21T10:40:43.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/170: chown f1 111359 1 2024-09-21T10:40:43.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/171: chown d2/d2f 8567 1 2024-09-21T10:40:43.683 INFO:tasks.workunit.client.1.smithi112.stdout:3/172: creat d2/d22/f38 x:0 0 0 2024-09-21T10:40:43.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/203: dread d8/d9/dd/f1d [0,4194304] 0 2024-09-21T10:40:43.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/204: chown d8/d9/dd/d1a 101675 1 2024-09-21T10:40:43.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/205: write d8/d9/dd/d2b/f2e [547909,14078] 0 2024-09-21T10:40:43.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/206: write d8/d9/dd/d2b/d31/f41 [853261,32662] 0 2024-09-21T10:40:43.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/207: truncate d8/d18/f23 1300129 0 2024-09-21T10:40:43.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/208: readlink d8/l3e 0 2024-09-21T10:40:43.688 INFO:tasks.workunit.client.1.smithi112.stdout:8/209: rmdir d8/d9 39 2024-09-21T10:40:43.692 INFO:tasks.workunit.client.1.smithi112.stdout:3/173: dread d2/d1f/f2c [0,4194304] 0 2024-09-21T10:40:43.694 INFO:tasks.workunit.client.1.smithi112.stdout:3/174: mkdir d2/d22/d31/d2a/d39 0 2024-09-21T10:40:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:43 smithi060 ceph-mon[28215]: pgmap v8: 65 pgs: 65 active+clean; 266 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 9.2 MiB/s wr, 620 op/s 2024-09-21T10:40:43.713 INFO:tasks.workunit.client.1.smithi112.stdout:5/227: rmdir d9/d15 39 2024-09-21T10:40:43.713 INFO:tasks.workunit.client.1.smithi112.stdout:3/175: dread d2/ff [0,4194304] 0 2024-09-21T10:40:43.714 INFO:tasks.workunit.client.1.smithi112.stdout:5/228: creat d9/d15/d1d/f46 x:0 0 0 2024-09-21T10:40:43.714 INFO:tasks.workunit.client.1.smithi112.stdout:5/229: chown d9/d15/d1d/f1f 3335 1 2024-09-21T10:40:43.714 INFO:tasks.workunit.client.1.smithi112.stdout:3/176: mkdir d2/d22/d31/d2a/d39/d3a 0 2024-09-21T10:40:43.715 INFO:tasks.workunit.client.1.smithi112.stdout:1/316: dread d8/f9 [0,4194304] 0 2024-09-21T10:40:43.716 INFO:tasks.workunit.client.1.smithi112.stdout:1/317: chown d8/d1a/c2a 77283 1 2024-09-21T10:40:43.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/230: mkdir d9/d15/d18/d20/d47 0 2024-09-21T10:40:43.716 INFO:tasks.workunit.client.1.smithi112.stdout:1/318: read d8/fe [7298374,27584] 0 2024-09-21T10:40:43.716 INFO:tasks.workunit.client.1.smithi112.stdout:5/231: chown d9/f1e 6656 1 2024-09-21T10:40:43.716 INFO:tasks.workunit.client.1.smithi112.stdout:1/319: link d8/d20/f32 d8/d54/d6d/f70 0 2024-09-21T10:40:43.717 INFO:tasks.workunit.client.1.smithi112.stdout:9/167: dwrite d1/d2/d1c/f33 [0,4194304] 0 2024-09-21T10:40:43.718 INFO:tasks.workunit.client.1.smithi112.stdout:5/232: rename d9/d15/c28 to d9/d15/d1d/c48 0 2024-09-21T10:40:43.718 INFO:tasks.workunit.client.1.smithi112.stdout:5/233: read d9/d15/f2a [230846,71048] 0 2024-09-21T10:40:43.718 INFO:tasks.workunit.client.1.smithi112.stdout:5/234: getdents d9/d15/d18/d20/d47 0 2024-09-21T10:40:43.720 INFO:tasks.workunit.client.1.smithi112.stdout:1/320: creat d8/d1a/d53/f71 x:0 0 0 2024-09-21T10:40:43.720 INFO:tasks.workunit.client.1.smithi112.stdout:1/321: write d8/f38 [21797,22171] 0 2024-09-21T10:40:43.724 INFO:tasks.workunit.client.1.smithi112.stdout:9/168: rename d1/l10 to d1/d2/d1c/d16/d30/l38 0 2024-09-21T10:40:43.724 INFO:tasks.workunit.client.1.smithi112.stdout:9/169: chown d1/lf 5971679 1 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:8/210: dwrite d8/f14 [0,4194304] 0 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:0/264: fsync d3/d4a/d4e/f5c 0 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:0/265: fsync d3/d23/f3f 0 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:0/266: fsync d3/d4/fe 0 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:3/177: write d2/f19 [3704404,7343] 0 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:8/211: write d8/d18/f27 [267878,118238] 0 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:3/178: chown d2/f14 95527 1 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:8/212: chown d8/d9/dd/c29 303631 1 2024-09-21T10:40:43.725 INFO:tasks.workunit.client.1.smithi112.stdout:1/322: unlink d8/d1a/c26 0 2024-09-21T10:40:43.731 INFO:tasks.workunit.client.1.smithi112.stdout:0/267: symlink d3/d23/l5d 0 2024-09-21T10:40:43.731 INFO:tasks.workunit.client.1.smithi112.stdout:8/213: truncate d8/d9/f25 6877516 0 2024-09-21T10:40:43.733 INFO:tasks.workunit.client.1.smithi112.stdout:3/179: creat d2/d22/d31/d2a/f3b x:0 0 0 2024-09-21T10:40:43.733 INFO:tasks.workunit.client.1.smithi112.stdout:3/180: chown d2/d22/d31 1506511 1 2024-09-21T10:40:43.733 INFO:tasks.workunit.client.1.smithi112.stdout:3/181: chown d2/c34 0 1 2024-09-21T10:40:43.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/170: mknod d1/d2/c39 0 2024-09-21T10:40:43.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/171: readlink d1/d2/d1c/l2b 0 2024-09-21T10:40:43.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/172: chown d1/d2/d27/l2c 1865 1 2024-09-21T10:40:43.735 INFO:tasks.workunit.client.1.smithi112.stdout:0/268: creat d3/d18/d52/d55/f5e x:0 0 0 2024-09-21T10:40:43.736 INFO:tasks.workunit.client.1.smithi112.stdout:3/182: symlink d2/d1f/l3c 0 2024-09-21T10:40:43.737 INFO:tasks.workunit.client.1.smithi112.stdout:0/269: mkdir d3/d18/d52/d5f 0 2024-09-21T10:40:43.737 INFO:tasks.workunit.client.1.smithi112.stdout:0/270: write d3/d4/f5 [3765664,129884] 0 2024-09-21T10:40:43.739 INFO:tasks.workunit.client.1.smithi112.stdout:1/323: dwrite d8/d20/f29 [0,4194304] 0 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/324: readlink d8/d1a/l1d 0 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/325: stat d8/d54/d6d/c6f 0 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/326: dread - d8/d1a/d53/d57/f6e zero size 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/327: chown d8/d1a/d53/d57/f6c 1743 1 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/328: chown d8/d1a/f1e 126 1 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/329: write d8/d1a/f67 [543222,68901] 0 2024-09-21T10:40:43.740 INFO:tasks.workunit.client.1.smithi112.stdout:0/271: rmdir d3/d4/d1a/d21/d4f/d57 0 2024-09-21T10:40:43.742 INFO:tasks.workunit.client.1.smithi112.stdout:1/330: truncate d8/f65 2573756 0 2024-09-21T10:40:43.742 INFO:tasks.workunit.client.1.smithi112.stdout:1/331: readlink d8/d1a/l1d 0 2024-09-21T10:40:43.743 INFO:tasks.workunit.client.1.smithi112.stdout:0/272: rename d3/d4/ld to d3/d4a/l60 0 2024-09-21T10:40:43.743 INFO:tasks.workunit.client.1.smithi112.stdout:0/273: creat d3/d4/d1a/d21/f61 x:0 0 0 2024-09-21T10:40:43.744 INFO:tasks.workunit.client.1.smithi112.stdout:1/332: mknod d8/d45/c72 0 2024-09-21T10:40:43.745 INFO:tasks.workunit.client.1.smithi112.stdout:0/274: dread d3/d4/f13 [0,4194304] 0 2024-09-21T10:40:43.747 INFO:tasks.workunit.client.1.smithi112.stdout:1/333: truncate d8/d1a/d31/f3e 1180206 0 2024-09-21T10:40:43.747 INFO:tasks.workunit.client.1.smithi112.stdout:1/334: truncate d8/d1a/d53/d57/f6c 487107 0 2024-09-21T10:40:43.748 INFO:tasks.workunit.client.1.smithi112.stdout:0/275: write d3/d4/fe [1183122,42286] 0 2024-09-21T10:40:43.749 INFO:tasks.workunit.client.1.smithi112.stdout:1/335: rename d8/d1a/f1e to d8/d1a/d31/f73 0 2024-09-21T10:40:43.750 INFO:tasks.workunit.client.1.smithi112.stdout:1/336: read d8/d54/d6d/f70 [132144,115209] 0 2024-09-21T10:40:43.750 INFO:tasks.workunit.client.1.smithi112.stdout:1/337: fsync d8/d1a/f62 0 2024-09-21T10:40:43.751 INFO:tasks.workunit.client.1.smithi112.stdout:0/276: symlink d3/d4/d1a/d21/l62 0 2024-09-21T10:40:43.751 INFO:tasks.workunit.client.1.smithi112.stdout:0/277: chown d3/d4/d10/c53 22636711 1 2024-09-21T10:40:43.751 INFO:tasks.workunit.client.1.smithi112.stdout:1/338: mknod d8/d1a/d31/c74 0 2024-09-21T10:40:43.753 INFO:tasks.workunit.client.1.smithi112.stdout:1/339: rename d8/d20/l44 to d8/d54/l75 0 2024-09-21T10:40:43.755 INFO:tasks.workunit.client.1.smithi112.stdout:1/340: mkdir d8/d1a/d53/d76 0 2024-09-21T10:40:43.757 INFO:tasks.workunit.client.1.smithi112.stdout:3/183: dwrite d2/d22/d31/f36 [0,4194304] 0 2024-09-21T10:40:43.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/173: dwrite d1/d2/d15/f21 [0,4194304] 0 2024-09-21T10:40:43.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/174: write d1/d2/d1c/d16/f1f [1097095,63866] 0 2024-09-21T10:40:43.761 INFO:tasks.workunit.client.1.smithi112.stdout:3/184: mkdir d2/d3d 0 2024-09-21T10:40:43.761 INFO:tasks.workunit.client.1.smithi112.stdout:3/185: write d2/fa [462334,96876] 0 2024-09-21T10:40:43.764 INFO:tasks.workunit.client.1.smithi112.stdout:9/175: unlink d1/d2/d1c/d16/l19 0 2024-09-21T10:40:43.767 INFO:tasks.workunit.client.1.smithi112.stdout:3/186: symlink d2/l3e 0 2024-09-21T10:40:43.767 INFO:tasks.workunit.client.1.smithi112.stdout:3/187: write d2/d1f/f35 [914540,126756] 0 2024-09-21T10:40:43.768 INFO:tasks.workunit.client.1.smithi112.stdout:8/214: read d8/d9/f25 [4103125,32369] 0 2024-09-21T10:40:43.769 INFO:tasks.workunit.client.1.smithi112.stdout:9/176: dread d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:43.772 INFO:tasks.workunit.client.1.smithi112.stdout:1/341: dwrite d8/f9 [0,4194304] 0 2024-09-21T10:40:43.772 INFO:tasks.workunit.client.1.smithi112.stdout:0/278: truncate d3/d4/d1a/f17 2591543 0 2024-09-21T10:40:43.773 INFO:tasks.workunit.client.1.smithi112.stdout:9/177: dread d1/d2/d27/f2f [0,4194304] 0 2024-09-21T10:40:43.773 INFO:tasks.workunit.client.1.smithi112.stdout:9/178: write d1/d2/d1c/d16/f22 [700793,110268] 0 2024-09-21T10:40:43.773 INFO:tasks.workunit.client.1.smithi112.stdout:1/342: dread d8/d1a/d53/d57/f6c [0,4194304] 0 2024-09-21T10:40:43.774 INFO:tasks.workunit.client.1.smithi112.stdout:0/279: truncate d3/f20 4056019 0 2024-09-21T10:40:43.774 INFO:tasks.workunit.client.1.smithi112.stdout:0/280: creat d3/d4a/d4e/f63 x:0 0 0 2024-09-21T10:40:43.782 INFO:tasks.workunit.client.1.smithi112.stdout:8/215: dread d8/d18/f24 [0,4194304] 0 2024-09-21T10:40:43.783 INFO:tasks.workunit.client.1.smithi112.stdout:8/216: rmdir d8/d9 39 2024-09-21T10:40:43.785 INFO:tasks.workunit.client.1.smithi112.stdout:1/343: dread d8/d20/f29 [0,4194304] 0 2024-09-21T10:40:43.786 INFO:tasks.workunit.client.1.smithi112.stdout:1/344: creat d8/d1a/d31/d37/f77 x:0 0 0 2024-09-21T10:40:43.787 INFO:tasks.workunit.client.1.smithi112.stdout:1/345: mknod d8/c78 0 2024-09-21T10:40:43.788 INFO:tasks.workunit.client.1.smithi112.stdout:3/188: dwrite d2/f18 [0,4194304] 0 2024-09-21T10:40:43.792 INFO:tasks.workunit.client.1.smithi112.stdout:8/217: dread d8/d9/fb [0,4194304] 0 2024-09-21T10:40:43.792 INFO:tasks.workunit.client.1.smithi112.stdout:8/218: fdatasync d8/d9/dd/f2c 0 2024-09-21T10:40:43.794 INFO:tasks.workunit.client.1.smithi112.stdout:3/189: mkdir d2/d2f/d3f 0 2024-09-21T10:40:43.797 INFO:tasks.workunit.client.1.smithi112.stdout:8/219: write d8/d9/f13 [1908375,64904] 0 2024-09-21T10:40:43.797 INFO:tasks.workunit.client.1.smithi112.stdout:8/220: dread - d8/d9/dd/d2b/d31/f39 zero size 2024-09-21T10:40:43.797 INFO:tasks.workunit.client.1.smithi112.stdout:8/221: write d8/d9/dd/f2c [247656,121575] 0 2024-09-21T10:40:43.800 INFO:tasks.workunit.client.1.smithi112.stdout:1/346: rmdir d8/d1a 39 2024-09-21T10:40:43.800 INFO:tasks.workunit.client.1.smithi112.stdout:1/347: chown d8/d1a/d31/f3e 1900737880 1 2024-09-21T10:40:43.803 INFO:tasks.workunit.client.1.smithi112.stdout:9/179: rename d1/d2/d1c to d1/d2/d27/d3a 0 2024-09-21T10:40:43.804 INFO:tasks.workunit.client.1.smithi112.stdout:8/222: creat d8/d9/dd/f42 x:0 0 0 2024-09-21T10:40:43.805 INFO:tasks.workunit.client.1.smithi112.stdout:9/180: truncate d1/d2/d15/f21 3160657 0 2024-09-21T10:40:43.808 INFO:tasks.workunit.client.1.smithi112.stdout:8/223: mkdir d8/d9/dd/d2a/d43 0 2024-09-21T10:40:43.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/224: creat d8/d9/dd/d2b/f44 x:0 0 0 2024-09-21T10:40:43.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/225: mknod d8/d9/dd/d2a/d43/c45 0 2024-09-21T10:40:43.811 INFO:tasks.workunit.client.1.smithi112.stdout:8/226: unlink d8/d9/fa 0 2024-09-21T10:40:43.816 INFO:tasks.workunit.client.1.smithi112.stdout:9/181: write d1/d2/f20 [1964749,23151] 0 2024-09-21T10:40:43.816 INFO:tasks.workunit.client.1.smithi112.stdout:3/190: dwrite d2/d2f/f30 [0,4194304] 0 2024-09-21T10:40:43.816 INFO:tasks.workunit.client.1.smithi112.stdout:9/182: fsync d1/d2/d27/d3a/d16/f22 0 2024-09-21T10:40:43.821 INFO:tasks.workunit.client.1.smithi112.stdout:1/348: dwrite d8/d1a/d53/d57/f6c [0,4194304] 0 2024-09-21T10:40:43.823 INFO:tasks.workunit.client.1.smithi112.stdout:3/191: truncate d2/d22/f29 848422 0 2024-09-21T10:40:43.823 INFO:tasks.workunit.client.1.smithi112.stdout:3/192: truncate d2/d1f/f35 1238953 0 2024-09-21T10:40:43.823 INFO:tasks.workunit.client.1.smithi112.stdout:3/193: creat d2/d1f/f40 x:0 0 0 2024-09-21T10:40:43.823 INFO:tasks.workunit.client.1.smithi112.stdout:9/183: mkdir d1/d2/d27/d37/d3b 0 2024-09-21T10:40:43.826 INFO:tasks.workunit.client.1.smithi112.stdout:1/349: mknod d8/d1a/d53/c79 0 2024-09-21T10:40:43.828 INFO:tasks.workunit.client.1.smithi112.stdout:3/194: rename d2/l3e to d2/d22/d31/d2a/d39/d3a/l41 0 2024-09-21T10:40:43.828 INFO:tasks.workunit.client.1.smithi112.stdout:9/184: creat d1/d2/d27/d3a/d16/f3c x:0 0 0 2024-09-21T10:40:43.829 INFO:tasks.workunit.client.1.smithi112.stdout:9/185: fdatasync d1/d2/d27/d3a/d16/f1f 0 2024-09-21T10:40:43.829 INFO:tasks.workunit.client.1.smithi112.stdout:1/350: mkdir d8/d7a 0 2024-09-21T10:40:43.831 INFO:tasks.workunit.client.1.smithi112.stdout:9/186: dread d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:43.832 INFO:tasks.workunit.client.1.smithi112.stdout:8/227: dwrite d8/d9/dd/f2c [0,4194304] 0 2024-09-21T10:40:43.837 INFO:tasks.workunit.client.1.smithi112.stdout:3/195: rmdir d2/d1f 39 2024-09-21T10:40:43.845 INFO:tasks.workunit.client.1.smithi112.stdout:8/228: dread d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:43.847 INFO:tasks.workunit.client.1.smithi112.stdout:8/229: mkdir d8/d9/dd/d2b/d31/d46 0 2024-09-21T10:40:43.847 INFO:tasks.workunit.client.1.smithi112.stdout:8/230: chown d8/d9/dd/d2a/d43/c45 37985 1 2024-09-21T10:40:43.849 INFO:tasks.workunit.client.1.smithi112.stdout:8/231: creat d8/d9/dd/d2a/d43/f47 x:0 0 0 2024-09-21T10:40:43.867 INFO:tasks.workunit.client.1.smithi112.stdout:1/351: dwrite d8/d1a/d31/d37/f46 [0,4194304] 0 2024-09-21T10:40:43.868 INFO:tasks.workunit.client.1.smithi112.stdout:9/187: dwrite d1/f1b [0,4194304] 0 2024-09-21T10:40:43.868 INFO:tasks.workunit.client.1.smithi112.stdout:8/232: dwrite d8/d9/dd/d2b/f2e [0,4194304] 0 2024-09-21T10:40:43.868 INFO:tasks.workunit.client.1.smithi112.stdout:3/196: dwrite d2/d22/f29 [0,4194304] 0 2024-09-21T10:40:43.869 INFO:tasks.workunit.client.1.smithi112.stdout:1/352: truncate d8/f40 4255010 0 2024-09-21T10:40:43.872 INFO:tasks.workunit.client.1.smithi112.stdout:9/188: link d1/d2/d27/f2f d1/d2/d27/f3d 0 2024-09-21T10:40:43.872 INFO:tasks.workunit.client.1.smithi112.stdout:9/189: write d1/d2/d27/d3a/d16/f3c [709969,12172] 0 2024-09-21T10:40:43.874 INFO:tasks.workunit.client.1.smithi112.stdout:9/190: dread d1/d2/d27/d3a/f23 [0,4194304] 0 2024-09-21T10:40:43.877 INFO:tasks.workunit.client.1.smithi112.stdout:8/233: creat d8/d9/dd/d2b/d31/d46/f48 x:0 0 0 2024-09-21T10:40:43.878 INFO:tasks.workunit.client.1.smithi112.stdout:3/197: mknod d2/d22/d31/d2a/d39/d3a/c42 0 2024-09-21T10:40:43.879 INFO:tasks.workunit.client.1.smithi112.stdout:9/191: creat d1/d2/f3e x:0 0 0 2024-09-21T10:40:43.881 INFO:tasks.workunit.client.1.smithi112.stdout:8/234: symlink d8/d9/d3c/l49 0 2024-09-21T10:40:43.881 INFO:tasks.workunit.client.1.smithi112.stdout:8/235: fsync d8/d9/dd/d2b/d31/f41 0 2024-09-21T10:40:43.882 INFO:tasks.workunit.client.1.smithi112.stdout:9/192: symlink d1/l3f 0 2024-09-21T10:40:43.882 INFO:tasks.workunit.client.1.smithi112.stdout:8/236: mknod d8/d9/dd/d2b/d31/d46/c4a 0 2024-09-21T10:40:43.883 INFO:tasks.workunit.client.1.smithi112.stdout:8/237: creat d8/d9/dd/d2b/d31/d46/f4b x:0 0 0 2024-09-21T10:40:43.884 INFO:tasks.workunit.client.1.smithi112.stdout:9/193: rename d1/d2/d27/d3a/d16/l1d to d1/d2/d27/d37/d3b/l40 0 2024-09-21T10:40:43.884 INFO:tasks.workunit.client.1.smithi112.stdout:9/194: write d1/f36 [286877,18217] 0 2024-09-21T10:40:43.885 INFO:tasks.workunit.client.1.smithi112.stdout:3/198: dread d2/f18 [0,4194304] 0 2024-09-21T10:40:43.885 INFO:tasks.workunit.client.1.smithi112.stdout:3/199: creat d2/d22/d31/d2a/f43 x:0 0 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:8/238: mknod d8/d9/d3c/c4c 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:8/239: fsync d8/d9/f13 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:8/240: creat d8/d9/dd/d2b/f4d x:0 0 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:8/241: truncate d8/d9/dd/d1a/f32 254224 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:8/242: truncate d8/d9/dd/d2b/f4d 81572 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:1/353: dwrite d8/d1a/d31/d37/f77 [0,4194304] 0 2024-09-21T10:40:43.886 INFO:tasks.workunit.client.1.smithi112.stdout:9/195: unlink d1/d2/le 0 2024-09-21T10:40:43.888 INFO:tasks.workunit.client.1.smithi112.stdout:3/200: link d2/ff d2/d2f/f44 0 2024-09-21T10:40:43.892 INFO:tasks.workunit.client.1.smithi112.stdout:1/354: creat d8/d1a/d31/d66/f7b x:0 0 0 2024-09-21T10:40:43.895 INFO:tasks.workunit.client.1.smithi112.stdout:9/196: unlink d1/d2/d27/d3a/d16/f22 0 2024-09-21T10:40:43.895 INFO:tasks.workunit.client.1.smithi112.stdout:9/197: truncate d1/f36 440005 0 2024-09-21T10:40:43.895 INFO:tasks.workunit.client.1.smithi112.stdout:9/198: chown d1/d2/c17 1 1 2024-09-21T10:40:43.895 INFO:tasks.workunit.client.1.smithi112.stdout:9/199: truncate d1/d2/d27/d3a/f23 533782 0 2024-09-21T10:40:43.896 INFO:tasks.workunit.client.1.smithi112.stdout:3/201: symlink d2/d22/d31/d2a/d39/l45 0 2024-09-21T10:40:43.901 INFO:tasks.workunit.client.1.smithi112.stdout:8/243: rmdir d8/d9/dd/d2a/d43 39 2024-09-21T10:40:43.902 INFO:tasks.workunit.client.1.smithi112.stdout:8/244: stat d8/d9/dd/d2b/f44 0 2024-09-21T10:40:43.904 INFO:tasks.workunit.client.1.smithi112.stdout:9/200: write d1/f1b [51648,52371] 0 2024-09-21T10:40:43.904 INFO:tasks.workunit.client.1.smithi112.stdout:1/355: creat d8/d1a/d31/f7c x:0 0 0 2024-09-21T10:40:43.906 INFO:tasks.workunit.client.1.smithi112.stdout:9/201: dread d1/d2/d27/f3d [0,4194304] 0 2024-09-21T10:40:43.907 INFO:tasks.workunit.client.1.smithi112.stdout:9/202: mknod d1/d2/d27/d37/d3b/c41 0 2024-09-21T10:40:43.910 INFO:tasks.workunit.client.1.smithi112.stdout:9/203: dread d1/d2/d27/f2f [0,4194304] 0 2024-09-21T10:40:43.923 INFO:tasks.workunit.client.1.smithi112.stdout:9/204: write d1/d2/d27/d3a/f33 [318056,31212] 0 2024-09-21T10:40:43.923 INFO:tasks.workunit.client.1.smithi112.stdout:9/205: fsync d1/d2/f20 0 2024-09-21T10:40:43.930 INFO:tasks.workunit.client.1.smithi112.stdout:3/202: dwrite d2/fa [0,4194304] 0 2024-09-21T10:40:43.931 INFO:tasks.workunit.client.1.smithi112.stdout:1/356: dwrite d8/f24 [4194304,4194304] 0 2024-09-21T10:40:43.932 INFO:tasks.workunit.client.1.smithi112.stdout:3/203: link d2/d22/d31/d2a/f43 d2/d22/d31/d37/f46 0 2024-09-21T10:40:43.936 INFO:tasks.workunit.client.1.smithi112.stdout:3/204: dread d2/f17 [0,4194304] 0 2024-09-21T10:40:43.936 INFO:tasks.workunit.client.1.smithi112.stdout:3/205: dread - d2/d22/f38 zero size 2024-09-21T10:40:43.936 INFO:tasks.workunit.client.1.smithi112.stdout:3/206: chown d2/f14 3334 1 2024-09-21T10:40:43.936 INFO:tasks.workunit.client.1.smithi112.stdout:3/207: write d2/d1f/f40 [804691,57625] 0 2024-09-21T10:40:43.937 INFO:tasks.workunit.client.1.smithi112.stdout:3/208: stat f0 0 2024-09-21T10:40:43.937 INFO:tasks.workunit.client.1.smithi112.stdout:9/206: dread d1/f1b [0,4194304] 0 2024-09-21T10:40:43.938 INFO:tasks.workunit.client.1.smithi112.stdout:9/207: write d1/f36 [433398,12683] 0 2024-09-21T10:40:43.938 INFO:tasks.workunit.client.1.smithi112.stdout:3/209: link f1 d2/d22/d31/d2a/d39/d3a/f47 0 2024-09-21T10:40:43.939 INFO:tasks.workunit.client.1.smithi112.stdout:3/210: dread - d2/d22/d31/d2a/f43 zero size 2024-09-21T10:40:43.940 INFO:tasks.workunit.client.1.smithi112.stdout:9/208: mkdir d1/d2/d42 0 2024-09-21T10:40:43.940 INFO:tasks.workunit.client.1.smithi112.stdout:9/209: chown d1/d2/c39 146 1 2024-09-21T10:40:43.940 INFO:tasks.workunit.client.1.smithi112.stdout:9/210: chown d1/d2/d27/d3a/d16/d30/l38 76 1 2024-09-21T10:40:43.941 INFO:tasks.workunit.client.1.smithi112.stdout:9/211: readlink d1/d2/l2e 0 2024-09-21T10:40:43.956 INFO:tasks.workunit.client.1.smithi112.stdout:1/357: dwrite d8/d1a/d31/d37/f47 [0,4194304] 0 2024-09-21T10:40:43.959 INFO:tasks.workunit.client.1.smithi112.stdout:3/211: dwrite d2/ff [0,4194304] 0 2024-09-21T10:40:43.961 INFO:tasks.workunit.client.1.smithi112.stdout:3/212: rename d2/c8 to d2/d22/d31/d37/c48 0 2024-09-21T10:40:43.962 INFO:tasks.workunit.client.1.smithi112.stdout:3/213: truncate d2/f1b 3370808 0 2024-09-21T10:40:43.964 INFO:tasks.workunit.client.1.smithi112.stdout:3/214: rmdir d2/d3d 0 2024-09-21T10:40:43.965 INFO:tasks.workunit.client.1.smithi112.stdout:9/212: dwrite d1/d2/d27/f3d [0,4194304] 0 2024-09-21T10:40:43.966 INFO:tasks.workunit.client.1.smithi112.stdout:3/215: creat d2/d22/d31/d2a/d39/d3a/f49 x:0 0 0 2024-09-21T10:40:43.969 INFO:tasks.workunit.client.1.smithi112.stdout:3/216: unlink d2/d22/d31/l2b 0 2024-09-21T10:40:43.971 INFO:tasks.workunit.client.1.smithi112.stdout:3/217: rename d2/d22/d31/d37/c48 to d2/d22/c4a 0 2024-09-21T10:40:43.981 INFO:tasks.workunit.client.1.smithi112.stdout:1/358: dwrite d8/f40 [0,4194304] 0 2024-09-21T10:40:43.981 INFO:tasks.workunit.client.1.smithi112.stdout:1/359: stat d8/d1a/d31/f4e 0 2024-09-21T10:40:43.981 INFO:tasks.workunit.client.1.smithi112.stdout:9/213: dwrite d1/d2/d27/d3a/d16/f1f [0,4194304] 0 2024-09-21T10:40:43.982 INFO:tasks.workunit.client.1.smithi112.stdout:9/214: fdatasync d1/d2/f20 0 2024-09-21T10:40:43.982 INFO:tasks.workunit.client.1.smithi112.stdout:1/360: creat d8/d1a/d53/d76/f7d x:0 0 0 2024-09-21T10:40:43.984 INFO:tasks.workunit.client.1.smithi112.stdout:9/215: dread d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:43.985 INFO:tasks.workunit.client.1.smithi112.stdout:3/218: dread d2/d1f/f40 [0,4194304] 0 2024-09-21T10:40:43.985 INFO:tasks.workunit.client.1.smithi112.stdout:1/361: creat d8/d7a/f7e x:0 0 0 2024-09-21T10:40:43.985 INFO:tasks.workunit.client.1.smithi112.stdout:1/362: truncate d8/d20/f5f 846945 0 2024-09-21T10:40:43.985 INFO:tasks.workunit.client.1.smithi112.stdout:1/363: fsync d8/d54/d6d/f70 0 2024-09-21T10:40:43.986 INFO:tasks.workunit.client.1.smithi112.stdout:3/219: symlink d2/d22/d31/d2a/d39/l4b 0 2024-09-21T10:40:43.991 INFO:tasks.workunit.client.1.smithi112.stdout:4/203: sync 2024-09-21T10:40:43.992 INFO:tasks.workunit.client.1.smithi112.stdout:3/220: rmdir d2/d22 39 2024-09-21T10:40:43.993 INFO:tasks.workunit.client.1.smithi112.stdout:9/216: dread d1/d2/d27/d3a/f2d [0,4194304] 0 2024-09-21T10:40:43.998 INFO:tasks.workunit.client.1.smithi112.stdout:1/364: dwrite d8/d1a/d53/f71 [0,4194304] 0 2024-09-21T10:40:44.000 INFO:tasks.workunit.client.1.smithi112.stdout:1/365: truncate d8/f24 5341858 0 2024-09-21T10:40:44.003 INFO:tasks.workunit.client.1.smithi112.stdout:1/366: mknod d8/c7f 0 2024-09-21T10:40:44.003 INFO:tasks.workunit.client.1.smithi112.stdout:1/367: write d8/d54/d6d/f70 [48785,65145] 0 2024-09-21T10:40:44.005 INFO:tasks.workunit.client.1.smithi112.stdout:1/368: symlink d8/d1a/d31/d37/l80 0 2024-09-21T10:40:44.006 INFO:tasks.workunit.client.1.smithi112.stdout:9/217: dread d1/d2/d27/d3a/d16/f3c [0,4194304] 0 2024-09-21T10:40:44.006 INFO:tasks.workunit.client.1.smithi112.stdout:9/218: creat d1/f43 x:0 0 0 2024-09-21T10:40:44.009 INFO:tasks.workunit.client.1.smithi112.stdout:9/219: truncate d1/d2/d27/f2f 1699132 0 2024-09-21T10:40:44.011 INFO:tasks.workunit.client.1.smithi112.stdout:1/369: dread d8/d1a/d31/d37/f5e [0,4194304] 0 2024-09-21T10:40:44.015 INFO:tasks.workunit.client.1.smithi112.stdout:1/370: dread d8/d20/f4a [0,4194304] 0 2024-09-21T10:40:44.015 INFO:tasks.workunit.client.1.smithi112.stdout:4/204: dwrite de/f15 [4194304,4194304] 0 2024-09-21T10:40:44.017 INFO:tasks.workunit.client.1.smithi112.stdout:1/371: rename d8/d20/f29 to d8/d1a/d31/d37/f81 0 2024-09-21T10:40:44.020 INFO:tasks.workunit.client.1.smithi112.stdout:3/221: dwrite d2/d2f/f30 [0,4194304] 0 2024-09-21T10:40:44.020 INFO:tasks.workunit.client.1.smithi112.stdout:4/205: link de/d18/c28 de/d34/d40/c45 0 2024-09-21T10:40:44.021 INFO:tasks.workunit.client.1.smithi112.stdout:3/222: mknod d2/d1f/c4c 0 2024-09-21T10:40:44.024 INFO:tasks.workunit.client.1.smithi112.stdout:4/206: mknod de/d33/d2f/c46 0 2024-09-21T10:40:44.028 INFO:tasks.workunit.client.1.smithi112.stdout:9/220: dwrite d1/d2/f1e [0,4194304] 0 2024-09-21T10:40:44.036 INFO:tasks.workunit.client.1.smithi112.stdout:4/207: write de/f10 [2489197,16444] 0 2024-09-21T10:40:44.043 INFO:tasks.workunit.client.1.smithi112.stdout:1/372: dwrite d8/d1a/f3b [0,4194304] 0 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:4/208: write de/f24 [3348417,96639] 0 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:1/373: stat d8/d1a/c36 0 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:1/374: fdatasync d8/d1a/d31/d37/f77 0 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:1/375: chown d8/c25 2584 1 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:1/376: creat d8/d1a/d31/d66/f82 x:0 0 0 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:3/223: dwrite d2/f19 [4194304,4194304] 0 2024-09-21T10:40:44.045 INFO:tasks.workunit.client.1.smithi112.stdout:3/224: write d2/f1d [4342229,121932] 0 2024-09-21T10:40:44.047 INFO:tasks.workunit.client.1.smithi112.stdout:4/209: mknod de/d34/d40/c47 0 2024-09-21T10:40:44.049 INFO:tasks.workunit.client.1.smithi112.stdout:1/377: unlink d8/l4f 0 2024-09-21T10:40:44.049 INFO:tasks.workunit.client.1.smithi112.stdout:1/378: stat d8/d1a/d31/d66 0 2024-09-21T10:40:44.055 INFO:tasks.workunit.client.1.smithi112.stdout:3/225: read d2/fa [2482624,52213] 0 2024-09-21T10:40:44.055 INFO:tasks.workunit.client.1.smithi112.stdout:3/226: readlink d2/d22/l26 0 2024-09-21T10:40:44.058 INFO:tasks.workunit.client.1.smithi112.stdout:4/210: write de/f15 [4445610,10590] 0 2024-09-21T10:40:44.058 INFO:tasks.workunit.client.1.smithi112.stdout:4/211: chown f5 78227556 1 2024-09-21T10:40:44.060 INFO:tasks.workunit.client.1.smithi112.stdout:4/212: creat de/d2e/f48 x:0 0 0 2024-09-21T10:40:44.060 INFO:tasks.workunit.client.1.smithi112.stdout:4/213: fdatasync de/d33/f30 0 2024-09-21T10:40:44.064 INFO:tasks.workunit.client.1.smithi112.stdout:3/227: write d2/d22/f29 [2424817,112427] 0 2024-09-21T10:40:44.065 INFO:tasks.workunit.client.1.smithi112.stdout:3/228: symlink d2/d2f/l4d 0 2024-09-21T10:40:44.065 INFO:tasks.workunit.client.1.smithi112.stdout:3/229: write d2/d22/d31/d2a/f3b [852761,44866] 0 2024-09-21T10:40:44.066 INFO:tasks.workunit.client.1.smithi112.stdout:1/379: dwrite d8/f40 [0,4194304] 0 2024-09-21T10:40:44.066 INFO:tasks.workunit.client.1.smithi112.stdout:1/380: chown d8/f15 100 1 2024-09-21T10:40:44.067 INFO:tasks.workunit.client.1.smithi112.stdout:1/381: mkdir d8/d1a/d53/d57/d83 0 2024-09-21T10:40:44.067 INFO:tasks.workunit.client.1.smithi112.stdout:1/382: chown d8/d1a/d53/d57/c6b 61596 1 2024-09-21T10:40:44.067 INFO:tasks.workunit.client.1.smithi112.stdout:1/383: fdatasync d8/d1a/d31/f4e 0 2024-09-21T10:40:44.068 INFO:tasks.workunit.client.1.smithi112.stdout:4/214: write de/f12 [3544280,118301] 0 2024-09-21T10:40:44.073 INFO:tasks.workunit.client.1.smithi112.stdout:3/230: write d2/d2f/f30 [1554401,96756] 0 2024-09-21T10:40:44.075 INFO:tasks.workunit.client.1.smithi112.stdout:4/215: dread f8 [0,4194304] 0 2024-09-21T10:40:44.076 INFO:tasks.workunit.client.1.smithi112.stdout:4/216: creat de/d2a/d3d/f49 x:0 0 0 2024-09-21T10:40:44.082 INFO:tasks.workunit.client.1.smithi112.stdout:4/217: dread de/d2a/d3d/f42 [0,4194304] 0 2024-09-21T10:40:44.083 INFO:tasks.workunit.client.1.smithi112.stdout:4/218: link de/f11 de/d34/f4a 0 2024-09-21T10:40:44.084 INFO:tasks.workunit.client.1.smithi112.stdout:4/219: symlink de/d2a/d31/l4b 0 2024-09-21T10:40:44.084 INFO:tasks.workunit.client.1.smithi112.stdout:4/220: mkdir de/d33/d2f/d35/d4c 0 2024-09-21T10:40:44.085 INFO:tasks.workunit.client.1.smithi112.stdout:4/221: creat de/f4d x:0 0 0 2024-09-21T10:40:44.088 INFO:tasks.workunit.client.1.smithi112.stdout:1/384: dwrite d8/f1f [0,4194304] 0 2024-09-21T10:40:44.088 INFO:tasks.workunit.client.1.smithi112.stdout:1/385: truncate d8/d1a/d31/f7c 494853 0 2024-09-21T10:40:44.089 INFO:tasks.workunit.client.1.smithi112.stdout:4/222: dread de/d2e/f32 [0,4194304] 0 2024-09-21T10:40:44.089 INFO:tasks.workunit.client.1.smithi112.stdout:4/223: chown de/d33/d2f/d35/d4c 32907209 1 2024-09-21T10:40:44.089 INFO:tasks.workunit.client.1.smithi112.stdout:3/231: dwrite d2/fe [0,4194304] 0 2024-09-21T10:40:44.090 INFO:tasks.workunit.client.1.smithi112.stdout:4/224: getdents de/d34/d40 0 2024-09-21T10:40:44.094 INFO:tasks.workunit.client.1.smithi112.stdout:5/235: sync 2024-09-21T10:40:44.094 INFO:tasks.workunit.client.1.smithi112.stdout:6/259: sync 2024-09-21T10:40:44.094 INFO:tasks.workunit.client.1.smithi112.stdout:0/281: sync 2024-09-21T10:40:44.094 INFO:tasks.workunit.client.1.smithi112.stdout:7/172: sync 2024-09-21T10:40:44.095 INFO:tasks.workunit.client.1.smithi112.stdout:2/226: sync 2024-09-21T10:40:44.095 INFO:tasks.workunit.client.1.smithi112.stdout:8/245: sync 2024-09-21T10:40:44.095 INFO:tasks.workunit.client.1.smithi112.stdout:8/246: chown l6 0 1 2024-09-21T10:40:44.095 INFO:tasks.workunit.client.1.smithi112.stdout:6/260: write d4/d6/da/fb [1468164,127235] 0 2024-09-21T10:40:44.095 INFO:tasks.workunit.client.1.smithi112.stdout:6/261: readlink d4/d6/l9 0 2024-09-21T10:40:44.096 INFO:tasks.workunit.client.1.smithi112.stdout:5/236: link d9/f11 d9/d15/d18/d20/d47/f49 0 2024-09-21T10:40:44.096 INFO:tasks.workunit.client.1.smithi112.stdout:5/237: chown c5 6294 1 2024-09-21T10:40:44.096 INFO:tasks.workunit.client.1.smithi112.stdout:7/173: truncate d7/f1c 1696510 0 2024-09-21T10:40:44.097 INFO:tasks.workunit.client.1.smithi112.stdout:8/247: unlink d8/d9/dd/d2b/f2e 0 2024-09-21T10:40:44.098 INFO:tasks.workunit.client.1.smithi112.stdout:2/227: symlink d0/dd/l48 0 2024-09-21T10:40:44.098 INFO:tasks.workunit.client.1.smithi112.stdout:2/228: truncate d0/f2f 428706 0 2024-09-21T10:40:44.099 INFO:tasks.workunit.client.1.smithi112.stdout:0/282: rmdir d3/d18 39 2024-09-21T10:40:44.099 INFO:tasks.workunit.client.1.smithi112.stdout:5/238: rmdir d9/d15 39 2024-09-21T10:40:44.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/174: link d7/d22/f31 d7/d22/f38 0 2024-09-21T10:40:44.101 INFO:tasks.workunit.client.1.smithi112.stdout:8/248: link d8/d9/dd/d1a/c36 d8/d9/dd/d2b/c4e 0 2024-09-21T10:40:44.101 INFO:tasks.workunit.client.1.smithi112.stdout:2/229: rename d0/d12/d26/d38 to d0/dd/d49 0 2024-09-21T10:40:44.127 INFO:tasks.workunit.client.1.smithi112.stdout:1/386: dwrite d8/d1a/d31/f4e [0,4194304] 0 2024-09-21T10:40:44.130 INFO:tasks.workunit.client.1.smithi112.stdout:1/387: rename d8/d1a/l43 to d8/d1a/l84 0 2024-09-21T10:40:44.131 INFO:tasks.workunit.client.1.smithi112.stdout:1/388: dread d8/f3a [0,4194304] 0 2024-09-21T10:40:44.132 INFO:tasks.workunit.client.1.smithi112.stdout:1/389: rename d8/f9 to d8/f85 0 2024-09-21T10:40:44.132 INFO:tasks.workunit.client.1.smithi112.stdout:1/390: fdatasync d8/d20/f5b 0 2024-09-21T10:40:44.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/391: truncate d8/d1a/d31/d37/f77 3830905 0 2024-09-21T10:40:44.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/392: write d8/d1a/f67 [1149255,60045] 0 2024-09-21T10:40:44.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/393: truncate d8/d1a/d53/f60 397709 0 2024-09-21T10:40:44.133 INFO:tasks.workunit.client.1.smithi112.stdout:1/394: rmdir d8/d20 39 2024-09-21T10:40:44.134 INFO:tasks.workunit.client.1.smithi112.stdout:1/395: creat d8/d54/d6d/f86 x:0 0 0 2024-09-21T10:40:44.135 INFO:tasks.workunit.client.1.smithi112.stdout:1/396: getdents d8/d1a/d31/d66 0 2024-09-21T10:40:44.135 INFO:tasks.workunit.client.1.smithi112.stdout:1/397: readlink d8/l48 0 2024-09-21T10:40:44.136 INFO:tasks.workunit.client.1.smithi112.stdout:1/398: mkdir d8/d1a/d31/d66/d87 0 2024-09-21T10:40:44.137 INFO:tasks.workunit.client.1.smithi112.stdout:1/399: mknod d8/d1a/d31/c88 0 2024-09-21T10:40:44.138 INFO:tasks.workunit.client.1.smithi112.stdout:1/400: mknod d8/c89 0 2024-09-21T10:40:44.152 INFO:tasks.workunit.client.1.smithi112.stdout:4/225: dwrite de/d33/f38 [0,4194304] 0 2024-09-21T10:40:44.153 INFO:tasks.workunit.client.1.smithi112.stdout:5/239: getdents d9/d15/d18/d20/d47 0 2024-09-21T10:40:44.155 INFO:tasks.workunit.client.1.smithi112.stdout:4/226: symlink de/d2a/d31/l4e 0 2024-09-21T10:40:44.156 INFO:tasks.workunit.client.1.smithi112.stdout:5/240: link d9/d15/d18/c2b d9/d15/d18/d20/d47/c4a 0 2024-09-21T10:40:44.156 INFO:tasks.workunit.client.1.smithi112.stdout:4/227: mkdir de/d34/d40/d4f 0 2024-09-21T10:40:44.157 INFO:tasks.workunit.client.1.smithi112.stdout:5/241: mkdir d9/d15/d18/d3a/d4b 0 2024-09-21T10:40:44.157 INFO:tasks.workunit.client.1.smithi112.stdout:5/242: write d9/d15/d18/d3a/f44 [351724,94266] 0 2024-09-21T10:40:44.157 INFO:tasks.workunit.client.1.smithi112.stdout:4/228: unlink de/d18/c28 0 2024-09-21T10:40:44.158 INFO:tasks.workunit.client.1.smithi112.stdout:4/229: rmdir de/d34 39 2024-09-21T10:40:44.160 INFO:tasks.workunit.client.1.smithi112.stdout:4/230: symlink de/l50 0 2024-09-21T10:40:44.160 INFO:tasks.workunit.client.1.smithi112.stdout:7/175: dwrite d7/f26 [0,4194304] 0 2024-09-21T10:40:44.160 INFO:tasks.workunit.client.1.smithi112.stdout:7/176: readlink d7/l32 0 2024-09-21T10:40:44.160 INFO:tasks.workunit.client.1.smithi112.stdout:7/177: fsync d7/f14 0 2024-09-21T10:40:44.160 INFO:tasks.workunit.client.1.smithi112.stdout:2/230: dwrite d0/dd/f2e [4194304,4194304] 0 2024-09-21T10:40:44.161 INFO:tasks.workunit.client.1.smithi112.stdout:8/249: dwrite d8/d9/dd/f42 [0,4194304] 0 2024-09-21T10:40:44.161 INFO:tasks.workunit.client.1.smithi112.stdout:6/262: dwrite d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:44.161 INFO:tasks.workunit.client.1.smithi112.stdout:6/263: chown d4/d6/da/l3d 21 1 2024-09-21T10:40:44.161 INFO:tasks.workunit.client.1.smithi112.stdout:1/401: dwrite d8/d1a/f62 [0,4194304] 0 2024-09-21T10:40:44.161 INFO:tasks.workunit.client.1.smithi112.stdout:3/232: dwrite d2/d22/f29 [0,4194304] 0 2024-09-21T10:40:44.162 INFO:tasks.workunit.client.1.smithi112.stdout:0/283: dwrite d3/d4/d10/f24 [4194304,4194304] 0 2024-09-21T10:40:44.162 INFO:tasks.workunit.client.1.smithi112.stdout:7/178: truncate d7/d22/f23 1474025 0 2024-09-21T10:40:44.164 INFO:tasks.workunit.client.1.smithi112.stdout:2/231: symlink d0/l4a 0 2024-09-21T10:40:44.168 INFO:tasks.workunit.client.1.smithi112.stdout:6/264: mkdir d4/d6/da/d14/d49/d62 0 2024-09-21T10:40:44.170 INFO:tasks.workunit.client.1.smithi112.stdout:3/233: symlink d2/d22/d31/d2a/l4e 0 2024-09-21T10:40:44.170 INFO:tasks.workunit.client.1.smithi112.stdout:3/234: fdatasync f0 0 2024-09-21T10:40:44.171 INFO:tasks.workunit.client.1.smithi112.stdout:0/284: creat d3/d4a/f64 x:0 0 0 2024-09-21T10:40:44.171 INFO:tasks.workunit.client.1.smithi112.stdout:0/285: chown d3/d4a/d4e 47545 1 2024-09-21T10:40:44.172 INFO:tasks.workunit.client.1.smithi112.stdout:7/179: symlink d7/d22/l39 0 2024-09-21T10:40:44.172 INFO:tasks.workunit.client.1.smithi112.stdout:7/180: chown f5 20420064 1 2024-09-21T10:40:44.173 INFO:tasks.workunit.client.1.smithi112.stdout:7/181: read d7/f10 [104911,103245] 0 2024-09-21T10:40:44.173 INFO:tasks.workunit.client.1.smithi112.stdout:7/182: write d7/f1e [942181,87882] 0 2024-09-21T10:40:44.173 INFO:tasks.workunit.client.1.smithi112.stdout:1/402: write d8/d1a/d31/f4e [3142853,26079] 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:8/250: rmdir d8/d9/dd 39 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:8/251: fdatasync d8/d9/dd/f20 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:6/265: symlink d4/d6/l63 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:3/235: creat d2/d1f/f4f x:0 0 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:0/286: creat d3/d4/d1a/f65 x:0 0 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:3/236: chown d2/c11 22124784 1 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:7/183: creat d7/f3a x:0 0 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:7/184: fsync d7/ff 0 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:5/243: rmdir d9 39 2024-09-21T10:40:44.182 INFO:tasks.workunit.client.1.smithi112.stdout:1/403: write d8/f1f [1451616,42740] 0 2024-09-21T10:40:44.185 INFO:tasks.workunit.client.1.smithi112.stdout:4/231: truncate de/f15 2369753 0 2024-09-21T10:40:44.189 INFO:tasks.workunit.client.1.smithi112.stdout:2/232: rmdir d0 39 2024-09-21T10:40:44.190 INFO:tasks.workunit.client.1.smithi112.stdout:8/252: rename d8/d9/dd/c28 to d8/d9/d3c/c4f 0 2024-09-21T10:40:44.193 INFO:tasks.workunit.client.1.smithi112.stdout:3/237: mknod d2/d22/d31/d2a/c50 0 2024-09-21T10:40:44.193 INFO:tasks.workunit.client.1.smithi112.stdout:2/233: dread d0/f19 [0,4194304] 0 2024-09-21T10:40:44.196 INFO:tasks.workunit.client.1.smithi112.stdout:5/244: dread d9/d15/d18/f38 [0,4194304] 0 2024-09-21T10:40:44.205 INFO:tasks.workunit.client.1.smithi112.stdout:8/253: dread d8/fc [0,4194304] 0 2024-09-21T10:40:44.205 INFO:tasks.workunit.client.1.smithi112.stdout:0/287: dwrite d3/d4/d1a/d21/f61 [0,4194304] 0 2024-09-21T10:40:44.206 INFO:tasks.workunit.client.1.smithi112.stdout:1/404: dwrite d8/d1a/f62 [0,4194304] 0 2024-09-21T10:40:44.207 INFO:tasks.workunit.client.1.smithi112.stdout:7/185: rename d7/d22/l2d to d7/l3b 0 2024-09-21T10:40:44.208 INFO:tasks.workunit.client.1.smithi112.stdout:6/266: getdents d4/d6 0 2024-09-21T10:40:44.208 INFO:tasks.workunit.client.1.smithi112.stdout:6/267: write d4/d6/da/d11/d1f/f55 [178328,102255] 0 2024-09-21T10:40:44.208 INFO:tasks.workunit.client.1.smithi112.stdout:6/268: write d4/dc/f4b [227381,127334] 0 2024-09-21T10:40:44.208 INFO:tasks.workunit.client.1.smithi112.stdout:1/405: read d8/d20/f4a [910167,41482] 0 2024-09-21T10:40:44.208 INFO:tasks.workunit.client.1.smithi112.stdout:2/234: mknod d0/dd/d47/c4b 0 2024-09-21T10:40:44.209 INFO:tasks.workunit.client.1.smithi112.stdout:8/254: creat d8/d9/d3c/f50 x:0 0 0 2024-09-21T10:40:44.211 INFO:tasks.workunit.client.1.smithi112.stdout:0/288: rmdir d3/d18/d52 39 2024-09-21T10:40:44.211 INFO:tasks.workunit.client.1.smithi112.stdout:0/289: creat d3/f66 x:0 0 0 2024-09-21T10:40:44.211 INFO:tasks.workunit.client.1.smithi112.stdout:0/290: creat d3/d23/f67 x:0 0 0 2024-09-21T10:40:44.213 INFO:tasks.workunit.client.1.smithi112.stdout:2/235: dread d0/d12/d26/f17 [0,4194304] 0 2024-09-21T10:40:44.213 INFO:tasks.workunit.client.1.smithi112.stdout:2/236: readlink d0/l2b 0 2024-09-21T10:40:44.213 INFO:tasks.workunit.client.1.smithi112.stdout:5/245: rename d9/d15/d1d/c41 to d9/d15/d18/d3a/d4b/c4c 0 2024-09-21T10:40:44.214 INFO:tasks.workunit.client.1.smithi112.stdout:8/255: creat d8/d9/dd/d1a/f51 x:0 0 0 2024-09-21T10:40:44.215 INFO:tasks.workunit.client.1.smithi112.stdout:8/256: chown d8/d9/dd/d1a/f26 43139 1 2024-09-21T10:40:44.216 INFO:tasks.workunit.client.1.smithi112.stdout:0/291: link d3/d23/l2f d3/d4/d10/l68 0 2024-09-21T10:40:44.217 INFO:tasks.workunit.client.1.smithi112.stdout:2/237: creat d0/d12/d26/f4c x:0 0 0 2024-09-21T10:40:44.217 INFO:tasks.workunit.client.1.smithi112.stdout:2/238: write d0/dd/f2e [9005717,59275] 0 2024-09-21T10:40:44.218 INFO:tasks.workunit.client.1.smithi112.stdout:0/292: dread d3/d4/f13 [0,4194304] 0 2024-09-21T10:40:44.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/246: creat d9/d15/d1d/f4d x:0 0 0 2024-09-21T10:40:44.218 INFO:tasks.workunit.client.1.smithi112.stdout:5/247: fdatasync d9/d15/d1d/f46 0 2024-09-21T10:40:44.219 INFO:tasks.workunit.client.1.smithi112.stdout:3/238: dwrite d2/f14 [0,4194304] 0 2024-09-21T10:40:44.219 INFO:tasks.workunit.client.1.smithi112.stdout:3/239: creat d2/f51 x:0 0 0 2024-09-21T10:40:44.220 INFO:tasks.workunit.client.1.smithi112.stdout:1/406: rename d8/d1a/d53/d57/f6c to d8/d1a/d31/d37/f8a 0 2024-09-21T10:40:44.220 INFO:tasks.workunit.client.1.smithi112.stdout:1/407: write d8/d54/d6d/f86 [773280,38024] 0 2024-09-21T10:40:44.220 INFO:tasks.workunit.client.1.smithi112.stdout:1/408: write d8/d20/f4a [1854747,97347] 0 2024-09-21T10:40:44.221 INFO:tasks.workunit.client.1.smithi112.stdout:5/248: rename d9 to d9/d15/d18/d4e 22 2024-09-21T10:40:44.225 INFO:tasks.workunit.client.1.smithi112.stdout:0/293: rename d3/d4/d10/c53 to d3/d4/d1a/c69 0 2024-09-21T10:40:44.225 INFO:tasks.workunit.client.1.smithi112.stdout:4/232: dwrite de/d33/d2f/d35/f36 [0,4194304] 0 2024-09-21T10:40:44.225 INFO:tasks.workunit.client.1.smithi112.stdout:4/233: stat f0 0 2024-09-21T10:40:44.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/257: dread d8/d9/f25 [4194304,4194304] 0 2024-09-21T10:40:44.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/258: write d8/d9/dd/d1a/f51 [847510,67675] 0 2024-09-21T10:40:44.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/259: unlink d8/d9/l40 0 2024-09-21T10:40:44.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/260: chown d8/d9/dd/d2b/c4e 2335 1 2024-09-21T10:40:44.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/261: dread - d8/d9/dd/d2a/d43/f47 zero size 2024-09-21T10:40:44.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/262: write d8/d9/dd/d2b/d31/d46/f4b [125199,114830] 0 2024-09-21T10:40:44.231 INFO:tasks.workunit.client.1.smithi112.stdout:8/263: link d8/d18/f24 d8/d9/d3c/f52 0 2024-09-21T10:40:44.234 INFO:tasks.workunit.client.1.smithi112.stdout:8/264: creat d8/d9/f53 x:0 0 0 2024-09-21T10:40:44.237 INFO:tasks.workunit.client.1.smithi112.stdout:8/265: rename d8/c17 to d8/d9/dd/d2a/c54 0 2024-09-21T10:40:44.237 INFO:tasks.workunit.client.1.smithi112.stdout:8/266: truncate d8/d9/dd/f2f 1876602 0 2024-09-21T10:40:44.239 INFO:tasks.workunit.client.1.smithi112.stdout:8/267: unlink d8/d9/dd/d2b/d31/d46/f4b 0 2024-09-21T10:40:44.244 INFO:tasks.workunit.client.1.smithi112.stdout:9/221: sync 2024-09-21T10:40:44.244 INFO:tasks.workunit.client.1.smithi112.stdout:9/222: creat d1/d2/d27/f44 x:0 0 0 2024-09-21T10:40:44.244 INFO:tasks.workunit.client.1.smithi112.stdout:9/223: readlink d1/l6 0 2024-09-21T10:40:44.244 INFO:tasks.workunit.client.1.smithi112.stdout:7/186: rmdir d7/d22 39 2024-09-21T10:40:44.254 INFO:tasks.workunit.client.1.smithi112.stdout:7/187: dread d7/f13 [0,4194304] 0 2024-09-21T10:40:44.254 INFO:tasks.workunit.client.1.smithi112.stdout:7/188: dread - d7/d22/f2e zero size 2024-09-21T10:40:44.254 INFO:tasks.workunit.client.1.smithi112.stdout:7/189: write d7/d22/f28 [653861,118801] 0 2024-09-21T10:40:44.256 INFO:tasks.workunit.client.1.smithi112.stdout:7/190: rmdir d7 39 2024-09-21T10:40:44.256 INFO:tasks.workunit.client.1.smithi112.stdout:7/191: symlink d7/l3c 0 2024-09-21T10:40:44.256 INFO:tasks.workunit.client.1.smithi112.stdout:7/192: stat d7/f14 0 2024-09-21T10:40:44.257 INFO:tasks.workunit.client.1.smithi112.stdout:7/193: mkdir d7/d3d 0 2024-09-21T10:40:44.258 INFO:tasks.workunit.client.1.smithi112.stdout:9/224: dread d1/d2/d27/d3a/f33 [0,4194304] 0 2024-09-21T10:40:44.259 INFO:tasks.workunit.client.1.smithi112.stdout:9/225: creat d1/d2/d42/f45 x:0 0 0 2024-09-21T10:40:44.260 INFO:tasks.workunit.client.1.smithi112.stdout:9/226: dread d1/f36 [0,4194304] 0 2024-09-21T10:40:44.264 INFO:tasks.workunit.client.1.smithi112.stdout:1/409: dwrite d8/d1a/d31/f3e [0,4194304] 0 2024-09-21T10:40:44.265 INFO:tasks.workunit.client.1.smithi112.stdout:1/410: link d8/f24 d8/d1a/d53/d57/d83/f8b 0 2024-09-21T10:40:44.265 INFO:tasks.workunit.client.1.smithi112.stdout:1/411: truncate d8/d1a/f2c 2855473 0 2024-09-21T10:40:44.266 INFO:tasks.workunit.client.1.smithi112.stdout:2/239: dwrite d0/d12/f41 [0,4194304] 0 2024-09-21T10:40:44.266 INFO:tasks.workunit.client.1.smithi112.stdout:5/249: dwrite d9/d15/f2a [0,4194304] 0 2024-09-21T10:40:44.266 INFO:tasks.workunit.client.1.smithi112.stdout:1/412: unlink d8/f18 0 2024-09-21T10:40:44.269 INFO:tasks.workunit.client.1.smithi112.stdout:4/234: dwrite de/d18/f26 [0,4194304] 0 2024-09-21T10:40:44.269 INFO:tasks.workunit.client.1.smithi112.stdout:2/240: creat d0/d12/f4d x:0 0 0 2024-09-21T10:40:44.269 INFO:tasks.workunit.client.1.smithi112.stdout:2/241: dread - d0/d12/d26/f4c zero size 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:3/240: dwrite d2/d22/d31/d37/f46 [0,4194304] 0 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/242: write d0/f19 [533194,6058] 0 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:0/294: dwrite d3/f66 [0,4194304] 0 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/243: write d0/d12/d26/f35 [448685,14642] 0 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:0/295: write d3/d23/f3f [1133964,25296] 0 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:0/296: stat d3/d4a/f64 0 2024-09-21T10:40:44.270 INFO:tasks.workunit.client.1.smithi112.stdout:0/297: creat d3/d4a/f6a x:0 0 0 2024-09-21T10:40:44.279 INFO:tasks.workunit.client.1.smithi112.stdout:5/250: dread d9/d15/f16 [4194304,4194304] 0 2024-09-21T10:40:44.280 INFO:tasks.workunit.client.1.smithi112.stdout:2/244: dread d0/dd/d33/f37 [0,4194304] 0 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:5/251: dread d9/f1b [0,4194304] 0 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:4/235: write de/f11 [3609027,10700] 0 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:4/236: fsync de/d33/d2f/d35/f3b 0 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:4/237: chown de/d2e/f32 234586 1 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:0/298: unlink d3/d18/d52/c3a 0 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:0/299: write d3/f2b [7287396,14764] 0 2024-09-21T10:40:44.287 INFO:tasks.workunit.client.1.smithi112.stdout:0/300: chown d3/d4/f13 13 1 2024-09-21T10:40:44.288 INFO:tasks.workunit.client.1.smithi112.stdout:3/241: getdents d2/d1f 0 2024-09-21T10:40:44.288 INFO:tasks.workunit.client.1.smithi112.stdout:0/301: write d3/d18/d52/d55/f5e [386480,38329] 0 2024-09-21T10:40:44.288 INFO:tasks.workunit.client.1.smithi112.stdout:0/302: dread - d3/d4a/d4e/f63 zero size 2024-09-21T10:40:44.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/227: dwrite d1/f1b [0,4194304] 0 2024-09-21T10:40:44.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/228: write d1/f43 [987820,128569] 0 2024-09-21T10:40:44.289 INFO:tasks.workunit.client.1.smithi112.stdout:5/252: mknod d9/d15/d18/c4f 0 2024-09-21T10:40:44.291 INFO:tasks.workunit.client.1.smithi112.stdout:5/253: mknod d9/d15/d1d/c50 0 2024-09-21T10:40:44.291 INFO:tasks.workunit.client.1.smithi112.stdout:5/254: creat d9/d15/d1d/f51 x:0 0 0 2024-09-21T10:40:44.291 INFO:tasks.workunit.client.1.smithi112.stdout:5/255: chown d9/f1c 20450 1 2024-09-21T10:40:44.291 INFO:tasks.workunit.client.1.smithi112.stdout:7/194: dwrite d7/d22/f28 [0,4194304] 0 2024-09-21T10:40:44.291 INFO:tasks.workunit.client.1.smithi112.stdout:7/195: getdents d7/d3d 0 2024-09-21T10:40:44.292 INFO:tasks.workunit.client.1.smithi112.stdout:8/268: rename d8/d9/dd/d2a/c54 to d8/d9/dd/d2b/d31/d46/c55 0 2024-09-21T10:40:44.292 INFO:tasks.workunit.client.1.smithi112.stdout:8/269: fsync d8/d9/f53 0 2024-09-21T10:40:44.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/196: link d7/f14 d7/d3d/f3e 0 2024-09-21T10:40:44.296 INFO:tasks.workunit.client.1.smithi112.stdout:4/238: rename de/c22 to de/d33/d2f/d35/d4c/c51 0 2024-09-21T10:40:44.298 INFO:tasks.workunit.client.1.smithi112.stdout:8/270: creat d8/d9/dd/d2b/f56 x:0 0 0 2024-09-21T10:40:44.298 INFO:tasks.workunit.client.1.smithi112.stdout:8/271: fdatasync d8/d9/dd/d2a/d43/f47 0 2024-09-21T10:40:44.298 INFO:tasks.workunit.client.1.smithi112.stdout:8/272: write d8/d9/f13 [2656809,21872] 0 2024-09-21T10:40:44.298 INFO:tasks.workunit.client.1.smithi112.stdout:4/239: dread de/d18/f3f [0,4194304] 0 2024-09-21T10:40:44.298 INFO:tasks.workunit.client.1.smithi112.stdout:8/273: write d8/d9/dd/d1a/f51 [411993,56490] 0 2024-09-21T10:40:44.299 INFO:tasks.workunit.client.1.smithi112.stdout:7/197: rmdir d7 39 2024-09-21T10:40:44.300 INFO:tasks.workunit.client.1.smithi112.stdout:3/242: rename d2/f1d to d2/d22/d31/d37/f52 0 2024-09-21T10:40:44.302 INFO:tasks.workunit.client.1.smithi112.stdout:4/240: creat de/d33/d2f/f52 x:0 0 0 2024-09-21T10:40:44.304 INFO:tasks.workunit.client.1.smithi112.stdout:7/198: unlink d7/d22/c2b 0 2024-09-21T10:40:44.307 INFO:tasks.workunit.client.1.smithi112.stdout:9/229: rename d1/d2/c17 to d1/d2/d27/c46 0 2024-09-21T10:40:44.309 INFO:tasks.workunit.client.1.smithi112.stdout:4/241: symlink de/d2a/d3d/d3e/l53 0 2024-09-21T10:40:44.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/243: rename d2/d22/d31/d2a/d39/d3a/f49 to d2/d2f/f53 0 2024-09-21T10:40:44.311 INFO:tasks.workunit.client.1.smithi112.stdout:4/242: dread f5 [0,4194304] 0 2024-09-21T10:40:44.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/230: getdents d1/d2/d27/d37 0 2024-09-21T10:40:44.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/231: chown d1/d2/d27/d3a/d16/d30/l38 94214583 1 2024-09-21T10:40:44.311 INFO:tasks.workunit.client.1.smithi112.stdout:9/232: dread - d1/d2/d42/f45 zero size 2024-09-21T10:40:44.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/243: mknod de/d34/d40/d4f/c54 0 2024-09-21T10:40:44.312 INFO:tasks.workunit.client.1.smithi112.stdout:4/244: creat de/d33/d2f/d35/f55 x:0 0 0 2024-09-21T10:40:44.314 INFO:tasks.workunit.client.1.smithi112.stdout:4/245: unlink de/d2a/d3d/f42 0 2024-09-21T10:40:44.314 INFO:tasks.workunit.client.1.smithi112.stdout:4/246: readlink de/l50 0 2024-09-21T10:40:44.316 INFO:tasks.workunit.client.1.smithi112.stdout:4/247: dread f5 [0,4194304] 0 2024-09-21T10:40:44.317 INFO:tasks.workunit.client.1.smithi112.stdout:4/248: write f5 [715727,85395] 0 2024-09-21T10:40:44.318 INFO:tasks.workunit.client.1.smithi112.stdout:4/249: mknod de/d2a/d3d/c56 0 2024-09-21T10:40:44.318 INFO:tasks.workunit.client.1.smithi112.stdout:4/250: getdents de/d34/d40 0 2024-09-21T10:40:44.320 INFO:tasks.workunit.client.1.smithi112.stdout:4/251: mkdir de/d2a/d3d/d3e/d57 0 2024-09-21T10:40:44.320 INFO:tasks.workunit.client.1.smithi112.stdout:3/244: dread d2/d22/d31/d2a/d39/d3a/f47 [0,4194304] 0 2024-09-21T10:40:44.320 INFO:tasks.workunit.client.1.smithi112.stdout:3/245: stat d2/d1f/f4f 0 2024-09-21T10:40:44.321 INFO:tasks.workunit.client.1.smithi112.stdout:3/246: symlink d2/d22/d31/d2a/l54 0 2024-09-21T10:40:44.321 INFO:tasks.workunit.client.1.smithi112.stdout:3/247: readlink d2/d22/d31/d2a/d39/l45 0 2024-09-21T10:40:44.326 INFO:tasks.workunit.client.1.smithi112.stdout:3/248: mknod d2/d22/c55 0 2024-09-21T10:40:44.328 INFO:tasks.workunit.client.1.smithi112.stdout:2/245: dwrite d0/f25 [0,4194304] 0 2024-09-21T10:40:44.330 INFO:tasks.workunit.client.1.smithi112.stdout:2/246: creat d0/dd/f4e x:0 0 0 2024-09-21T10:40:44.331 INFO:tasks.workunit.client.1.smithi112.stdout:5/256: dwrite d9/d15/f2e [0,4194304] 0 2024-09-21T10:40:44.331 INFO:tasks.workunit.client.1.smithi112.stdout:0/303: dwrite d3/d4/d10/f35 [0,4194304] 0 2024-09-21T10:40:44.331 INFO:tasks.workunit.client.1.smithi112.stdout:0/304: readlink d3/d4/lf 0 2024-09-21T10:40:44.332 INFO:tasks.workunit.client.1.smithi112.stdout:2/247: link d0/d12/d26/f1a d0/d12/d26/f4f 0 2024-09-21T10:40:44.332 INFO:tasks.workunit.client.1.smithi112.stdout:1/413: dwrite d8/d1a/f67 [0,4194304] 0 2024-09-21T10:40:44.333 INFO:tasks.workunit.client.1.smithi112.stdout:9/233: dwrite d1/d2/d27/d3a/f2d [0,4194304] 0 2024-09-21T10:40:44.333 INFO:tasks.workunit.client.1.smithi112.stdout:5/257: creat d9/d15/d18/d3a/d4b/f52 x:0 0 0 2024-09-21T10:40:44.333 INFO:tasks.workunit.client.1.smithi112.stdout:5/258: write d9/d15/d18/d3a/d4b/f52 [949344,92039] 0 2024-09-21T10:40:44.333 INFO:tasks.workunit.client.1.smithi112.stdout:5/259: write d9/f11 [4477095,1985] 0 2024-09-21T10:40:44.335 INFO:tasks.workunit.client.1.smithi112.stdout:4/252: write f0 [1928910,39048] 0 2024-09-21T10:40:44.345 INFO:tasks.workunit.client.1.smithi112.stdout:7/199: dwrite d7/f1c [0,4194304] 0 2024-09-21T10:40:44.348 INFO:tasks.workunit.client.1.smithi112.stdout:1/414: rename d8/d1a/d53/f71 to d8/d54/f8c 0 2024-09-21T10:40:44.349 INFO:tasks.workunit.client.1.smithi112.stdout:9/234: mknod d1/d2/d27/c47 0 2024-09-21T10:40:44.350 INFO:tasks.workunit.client.1.smithi112.stdout:8/274: dwrite d8/d9/dd/f1d [0,4194304] 0 2024-09-21T10:40:44.351 INFO:tasks.workunit.client.1.smithi112.stdout:8/275: stat d8/d18/f1c 0 2024-09-21T10:40:44.351 INFO:tasks.workunit.client.1.smithi112.stdout:4/253: write de/d33/f38 [1641054,123844] 0 2024-09-21T10:40:44.354 INFO:tasks.workunit.client.1.smithi112.stdout:7/200: creat d7/f3f x:0 0 0 2024-09-21T10:40:44.365 INFO:tasks.workunit.client.1.smithi112.stdout:7/201: dread f6 [0,4194304] 0 2024-09-21T10:40:44.365 INFO:tasks.workunit.client.1.smithi112.stdout:7/202: readlink d7/l8 0 2024-09-21T10:40:44.366 INFO:tasks.workunit.client.1.smithi112.stdout:7/203: link d7/f1c d7/d3d/f40 0 2024-09-21T10:40:44.367 INFO:tasks.workunit.client.1.smithi112.stdout:7/204: mkdir d7/d22/d41 0 2024-09-21T10:40:44.367 INFO:tasks.workunit.client.1.smithi112.stdout:7/205: truncate d7/f13 3157342 0 2024-09-21T10:40:44.384 INFO:tasks.workunit.client.1.smithi112.stdout:3/249: dwrite d2/f18 [0,4194304] 0 2024-09-21T10:40:44.384 INFO:tasks.workunit.client.1.smithi112.stdout:0/305: dwrite d3/f66 [4194304,4194304] 0 2024-09-21T10:40:44.384 INFO:tasks.workunit.client.1.smithi112.stdout:0/306: dread - d3/d4a/d4e/f63 zero size 2024-09-21T10:40:44.387 INFO:tasks.workunit.client.1.smithi112.stdout:3/250: symlink d2/d2f/l56 0 2024-09-21T10:40:44.387 INFO:tasks.workunit.client.1.smithi112.stdout:3/251: stat d2/d22/f38 0 2024-09-21T10:40:44.391 INFO:tasks.workunit.client.1.smithi112.stdout:4/254: fdatasync de/d33/f38 0 2024-09-21T10:40:44.391 INFO:tasks.workunit.client.1.smithi112.stdout:5/260: dwrite d9/d15/d18/f29 [0,4194304] 0 2024-09-21T10:40:44.391 INFO:tasks.workunit.client.1.smithi112.stdout:1/415: dwrite d8/f17 [4194304,4194304] 0 2024-09-21T10:40:44.392 INFO:tasks.workunit.client.1.smithi112.stdout:2/248: dwrite d0/fe [0,4194304] 0 2024-09-21T10:40:44.392 INFO:tasks.workunit.client.1.smithi112.stdout:9/235: dwrite d1/d2/d27/f44 [0,4194304] 0 2024-09-21T10:40:44.393 INFO:tasks.workunit.client.1.smithi112.stdout:9/236: write d1/d2/d27/d3a/f23 [1437229,107906] 0 2024-09-21T10:40:44.393 INFO:tasks.workunit.client.1.smithi112.stdout:7/206: dwrite d7/f1c [4194304,4194304] 0 2024-09-21T10:40:44.402 INFO:tasks.workunit.client.1.smithi112.stdout:0/307: rename d3/d4/f39 to d3/d4/d10/f6b 0 2024-09-21T10:40:44.403 INFO:tasks.workunit.client.1.smithi112.stdout:3/252: unlink d2/d22/c4a 0 2024-09-21T10:40:44.403 INFO:tasks.workunit.client.1.smithi112.stdout:3/253: read d2/f1b [262828,88362] 0 2024-09-21T10:40:44.406 INFO:tasks.workunit.client.1.smithi112.stdout:8/276: dwrite d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:44.407 INFO:tasks.workunit.client.1.smithi112.stdout:5/261: truncate d9/f1e 126611 0 2024-09-21T10:40:44.408 INFO:tasks.workunit.client.1.smithi112.stdout:5/262: readlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:44.408 INFO:tasks.workunit.client.1.smithi112.stdout:8/277: dread d8/d18/f23 [0,4194304] 0 2024-09-21T10:40:44.408 INFO:tasks.workunit.client.1.smithi112.stdout:2/249: creat d0/dd/d47/f50 x:0 0 0 2024-09-21T10:40:44.408 INFO:tasks.workunit.client.1.smithi112.stdout:2/250: write d0/d12/d26/f17 [2548720,68759] 0 2024-09-21T10:40:44.409 INFO:tasks.workunit.client.1.smithi112.stdout:0/308: fdatasync d3/f2b 0 2024-09-21T10:40:44.411 INFO:tasks.workunit.client.1.smithi112.stdout:9/237: creat d1/d2/f48 x:0 0 0 2024-09-21T10:40:44.411 INFO:tasks.workunit.client.1.smithi112.stdout:9/238: readlink d1/lf 0 2024-09-21T10:40:44.411 INFO:tasks.workunit.client.1.smithi112.stdout:7/207: rename d7/l3b to d7/l42 0 2024-09-21T10:40:44.413 INFO:tasks.workunit.client.1.smithi112.stdout:4/255: rename de/c17 to de/d2a/d3d/d3e/d57/c58 0 2024-09-21T10:40:44.414 INFO:tasks.workunit.client.1.smithi112.stdout:3/254: symlink d2/d2f/d3f/l57 0 2024-09-21T10:40:44.416 INFO:tasks.workunit.client.1.smithi112.stdout:8/278: mkdir d8/d9/d3c/d57 0 2024-09-21T10:40:44.417 INFO:tasks.workunit.client.1.smithi112.stdout:0/309: dread d3/f20 [0,4194304] 0 2024-09-21T10:40:44.418 INFO:tasks.workunit.client.1.smithi112.stdout:1/416: rename d8/l3c to d8/d1a/d31/d66/d87/l8d 0 2024-09-21T10:40:44.418 INFO:tasks.workunit.client.1.smithi112.stdout:1/417: chown d8/d1a/d31/d66 743 1 2024-09-21T10:40:44.418 INFO:tasks.workunit.client.1.smithi112.stdout:4/256: mknod de/d33/c59 0 2024-09-21T10:40:44.419 INFO:tasks.workunit.client.1.smithi112.stdout:3/255: truncate d2/d2f/f30 3887424 0 2024-09-21T10:40:44.419 INFO:tasks.workunit.client.1.smithi112.stdout:3/256: chown d2/d1f/l24 212274801 1 2024-09-21T10:40:44.420 INFO:tasks.workunit.client.1.smithi112.stdout:3/257: fsync d2/f14 0 2024-09-21T10:40:44.420 INFO:tasks.workunit.client.1.smithi112.stdout:3/258: chown d2/d2f/f30 15 1 2024-09-21T10:40:44.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/279: mkdir d8/d9/dd/d2a/d43/d58 0 2024-09-21T10:40:44.421 INFO:tasks.workunit.client.1.smithi112.stdout:2/251: mkdir d0/d12/d1b/d51 0 2024-09-21T10:40:44.421 INFO:tasks.workunit.client.1.smithi112.stdout:1/418: dread d8/d1a/d31/d37/f81 [0,4194304] 0 2024-09-21T10:40:44.422 INFO:tasks.workunit.client.1.smithi112.stdout:0/310: creat d3/d18/d52/f6c x:0 0 0 2024-09-21T10:40:44.423 INFO:tasks.workunit.client.1.smithi112.stdout:0/311: creat d3/d4/d1a/d21/f6d x:0 0 0 2024-09-21T10:40:44.423 INFO:tasks.workunit.client.1.smithi112.stdout:0/312: write d3/d23/f54 [901872,24315] 0 2024-09-21T10:40:44.423 INFO:tasks.workunit.client.1.smithi112.stdout:0/313: creat d3/d4a/d4e/f6e x:0 0 0 2024-09-21T10:40:44.423 INFO:tasks.workunit.client.1.smithi112.stdout:0/314: read - d3/d18/d52/f6c zero size 2024-09-21T10:40:44.423 INFO:tasks.workunit.client.1.smithi112.stdout:0/315: truncate d3/d23/f67 601275 0 2024-09-21T10:40:44.423 INFO:tasks.workunit.client.1.smithi112.stdout:9/239: rename d1/d2/c34 to d1/c49 0 2024-09-21T10:40:44.424 INFO:tasks.workunit.client.1.smithi112.stdout:8/280: link d8/d9/dd/d2b/l3a d8/l59 0 2024-09-21T10:40:44.425 INFO:tasks.workunit.client.1.smithi112.stdout:2/252: creat d0/dd/d49/f52 x:0 0 0 2024-09-21T10:40:44.425 INFO:tasks.workunit.client.1.smithi112.stdout:2/253: write d0/dd/f4e [61624,110137] 0 2024-09-21T10:40:44.425 INFO:tasks.workunit.client.1.smithi112.stdout:2/254: write d0/dd/f42 [395954,102243] 0 2024-09-21T10:40:44.426 INFO:tasks.workunit.client.1.smithi112.stdout:6/269: sync 2024-09-21T10:40:44.428 INFO:tasks.workunit.client.1.smithi112.stdout:0/316: link d3/d4/d10/c47 d3/d23/c6f 0 2024-09-21T10:40:44.429 INFO:tasks.workunit.client.1.smithi112.stdout:3/259: write d2/d22/d31/d37/f46 [494752,38456] 0 2024-09-21T10:40:44.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/317: read d3/d4/f38 [116984,61817] 0 2024-09-21T10:40:44.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/318: write d3/d4/d1a/d21/f6d [57234,14332] 0 2024-09-21T10:40:44.429 INFO:tasks.workunit.client.1.smithi112.stdout:7/208: rename d7/l21 to d7/d22/d41/l43 0 2024-09-21T10:40:44.431 INFO:tasks.workunit.client.1.smithi112.stdout:8/281: creat d8/d9/dd/d2a/f5a x:0 0 0 2024-09-21T10:40:44.433 INFO:tasks.workunit.client.1.smithi112.stdout:9/240: dread d1/d2/d27/d3a/d16/f1f [0,4194304] 0 2024-09-21T10:40:44.435 INFO:tasks.workunit.client.1.smithi112.stdout:5/263: truncate d9/f1e 441289 0 2024-09-21T10:40:44.435 INFO:tasks.workunit.client.1.smithi112.stdout:4/257: rename de/f11 to de/d34/d40/f5a 0 2024-09-21T10:40:44.436 INFO:tasks.workunit.client.1.smithi112.stdout:9/241: dread d1/f36 [0,4194304] 0 2024-09-21T10:40:44.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/264: mkdir d9/d15/d18/d3a/d4b/d53 0 2024-09-21T10:40:44.439 INFO:tasks.workunit.client.1.smithi112.stdout:3/260: dread d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:44.441 INFO:tasks.workunit.client.1.smithi112.stdout:1/419: rename d8/d1a/d31/f73 to d8/d20/f8e 0 2024-09-21T10:40:44.442 INFO:tasks.workunit.client.1.smithi112.stdout:9/242: mknod d1/d2/d27/d37/c4a 0 2024-09-21T10:40:44.445 INFO:tasks.workunit.client.1.smithi112.stdout:1/420: symlink d8/d1a/d53/l8f 0 2024-09-21T10:40:44.445 INFO:tasks.workunit.client.1.smithi112.stdout:3/261: mknod d2/d22/d31/d2a/d39/d3a/c58 0 2024-09-21T10:40:44.446 INFO:tasks.workunit.client.1.smithi112.stdout:5/265: write d9/d15/d18/d3a/f44 [319330,39334] 0 2024-09-21T10:40:44.446 INFO:tasks.workunit.client.1.smithi112.stdout:5/266: write d9/d15/f40 [307417,34069] 0 2024-09-21T10:40:44.453 INFO:tasks.workunit.client.1.smithi112.stdout:3/262: creat d2/d22/d31/d2a/d39/d3a/f59 x:0 0 0 2024-09-21T10:40:44.458 INFO:tasks.workunit.client.1.smithi112.stdout:5/267: rename d9/d15/d18/f38 to d9/f54 0 2024-09-21T10:40:44.461 INFO:tasks.workunit.client.1.smithi112.stdout:0/319: fsync d3/d4a/d4e/f6e 0 2024-09-21T10:40:44.462 INFO:tasks.workunit.client.1.smithi112.stdout:0/320: creat d3/d4a/f70 x:0 0 0 2024-09-21T10:40:44.466 INFO:tasks.workunit.client.1.smithi112.stdout:0/321: rename d3/d18/c41 to d3/c71 0 2024-09-21T10:40:44.475 INFO:tasks.workunit.client.1.smithi112.stdout:5/268: dread d9/d15/f2e [0,4194304] 0 2024-09-21T10:40:44.477 INFO:tasks.workunit.client.1.smithi112.stdout:5/269: mkdir d9/d15/d18/d20/d55 0 2024-09-21T10:40:44.477 INFO:tasks.workunit.client.1.smithi112.stdout:7/209: dwrite d7/ff [0,4194304] 0 2024-09-21T10:40:44.477 INFO:tasks.workunit.client.1.smithi112.stdout:4/258: dwrite de/d34/d40/f5a [0,4194304] 0 2024-09-21T10:40:44.477 INFO:tasks.workunit.client.1.smithi112.stdout:4/259: dread - de/d33/d2f/f52 zero size 2024-09-21T10:40:44.478 INFO:tasks.workunit.client.1.smithi112.stdout:5/270: symlink d9/d15/d18/d20/l56 0 2024-09-21T10:40:44.478 INFO:tasks.workunit.client.1.smithi112.stdout:5/271: fsync d9/d15/f16 0 2024-09-21T10:40:44.478 INFO:tasks.workunit.client.1.smithi112.stdout:5/272: chown d9/d15/d1d 7677354 1 2024-09-21T10:40:44.479 INFO:tasks.workunit.client.1.smithi112.stdout:7/210: mknod d7/c44 0 2024-09-21T10:40:44.480 INFO:tasks.workunit.client.1.smithi112.stdout:4/260: rename cb to de/d18/c5b 0 2024-09-21T10:40:44.480 INFO:tasks.workunit.client.1.smithi112.stdout:4/261: read - de/d2a/d3d/f49 zero size 2024-09-21T10:40:44.481 INFO:tasks.workunit.client.1.smithi112.stdout:4/262: mkdir de/d33/d2f/d35/d4c/d5c 0 2024-09-21T10:40:44.481 INFO:tasks.workunit.client.1.smithi112.stdout:4/263: fsync de/d2e/f32 0 2024-09-21T10:40:44.482 INFO:tasks.workunit.client.1.smithi112.stdout:4/264: read de/d2e/f32 [529251,109563] 0 2024-09-21T10:40:44.482 INFO:tasks.workunit.client.1.smithi112.stdout:5/273: mkdir d9/d57 0 2024-09-21T10:40:44.482 INFO:tasks.workunit.client.1.smithi112.stdout:4/265: mknod de/d33/d2f/d35/d4c/c5d 0 2024-09-21T10:40:44.482 INFO:tasks.workunit.client.1.smithi112.stdout:4/266: chown de/d2a/d3d/d3e/d57/c58 2817 1 2024-09-21T10:40:44.483 INFO:tasks.workunit.client.1.smithi112.stdout:5/274: creat d9/d15/d18/d20/d55/f58 x:0 0 0 2024-09-21T10:40:44.483 INFO:tasks.workunit.client.1.smithi112.stdout:5/275: readlink d9/d15/d18/l3f 0 2024-09-21T10:40:44.486 INFO:tasks.workunit.client.1.smithi112.stdout:2/255: dwrite d0/d12/f28 [0,4194304] 0 2024-09-21T10:40:44.486 INFO:tasks.workunit.client.1.smithi112.stdout:6/270: dwrite d4/dc/d1a/d31/d3c/f53 [0,4194304] 0 2024-09-21T10:40:44.486 INFO:tasks.workunit.client.1.smithi112.stdout:3/263: dwrite d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:44.487 INFO:tasks.workunit.client.1.smithi112.stdout:8/282: dwrite d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:44.487 INFO:tasks.workunit.client.1.smithi112.stdout:8/283: creat d8/d18/f5b x:0 0 0 2024-09-21T10:40:44.488 INFO:tasks.workunit.client.1.smithi112.stdout:9/243: dwrite d1/d2/d27/d3a/d16/f3c [0,4194304] 0 2024-09-21T10:40:44.491 INFO:tasks.workunit.client.1.smithi112.stdout:2/256: read - d0/d12/d1b/f1e zero size 2024-09-21T10:40:44.498 INFO:tasks.workunit.client.1.smithi112.stdout:3/264: symlink d2/d22/d31/d2a/d39/l5a 0 2024-09-21T10:40:44.498 INFO:tasks.workunit.client.1.smithi112.stdout:3/265: creat d2/d22/d31/d2a/d39/d3a/f5b x:0 0 0 2024-09-21T10:40:44.498 INFO:tasks.workunit.client.1.smithi112.stdout:3/266: write d2/d1f/f4f [84194,61466] 0 2024-09-21T10:40:44.499 INFO:tasks.workunit.client.1.smithi112.stdout:8/284: rmdir d8/d9/dd/d2b/d31 39 2024-09-21T10:40:44.504 INFO:tasks.workunit.client.1.smithi112.stdout:8/285: dread d8/d9/f13 [0,4194304] 0 2024-09-21T10:40:44.504 INFO:tasks.workunit.client.1.smithi112.stdout:8/286: chown d8/d9/dd/d2b/d31/f39 0 1 2024-09-21T10:40:44.509 INFO:tasks.workunit.client.1.smithi112.stdout:2/257: creat d0/d12/d1b/d51/f53 x:0 0 0 2024-09-21T10:40:44.509 INFO:tasks.workunit.client.1.smithi112.stdout:2/258: creat d0/d12/d1b/d51/f54 x:0 0 0 2024-09-21T10:40:44.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/244: getdents d1/d2/d27 0 2024-09-21T10:40:44.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/245: chown d1/d2/d15/f21 3129605 1 2024-09-21T10:40:44.512 INFO:tasks.workunit.client.1.smithi112.stdout:6/271: rename d4/d6/da/d11/d37/d19/d34 to d4/dc/d1a/d31/d56/d64 0 2024-09-21T10:40:44.512 INFO:tasks.workunit.client.1.smithi112.stdout:6/272: stat d4/d3e/f4c 0 2024-09-21T10:40:44.513 INFO:tasks.workunit.client.1.smithi112.stdout:9/246: mknod d1/d2/d27/d3a/c4b 0 2024-09-21T10:40:44.521 INFO:tasks.workunit.client.1.smithi112.stdout:0/322: dwrite d3/d4/fe [0,4194304] 0 2024-09-21T10:40:44.521 INFO:tasks.workunit.client.1.smithi112.stdout:0/323: write d3/d4/d1a/d21/f6d [1067734,55972] 0 2024-09-21T10:40:44.523 INFO:tasks.workunit.client.1.smithi112.stdout:0/324: mkdir d3/d4a/d4e/d72 0 2024-09-21T10:40:44.525 INFO:tasks.workunit.client.1.smithi112.stdout:0/325: symlink d3/d4/d43/l73 0 2024-09-21T10:40:44.525 INFO:tasks.workunit.client.1.smithi112.stdout:0/326: stat d3/d4/d1a/d21/f30 0 2024-09-21T10:40:44.526 INFO:tasks.workunit.client.1.smithi112.stdout:0/327: write d3/d4/d1a/f65 [262463,25595] 0 2024-09-21T10:40:44.526 INFO:tasks.workunit.client.1.smithi112.stdout:0/328: fsync d3/d4a/d4e/f5c 0 2024-09-21T10:40:44.527 INFO:tasks.workunit.client.1.smithi112.stdout:0/329: link d3/d4/d10/l68 d3/d23/l74 0 2024-09-21T10:40:44.527 INFO:tasks.workunit.client.1.smithi112.stdout:0/330: fsync d3/f20 0 2024-09-21T10:40:44.528 INFO:tasks.workunit.client.1.smithi112.stdout:0/331: rename d3/d4/d10/f6b to d3/d18/f75 0 2024-09-21T10:40:44.529 INFO:tasks.workunit.client.1.smithi112.stdout:0/332: link d3/d4a/d4e/f63 d3/d4/d1a/d21/d46/f76 0 2024-09-21T10:40:44.529 INFO:tasks.workunit.client.1.smithi112.stdout:0/333: creat d3/d18/d52/f77 x:0 0 0 2024-09-21T10:40:44.530 INFO:tasks.workunit.client.1.smithi112.stdout:0/334: creat d3/d4a/d4e/f78 x:0 0 0 2024-09-21T10:40:44.530 INFO:tasks.workunit.client.1.smithi112.stdout:0/335: chown d3/d4/d1a/d21/d46/f76 123137 1 2024-09-21T10:40:44.531 INFO:tasks.workunit.client.1.smithi112.stdout:0/336: symlink d3/d4a/d4e/d72/l79 0 2024-09-21T10:40:44.532 INFO:tasks.workunit.client.1.smithi112.stdout:0/337: link d3/c19 d3/d4/d1a/d21/d46/c7a 0 2024-09-21T10:40:44.541 INFO:tasks.workunit.client.1.smithi112.stdout:7/211: dwrite f6 [0,4194304] 0 2024-09-21T10:40:44.542 INFO:tasks.workunit.client.1.smithi112.stdout:7/212: unlink d7/d22/c2f 0 2024-09-21T10:40:44.543 INFO:tasks.workunit.client.1.smithi112.stdout:4/267: dwrite de/d33/d2f/d35/f36 [4194304,4194304] 0 2024-09-21T10:40:44.543 INFO:tasks.workunit.client.1.smithi112.stdout:4/268: write de/f24 [2781891,59130] 0 2024-09-21T10:40:44.543 INFO:tasks.workunit.client.1.smithi112.stdout:4/269: write f0 [8455309,95609] 0 2024-09-21T10:40:44.544 INFO:tasks.workunit.client.1.smithi112.stdout:9/247: dwrite d1/d2/d27/f3d [0,4194304] 0 2024-09-21T10:40:44.544 INFO:tasks.workunit.client.1.smithi112.stdout:7/213: getdents d7 0 2024-09-21T10:40:44.544 INFO:tasks.workunit.client.1.smithi112.stdout:9/248: write d1/f36 [752755,103962] 0 2024-09-21T10:40:44.544 INFO:tasks.workunit.client.1.smithi112.stdout:8/287: dwrite d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:44.545 INFO:tasks.workunit.client.1.smithi112.stdout:3/267: dwrite d2/f14 [0,4194304] 0 2024-09-21T10:40:44.545 INFO:tasks.workunit.client.1.smithi112.stdout:3/268: chown d2/d22/d31/d2a/l4e 212078013 1 2024-09-21T10:40:44.545 INFO:tasks.workunit.client.1.smithi112.stdout:3/269: write d2/d22/d31/d2a/f43 [4267961,117530] 0 2024-09-21T10:40:44.545 INFO:tasks.workunit.client.1.smithi112.stdout:2/259: dwrite d0/f9 [4194304,4194304] 0 2024-09-21T10:40:44.546 INFO:tasks.workunit.client.1.smithi112.stdout:4/270: symlink de/d33/d2f/l5e 0 2024-09-21T10:40:44.546 INFO:tasks.workunit.client.1.smithi112.stdout:0/338: write d3/d23/f26 [6563121,101402] 0 2024-09-21T10:40:44.547 INFO:tasks.workunit.client.1.smithi112.stdout:0/339: read - d3/d4a/d4e/f5c zero size 2024-09-21T10:40:44.547 INFO:tasks.workunit.client.1.smithi112.stdout:0/340: dread - d3/d4/d10/f3c zero size 2024-09-21T10:40:44.547 INFO:tasks.workunit.client.1.smithi112.stdout:0/341: write d3/d4/d1a/d21/f4d [502364,41032] 0 2024-09-21T10:40:44.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/214: mknod d7/d22/d41/c45 0 2024-09-21T10:40:44.547 INFO:tasks.workunit.client.1.smithi112.stdout:2/260: dread d0/f2f [0,4194304] 0 2024-09-21T10:40:44.549 INFO:tasks.workunit.client.1.smithi112.stdout:9/249: unlink d1/d2/d27/d37/d3b/c41 0 2024-09-21T10:40:44.553 INFO:tasks.workunit.client.1.smithi112.stdout:4/271: dread de/d33/f38 [0,4194304] 0 2024-09-21T10:40:44.553 INFO:tasks.workunit.client.1.smithi112.stdout:7/215: creat d7/d22/f46 x:0 0 0 2024-09-21T10:40:44.556 INFO:tasks.workunit.client.1.smithi112.stdout:0/342: write d3/d4/fe [1644501,5244] 0 2024-09-21T10:40:44.557 INFO:tasks.workunit.client.1.smithi112.stdout:0/343: read d3/d4/d1a/d21/f4d [484672,74583] 0 2024-09-21T10:40:44.557 INFO:tasks.workunit.client.1.smithi112.stdout:2/261: link d0/dd/f3b d0/dd/d33/f55 0 2024-09-21T10:40:44.558 INFO:tasks.workunit.client.1.smithi112.stdout:9/250: mkdir d1/d2/d27/d3a/d4c 0 2024-09-21T10:40:44.558 INFO:tasks.workunit.client.1.smithi112.stdout:0/344: write d3/d18/d52/d55/f5e [70164,42545] 0 2024-09-21T10:40:44.559 INFO:tasks.workunit.client.1.smithi112.stdout:7/216: mkdir d7/d22/d47 0 2024-09-21T10:40:44.560 INFO:tasks.workunit.client.1.smithi112.stdout:4/272: write de/d18/f21 [2029387,90811] 0 2024-09-21T10:40:44.561 INFO:tasks.workunit.client.1.smithi112.stdout:4/273: dread - de/d2a/d3d/f49 zero size 2024-09-21T10:40:44.561 INFO:tasks.workunit.client.1.smithi112.stdout:4/274: truncate de/d2e/f48 347514 0 2024-09-21T10:40:44.561 INFO:tasks.workunit.client.1.smithi112.stdout:4/275: dread - de/d33/d2f/d35/f3b zero size 2024-09-21T10:40:44.561 INFO:tasks.workunit.client.1.smithi112.stdout:2/262: symlink d0/l56 0 2024-09-21T10:40:44.561 INFO:tasks.workunit.client.1.smithi112.stdout:0/345: stat d3/d4/d1a/d21/c2d 0 2024-09-21T10:40:44.564 INFO:tasks.workunit.client.1.smithi112.stdout:4/276: symlink de/d2a/d3d/d3e/l5f 0 2024-09-21T10:40:44.565 INFO:tasks.workunit.client.1.smithi112.stdout:0/346: mkdir d3/d23/d7b 0 2024-09-21T10:40:44.567 INFO:tasks.workunit.client.1.smithi112.stdout:4/277: rename ld to de/l60 0 2024-09-21T10:40:44.567 INFO:tasks.workunit.client.1.smithi112.stdout:4/278: write de/f4d [445696,113429] 0 2024-09-21T10:40:44.569 INFO:tasks.workunit.client.1.smithi112.stdout:9/251: dread d1/d2/f1e [0,4194304] 0 2024-09-21T10:40:44.574 INFO:tasks.workunit.client.1.smithi112.stdout:2/263: write d0/d12/d26/f22 [1129554,20615] 0 2024-09-21T10:40:44.577 INFO:tasks.workunit.client.1.smithi112.stdout:9/252: unlink d1/l3f 0 2024-09-21T10:40:44.580 INFO:tasks.workunit.client.1.smithi112.stdout:4/279: dread de/d18/f26 [0,4194304] 0 2024-09-21T10:40:44.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/280: truncate de/d18/f25 477497 0 2024-09-21T10:40:44.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/281: creat de/d33/d2f/f61 x:0 0 0 2024-09-21T10:40:44.588 INFO:tasks.workunit.client.1.smithi112.stdout:8/288: dwrite d8/d9/dd/f1d [0,4194304] 0 2024-09-21T10:40:44.588 INFO:tasks.workunit.client.1.smithi112.stdout:8/289: chown d8/d9/d3c/f50 13962 1 2024-09-21T10:40:44.589 INFO:tasks.workunit.client.1.smithi112.stdout:0/347: dwrite d3/d4/d1a/d21/f4d [0,4194304] 0 2024-09-21T10:40:44.589 INFO:tasks.workunit.client.1.smithi112.stdout:3/270: dwrite d2/d1f/f2c [0,4194304] 0 2024-09-21T10:40:44.589 INFO:tasks.workunit.client.1.smithi112.stdout:3/271: fsync f0 0 2024-09-21T10:40:44.591 INFO:tasks.workunit.client.1.smithi112.stdout:3/272: mknod d2/d2f/c5c 0 2024-09-21T10:40:44.592 INFO:tasks.workunit.client.1.smithi112.stdout:3/273: read d2/f1b [871163,77270] 0 2024-09-21T10:40:44.592 INFO:tasks.workunit.client.1.smithi112.stdout:2/264: rename d0/dd/d33 to d0/d12/d1b/d51/d57 0 2024-09-21T10:40:44.592 INFO:tasks.workunit.client.1.smithi112.stdout:2/265: creat d0/dd/d47/f58 x:0 0 0 2024-09-21T10:40:44.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/274: mknod d2/c5d 0 2024-09-21T10:40:44.595 INFO:tasks.workunit.client.1.smithi112.stdout:8/290: rename d8/d9/fb to d8/d9/d3c/f5c 0 2024-09-21T10:40:44.597 INFO:tasks.workunit.client.1.smithi112.stdout:2/266: symlink d0/dd/d49/l59 0 2024-09-21T10:40:44.597 INFO:tasks.workunit.client.1.smithi112.stdout:0/348: dread d3/d4/d1a/d21/f61 [0,4194304] 0 2024-09-21T10:40:44.598 INFO:tasks.workunit.client.1.smithi112.stdout:8/291: mkdir d8/d9/dd/d1a/d5d 0 2024-09-21T10:40:44.599 INFO:tasks.workunit.client.1.smithi112.stdout:4/282: dwrite de/d18/f26 [4194304,4194304] 0 2024-09-21T10:40:44.599 INFO:tasks.workunit.client.1.smithi112.stdout:2/267: unlink d0/d12/d1b/d51/d57/f55 0 2024-09-21T10:40:44.599 INFO:tasks.workunit.client.1.smithi112.stdout:2/268: creat d0/dd/d49/f5a x:0 0 0 2024-09-21T10:40:44.599 INFO:tasks.workunit.client.1.smithi112.stdout:2/269: dread - d0/dd/d49/f5a zero size 2024-09-21T10:40:44.600 INFO:tasks.workunit.client.1.smithi112.stdout:0/349: symlink d3/d4/d1a/d21/l7c 0 2024-09-21T10:40:44.603 INFO:tasks.workunit.client.1.smithi112.stdout:8/292: rename d8/d9/dd/d2b/f56 to d8/d9/dd/d2a/d43/d58/f5e 0 2024-09-21T10:40:44.603 INFO:tasks.workunit.client.1.smithi112.stdout:8/293: truncate d8/d9/dd/d2a/f5a 42185 0 2024-09-21T10:40:44.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/275: dread d2/fa [0,4194304] 0 2024-09-21T10:40:44.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/276: write f0 [1154072,108891] 0 2024-09-21T10:40:44.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/283: creat de/d34/d40/f62 x:0 0 0 2024-09-21T10:40:44.607 INFO:tasks.workunit.client.1.smithi112.stdout:8/294: link d8/d9/dd/f16 d8/d9/dd/f5f 0 2024-09-21T10:40:44.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/277: dread d2/f14 [0,4194304] 0 2024-09-21T10:40:44.608 INFO:tasks.workunit.client.1.smithi112.stdout:0/350: dread d3/f1b [0,4194304] 0 2024-09-21T10:40:44.609 INFO:tasks.workunit.client.1.smithi112.stdout:4/284: unlink de/d18/f25 0 2024-09-21T10:40:44.611 INFO:tasks.workunit.client.1.smithi112.stdout:0/351: creat d3/d18/d52/d5f/f7d x:0 0 0 2024-09-21T10:40:44.611 INFO:tasks.workunit.client.1.smithi112.stdout:9/253: truncate d1/d2/d27/f2f 1951796 0 2024-09-21T10:40:44.613 INFO:tasks.workunit.client.1.smithi112.stdout:4/285: link de/d18/l1e de/d34/d40/l63 0 2024-09-21T10:40:44.613 INFO:tasks.workunit.client.1.smithi112.stdout:8/295: write d8/fc [3086517,4122] 0 2024-09-21T10:40:44.613 INFO:tasks.workunit.client.1.smithi112.stdout:8/296: write d8/d9/dd/d1a/f26 [95498,85438] 0 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/352: creat d3/d4/d1a/d21/d4f/f7e x:0 0 0 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/353: truncate d3/d4/d1a/f65 1184663 0 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/354: chown d3/d4/d1a/d21/l7c 14 1 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/355: fdatasync d3/d4/d10/f24 0 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:0/356: chown d3/d23/f3f 22967 1 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/254: symlink d1/d2/d42/l4d 0 2024-09-21T10:40:44.614 INFO:tasks.workunit.client.1.smithi112.stdout:4/286: creat de/d2a/d3d/d3e/f64 x:0 0 0 2024-09-21T10:40:44.615 INFO:tasks.workunit.client.1.smithi112.stdout:8/297: mknod d8/c60 0 2024-09-21T10:40:44.616 INFO:tasks.workunit.client.1.smithi112.stdout:9/255: truncate d1/d2/d27/d3a/f33 1110824 0 2024-09-21T10:40:44.617 INFO:tasks.workunit.client.1.smithi112.stdout:4/287: truncate f8 1259863 0 2024-09-21T10:40:44.620 INFO:tasks.workunit.client.1.smithi112.stdout:9/256: symlink d1/d2/d27/d3a/d4c/l4e 0 2024-09-21T10:40:44.623 INFO:tasks.workunit.client.1.smithi112.stdout:4/288: mknod de/d34/d40/d4f/c65 0 2024-09-21T10:40:44.623 INFO:tasks.workunit.client.1.smithi112.stdout:3/278: dwrite f1 [0,4194304] 0 2024-09-21T10:40:44.626 INFO:tasks.workunit.client.1.smithi112.stdout:9/257: dread d1/d2/d27/d3a/f23 [0,4194304] 0 2024-09-21T10:40:44.627 INFO:tasks.workunit.client.1.smithi112.stdout:4/289: symlink de/d2a/d3d/d3e/l66 0 2024-09-21T10:40:44.629 INFO:tasks.workunit.client.1.smithi112.stdout:8/298: dread d8/f14 [0,4194304] 0 2024-09-21T10:40:44.630 INFO:tasks.workunit.client.1.smithi112.stdout:4/290: symlink de/d34/l67 0 2024-09-21T10:40:44.630 INFO:tasks.workunit.client.1.smithi112.stdout:4/291: fsync de/d33/f30 0 2024-09-21T10:40:44.630 INFO:tasks.workunit.client.1.smithi112.stdout:4/292: stat de/f4d 0 2024-09-21T10:40:44.631 INFO:tasks.workunit.client.1.smithi112.stdout:9/258: mknod d1/d2/c4f 0 2024-09-21T10:40:44.636 INFO:tasks.workunit.client.1.smithi112.stdout:0/357: dwrite d3/f20 [0,4194304] 0 2024-09-21T10:40:44.636 INFO:tasks.workunit.client.1.smithi112.stdout:0/358: chown d3/d4/d1a/d21/f30 0 1 2024-09-21T10:40:44.636 INFO:tasks.workunit.client.1.smithi112.stdout:0/359: truncate d3/d18/f22 3200014 0 2024-09-21T10:40:44.641 INFO:tasks.workunit.client.1.smithi112.stdout:9/259: write d1/d2/d27/f44 [222668,70048] 0 2024-09-21T10:40:44.641 INFO:tasks.workunit.client.1.smithi112.stdout:8/299: truncate d8/d18/f24 2992581 0 2024-09-21T10:40:44.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/360: mkdir d3/d23/d7b/d7f 0 2024-09-21T10:40:44.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/361: dread - d3/d18/f75 zero size 2024-09-21T10:40:44.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/362: write d3/d23/f54 [1519714,111660] 0 2024-09-21T10:40:44.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/363: stat d3/d23/l5d 0 2024-09-21T10:40:44.646 INFO:tasks.workunit.client.1.smithi112.stdout:9/260: creat d1/d2/d27/d3a/d16/d30/f50 x:0 0 0 2024-09-21T10:40:44.647 INFO:tasks.workunit.client.1.smithi112.stdout:8/300: mknod d8/d9/dd/d1a/c61 0 2024-09-21T10:40:44.648 INFO:tasks.workunit.client.1.smithi112.stdout:3/279: dwrite d2/ff [4194304,4194304] 0 2024-09-21T10:40:44.648 INFO:tasks.workunit.client.1.smithi112.stdout:3/280: write d2/d22/d31/d37/f46 [5151096,130551] 0 2024-09-21T10:40:44.648 INFO:tasks.workunit.client.1.smithi112.stdout:0/364: rename d3/d18/f22 to d3/d18/f80 0 2024-09-21T10:40:44.648 INFO:tasks.workunit.client.1.smithi112.stdout:0/365: stat d3/d23/c49 0 2024-09-21T10:40:44.649 INFO:tasks.workunit.client.1.smithi112.stdout:4/293: dwrite de/d33/f30 [0,4194304] 0 2024-09-21T10:40:44.649 INFO:tasks.workunit.client.1.smithi112.stdout:4/294: write de/d34/d40/f62 [201443,64690] 0 2024-09-21T10:40:44.649 INFO:tasks.workunit.client.1.smithi112.stdout:3/281: truncate d2/d1f/f35 2063757 0 2024-09-21T10:40:44.651 INFO:tasks.workunit.client.1.smithi112.stdout:8/301: rmdir d8/d9/dd/d2b/d31/d46 39 2024-09-21T10:40:44.653 INFO:tasks.workunit.client.1.smithi112.stdout:3/282: creat d2/d22/f5e x:0 0 0 2024-09-21T10:40:44.658 INFO:tasks.workunit.client.1.smithi112.stdout:0/366: rmdir d3/d4/d1a 39 2024-09-21T10:40:44.658 INFO:tasks.workunit.client.1.smithi112.stdout:0/367: write d3/d18/d52/d55/f5e [677759,7880] 0 2024-09-21T10:40:44.658 INFO:tasks.workunit.client.1.smithi112.stdout:0/368: truncate d3/d18/f42 435869 0 2024-09-21T10:40:44.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/302: getdents d8/d9/dd/d2b/d31 0 2024-09-21T10:40:44.661 INFO:tasks.workunit.client.1.smithi112.stdout:3/283: mknod d2/d22/d31/d2a/c5f 0 2024-09-21T10:40:44.664 INFO:tasks.workunit.client.1.smithi112.stdout:0/369: rmdir d3/d4/d43 39 2024-09-21T10:40:44.664 INFO:tasks.workunit.client.1.smithi112.stdout:0/370: chown d3/d4/d1a/d21/f4d 7079 1 2024-09-21T10:40:44.667 INFO:tasks.workunit.client.1.smithi112.stdout:0/371: symlink d3/d4a/d4e/d72/l81 0 2024-09-21T10:40:44.667 INFO:tasks.workunit.client.1.smithi112.stdout:0/372: write d3/d4/d1a/d21/d46/f76 [716350,28073] 0 2024-09-21T10:40:44.667 INFO:tasks.workunit.client.1.smithi112.stdout:0/373: write d3/d4a/f64 [365463,9308] 0 2024-09-21T10:40:44.668 INFO:tasks.workunit.client.1.smithi112.stdout:0/374: fdatasync d3/d4/f1d 0 2024-09-21T10:40:44.668 INFO:tasks.workunit.client.1.smithi112.stdout:5/276: sync 2024-09-21T10:40:44.668 INFO:tasks.workunit.client.1.smithi112.stdout:1/421: sync 2024-09-21T10:40:44.668 INFO:tasks.workunit.client.1.smithi112.stdout:4/295: dwrite de/d33/f30 [0,4194304] 0 2024-09-21T10:40:44.669 INFO:tasks.workunit.client.1.smithi112.stdout:0/375: rmdir d3/d23/d7b 39 2024-09-21T10:40:44.669 INFO:tasks.workunit.client.1.smithi112.stdout:0/376: chown d3/d4/d1a/c32 102883 1 2024-09-21T10:40:44.669 INFO:tasks.workunit.client.1.smithi112.stdout:8/303: dread d8/d9/dd/f16 [0,4194304] 0 2024-09-21T10:40:44.672 INFO:tasks.workunit.client.1.smithi112.stdout:1/422: rename d8/d20/f8e to d8/d1a/d53/d57/f90 0 2024-09-21T10:40:44.674 INFO:tasks.workunit.client.1.smithi112.stdout:4/296: mknod de/d34/c68 0 2024-09-21T10:40:44.674 INFO:tasks.workunit.client.1.smithi112.stdout:4/297: truncate de/d33/f30 4536443 0 2024-09-21T10:40:44.676 INFO:tasks.workunit.client.1.smithi112.stdout:5/277: link d9/d15/d1d/l26 d9/d15/d18/d20/d47/l59 0 2024-09-21T10:40:44.676 INFO:tasks.workunit.client.1.smithi112.stdout:5/278: write d9/f12 [221381,34637] 0 2024-09-21T10:40:44.679 INFO:tasks.workunit.client.1.smithi112.stdout:8/304: rename d8/d9/f53 to d8/f62 0 2024-09-21T10:40:44.679 INFO:tasks.workunit.client.1.smithi112.stdout:8/305: creat d8/f63 x:0 0 0 2024-09-21T10:40:44.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/298: symlink de/l69 0 2024-09-21T10:40:44.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/299: dread f0 [4194304,4194304] 0 2024-09-21T10:40:44.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/300: chown de/l20 465 1 2024-09-21T10:40:44.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/301: write de/f24 [2666913,26524] 0 2024-09-21T10:40:44.707 INFO:tasks.workunit.client.1.smithi112.stdout:4/302: dread de/d18/f21 [0,4194304] 0 2024-09-21T10:40:44.707 INFO:tasks.workunit.client.1.smithi112.stdout:4/303: write de/f12 [763961,9089] 0 2024-09-21T10:40:44.707 INFO:tasks.workunit.client.1.smithi112.stdout:4/304: read - de/d2a/d3d/d3e/f64 zero size 2024-09-21T10:40:44.707 INFO:tasks.workunit.client.1.smithi112.stdout:4/305: stat de/d18/c27 0 2024-09-21T10:40:44.707 INFO:tasks.workunit.client.1.smithi112.stdout:9/261: dwrite d1/d2/d27/f44 [0,4194304] 0 2024-09-21T10:40:44.709 INFO:tasks.workunit.client.1.smithi112.stdout:8/306: write d8/d9/dd/d1a/f51 [3792445,59795] 0 2024-09-21T10:40:44.710 INFO:tasks.workunit.client.1.smithi112.stdout:8/307: unlink l6 0 2024-09-21T10:40:44.715 INFO:tasks.workunit.client.1.smithi112.stdout:9/262: dread d1/d2/f20 [0,4194304] 0 2024-09-21T10:40:44.715 INFO:tasks.workunit.client.1.smithi112.stdout:9/263: chown d1/d2/l1a 79593890 1 2024-09-21T10:40:44.715 INFO:tasks.workunit.client.1.smithi112.stdout:9/264: dread - d1/d2/d27/d3a/d16/d30/f50 zero size 2024-09-21T10:40:44.715 INFO:tasks.workunit.client.1.smithi112.stdout:9/265: creat d1/d2/f51 x:0 0 0 2024-09-21T10:40:44.716 INFO:tasks.workunit.client.1.smithi112.stdout:9/266: truncate d1/d2/d27/d3a/d16/f3c 3417538 0 2024-09-21T10:40:44.720 INFO:tasks.workunit.client.1.smithi112.stdout:5/279: dwrite d9/d15/f24 [4194304,4194304] 0 2024-09-21T10:40:44.720 INFO:tasks.workunit.client.1.smithi112.stdout:3/284: dwrite d2/d22/d31/d37/f46 [0,4194304] 0 2024-09-21T10:40:44.720 INFO:tasks.workunit.client.1.smithi112.stdout:3/285: write d2/f17 [841826,36278] 0 2024-09-21T10:40:44.721 INFO:tasks.workunit.client.1.smithi112.stdout:1/423: dwrite d8/d1a/d31/d66/f7b [0,4194304] 0 2024-09-21T10:40:44.722 INFO:tasks.workunit.client.1.smithi112.stdout:5/280: dread d9/ff [0,4194304] 0 2024-09-21T10:40:44.722 INFO:tasks.workunit.client.1.smithi112.stdout:5/281: fsync d9/f54 0 2024-09-21T10:40:44.722 INFO:tasks.workunit.client.1.smithi112.stdout:5/282: stat d9/d15/d18/d20/c3c 0 2024-09-21T10:40:44.723 INFO:tasks.workunit.client.1.smithi112.stdout:9/267: dread d1/d2/d27/f3d [0,4194304] 0 2024-09-21T10:40:44.723 INFO:tasks.workunit.client.1.smithi112.stdout:9/268: fsync d1/d2/d27/d3a/d16/f1f 0 2024-09-21T10:40:44.726 INFO:tasks.workunit.client.1.smithi112.stdout:3/286: unlink d2/d22/d31/d2a/d39/l4b 0 2024-09-21T10:40:44.730 INFO:tasks.workunit.client.1.smithi112.stdout:8/308: dwrite d8/fc [0,4194304] 0 2024-09-21T10:40:44.731 INFO:tasks.workunit.client.1.smithi112.stdout:5/283: link d9/d15/d18/d3a/f2d d9/d15/d1d/f5a 0 2024-09-21T10:40:44.732 INFO:tasks.workunit.client.1.smithi112.stdout:1/424: rmdir d8/d54/d6d 39 2024-09-21T10:40:44.732 INFO:tasks.workunit.client.1.smithi112.stdout:1/425: write d8/d54/d6d/f86 [1119866,119128] 0 2024-09-21T10:40:44.732 INFO:tasks.workunit.client.1.smithi112.stdout:1/426: chown d8/d1a/d53/c79 1 1 2024-09-21T10:40:44.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/269: mknod d1/d2/c52 0 2024-09-21T10:40:44.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/270: fdatasync d1/d2/f51 0 2024-09-21T10:40:44.735 INFO:tasks.workunit.client.1.smithi112.stdout:9/271: chown d1/d2/f48 3552609 1 2024-09-21T10:40:44.739 INFO:tasks.workunit.client.1.smithi112.stdout:9/272: creat d1/d2/d27/d37/d3b/f53 x:0 0 0 2024-09-21T10:40:44.739 INFO:tasks.workunit.client.1.smithi112.stdout:9/273: creat d1/d2/d27/d3a/d16/d30/f54 x:0 0 0 2024-09-21T10:40:44.739 INFO:tasks.workunit.client.1.smithi112.stdout:9/274: write d1/d2/d27/d3a/d16/d30/f50 [784258,21071] 0 2024-09-21T10:40:44.749 INFO:tasks.workunit.client.1.smithi112.stdout:9/275: write d1/d2/d27/d3a/f2d [358240,109753] 0 2024-09-21T10:40:44.770 INFO:tasks.workunit.client.1.smithi112.stdout:3/287: dwrite d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:44.770 INFO:tasks.workunit.client.1.smithi112.stdout:8/309: dwrite d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:44.772 INFO:tasks.workunit.client.1.smithi112.stdout:8/310: chown d8/d9/dd/l33 18408363 1 2024-09-21T10:40:44.772 INFO:tasks.workunit.client.1.smithi112.stdout:8/311: write d8/d9/d3c/f52 [3297648,10464] 0 2024-09-21T10:40:44.772 INFO:tasks.workunit.client.1.smithi112.stdout:8/312: chown d8/d9/d3c/f50 502995105 1 2024-09-21T10:40:44.772 INFO:tasks.workunit.client.1.smithi112.stdout:8/313: rename d8 to d8/d9/d3c/d64 22 2024-09-21T10:40:44.773 INFO:tasks.workunit.client.1.smithi112.stdout:5/284: dwrite d9/d15/f2e [0,4194304] 0 2024-09-21T10:40:44.773 INFO:tasks.workunit.client.1.smithi112.stdout:5/285: write d9/d15/d1d/f32 [310659,103282] 0 2024-09-21T10:40:44.774 INFO:tasks.workunit.client.1.smithi112.stdout:5/286: chown d9/d15/d18/d3a/c3d 7182475 1 2024-09-21T10:40:44.774 INFO:tasks.workunit.client.1.smithi112.stdout:5/287: fdatasync d9/d15/d1d/f51 0 2024-09-21T10:40:44.775 INFO:tasks.workunit.client.1.smithi112.stdout:9/276: dwrite d1/d2/d27/d3a/d16/d30/f54 [0,4194304] 0 2024-09-21T10:40:44.777 INFO:tasks.workunit.client.1.smithi112.stdout:8/314: dread d8/d9/dd/f5f [0,4194304] 0 2024-09-21T10:40:44.777 INFO:tasks.workunit.client.1.smithi112.stdout:8/315: chown d8/d9/dd/d2b/d31/d46 250704 1 2024-09-21T10:40:44.782 INFO:tasks.workunit.client.1.smithi112.stdout:5/288: dread d9/f54 [0,4194304] 0 2024-09-21T10:40:44.784 INFO:tasks.workunit.client.1.smithi112.stdout:9/277: mknod d1/d2/d27/d3a/d16/d30/c55 0 2024-09-21T10:40:44.785 INFO:tasks.workunit.client.1.smithi112.stdout:8/316: dread d8/d9/dd/f2c [0,4194304] 0 2024-09-21T10:40:44.786 INFO:tasks.workunit.client.1.smithi112.stdout:5/289: creat d9/d15/d18/d3a/f5b x:0 0 0 2024-09-21T10:40:44.786 INFO:tasks.workunit.client.1.smithi112.stdout:5/290: fdatasync d9/f11 0 2024-09-21T10:40:44.786 INFO:tasks.workunit.client.1.smithi112.stdout:5/291: readlink d9/d15/d18/d20/l37 0 2024-09-21T10:40:44.786 INFO:tasks.workunit.client.1.smithi112.stdout:9/278: creat d1/d2/d27/d3a/f56 x:0 0 0 2024-09-21T10:40:44.787 INFO:tasks.workunit.client.1.smithi112.stdout:9/279: link d1/d2/d27/d3a/f23 d1/d2/d27/d3a/d16/d30/f57 0 2024-09-21T10:40:44.788 INFO:tasks.workunit.client.1.smithi112.stdout:8/317: read d8/d9/dd/d2b/d31/f41 [274268,127152] 0 2024-09-21T10:40:44.789 INFO:tasks.workunit.client.1.smithi112.stdout:9/280: symlink d1/d2/d42/l58 0 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:9/281: creat d1/d2/d27/d37/f59 x:0 0 0 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:6/273: sync 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:2/270: sync 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:7/217: sync 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:9/282: readlink d1/d2/d27/l2c 0 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:9/283: fdatasync d1/f1b 0 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:9/284: stat d1/d2/f48 0 2024-09-21T10:40:44.858 INFO:tasks.workunit.client.1.smithi112.stdout:6/274: write d4/d6/f40 [880800,56231] 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:9/285: write d1/d2/d27/d3a/d16/d30/f50 [1088368,129736] 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:7/218: getdents d7/d22/d41 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:7/219: fdatasync d7/ff 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:2/271: symlink d0/d12/l5b 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:2/272: creat d0/dd/f5c x:0 0 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:8/318: dread d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:8/319: readlink d8/d9/dd/d1a/l1f 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/275: mkdir d4/d6/d65 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/276: fdatasync d4/d6/da/f2c 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:9/286: symlink d1/d2/d27/d3a/l5a 0 2024-09-21T10:40:44.859 INFO:tasks.workunit.client.1.smithi112.stdout:2/273: truncate d0/f19 96653 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:2/274: fsync d0/dd/d47/f58 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:6/277: rename d4/d6/da/d11/d1f/f55 to d4/d4f/f66 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:2/275: write d0/dd/f3b [797637,112160] 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:8/320: dread d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:6/278: rename d4/d6/d65 to d4/dc/d67 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:5/292: dwrite d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:44.860 INFO:tasks.workunit.client.1.smithi112.stdout:5/293: chown d9/d57 170898 1 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:5/294: chown c5 754 1 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:5/295: chown d9/f54 1 1 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/321: creat d8/d9/dd/d1a/d5d/f65 x:0 0 0 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/322: truncate d8/d9/dd/d2a/d43/d58/f5e 953513 0 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:5/296: symlink d9/d15/d1d/l5c 0 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/323: readlink d8/l59 0 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/324: creat d8/d9/dd/d2a/d43/f66 x:0 0 0 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/325: stat d8/d9/c35 0 2024-09-21T10:40:44.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/326: creat d8/d9/dd/d1a/f67 x:0 0 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:5/297: rename d9/c36 to d9/c5d 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:8/327: rename d8/f62 to d8/d9/dd/d2a/d43/d58/f68 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:5/298: read d9/d15/f24 [5390167,5900] 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:5/299: dread f3 [4194304,4194304] 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:5/300: read d9/d15/d18/f31 [2951825,17233] 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:6/279: dwrite d4/d6/da/f47 [0,4194304] 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:6/280: fsync d4/d6/f40 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:2/276: dwrite d0/f19 [0,4194304] 0 2024-09-21T10:40:44.862 INFO:tasks.workunit.client.1.smithi112.stdout:5/301: getdents d9/d15/d18/d20/d47 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/328: dwrite d8/f63 [0,4194304] 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:6/281: dread d4/d6/da/d11/d37/f5e [0,4194304] 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/302: mknod d9/d15/d18/d20/d55/c5e 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/303: write d9/d15/d1d/f32 [473811,90159] 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/329: creat d8/f69 x:0 0 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/304: mknod d9/d15/d18/d3a/d4b/d53/c5f 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/305: fsync d9/d15/f35 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/306: chown d9/d15/f40 377 1 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/330: rmdir d8/d9/dd/d2b/d31 39 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/307: unlink d9/d15/d1d/f51 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/331: symlink d8/d9/dd/d2b/l6a 0 2024-09-21T10:40:44.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/332: mknod d8/d9/dd/d2a/d43/c6b 0 2024-09-21T10:40:44.864 INFO:tasks.workunit.client.1.smithi112.stdout:8/333: symlink d8/d9/l6c 0 2024-09-21T10:40:44.879 INFO:tasks.workunit.client.1.smithi112.stdout:6/282: dwrite d4/d6/da/f60 [0,4194304] 0 2024-09-21T10:40:44.880 INFO:tasks.workunit.client.1.smithi112.stdout:2/277: dwrite d0/d12/d1b/f1e [0,4194304] 0 2024-09-21T10:40:44.881 INFO:tasks.workunit.client.1.smithi112.stdout:8/334: mkdir d8/d9/d3c/d6d 0 2024-09-21T10:40:44.883 INFO:tasks.workunit.client.1.smithi112.stdout:5/308: dwrite d9/f11 [0,4194304] 0 2024-09-21T10:40:44.883 INFO:tasks.workunit.client.1.smithi112.stdout:5/309: chown d9/d15/d1d 3811 1 2024-09-21T10:40:44.884 INFO:tasks.workunit.client.1.smithi112.stdout:6/283: creat d4/dc/d1a/d31/f68 x:0 0 0 2024-09-21T10:40:44.884 INFO:tasks.workunit.client.1.smithi112.stdout:6/284: chown d4/dc/d1a/d31/d56/d64/c59 14207397 1 2024-09-21T10:40:44.884 INFO:tasks.workunit.client.1.smithi112.stdout:6/285: write d4/dc/d1a/d31/d3c/f53 [4751314,43850] 0 2024-09-21T10:40:44.885 INFO:tasks.workunit.client.1.smithi112.stdout:8/335: link d8/d9/dd/d2b/d31/d46/c55 d8/d9/dd/d2b/d31/c6e 0 2024-09-21T10:40:44.886 INFO:tasks.workunit.client.1.smithi112.stdout:5/310: creat d9/d15/d18/d20/f60 x:0 0 0 2024-09-21T10:40:44.888 INFO:tasks.workunit.client.1.smithi112.stdout:6/286: rmdir d4/d6 39 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/377: sync 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:3/288: sync 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:4/306: sync 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:1/427: sync 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:7/220: sync 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:4/307: truncate de/d33/f38 4401891 0 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/378: truncate d3/d4/d1a/d21/d46/f58 177265 0 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:7/221: fsync d7/d22/f23 0 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/379: fdatasync d3/d4/d1a/d21/f4d 0 2024-09-21T10:40:44.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/380: chown d3/d4/d1a/d21/l62 544 1 2024-09-21T10:40:44.894 INFO:tasks.workunit.client.1.smithi112.stdout:9/287: sync 2024-09-21T10:40:44.894 INFO:tasks.workunit.client.1.smithi112.stdout:7/222: write d7/d22/f23 [1271603,122251] 0 2024-09-21T10:40:44.894 INFO:tasks.workunit.client.1.smithi112.stdout:7/223: creat d7/d22/f48 x:0 0 0 2024-09-21T10:40:44.894 INFO:tasks.workunit.client.1.smithi112.stdout:5/311: dread d9/d15/d18/d20/d47/f49 [0,4194304] 0 2024-09-21T10:40:44.894 INFO:tasks.workunit.client.1.smithi112.stdout:5/312: chown d9/c13 3 1 2024-09-21T10:40:44.895 INFO:tasks.workunit.client.1.smithi112.stdout:4/308: creat de/d34/f6a x:0 0 0 2024-09-21T10:40:44.895 INFO:tasks.workunit.client.1.smithi112.stdout:2/278: dwrite d0/dd/d47/f58 [0,4194304] 0 2024-09-21T10:40:44.896 INFO:tasks.workunit.client.1.smithi112.stdout:9/288: unlink d1/d2/d27/d37/c4a 0 2024-09-21T10:40:44.896 INFO:tasks.workunit.client.1.smithi112.stdout:9/289: dread - d1/d2/d42/f45 zero size 2024-09-21T10:40:44.898 INFO:tasks.workunit.client.1.smithi112.stdout:6/287: dread d4/d6/da/f47 [0,4194304] 0 2024-09-21T10:40:44.899 INFO:tasks.workunit.client.1.smithi112.stdout:7/224: creat d7/f49 x:0 0 0 2024-09-21T10:40:44.899 INFO:tasks.workunit.client.1.smithi112.stdout:7/225: readlink d7/d22/l30 0 2024-09-21T10:40:44.900 INFO:tasks.workunit.client.1.smithi112.stdout:8/336: read d8/fc [1416974,46024] 0 2024-09-21T10:40:44.900 INFO:tasks.workunit.client.1.smithi112.stdout:8/337: creat d8/d9/dd/d2a/d43/f6f x:0 0 0 2024-09-21T10:40:44.900 INFO:tasks.workunit.client.1.smithi112.stdout:8/338: chown d8/d9/dd/l33 802 1 2024-09-21T10:40:44.900 INFO:tasks.workunit.client.1.smithi112.stdout:8/339: readlink d8/d9/dd/d1a/l1f 0 2024-09-21T10:40:44.900 INFO:tasks.workunit.client.1.smithi112.stdout:8/340: truncate d8/d9/dd/d2a/f5a 527435 0 2024-09-21T10:40:44.900 INFO:tasks.workunit.client.1.smithi112.stdout:3/289: rmdir d2/d22 39 2024-09-21T10:40:44.902 INFO:tasks.workunit.client.1.smithi112.stdout:5/313: mkdir d9/d15/d18/d3a/d61 0 2024-09-21T10:40:44.903 INFO:tasks.workunit.client.1.smithi112.stdout:4/309: creat de/d34/d40/d4f/f6b x:0 0 0 2024-09-21T10:40:44.903 INFO:tasks.workunit.client.1.smithi112.stdout:4/310: chown de/d2a/d3d/d3e/l5f 608069 1 2024-09-21T10:40:44.904 INFO:tasks.workunit.client.1.smithi112.stdout:1/428: dread d8/d20/f58 [0,4194304] 0 2024-09-21T10:40:44.904 INFO:tasks.workunit.client.1.smithi112.stdout:4/311: write de/f4d [356972,114028] 0 2024-09-21T10:40:44.905 INFO:tasks.workunit.client.1.smithi112.stdout:2/279: symlink d0/d12/d1b/d51/l5d 0 2024-09-21T10:40:44.907 INFO:tasks.workunit.client.1.smithi112.stdout:6/288: rename d4/d6/da/d11/d37/fe to d4/d6/da/d14/d49/d62/f69 0 2024-09-21T10:40:44.908 INFO:tasks.workunit.client.1.smithi112.stdout:7/226: mkdir d7/d22/d47/d4a 0 2024-09-21T10:40:44.910 INFO:tasks.workunit.client.1.smithi112.stdout:8/341: link d8/d9/d3c/l49 d8/d9/d3c/d57/l70 0 2024-09-21T10:40:44.910 INFO:tasks.workunit.client.1.smithi112.stdout:3/290: dread d2/d22/f29 [0,4194304] 0 2024-09-21T10:40:44.910 INFO:tasks.workunit.client.1.smithi112.stdout:3/291: chown d2/d22/d31/d2a 678329644 1 2024-09-21T10:40:44.912 INFO:tasks.workunit.client.1.smithi112.stdout:2/280: mknod d0/d12/d1b/d51/d57/c5e 0 2024-09-21T10:40:44.912 INFO:tasks.workunit.client.1.smithi112.stdout:2/281: write d0/d12/d26/f4c [21978,73547] 0 2024-09-21T10:40:44.912 INFO:tasks.workunit.client.1.smithi112.stdout:2/282: creat d0/d12/d26/f5f x:0 0 0 2024-09-21T10:40:44.913 INFO:tasks.workunit.client.1.smithi112.stdout:9/290: getdents d1/d2 0 2024-09-21T10:40:44.915 INFO:tasks.workunit.client.1.smithi112.stdout:6/289: rename d4/d6/da/d11/d37/d19/l24 to d4/d6/da/d11/d1f/l6a 0 2024-09-21T10:40:44.915 INFO:tasks.workunit.client.1.smithi112.stdout:1/429: dread d8/f85 [0,4194304] 0 2024-09-21T10:40:44.916 INFO:tasks.workunit.client.1.smithi112.stdout:7/227: mkdir d7/d22/d41/d4b 0 2024-09-21T10:40:44.917 INFO:tasks.workunit.client.1.smithi112.stdout:4/312: rmdir de/d34/d40 39 2024-09-21T10:40:44.919 INFO:tasks.workunit.client.1.smithi112.stdout:5/314: dwrite d9/d15/f3e [0,4194304] 0 2024-09-21T10:40:44.919 INFO:tasks.workunit.client.1.smithi112.stdout:5/315: chown d9/d15/d18/d3a/d4b/c4c 678 1 2024-09-21T10:40:44.919 INFO:tasks.workunit.client.1.smithi112.stdout:5/316: write d9/d15/f40 [559988,61626] 0 2024-09-21T10:40:44.919 INFO:tasks.workunit.client.1.smithi112.stdout:9/291: link d1/d2/d27/d3a/c14 d1/d2/d27/d37/d3b/c5b 0 2024-09-21T10:40:44.921 INFO:tasks.workunit.client.1.smithi112.stdout:3/292: dread d2/fe [4194304,4194304] 0 2024-09-21T10:40:44.921 INFO:tasks.workunit.client.1.smithi112.stdout:6/290: unlink d4/dc/d1a/d31/d39/l44 0 2024-09-21T10:40:44.922 INFO:tasks.workunit.client.1.smithi112.stdout:1/430: truncate d8/d1a/d31/f4e 2981402 0 2024-09-21T10:40:44.923 INFO:tasks.workunit.client.1.smithi112.stdout:4/313: dread de/f12 [0,4194304] 0 2024-09-21T10:40:44.923 INFO:tasks.workunit.client.1.smithi112.stdout:4/314: dread - de/d33/d2f/f52 zero size 2024-09-21T10:40:44.923 INFO:tasks.workunit.client.1.smithi112.stdout:4/315: write de/d34/d40/f62 [802785,47551] 0 2024-09-21T10:40:44.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/228: unlink d7/l42 0 2024-09-21T10:40:44.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/229: truncate d7/d22/f35 465960 0 2024-09-21T10:40:44.926 INFO:tasks.workunit.client.1.smithi112.stdout:6/291: write d4/d6/da/d14/d49/d62/f69 [1470733,61876] 0 2024-09-21T10:40:44.926 INFO:tasks.workunit.client.1.smithi112.stdout:5/317: mkdir d9/d15/d18/d3a/d61/d62 0 2024-09-21T10:40:44.927 INFO:tasks.workunit.client.1.smithi112.stdout:3/293: mkdir d2/d22/d31/d2a/d39/d60 0 2024-09-21T10:40:44.928 INFO:tasks.workunit.client.1.smithi112.stdout:6/292: symlink d4/dc/l6b 0 2024-09-21T10:40:44.930 INFO:tasks.workunit.client.1.smithi112.stdout:5/318: truncate f3 4596873 0 2024-09-21T10:40:44.930 INFO:tasks.workunit.client.1.smithi112.stdout:5/319: write d9/d15/f16 [8494689,125407] 0 2024-09-21T10:40:44.931 INFO:tasks.workunit.client.1.smithi112.stdout:3/294: rename d2/c20 to d2/d22/d31/d2a/c61 0 2024-09-21T10:40:44.931 INFO:tasks.workunit.client.1.smithi112.stdout:3/295: dread - d2/d22/d31/d2a/d39/d3a/f59 zero size 2024-09-21T10:40:44.933 INFO:tasks.workunit.client.1.smithi112.stdout:3/296: creat d2/d22/d31/f62 x:0 0 0 2024-09-21T10:40:44.933 INFO:tasks.workunit.client.1.smithi112.stdout:3/297: write d2/f17 [374291,74379] 0 2024-09-21T10:40:44.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/283: dwrite d0/f10 [0,4194304] 0 2024-09-21T10:40:44.937 INFO:tasks.workunit.client.1.smithi112.stdout:1/431: write d8/f40 [2594569,105928] 0 2024-09-21T10:40:44.937 INFO:tasks.workunit.client.1.smithi112.stdout:1/432: truncate d8/d1a/d31/d37/f77 4578973 0 2024-09-21T10:40:44.938 INFO:tasks.workunit.client.1.smithi112.stdout:1/433: read d8/d1a/d53/f60 [232084,62445] 0 2024-09-21T10:40:44.938 INFO:tasks.workunit.client.1.smithi112.stdout:9/292: read d1/f1b [3304611,90158] 0 2024-09-21T10:40:44.939 INFO:tasks.workunit.client.1.smithi112.stdout:2/284: read d0/dd/f21 [175189,43961] 0 2024-09-21T10:40:44.939 INFO:tasks.workunit.client.1.smithi112.stdout:2/285: readlink d0/l3a 0 2024-09-21T10:40:44.940 INFO:tasks.workunit.client.1.smithi112.stdout:1/434: symlink d8/d1a/d53/l91 0 2024-09-21T10:40:44.940 INFO:tasks.workunit.client.1.smithi112.stdout:1/435: chown d8/d1a/d31/f68 2227453 1 2024-09-21T10:40:44.942 INFO:tasks.workunit.client.1.smithi112.stdout:9/293: mkdir d1/d2/d27/d3a/d16/d30/d5c 0 2024-09-21T10:40:44.942 INFO:tasks.workunit.client.1.smithi112.stdout:9/294: chown d1/d2/d27/f2f 969987120 1 2024-09-21T10:40:44.942 INFO:tasks.workunit.client.1.smithi112.stdout:1/436: dread d8/f3a [0,4194304] 0 2024-09-21T10:40:44.943 INFO:tasks.workunit.client.1.smithi112.stdout:7/230: write d7/f26 [3788145,86377] 0 2024-09-21T10:40:44.943 INFO:tasks.workunit.client.1.smithi112.stdout:1/437: truncate d8/d45/f59 3955625 0 2024-09-21T10:40:44.944 INFO:tasks.workunit.client.1.smithi112.stdout:1/438: rename d8/d1a/d53/d57/l61 to d8/d54/d6d/l92 0 2024-09-21T10:40:44.944 INFO:tasks.workunit.client.1.smithi112.stdout:1/439: chown d8/d1a/c2e 1585 1 2024-09-21T10:40:44.954 INFO:tasks.workunit.client.1.smithi112.stdout:2/286: dread d0/d12/f41 [0,4194304] 0 2024-09-21T10:40:44.955 INFO:tasks.workunit.client.1.smithi112.stdout:2/287: link d0/d12/d1b/c44 d0/c60 0 2024-09-21T10:40:44.955 INFO:tasks.workunit.client.1.smithi112.stdout:7/231: write d7/d3d/f40 [7045604,43851] 0 2024-09-21T10:40:44.955 INFO:tasks.workunit.client.1.smithi112.stdout:7/232: chown d7/f49 22231034 1 2024-09-21T10:40:44.955 INFO:tasks.workunit.client.1.smithi112.stdout:7/233: stat d7/f49 0 2024-09-21T10:40:44.956 INFO:tasks.workunit.client.1.smithi112.stdout:7/234: mkdir d7/d3d/d4c 0 2024-09-21T10:40:44.958 INFO:tasks.workunit.client.1.smithi112.stdout:7/235: mkdir d7/d3d/d4c/d4d 0 2024-09-21T10:40:44.958 INFO:tasks.workunit.client.1.smithi112.stdout:3/298: dread d2/d2f/f44 [0,4194304] 0 2024-09-21T10:40:44.958 INFO:tasks.workunit.client.1.smithi112.stdout:3/299: chown d2/d22/f38 492707824 1 2024-09-21T10:40:44.959 INFO:tasks.workunit.client.1.smithi112.stdout:7/236: rmdir d7/d3d/d4c 39 2024-09-21T10:40:44.961 INFO:tasks.workunit.client.1.smithi112.stdout:7/237: link d7/d22/f46 d7/d3d/d4c/f4e 0 2024-09-21T10:40:44.961 INFO:tasks.workunit.client.1.smithi112.stdout:7/238: chown d7/d22/d47/d4a 7 1 2024-09-21T10:40:44.963 INFO:tasks.workunit.client.1.smithi112.stdout:4/316: dwrite de/f12 [0,4194304] 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:7/239: rename d7/le to d7/d3d/d4c/l4f 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:9/295: dwrite d1/d2/f51 [0,4194304] 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:6/293: dwrite d4/dc/d1a/f61 [0,4194304] 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:6/294: fsync d4/dc/f3f 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:5/320: dwrite d9/d15/f2a [0,4194304] 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:5/321: getdents d9/d57 0 2024-09-21T10:40:44.964 INFO:tasks.workunit.client.1.smithi112.stdout:5/322: getdents d9/d15/d18/d20/d47 0 2024-09-21T10:40:44.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/296: write d1/d2/d27/f3d [942553,99384] 0 2024-09-21T10:40:44.967 INFO:tasks.workunit.client.1.smithi112.stdout:4/317: symlink de/d33/d2f/d35/d4c/d5c/l6c 0 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:2/288: dwrite d0/dd/f42 [0,4194304] 0 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:2/289: fdatasync d0/dd/f42 0 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:5/323: write d9/fe [2011677,59734] 0 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:5/324: dread - d9/d15/d18/d20/d55/f58 zero size 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:5/325: fdatasync d9/d15/d18/d3a/f5b 0 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:5/326: fdatasync d9/f11 0 2024-09-21T10:40:44.975 INFO:tasks.workunit.client.1.smithi112.stdout:5/327: write d9/d15/d18/d3a/f2d [1172169,51713] 0 2024-09-21T10:40:44.979 INFO:tasks.workunit.client.1.smithi112.stdout:9/297: rename d1/lf to d1/d2/d27/d37/d3b/l5d 0 2024-09-21T10:40:44.980 INFO:tasks.workunit.client.1.smithi112.stdout:4/318: mkdir de/d18/d6d 0 2024-09-21T10:40:44.980 INFO:tasks.workunit.client.1.smithi112.stdout:7/240: dwrite d7/d22/f35 [0,4194304] 0 2024-09-21T10:40:44.982 INFO:tasks.workunit.client.1.smithi112.stdout:2/290: rmdir d0 39 2024-09-21T10:40:44.984 INFO:tasks.workunit.client.1.smithi112.stdout:5/328: rename d9/d15/f40 to d9/d15/f63 0 2024-09-21T10:40:44.984 INFO:tasks.workunit.client.1.smithi112.stdout:5/329: write d9/d15/d1d/f46 [193319,78125] 0 2024-09-21T10:40:44.984 INFO:tasks.workunit.client.1.smithi112.stdout:5/330: fdatasync d9/d15/d18/d3a/f44 0 2024-09-21T10:40:44.985 INFO:tasks.workunit.client.1.smithi112.stdout:9/298: truncate d1/d2/d27/f44 2236052 0 2024-09-21T10:40:44.985 INFO:tasks.workunit.client.1.smithi112.stdout:9/299: write d1/d2/f20 [1745375,156] 0 2024-09-21T10:40:44.986 INFO:tasks.workunit.client.1.smithi112.stdout:4/319: mkdir de/d18/d6d/d6e 0 2024-09-21T10:40:44.989 INFO:tasks.workunit.client.1.smithi112.stdout:7/241: creat d7/d3d/f50 x:0 0 0 2024-09-21T10:40:44.989 INFO:tasks.workunit.client.1.smithi112.stdout:7/242: chown d7/d22/d41/d4b 12 1 2024-09-21T10:40:44.990 INFO:tasks.workunit.client.1.smithi112.stdout:2/291: rename d0/dd/f30 to d0/dd/f61 0 2024-09-21T10:40:44.991 INFO:tasks.workunit.client.1.smithi112.stdout:4/320: dread de/d18/f21 [0,4194304] 0 2024-09-21T10:40:44.991 INFO:tasks.workunit.client.1.smithi112.stdout:4/321: chown de/d18 1777694887 1 2024-09-21T10:40:44.992 INFO:tasks.workunit.client.1.smithi112.stdout:5/331: symlink d9/d15/d18/d20/d47/l64 0 2024-09-21T10:40:44.993 INFO:tasks.workunit.client.1.smithi112.stdout:9/300: mkdir d1/d2/d27/d3a/d16/d30/d5e 0 2024-09-21T10:40:44.994 INFO:tasks.workunit.client.1.smithi112.stdout:4/322: mkdir de/d33/d6f 0 2024-09-21T10:40:45.001 INFO:tasks.workunit.client.1.smithi112.stdout:5/332: dread d9/d15/f24 [0,4194304] 0 2024-09-21T10:40:45.001 INFO:tasks.workunit.client.1.smithi112.stdout:0/381: sync 2024-09-21T10:40:45.002 INFO:tasks.workunit.client.1.smithi112.stdout:0/382: write d3/d18/f3b [835590,1050] 0 2024-09-21T10:40:45.002 INFO:tasks.workunit.client.1.smithi112.stdout:0/383: chown d3/d4a/l60 126719920 1 2024-09-21T10:40:45.002 INFO:tasks.workunit.client.1.smithi112.stdout:0/384: chown d3/d18/c4c 50 1 2024-09-21T10:40:45.008 INFO:tasks.workunit.client.1.smithi112.stdout:7/243: dwrite d7/f14 [4194304,4194304] 0 2024-09-21T10:40:45.010 INFO:tasks.workunit.client.1.smithi112.stdout:7/244: creat d7/d22/d41/f51 x:0 0 0 2024-09-21T10:40:45.010 INFO:tasks.workunit.client.1.smithi112.stdout:7/245: readlink d7/d22/l37 0 2024-09-21T10:40:45.010 INFO:tasks.workunit.client.1.smithi112.stdout:7/246: fsync d7/f26 0 2024-09-21T10:40:45.010 INFO:tasks.workunit.client.1.smithi112.stdout:7/247: stat d7/d22 0 2024-09-21T10:40:45.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/248: truncate d7/ff 48236 0 2024-09-21T10:40:45.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/249: fsync f6 0 2024-09-21T10:40:45.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/250: truncate d7/d22/f46 119749 0 2024-09-21T10:40:45.012 INFO:tasks.workunit.client.1.smithi112.stdout:7/251: mkdir d7/d22/d41/d4b/d52 0 2024-09-21T10:40:45.012 INFO:tasks.workunit.client.1.smithi112.stdout:7/252: mknod d7/d3d/d4c/c53 0 2024-09-21T10:40:45.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/385: dwrite d3/d4/d1a/f65 [0,4194304] 0 2024-09-21T10:40:45.018 INFO:tasks.workunit.client.1.smithi112.stdout:7/253: rename d7/d3d/d4c to d7/d22/d41/d54 0 2024-09-21T10:40:45.018 INFO:tasks.workunit.client.1.smithi112.stdout:7/254: fdatasync d7/f1e 0 2024-09-21T10:40:45.020 INFO:tasks.workunit.client.1.smithi112.stdout:0/386: creat d3/d23/d7b/d7f/f82 x:0 0 0 2024-09-21T10:40:45.020 INFO:tasks.workunit.client.1.smithi112.stdout:0/387: write d3/d18/d52/f6c [583245,20302] 0 2024-09-21T10:40:45.020 INFO:tasks.workunit.client.1.smithi112.stdout:7/255: mknod d7/d22/d41/c55 0 2024-09-21T10:40:45.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/388: dread d3/d4/d1a/d21/f4d [0,4194304] 0 2024-09-21T10:40:45.028 INFO:tasks.workunit.client.1.smithi112.stdout:0/389: write d3/d4/f5 [2364435,117586] 0 2024-09-21T10:40:45.029 INFO:tasks.workunit.client.1.smithi112.stdout:0/390: mkdir d3/d4/d1a/d21/d4f/d83 0 2024-09-21T10:40:45.029 INFO:tasks.workunit.client.1.smithi112.stdout:0/391: fdatasync d3/d4/d1a/d21/d4f/f7e 0 2024-09-21T10:40:45.029 INFO:tasks.workunit.client.1.smithi112.stdout:0/392: write d3/d4/d10/f24 [9193440,108263] 0 2024-09-21T10:40:45.035 INFO:tasks.workunit.client.1.smithi112.stdout:7/256: dwrite d7/d22/f33 [0,4194304] 0 2024-09-21T10:40:45.036 INFO:tasks.workunit.client.1.smithi112.stdout:7/257: mkdir d7/d22/d41/d56 0 2024-09-21T10:40:45.038 INFO:tasks.workunit.client.1.smithi112.stdout:7/258: link d7/f26 d7/d22/d47/f57 0 2024-09-21T10:40:45.065 INFO:tasks.workunit.client.1.smithi112.stdout:7/259: dwrite d7/d22/f33 [0,4194304] 0 2024-09-21T10:40:45.082 INFO:tasks.workunit.client.1.smithi112.stdout:7/260: dwrite f5 [0,4194304] 0 2024-09-21T10:40:45.083 INFO:tasks.workunit.client.1.smithi112.stdout:7/261: mkdir d7/d22/d41/d56/d58 0 2024-09-21T10:40:45.090 INFO:tasks.workunit.client.1.smithi112.stdout:8/342: sync 2024-09-21T10:40:45.091 INFO:tasks.workunit.client.1.smithi112.stdout:8/343: truncate d8/d9/dd/f42 392992 0 2024-09-21T10:40:45.092 INFO:tasks.workunit.client.1.smithi112.stdout:8/344: symlink d8/l71 0 2024-09-21T10:40:45.092 INFO:tasks.workunit.client.1.smithi112.stdout:8/345: readlink d8/l71 0 2024-09-21T10:40:45.099 INFO:tasks.workunit.client.1.smithi112.stdout:7/262: dwrite d7/f1c [0,4194304] 0 2024-09-21T10:40:45.099 INFO:tasks.workunit.client.1.smithi112.stdout:7/263: fsync d7/d22/f38 0 2024-09-21T10:40:45.099 INFO:tasks.workunit.client.1.smithi112.stdout:7/264: write d7/d22/d47/f57 [4732621,89076] 0 2024-09-21T10:40:45.101 INFO:tasks.workunit.client.1.smithi112.stdout:7/265: rename d7/d22/d41/c45 to d7/d22/d47/c59 0 2024-09-21T10:40:45.102 INFO:tasks.workunit.client.1.smithi112.stdout:7/266: mkdir d7/d5a 0 2024-09-21T10:40:45.103 INFO:tasks.workunit.client.1.smithi112.stdout:7/267: getdents d7/d22/d41/d56 0 2024-09-21T10:40:45.103 INFO:tasks.workunit.client.1.smithi112.stdout:7/268: write f5 [4879200,11248] 0 2024-09-21T10:40:45.107 INFO:tasks.workunit.client.1.smithi112.stdout:8/346: dwrite f3 [0,4194304] 0 2024-09-21T10:40:45.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/347: getdents d8/d9/dd/d2a/d43/d58 0 2024-09-21T10:40:45.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/348: fsync d8/d9/dd/f1d 0 2024-09-21T10:40:45.110 INFO:tasks.workunit.client.1.smithi112.stdout:8/349: link d8/d18/f1c d8/d9/dd/d1a/f72 0 2024-09-21T10:40:45.111 INFO:tasks.workunit.client.1.smithi112.stdout:7/269: truncate d7/f26 1060914 0 2024-09-21T10:40:45.111 INFO:tasks.workunit.client.1.smithi112.stdout:7/270: chown d7/f1e 32 1 2024-09-21T10:40:45.111 INFO:tasks.workunit.client.1.smithi112.stdout:8/350: truncate d8/fc 744688 0 2024-09-21T10:40:45.111 INFO:tasks.workunit.client.1.smithi112.stdout:7/271: symlink d7/d22/d41/d54/l5b 0 2024-09-21T10:40:45.112 INFO:tasks.workunit.client.1.smithi112.stdout:8/351: link l4 d8/d18/l73 0 2024-09-21T10:40:45.114 INFO:tasks.workunit.client.1.smithi112.stdout:8/352: dread d8/d9/dd/f42 [0,4194304] 0 2024-09-21T10:40:45.120 INFO:tasks.workunit.client.1.smithi112.stdout:7/272: write d7/f34 [4140012,48131] 0 2024-09-21T10:40:45.121 INFO:tasks.workunit.client.1.smithi112.stdout:7/273: stat d7/d22/d41/d54/l5b 0 2024-09-21T10:40:45.121 INFO:tasks.workunit.client.1.smithi112.stdout:7/274: write d7/d3d/f50 [693517,120429] 0 2024-09-21T10:40:45.123 INFO:tasks.workunit.client.1.smithi112.stdout:7/275: mkdir d7/d22/d41/d56/d5c 0 2024-09-21T10:40:45.123 INFO:tasks.workunit.client.1.smithi112.stdout:7/276: dread - d7/f3a zero size 2024-09-21T10:40:45.123 INFO:tasks.workunit.client.1.smithi112.stdout:7/277: getdents d7/d22/d41/d54/d4d 0 2024-09-21T10:40:45.130 INFO:tasks.workunit.client.1.smithi112.stdout:8/353: dwrite d8/d9/dd/f2f [0,4194304] 0 2024-09-21T10:40:45.131 INFO:tasks.workunit.client.1.smithi112.stdout:8/354: creat d8/d9/d3c/d6d/f74 x:0 0 0 2024-09-21T10:40:45.138 INFO:tasks.workunit.client.1.smithi112.stdout:8/355: read d8/d18/f27 [182531,23935] 0 2024-09-21T10:40:45.138 INFO:tasks.workunit.client.1.smithi112.stdout:8/356: chown d8/d18/f24 106808 1 2024-09-21T10:40:45.138 INFO:tasks.workunit.client.1.smithi112.stdout:8/357: truncate d8/d9/dd/d2a/d43/d58/f68 614234 0 2024-09-21T10:40:45.151 INFO:tasks.workunit.client.1.smithi112.stdout:8/358: dwrite d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:45.156 INFO:tasks.workunit.client.1.smithi112.stdout:8/359: dread d8/d9/dd/f2c [0,4194304] 0 2024-09-21T10:40:45.169 INFO:tasks.workunit.client.1.smithi112.stdout:6/295: sync 2024-09-21T10:40:45.169 INFO:tasks.workunit.client.1.smithi112.stdout:1/440: sync 2024-09-21T10:40:45.169 INFO:tasks.workunit.client.1.smithi112.stdout:3/300: sync 2024-09-21T10:40:45.169 INFO:tasks.workunit.client.1.smithi112.stdout:6/296: dread - d4/dc/d1a/d31/f68 zero size 2024-09-21T10:40:45.170 INFO:tasks.workunit.client.1.smithi112.stdout:3/301: truncate d2/d2f/f30 1626252 0 2024-09-21T10:40:45.170 INFO:tasks.workunit.client.1.smithi112.stdout:6/297: mknod d4/d4f/c6c 0 2024-09-21T10:40:45.170 INFO:tasks.workunit.client.1.smithi112.stdout:6/298: dread - d4/d4f/f5d zero size 2024-09-21T10:40:45.170 INFO:tasks.workunit.client.1.smithi112.stdout:1/441: symlink d8/d1a/d31/d66/d87/l93 0 2024-09-21T10:40:45.171 INFO:tasks.workunit.client.1.smithi112.stdout:1/442: readlink d8/d54/d6d/l92 0 2024-09-21T10:40:45.171 INFO:tasks.workunit.client.1.smithi112.stdout:3/302: symlink d2/d22/l63 0 2024-09-21T10:40:45.173 INFO:tasks.workunit.client.1.smithi112.stdout:3/303: rmdir d2/d1f 39 2024-09-21T10:40:45.173 INFO:tasks.workunit.client.1.smithi112.stdout:3/304: getdents d2/d22/d31/d2a/d39/d60 0 2024-09-21T10:40:45.174 INFO:tasks.workunit.client.1.smithi112.stdout:3/305: dread - d2/d22/d31/d2a/d39/d3a/f5b zero size 2024-09-21T10:40:45.174 INFO:tasks.workunit.client.1.smithi112.stdout:3/306: truncate d2/f17 2415274 0 2024-09-21T10:40:45.174 INFO:tasks.workunit.client.1.smithi112.stdout:1/443: getdents d8/d54 0 2024-09-21T10:40:45.184 INFO:tasks.workunit.client.1.smithi112.stdout:3/307: dread d2/f18 [0,4194304] 0 2024-09-21T10:40:45.194 INFO:tasks.workunit.client.1.smithi112.stdout:3/308: write d2/d22/d31/d37/f52 [2488959,29710] 0 2024-09-21T10:40:45.195 INFO:tasks.workunit.client.1.smithi112.stdout:6/299: dwrite d4/d4f/f5d [0,4194304] 0 2024-09-21T10:40:45.195 INFO:tasks.workunit.client.1.smithi112.stdout:3/309: link d2/f51 d2/d2f/f64 0 2024-09-21T10:40:45.195 INFO:tasks.workunit.client.1.smithi112.stdout:1/444: dwrite d8/d54/d6d/f86 [0,4194304] 0 2024-09-21T10:40:45.196 INFO:tasks.workunit.client.1.smithi112.stdout:1/445: chown d8/d1a/d53/d57/c5a 1 1 2024-09-21T10:40:45.197 INFO:tasks.workunit.client.1.smithi112.stdout:6/300: creat d4/dc/d1a/d31/d56/f6d x:0 0 0 2024-09-21T10:40:45.197 INFO:tasks.workunit.client.1.smithi112.stdout:6/301: readlink d4/d6/da/d11/d1f/l6a 0 2024-09-21T10:40:45.197 INFO:tasks.workunit.client.1.smithi112.stdout:3/310: symlink d2/d2f/l65 0 2024-09-21T10:40:45.200 INFO:tasks.workunit.client.1.smithi112.stdout:1/446: creat d8/d45/f94 x:0 0 0 2024-09-21T10:40:45.200 INFO:tasks.workunit.client.1.smithi112.stdout:1/447: mknod d8/d1a/c95 0 2024-09-21T10:40:45.201 INFO:tasks.workunit.client.1.smithi112.stdout:1/448: stat d8/l30 0 2024-09-21T10:40:45.203 INFO:tasks.workunit.client.1.smithi112.stdout:1/449: mknod d8/c96 0 2024-09-21T10:40:45.206 INFO:tasks.workunit.client.1.smithi112.stdout:6/302: write d4/d6/da/d11/d1f/d22/f33 [1456221,80726] 0 2024-09-21T10:40:45.207 INFO:tasks.workunit.client.1.smithi112.stdout:3/311: dread d2/d22/d31/d37/f46 [0,4194304] 0 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:9/301: sync 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:4/323: sync 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:2/292: sync 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:4/324: chown de/c1c 5814 1 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:9/302: dread - d1/d2/f3e zero size 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:3/312: write d2/d22/d31/d2a/f3b [203980,17033] 0 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:3/313: fdatasync d2/d22/d31/d2a/d39/d3a/f47 0 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:4/325: write de/d33/f38 [4452890,119120] 0 2024-09-21T10:40:45.208 INFO:tasks.workunit.client.1.smithi112.stdout:4/326: stat de/d2a/d3d/f49 0 2024-09-21T10:40:45.209 INFO:tasks.workunit.client.1.smithi112.stdout:6/303: symlink d4/d6/da/d11/d1f/d22/l6e 0 2024-09-21T10:40:45.210 INFO:tasks.workunit.client.1.smithi112.stdout:3/314: creat d2/d2f/f66 x:0 0 0 2024-09-21T10:40:45.210 INFO:tasks.workunit.client.1.smithi112.stdout:3/315: write d2/f1b [1968375,111339] 0 2024-09-21T10:40:45.211 INFO:tasks.workunit.client.1.smithi112.stdout:2/293: getdents d0/d12 0 2024-09-21T10:40:45.212 INFO:tasks.workunit.client.1.smithi112.stdout:1/450: dread d8/d1a/f67 [0,4194304] 0 2024-09-21T10:40:45.213 INFO:tasks.workunit.client.1.smithi112.stdout:3/316: link f1 d2/d22/d31/f67 0 2024-09-21T10:40:45.214 INFO:tasks.workunit.client.1.smithi112.stdout:1/451: symlink d8/d1a/d53/l97 0 2024-09-21T10:40:45.217 INFO:tasks.workunit.client.1.smithi112.stdout:6/304: read d4/d6/da/f47 [1098690,27694] 0 2024-09-21T10:40:45.218 INFO:tasks.workunit.client.1.smithi112.stdout:6/305: creat d4/d6/da/f6f x:0 0 0 2024-09-21T10:40:45.218 INFO:tasks.workunit.client.1.smithi112.stdout:1/452: read d8/d1a/d31/f7c [133913,94807] 0 2024-09-21T10:40:45.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/306: link d4/d6/da/f47 d4/d6/da/d11/d37/f70 0 2024-09-21T10:40:45.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/307: chown d4/d6/da/f46 15052 1 2024-09-21T10:40:45.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/308: creat d4/dc/d1a/d31/f71 x:0 0 0 2024-09-21T10:40:45.221 INFO:tasks.workunit.client.1.smithi112.stdout:6/309: creat d4/dc/d1a/d31/d56/f72 x:0 0 0 2024-09-21T10:40:45.221 INFO:tasks.workunit.client.1.smithi112.stdout:4/327: read de/d33/d2f/d35/f36 [3334718,96026] 0 2024-09-21T10:40:45.225 INFO:tasks.workunit.client.1.smithi112.stdout:6/310: mkdir d4/d6/da/d14/d49/d73 0 2024-09-21T10:40:45.227 INFO:tasks.workunit.client.1.smithi112.stdout:6/311: mkdir d4/d6/da/d14/d49/d73/d74 0 2024-09-21T10:40:45.230 INFO:tasks.workunit.client.1.smithi112.stdout:9/303: dwrite d1/d2/d27/d37/d3b/f53 [0,4194304] 0 2024-09-21T10:40:45.231 INFO:tasks.workunit.client.1.smithi112.stdout:4/328: dread de/d33/f30 [0,4194304] 0 2024-09-21T10:40:45.231 INFO:tasks.workunit.client.1.smithi112.stdout:4/329: getdents de/d18/d6d/d6e 0 2024-09-21T10:40:45.231 INFO:tasks.workunit.client.1.smithi112.stdout:4/330: chown de/d33/d2f/d35/f55 226 1 2024-09-21T10:40:45.232 INFO:tasks.workunit.client.1.smithi112.stdout:3/317: dread d2/f19 [0,4194304] 0 2024-09-21T10:40:45.233 INFO:tasks.workunit.client.1.smithi112.stdout:9/304: rename d1/d2/f51 to d1/d2/d27/f5f 0 2024-09-21T10:40:45.233 INFO:tasks.workunit.client.1.smithi112.stdout:4/331: creat de/d18/d6d/f70 x:0 0 0 2024-09-21T10:40:45.234 INFO:tasks.workunit.client.1.smithi112.stdout:3/318: creat d2/d22/d31/d37/f68 x:0 0 0 2024-09-21T10:40:45.237 INFO:tasks.workunit.client.1.smithi112.stdout:3/319: mknod d2/d2f/d3f/c69 0 2024-09-21T10:40:45.239 INFO:tasks.workunit.client.1.smithi112.stdout:4/332: rename de/d34 to de/d33/d2f/d71 0 2024-09-21T10:40:45.240 INFO:tasks.workunit.client.1.smithi112.stdout:4/333: unlink de/d33/d2f/l5e 0 2024-09-21T10:40:45.254 INFO:tasks.workunit.client.1.smithi112.stdout:2/294: dwrite d0/f2 [4194304,4194304] 0 2024-09-21T10:40:45.260 INFO:tasks.workunit.client.1.smithi112.stdout:2/295: dread d0/d12/d1b/d51/d57/f37 [0,4194304] 0 2024-09-21T10:40:45.261 INFO:tasks.workunit.client.1.smithi112.stdout:2/296: mkdir d0/dd/d49/d62 0 2024-09-21T10:40:45.263 INFO:tasks.workunit.client.1.smithi112.stdout:1/453: dwrite d8/d20/f32 [0,4194304] 0 2024-09-21T10:40:45.263 INFO:tasks.workunit.client.1.smithi112.stdout:1/454: readlink d8/d1a/d53/l97 0 2024-09-21T10:40:45.263 INFO:tasks.workunit.client.1.smithi112.stdout:1/455: fdatasync d8/d1a/d53/d57/f6e 0 2024-09-21T10:40:45.263 INFO:tasks.workunit.client.1.smithi112.stdout:9/305: dwrite d1/d2/d27/d3a/d16/d30/f57 [0,4194304] 0 2024-09-21T10:40:45.264 INFO:tasks.workunit.client.1.smithi112.stdout:3/320: dwrite d2/d2f/f44 [0,4194304] 0 2024-09-21T10:40:45.264 INFO:tasks.workunit.client.1.smithi112.stdout:3/321: readlink d2/d1f/l24 0 2024-09-21T10:40:45.265 INFO:tasks.workunit.client.1.smithi112.stdout:1/456: dread d8/d1a/d31/d37/f5e [0,4194304] 0 2024-09-21T10:40:45.266 INFO:tasks.workunit.client.1.smithi112.stdout:1/457: symlink d8/d54/l98 0 2024-09-21T10:40:45.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/322: read d2/f18 [1365150,68266] 0 2024-09-21T10:40:45.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/323: creat d2/d2f/f6a x:0 0 0 2024-09-21T10:40:45.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/324: write d2/f51 [482226,91143] 0 2024-09-21T10:40:45.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/325: read d2/d22/d31/d2a/f3b [162512,25618] 0 2024-09-21T10:40:45.268 INFO:tasks.workunit.client.1.smithi112.stdout:1/458: rename d8/d1a/d31/d37/l80 to d8/d1a/d31/d66/l99 0 2024-09-21T10:40:45.268 INFO:tasks.workunit.client.1.smithi112.stdout:1/459: readlink d8/l1b 0 2024-09-21T10:40:45.269 INFO:tasks.workunit.client.1.smithi112.stdout:3/326: mknod d2/d22/d31/d37/c6b 0 2024-09-21T10:40:45.269 INFO:tasks.workunit.client.1.smithi112.stdout:3/327: chown d2/d22/d31/d2a/d39 2 1 2024-09-21T10:40:45.271 INFO:tasks.workunit.client.1.smithi112.stdout:1/460: unlink d8/d1a/d31/d66/f7b 0 2024-09-21T10:40:45.272 INFO:tasks.workunit.client.1.smithi112.stdout:9/306: read d1/d2/d27/d3a/d16/d30/f57 [1087950,61724] 0 2024-09-21T10:40:45.272 INFO:tasks.workunit.client.1.smithi112.stdout:9/307: stat d1/d2/d15/f21 0 2024-09-21T10:40:45.274 INFO:tasks.workunit.client.1.smithi112.stdout:9/308: rename d1/d2/d27/d3a/d16/d30/f50 to d1/d2/f60 0 2024-09-21T10:40:45.274 INFO:tasks.workunit.client.1.smithi112.stdout:9/309: dread - d1/d2/d27/d3a/f56 zero size 2024-09-21T10:40:45.276 INFO:tasks.workunit.client.1.smithi112.stdout:3/328: dread d2/d22/f29 [0,4194304] 0 2024-09-21T10:40:45.279 INFO:tasks.workunit.client.1.smithi112.stdout:9/310: dread d1/d2/d27/f44 [0,4194304] 0 2024-09-21T10:40:45.279 INFO:tasks.workunit.client.1.smithi112.stdout:9/311: truncate d1/d2/f3e 49315 0 2024-09-21T10:40:45.279 INFO:tasks.workunit.client.1.smithi112.stdout:1/461: write d8/d54/f8c [1790684,124671] 0 2024-09-21T10:40:45.279 INFO:tasks.workunit.client.1.smithi112.stdout:1/462: write d8/f38 [1075799,73034] 0 2024-09-21T10:40:45.280 INFO:tasks.workunit.client.1.smithi112.stdout:9/312: getdents d1/d2/d27/d3a 0 2024-09-21T10:40:45.282 INFO:tasks.workunit.client.1.smithi112.stdout:9/313: mknod d1/d2/d27/d3a/d16/d30/d5c/c61 0 2024-09-21T10:40:45.298 INFO:tasks.workunit.client.1.smithi112.stdout:3/329: dwrite f1 [0,4194304] 0 2024-09-21T10:40:45.299 INFO:tasks.workunit.client.1.smithi112.stdout:9/314: dwrite d1/d2/d27/d3a/d16/d30/f57 [4194304,4194304] 0 2024-09-21T10:40:45.309 INFO:tasks.workunit.client.1.smithi112.stdout:3/330: dread d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:45.309 INFO:tasks.workunit.client.1.smithi112.stdout:3/331: symlink d2/d22/d31/l6c 0 2024-09-21T10:40:45.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/332: creat d2/d1f/f6d x:0 0 0 2024-09-21T10:40:45.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/333: write d2/d22/f38 [175675,108552] 0 2024-09-21T10:40:45.316 INFO:tasks.workunit.client.1.smithi112.stdout:9/315: dwrite d1/d2/f48 [0,4194304] 0 2024-09-21T10:40:45.316 INFO:tasks.workunit.client.1.smithi112.stdout:9/316: fdatasync d1/d2/d27/f5f 0 2024-09-21T10:40:45.324 INFO:tasks.workunit.client.1.smithi112.stdout:3/334: dwrite d2/d22/d31/d2a/d39/d3a/f47 [0,4194304] 0 2024-09-21T10:40:45.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/335: rename d2/d22/l26 to d2/d22/d31/d2a/l6e 0 2024-09-21T10:40:45.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/336: write d2/d22/d31/d2a/d39/d3a/f5b [750520,76938] 0 2024-09-21T10:40:45.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/337: chown d2/d22/d31/d2a/l32 40429 1 2024-09-21T10:40:45.332 INFO:tasks.workunit.client.1.smithi112.stdout:9/317: dwrite d1/d2/f20 [4194304,4194304] 0 2024-09-21T10:40:45.342 INFO:tasks.workunit.client.1.smithi112.stdout:9/318: read d1/d2/d27/d3a/f23 [5006121,83239] 0 2024-09-21T10:40:45.343 INFO:tasks.workunit.client.1.smithi112.stdout:9/319: mkdir d1/d2/d27/d62 0 2024-09-21T10:40:45.350 INFO:tasks.workunit.client.1.smithi112.stdout:9/320: dread d1/d2/d27/d3a/f33 [0,4194304] 0 2024-09-21T10:40:45.351 INFO:tasks.workunit.client.1.smithi112.stdout:9/321: mknod d1/c63 0 2024-09-21T10:40:45.352 INFO:tasks.workunit.client.1.smithi112.stdout:9/322: symlink d1/d2/l64 0 2024-09-21T10:40:45.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/323: symlink d1/d2/d27/d3a/d16/d30/l65 0 2024-09-21T10:40:45.353 INFO:tasks.workunit.client.1.smithi112.stdout:7/278: sync 2024-09-21T10:40:45.353 INFO:tasks.workunit.client.1.smithi112.stdout:5/333: sync 2024-09-21T10:40:45.353 INFO:tasks.workunit.client.1.smithi112.stdout:0/393: sync 2024-09-21T10:40:45.353 INFO:tasks.workunit.client.1.smithi112.stdout:5/334: truncate d9/d15/d18/d20/f60 879227 0 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:0/394: write d3/d4/d1a/d21/f30 [210723,74227] 0 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:0/395: chown d3/d18/d52/f77 81662844 1 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:0/396: read - d3/f50 zero size 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:9/324: creat d1/d2/d27/d3a/d16/d30/d5e/f66 x:0 0 0 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:8/360: sync 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:7/279: mknod d7/d22/d41/c5d 0 2024-09-21T10:40:45.354 INFO:tasks.workunit.client.1.smithi112.stdout:0/397: symlink d3/d18/d52/d55/l84 0 2024-09-21T10:40:45.355 INFO:tasks.workunit.client.1.smithi112.stdout:8/361: symlink d8/d9/dd/d2a/d43/l75 0 2024-09-21T10:40:45.355 INFO:tasks.workunit.client.1.smithi112.stdout:8/362: chown d8/fc 165 1 2024-09-21T10:40:45.356 INFO:tasks.workunit.client.1.smithi112.stdout:8/363: fdatasync d8/d9/dd/d1a/d5d/f65 0 2024-09-21T10:40:45.356 INFO:tasks.workunit.client.1.smithi112.stdout:7/280: mkdir d7/d22/d41/d4b/d5e 0 2024-09-21T10:40:45.356 INFO:tasks.workunit.client.1.smithi112.stdout:0/398: unlink d3/d4/f38 0 2024-09-21T10:40:45.358 INFO:tasks.workunit.client.1.smithi112.stdout:3/338: dwrite d2/d22/d31/d2a/d39/d3a/f5b [0,4194304] 0 2024-09-21T10:40:45.358 INFO:tasks.workunit.client.1.smithi112.stdout:3/339: dread - d2/d2f/f6a zero size 2024-09-21T10:40:45.358 INFO:tasks.workunit.client.1.smithi112.stdout:5/335: dread d9/d15/d1d/f46 [0,4194304] 0 2024-09-21T10:40:45.358 INFO:tasks.workunit.client.1.smithi112.stdout:7/281: read d7/f19 [767244,19933] 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:0/399: mknod d3/d23/d7b/c85 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:0/400: chown d3/d4a/d4e/d72 2254198 1 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:0/401: fsync d3/d4/d1a/f17 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/282: write d7/f1c [5085359,81826] 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/283: fsync d7/d22/f28 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/284: fdatasync d7/f19 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/285: write d7/f3f [721331,66120] 0 2024-09-21T10:40:45.359 INFO:tasks.workunit.client.1.smithi112.stdout:7/286: truncate d7/d22/d41/d54/f4e 699111 0 2024-09-21T10:40:45.360 INFO:tasks.workunit.client.1.smithi112.stdout:3/340: creat d2/d22/d31/d2a/d39/d60/f6f x:0 0 0 2024-09-21T10:40:45.360 INFO:tasks.workunit.client.1.smithi112.stdout:0/402: link d3/d4/d1a/d21/d46/f58 d3/d4/d1a/d21/f86 0 2024-09-21T10:40:45.361 INFO:tasks.workunit.client.1.smithi112.stdout:7/287: truncate d7/f14 4869638 0 2024-09-21T10:40:45.361 INFO:tasks.workunit.client.1.smithi112.stdout:7/288: stat d7/c27 0 2024-09-21T10:40:45.362 INFO:tasks.workunit.client.1.smithi112.stdout:3/341: symlink d2/d22/d31/l70 0 2024-09-21T10:40:45.362 INFO:tasks.workunit.client.1.smithi112.stdout:3/342: write d2/d22/d31/d2a/f43 [5332764,111031] 0 2024-09-21T10:40:45.363 INFO:tasks.workunit.client.1.smithi112.stdout:0/403: rename d3/d4/d1a/d21/d46/f76 to d3/d4/d1a/d21/d46/f87 0 2024-09-21T10:40:45.363 INFO:tasks.workunit.client.1.smithi112.stdout:5/336: symlink d9/l65 0 2024-09-21T10:40:45.364 INFO:tasks.workunit.client.1.smithi112.stdout:3/343: symlink d2/d2f/l71 0 2024-09-21T10:40:45.364 INFO:tasks.workunit.client.1.smithi112.stdout:3/344: readlink d2/d1f/l2e 0 2024-09-21T10:40:45.365 INFO:tasks.workunit.client.1.smithi112.stdout:3/345: getdents d2/d22/d31/d2a/d39/d3a 0 2024-09-21T10:40:45.366 INFO:tasks.workunit.client.1.smithi112.stdout:3/346: link d2/d22/d31/d2a/d39/d3a/c58 d2/d22/d31/d2a/c72 0 2024-09-21T10:40:45.366 INFO:tasks.workunit.client.1.smithi112.stdout:3/347: dread - d2/d22/d31/d37/f68 zero size 2024-09-21T10:40:45.367 INFO:tasks.workunit.client.1.smithi112.stdout:7/289: dread d7/d22/f23 [0,4194304] 0 2024-09-21T10:40:45.370 INFO:tasks.workunit.client.1.smithi112.stdout:5/337: dread d9/f54 [0,4194304] 0 2024-09-21T10:40:45.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/290: write d7/ff [294407,40647] 0 2024-09-21T10:40:45.409 INFO:tasks.workunit.client.1.smithi112.stdout:3/348: mknod d2/d22/c73 0 2024-09-21T10:40:45.411 INFO:tasks.workunit.client.1.smithi112.stdout:5/338: mknod d9/d15/d18/d20/d47/c66 0 2024-09-21T10:40:45.411 INFO:tasks.workunit.client.1.smithi112.stdout:5/339: chown d9/c5d 5 1 2024-09-21T10:40:45.411 INFO:tasks.workunit.client.1.smithi112.stdout:5/340: readlink d9/d15/d18/d3a/l3b 0 2024-09-21T10:40:45.412 INFO:tasks.workunit.client.1.smithi112.stdout:7/291: getdents d7/d22/d41/d54 0 2024-09-21T10:40:45.413 INFO:tasks.workunit.client.1.smithi112.stdout:3/349: mknod d2/d22/d31/d2a/d39/c74 0 2024-09-21T10:40:45.414 INFO:tasks.workunit.client.1.smithi112.stdout:3/350: dread - d2/d2f/f6a zero size 2024-09-21T10:40:45.414 INFO:tasks.workunit.client.1.smithi112.stdout:8/364: dwrite d8/d9/dd/d1a/d5d/f65 [0,4194304] 0 2024-09-21T10:40:45.415 INFO:tasks.workunit.client.1.smithi112.stdout:9/325: dwrite d1/f36 [0,4194304] 0 2024-09-21T10:40:45.415 INFO:tasks.workunit.client.1.smithi112.stdout:9/326: fsync d1/d2/d27/d37/d3b/f53 0 2024-09-21T10:40:45.415 INFO:tasks.workunit.client.1.smithi112.stdout:5/341: unlink d9/d15/d18/d3a/d4b/d53/c5f 0 2024-09-21T10:40:45.416 INFO:tasks.workunit.client.1.smithi112.stdout:7/292: mknod d7/d22/c5f 0 2024-09-21T10:40:45.416 INFO:tasks.workunit.client.1.smithi112.stdout:7/293: dread - d7/f49 zero size 2024-09-21T10:40:45.416 INFO:tasks.workunit.client.1.smithi112.stdout:7/294: stat d7/l8 0 2024-09-21T10:40:45.416 INFO:tasks.workunit.client.1.smithi112.stdout:7/295: readlink d7/d22/l25 0 2024-09-21T10:40:45.416 INFO:tasks.workunit.client.1.smithi112.stdout:3/351: creat d2/d2f/d3f/f75 x:0 0 0 2024-09-21T10:40:45.417 INFO:tasks.workunit.client.1.smithi112.stdout:3/352: write d2/f51 [371321,12350] 0 2024-09-21T10:40:45.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/365: readlink d8/le 0 2024-09-21T10:40:45.420 INFO:tasks.workunit.client.1.smithi112.stdout:8/366: readlink d8/d9/dd/d2b/d31/l3f 0 2024-09-21T10:40:45.422 INFO:tasks.workunit.client.1.smithi112.stdout:9/327: rename d1/c32 to d1/d2/d27/d3a/d16/c67 0 2024-09-21T10:40:45.422 INFO:tasks.workunit.client.1.smithi112.stdout:9/328: write d1/d2/d27/f2f [2453049,128024] 0 2024-09-21T10:40:45.422 INFO:tasks.workunit.client.1.smithi112.stdout:9/329: read - d1/d2/d27/d3a/d16/d30/d5e/f66 zero size 2024-09-21T10:40:45.422 INFO:tasks.workunit.client.1.smithi112.stdout:9/330: write d1/d2/d27/d3a/d16/d30/f57 [1191906,5585] 0 2024-09-21T10:40:45.422 INFO:tasks.workunit.client.1.smithi112.stdout:5/342: rmdir d9/d15/d18/d20/d47 39 2024-09-21T10:40:45.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/343: read d9/d15/d18/f31 [176758,55735] 0 2024-09-21T10:40:45.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/344: write d9/d15/d1d/f4d [950605,88366] 0 2024-09-21T10:40:45.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/345: readlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:45.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/296: unlink d7/l15 0 2024-09-21T10:40:45.426 INFO:tasks.workunit.client.1.smithi112.stdout:7/297: dread d7/f1e [0,4194304] 0 2024-09-21T10:40:45.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/404: fsync d3/d4/d1a/d21/d46/f87 0 2024-09-21T10:40:45.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/405: dread - d3/d4a/d4e/f6e zero size 2024-09-21T10:40:45.429 INFO:tasks.workunit.client.1.smithi112.stdout:0/406: readlink d3/d4a/d4e/d72/l81 0 2024-09-21T10:40:45.436 INFO:tasks.workunit.client.1.smithi112.stdout:3/353: mkdir d2/d22/d31/d2a/d39/d3a/d76 0 2024-09-21T10:40:45.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/346: mknod d9/d15/c67 0 2024-09-21T10:40:45.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/347: truncate d9/d15/f35 322510 0 2024-09-21T10:40:45.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/348: write d9/d15/d1d/f46 [428619,70133] 0 2024-09-21T10:40:45.439 INFO:tasks.workunit.client.1.smithi112.stdout:7/298: rename d7/d22/d47/c59 to d7/c60 0 2024-09-21T10:40:45.439 INFO:tasks.workunit.client.1.smithi112.stdout:7/299: stat d7/c1f 0 2024-09-21T10:40:45.440 INFO:tasks.workunit.client.1.smithi112.stdout:9/331: dwrite d1/d2/d27/d3a/f56 [0,4194304] 0 2024-09-21T10:40:45.440 INFO:tasks.workunit.client.1.smithi112.stdout:0/407: mknod d3/d4/d1a/d21/d4f/c88 0 2024-09-21T10:40:45.440 INFO:tasks.workunit.client.1.smithi112.stdout:8/367: dwrite d8/d9/d3c/d6d/f74 [0,4194304] 0 2024-09-21T10:40:45.440 INFO:tasks.workunit.client.1.smithi112.stdout:8/368: chown d8/fc 1768278955 1 2024-09-21T10:40:45.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/354: unlink d2/d22/d31/l6c 0 2024-09-21T10:40:45.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/355: creat d2/d2f/d3f/f77 x:0 0 0 2024-09-21T10:40:45.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/356: stat d2/d1f/f4f 0 2024-09-21T10:40:45.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/357: write d2/f17 [560518,23076] 0 2024-09-21T10:40:45.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/358: creat d2/f78 x:0 0 0 2024-09-21T10:40:45.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/359: truncate d2/d22/f38 669383 0 2024-09-21T10:40:45.442 INFO:tasks.workunit.client.1.smithi112.stdout:5/349: unlink d9/d15/d18/d20/l37 0 2024-09-21T10:40:45.442 INFO:tasks.workunit.client.1.smithi112.stdout:5/350: chown d9/d15/d1d/f32 188862 1 2024-09-21T10:40:45.442 INFO:tasks.workunit.client.1.smithi112.stdout:5/351: dread - d9/d15/d18/d3a/f5b zero size 2024-09-21T10:40:45.443 INFO:tasks.workunit.client.1.smithi112.stdout:7/300: creat d7/d22/d41/d56/d58/f61 x:0 0 0 2024-09-21T10:40:45.443 INFO:tasks.workunit.client.1.smithi112.stdout:7/301: write d7/d22/f48 [1015158,16226] 0 2024-09-21T10:40:45.446 INFO:tasks.workunit.client.1.smithi112.stdout:9/332: mkdir d1/d2/d27/d37/d68 0 2024-09-21T10:40:45.449 INFO:tasks.workunit.client.1.smithi112.stdout:0/408: dread d3/d4/d1a/f65 [0,4194304] 0 2024-09-21T10:40:45.450 INFO:tasks.workunit.client.1.smithi112.stdout:3/360: rename d2/d2f/l56 to d2/d22/d31/d2a/d39/d60/l79 0 2024-09-21T10:40:45.450 INFO:tasks.workunit.client.1.smithi112.stdout:3/361: write d2/d2f/f66 [395502,28842] 0 2024-09-21T10:40:45.450 INFO:tasks.workunit.client.1.smithi112.stdout:3/362: fsync d2/d1f/f6d 0 2024-09-21T10:40:45.451 INFO:tasks.workunit.client.1.smithi112.stdout:0/409: dread d3/d23/f67 [0,4194304] 0 2024-09-21T10:40:45.451 INFO:tasks.workunit.client.1.smithi112.stdout:5/352: symlink d9/d15/d18/l68 0 2024-09-21T10:40:45.451 INFO:tasks.workunit.client.1.smithi112.stdout:7/302: dread d7/f34 [0,4194304] 0 2024-09-21T10:40:45.452 INFO:tasks.workunit.client.1.smithi112.stdout:9/333: mkdir d1/d2/d27/d37/d3b/d69 0 2024-09-21T10:40:45.453 INFO:tasks.workunit.client.1.smithi112.stdout:3/363: creat d2/d22/d31/d2a/d39/f7a x:0 0 0 2024-09-21T10:40:45.454 INFO:tasks.workunit.client.1.smithi112.stdout:0/410: rename d3/d4/d10/l5b to d3/d4/d10/l89 0 2024-09-21T10:40:45.454 INFO:tasks.workunit.client.1.smithi112.stdout:7/303: mknod d7/d22/d41/d56/d5c/c62 0 2024-09-21T10:40:45.454 INFO:tasks.workunit.client.1.smithi112.stdout:8/369: dwrite d8/d9/dd/d2a/d43/f66 [0,4194304] 0 2024-09-21T10:40:45.455 INFO:tasks.workunit.client.1.smithi112.stdout:8/370: write d8/d9/dd/d2a/d43/d58/f5e [1835346,33285] 0 2024-09-21T10:40:45.455 INFO:tasks.workunit.client.1.smithi112.stdout:8/371: chown d8/d9/dd/d2a/d43/f6f 120270009 1 2024-09-21T10:40:45.455 INFO:tasks.workunit.client.1.smithi112.stdout:8/372: readlink d8/l59 0 2024-09-21T10:40:45.456 INFO:tasks.workunit.client.1.smithi112.stdout:9/334: rename d1/d2/d27/d3a/l5a to d1/d2/d27/l6a 0 2024-09-21T10:40:45.456 INFO:tasks.workunit.client.1.smithi112.stdout:5/353: write d9/d15/d18/d20/d47/f49 [2228981,110863] 0 2024-09-21T10:40:45.456 INFO:tasks.workunit.client.1.smithi112.stdout:5/354: chown d9/l65 117 1 2024-09-21T10:40:45.456 INFO:tasks.workunit.client.1.smithi112.stdout:5/355: fsync d9/d15/d18/f39 0 2024-09-21T10:40:45.456 INFO:tasks.workunit.client.1.smithi112.stdout:3/364: symlink d2/d2f/d3f/l7b 0 2024-09-21T10:40:45.459 INFO:tasks.workunit.client.1.smithi112.stdout:7/304: write d7/f13 [728937,19238] 0 2024-09-21T10:40:45.459 INFO:tasks.workunit.client.1.smithi112.stdout:7/305: creat d7/d22/f63 x:0 0 0 2024-09-21T10:40:45.459 INFO:tasks.workunit.client.1.smithi112.stdout:7/306: write d7/d22/d41/d56/d58/f61 [131786,43027] 0 2024-09-21T10:40:45.460 INFO:tasks.workunit.client.1.smithi112.stdout:3/365: symlink d2/d22/d31/d37/l7c 0 2024-09-21T10:40:45.461 INFO:tasks.workunit.client.1.smithi112.stdout:8/373: getdents d8 0 2024-09-21T10:40:45.464 INFO:tasks.workunit.client.1.smithi112.stdout:7/307: rename d7/d22/d47/f57 to d7/d22/d41/d4b/f64 0 2024-09-21T10:40:45.464 INFO:tasks.workunit.client.1.smithi112.stdout:7/308: fdatasync d7/d22/f2e 0 2024-09-21T10:40:45.464 INFO:tasks.workunit.client.1.smithi112.stdout:5/356: dread d9/d15/d18/d20/f34 [0,4194304] 0 2024-09-21T10:40:45.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/334: sync 2024-09-21T10:40:45.466 INFO:tasks.workunit.client.1.smithi112.stdout:6/312: sync 2024-09-21T10:40:45.466 INFO:tasks.workunit.client.1.smithi112.stdout:1/463: sync 2024-09-21T10:40:45.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/297: sync 2024-09-21T10:40:45.466 INFO:tasks.workunit.client.1.smithi112.stdout:2/298: stat d0/dd/f2e 0 2024-09-21T10:40:45.467 INFO:tasks.workunit.client.1.smithi112.stdout:5/357: write d9/d15/f24 [458266,43115] 0 2024-09-21T10:40:45.468 INFO:tasks.workunit.client.1.smithi112.stdout:0/411: dwrite d3/d4/d1a/d21/f86 [0,4194304] 0 2024-09-21T10:40:45.468 INFO:tasks.workunit.client.1.smithi112.stdout:0/412: truncate d3/d4a/d4e/f6e 891428 0 2024-09-21T10:40:45.468 INFO:tasks.workunit.client.1.smithi112.stdout:0/413: truncate d3/d18/f75 197946 0 2024-09-21T10:40:45.468 INFO:tasks.workunit.client.1.smithi112.stdout:3/366: link d2/d2f/f64 d2/d1f/f7d 0 2024-09-21T10:40:45.469 INFO:tasks.workunit.client.1.smithi112.stdout:8/374: mkdir d8/d9/dd/d76 0 2024-09-21T10:40:45.470 INFO:tasks.workunit.client.1.smithi112.stdout:6/313: truncate d4/d6/da/f12 1028508 0 2024-09-21T10:40:45.475 INFO:tasks.workunit.client.1.smithi112.stdout:9/335: rename d1/d2/d27/d3a/d16 to d1/d2/d27/d3a/d6b 0 2024-09-21T10:40:45.477 INFO:tasks.workunit.client.1.smithi112.stdout:1/464: dread d8/d1a/d31/d37/f47 [0,4194304] 0 2024-09-21T10:40:45.478 INFO:tasks.workunit.client.1.smithi112.stdout:1/465: write d8/d20/f5f [1376295,65547] 0 2024-09-21T10:40:45.479 INFO:tasks.workunit.client.1.smithi112.stdout:5/358: truncate d9/d15/d18/f29 3410823 0 2024-09-21T10:40:45.481 INFO:tasks.workunit.client.1.smithi112.stdout:0/414: mknod d3/d18/d52/d5f/c8a 0 2024-09-21T10:40:45.483 INFO:tasks.workunit.client.1.smithi112.stdout:3/367: mknod d2/d22/d31/d2a/d39/d3a/d76/c7e 0 2024-09-21T10:40:45.485 INFO:tasks.workunit.client.1.smithi112.stdout:6/314: mkdir d4/d6/d75 0 2024-09-21T10:40:45.486 INFO:tasks.workunit.client.1.smithi112.stdout:7/309: dwrite f5 [4194304,4194304] 0 2024-09-21T10:40:45.486 INFO:tasks.workunit.client.1.smithi112.stdout:7/310: fsync d7/f3a 0 2024-09-21T10:40:45.487 INFO:tasks.workunit.client.1.smithi112.stdout:9/336: mknod d1/d2/d27/d3a/d6b/d30/d5c/c6c 0 2024-09-21T10:40:45.487 INFO:tasks.workunit.client.1.smithi112.stdout:9/337: write d1/d2/d42/f45 [172536,112935] 0 2024-09-21T10:40:45.487 INFO:tasks.workunit.client.1.smithi112.stdout:9/338: creat d1/f6d x:0 0 0 2024-09-21T10:40:45.490 INFO:tasks.workunit.client.1.smithi112.stdout:1/466: creat d8/f9a x:0 0 0 2024-09-21T10:40:45.492 INFO:tasks.workunit.client.1.smithi112.stdout:5/359: mknod d9/d15/d18/d3a/d4b/c69 0 2024-09-21T10:40:45.493 INFO:tasks.workunit.client.1.smithi112.stdout:4/335: dwrite de/d33/d2f/d71/d40/d4f/f6b [0,4194304] 0 2024-09-21T10:40:45.496 INFO:tasks.workunit.client.1.smithi112.stdout:3/368: dread d2/fe [0,4194304] 0 2024-09-21T10:40:45.502 INFO:tasks.workunit.client.1.smithi112.stdout:2/299: rename d0/d12/d26 to d0/dd/d49/d62/d63 0 2024-09-21T10:40:45.502 INFO:tasks.workunit.client.1.smithi112.stdout:1/467: read d8/f15 [1594171,113496] 0 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:9/339: link d1/d2/d27/d37/d3b/l40 d1/d2/d27/d3a/d6b/l6e 0 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:9/340: chown d1/d2/d27/f5f 11793 1 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/315: dwrite d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/316: creat d4/dc/d1a/d31/d3c/f76 x:0 0 0 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/317: fsync d4/d4f/f66 0 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/318: chown d4/dc/f4b 88109685 1 2024-09-21T10:40:45.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/319: truncate d4/d3e/f4c 300096 0 2024-09-21T10:40:45.506 INFO:tasks.workunit.client.1.smithi112.stdout:5/360: creat d9/d15/f6a x:0 0 0 2024-09-21T10:40:45.506 INFO:tasks.workunit.client.1.smithi112.stdout:5/361: write d9/d15/d1d/f46 [768154,8526] 0 2024-09-21T10:40:45.509 INFO:tasks.workunit.client.1.smithi112.stdout:4/336: creat de/d33/d2f/d71/d40/f72 x:0 0 0 2024-09-21T10:40:45.509 INFO:tasks.workunit.client.1.smithi112.stdout:4/337: dread - de/d33/d2f/f61 zero size 2024-09-21T10:40:45.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/341: truncate d1/d2/f1e 1298579 0 2024-09-21T10:40:45.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/342: chown d1/f6d 27703 1 2024-09-21T10:40:45.513 INFO:tasks.workunit.client.1.smithi112.stdout:2/300: dread d0/dd/f61 [0,4194304] 0 2024-09-21T10:40:45.513 INFO:tasks.workunit.client.1.smithi112.stdout:5/362: dread d9/d15/f16 [4194304,4194304] 0 2024-09-21T10:40:45.514 INFO:tasks.workunit.client.1.smithi112.stdout:5/363: dread d9/d15/f35 [0,4194304] 0 2024-09-21T10:40:45.515 INFO:tasks.workunit.client.1.smithi112.stdout:4/338: unlink de/d33/d2f/d35/f55 0 2024-09-21T10:40:45.518 INFO:tasks.workunit.client.1.smithi112.stdout:2/301: unlink d0/l3a 0 2024-09-21T10:40:45.520 INFO:tasks.workunit.client.1.smithi112.stdout:4/339: symlink de/l73 0 2024-09-21T10:40:45.520 INFO:tasks.workunit.client.1.smithi112.stdout:4/340: truncate f8 1667354 0 2024-09-21T10:40:45.521 INFO:tasks.workunit.client.1.smithi112.stdout:9/343: write d1/d2/d27/d3a/d6b/f3c [4589,48792] 0 2024-09-21T10:40:45.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/369: dwrite d2/d1f/f40 [0,4194304] 0 2024-09-21T10:40:45.523 INFO:tasks.workunit.client.1.smithi112.stdout:1/468: dwrite d8/d1a/d31/f7c [0,4194304] 0 2024-09-21T10:40:45.523 INFO:tasks.workunit.client.1.smithi112.stdout:1/469: creat d8/d45/f9b x:0 0 0 2024-09-21T10:40:45.523 INFO:tasks.workunit.client.1.smithi112.stdout:1/470: fdatasync d8/f24 0 2024-09-21T10:40:45.524 INFO:tasks.workunit.client.1.smithi112.stdout:0/415: rename d3/d18/d52/d5f to d3/d4/d10/d8b 0 2024-09-21T10:40:45.525 INFO:tasks.workunit.client.1.smithi112.stdout:2/302: rmdir d0/dd/d49/d62 39 2024-09-21T10:40:45.527 INFO:tasks.workunit.client.1.smithi112.stdout:9/344: read d1/d2/d27/f44 [1213991,89398] 0 2024-09-21T10:40:45.528 INFO:tasks.workunit.client.1.smithi112.stdout:3/370: symlink d2/d22/d31/l7f 0 2024-09-21T10:40:45.531 INFO:tasks.workunit.client.1.smithi112.stdout:1/471: rmdir d8/d1a/d53/d57/d83 39 2024-09-21T10:40:45.531 INFO:tasks.workunit.client.1.smithi112.stdout:1/472: chown d8/d45 28835 1 2024-09-21T10:40:45.532 INFO:tasks.workunit.client.1.smithi112.stdout:6/320: rename d4/d6/l9 to d4/dc/d1a/d31/d3c/l77 0 2024-09-21T10:40:45.539 INFO:tasks.workunit.client.1.smithi112.stdout:2/303: mknod d0/d12/c64 0 2024-09-21T10:40:45.539 INFO:tasks.workunit.client.1.smithi112.stdout:2/304: fsync d0/dd/f21 0 2024-09-21T10:40:45.539 INFO:tasks.workunit.client.1.smithi112.stdout:2/305: readlink d0/dd/d49/d62/d63/l31 0 2024-09-21T10:40:45.539 INFO:tasks.workunit.client.1.smithi112.stdout:2/306: write d0/dd/f21 [1277949,71629] 0 2024-09-21T10:40:45.539 INFO:tasks.workunit.client.1.smithi112.stdout:9/345: symlink d1/d2/l6f 0 2024-09-21T10:40:45.541 INFO:tasks.workunit.client.1.smithi112.stdout:3/371: unlink d2/d1f/l24 0 2024-09-21T10:40:45.541 INFO:tasks.workunit.client.1.smithi112.stdout:1/473: read - d8/d1a/d31/d66/f82 zero size 2024-09-21T10:40:45.544 INFO:tasks.workunit.client.1.smithi112.stdout:5/364: rename d9/d15/d18/d3a/d4b/d53 to d9/d15/d18/d3a/d61/d62/d6b 0 2024-09-21T10:40:45.544 INFO:tasks.workunit.client.1.smithi112.stdout:4/341: rename de/d33/d2f/d71/d40/d4f to de/d33/d2f/d71/d40/d4f/d74 22 2024-09-21T10:40:45.544 INFO:tasks.workunit.client.1.smithi112.stdout:5/365: readlink d9/d15/d18/l68 0 2024-09-21T10:40:45.546 INFO:tasks.workunit.client.1.smithi112.stdout:0/416: rename d3/d4/d1a/d21/l62 to d3/d4/l8c 0 2024-09-21T10:40:45.546 INFO:tasks.workunit.client.1.smithi112.stdout:5/366: rmdir d9 39 2024-09-21T10:40:45.547 INFO:tasks.workunit.client.1.smithi112.stdout:4/342: mkdir de/d2a/d3d/d3e/d75 0 2024-09-21T10:40:45.548 INFO:tasks.workunit.client.1.smithi112.stdout:3/372: dread f1 [0,4194304] 0 2024-09-21T10:40:45.548 INFO:tasks.workunit.client.1.smithi112.stdout:6/321: rename d4/d6/da/f46 to d4/dc/d1a/d31/d39/f78 0 2024-09-21T10:40:45.548 INFO:tasks.workunit.client.1.smithi112.stdout:6/322: creat d4/dc/d1a/d31/d56/f79 x:0 0 0 2024-09-21T10:40:45.549 INFO:tasks.workunit.client.1.smithi112.stdout:0/417: mknod d3/d4/d10/d8b/c8d 0 2024-09-21T10:40:45.549 INFO:tasks.workunit.client.1.smithi112.stdout:4/343: getdents de/d33/d2f/d71/d40/d4f 0 2024-09-21T10:40:45.551 INFO:tasks.workunit.client.1.smithi112.stdout:3/373: creat d2/d22/d31/d2a/d39/d3a/d76/f80 x:0 0 0 2024-09-21T10:40:45.552 INFO:tasks.workunit.client.1.smithi112.stdout:2/307: rename d0/f25 to d0/d12/d46/f65 0 2024-09-21T10:40:45.554 INFO:tasks.workunit.client.1.smithi112.stdout:6/323: mkdir d4/d6/d75/d7a 0 2024-09-21T10:40:45.554 INFO:tasks.workunit.client.1.smithi112.stdout:0/418: truncate d3/d4/d1a/d21/f61 2094771 0 2024-09-21T10:40:45.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/419: write d3/d23/f67 [103754,38225] 0 2024-09-21T10:40:45.556 INFO:tasks.workunit.client.1.smithi112.stdout:5/367: dread d9/d15/d18/d20/f34 [0,4194304] 0 2024-09-21T10:40:45.557 INFO:tasks.workunit.client.1.smithi112.stdout:9/346: rename d1/d2/d15 to d1/d2/d27/d62/d70 0 2024-09-21T10:40:45.560 INFO:tasks.workunit.client.1.smithi112.stdout:6/324: unlink d4/d6/da/d11/d37/l1c 0 2024-09-21T10:40:45.560 INFO:tasks.workunit.client.1.smithi112.stdout:6/325: creat d4/dc/d1a/d31/d56/f7b x:0 0 0 2024-09-21T10:40:45.560 INFO:tasks.workunit.client.1.smithi112.stdout:6/326: creat d4/dc/d1a/d31/d3c/f7c x:0 0 0 2024-09-21T10:40:45.561 INFO:tasks.workunit.client.1.smithi112.stdout:3/374: write d2/fe [7005244,50801] 0 2024-09-21T10:40:45.561 INFO:tasks.workunit.client.1.smithi112.stdout:5/368: symlink d9/d15/d18/d3a/l6c 0 2024-09-21T10:40:45.564 INFO:tasks.workunit.client.1.smithi112.stdout:1/474: rename d8/d1a/d53/l91 to d8/d54/d6d/l9c 0 2024-09-21T10:40:45.564 INFO:tasks.workunit.client.1.smithi112.stdout:1/475: chown d8/d1a/d31/f68 144873 1 2024-09-21T10:40:45.564 INFO:tasks.workunit.client.1.smithi112.stdout:1/476: fdatasync d8/d20/f4a 0 2024-09-21T10:40:45.565 INFO:tasks.workunit.client.1.smithi112.stdout:9/347: creat d1/d2/d27/d3a/f71 x:0 0 0 2024-09-21T10:40:45.571 INFO:tasks.workunit.client.1.smithi112.stdout:4/344: dwrite de/d33/d2f/d71/d40/f5a [0,4194304] 0 2024-09-21T10:40:45.571 INFO:tasks.workunit.client.1.smithi112.stdout:2/308: dwrite d0/f9 [4194304,4194304] 0 2024-09-21T10:40:45.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/369: symlink d9/d15/d18/d20/d47/l6d 0 2024-09-21T10:40:45.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/327: dread d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:45.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/328: dread - d4/dc/d1a/d31/d56/f79 zero size 2024-09-21T10:40:45.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/329: write d4/dc/f3f [746457,82269] 0 2024-09-21T10:40:45.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/330: stat d4/dc/d1a 0 2024-09-21T10:40:45.572 INFO:tasks.workunit.client.1.smithi112.stdout:6/331: chown d4/d6/da/d14/l32 187578 1 2024-09-21T10:40:45.572 INFO:tasks.workunit.client.1.smithi112.stdout:1/477: mknod d8/d1a/d53/d57/c9d 0 2024-09-21T10:40:45.573 INFO:tasks.workunit.client.1.smithi112.stdout:1/478: read d8/d1a/d31/f4e [1404957,100787] 0 2024-09-21T10:40:45.573 INFO:tasks.workunit.client.1.smithi112.stdout:9/348: rename d1/d2/f20 to d1/d2/d42/f72 0 2024-09-21T10:40:45.573 INFO:tasks.workunit.client.1.smithi112.stdout:9/349: fsync d1/d2/f5 0 2024-09-21T10:40:45.575 INFO:tasks.workunit.client.1.smithi112.stdout:2/309: truncate d0/d12/f41 3090863 0 2024-09-21T10:40:45.577 INFO:tasks.workunit.client.1.smithi112.stdout:6/332: symlink d4/d6/da/d11/d1f/l7d 0 2024-09-21T10:40:45.577 INFO:tasks.workunit.client.1.smithi112.stdout:6/333: readlink d4/d6/lf 0 2024-09-21T10:40:45.577 INFO:tasks.workunit.client.1.smithi112.stdout:6/334: chown d4/dc/d1a/d31/d56/d64 133497743 1 2024-09-21T10:40:45.578 INFO:tasks.workunit.client.1.smithi112.stdout:6/335: chown d4/d6/l63 758244 1 2024-09-21T10:40:45.579 INFO:tasks.workunit.client.1.smithi112.stdout:1/479: mkdir d8/d1a/d31/d37/d9e 0 2024-09-21T10:40:45.579 INFO:tasks.workunit.client.1.smithi112.stdout:1/480: write d8/d1a/d53/f5c [336365,20859] 0 2024-09-21T10:40:45.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/345: rename de/d33/d2f/d71/d40/f62 to de/d18/f76 0 2024-09-21T10:40:45.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/346: truncate de/f4d 1443888 0 2024-09-21T10:40:45.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/347: write de/d33/d2f/d71/d40/f72 [562322,51833] 0 2024-09-21T10:40:45.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/348: chown de/l60 85 1 2024-09-21T10:40:45.581 INFO:tasks.workunit.client.1.smithi112.stdout:9/350: mkdir d1/d2/d27/d37/d3b/d69/d73 0 2024-09-21T10:40:45.582 INFO:tasks.workunit.client.1.smithi112.stdout:2/310: mkdir d0/d12/d1b/d51/d66 0 2024-09-21T10:40:45.583 INFO:tasks.workunit.client.1.smithi112.stdout:5/370: getdents d9/d15/d18/d3a 0 2024-09-21T10:40:45.584 INFO:tasks.workunit.client.1.smithi112.stdout:6/336: mkdir d4/dc/d7e 0 2024-09-21T10:40:45.587 INFO:tasks.workunit.client.1.smithi112.stdout:1/481: creat d8/d1a/f9f x:0 0 0 2024-09-21T10:40:45.589 INFO:tasks.workunit.client.1.smithi112.stdout:4/349: rename de/f14 to de/d2a/d3d/d3e/d57/f77 0 2024-09-21T10:40:45.590 INFO:tasks.workunit.client.1.smithi112.stdout:9/351: truncate d1/d2/d27/d3a/f23 7221652 0 2024-09-21T10:40:45.592 INFO:tasks.workunit.client.1.smithi112.stdout:5/371: dread d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:45.592 INFO:tasks.workunit.client.1.smithi112.stdout:6/337: creat d4/d6/da/d14/d49/d73/f7f x:0 0 0 2024-09-21T10:40:45.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/352: mknod d1/d2/d42/c74 0 2024-09-21T10:40:45.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/353: write d1/d2/d27/d37/d3b/f53 [4796701,8368] 0 2024-09-21T10:40:45.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/354: write d1/d2/d27/d3a/d6b/f3c [2427196,99210] 0 2024-09-21T10:40:45.596 INFO:tasks.workunit.client.1.smithi112.stdout:6/338: unlink d4/dc/d1a/d31/d56/f6d 0 2024-09-21T10:40:45.597 INFO:tasks.workunit.client.1.smithi112.stdout:1/482: dread d8/d1a/d31/d37/f46 [0,4194304] 0 2024-09-21T10:40:45.600 INFO:tasks.workunit.client.1.smithi112.stdout:5/372: mkdir d9/d6e 0 2024-09-21T10:40:45.600 INFO:tasks.workunit.client.1.smithi112.stdout:5/373: write d9/d15/f63 [1057716,63844] 0 2024-09-21T10:40:45.600 INFO:tasks.workunit.client.1.smithi112.stdout:5/374: creat d9/d15/d18/d3a/d4b/f6f x:0 0 0 2024-09-21T10:40:45.601 INFO:tasks.workunit.client.1.smithi112.stdout:6/339: truncate d4/dc/d1a/f61 70091 0 2024-09-21T10:40:45.604 INFO:tasks.workunit.client.1.smithi112.stdout:5/375: symlink d9/d15/d18/d3a/d61/l70 0 2024-09-21T10:40:45.604 INFO:tasks.workunit.client.1.smithi112.stdout:9/355: dread d1/d2/f48 [0,4194304] 0 2024-09-21T10:40:45.604 INFO:tasks.workunit.client.1.smithi112.stdout:9/356: truncate d1/d2/d27/d3a/f71 830304 0 2024-09-21T10:40:45.604 INFO:tasks.workunit.client.1.smithi112.stdout:9/357: write d1/d2/f1e [2183189,5919] 0 2024-09-21T10:40:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/376: mkdir d9/d15/d18/d3a/d4b/d71 0 2024-09-21T10:40:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/377: dread - d9/d15/d18/d3a/f5b zero size 2024-09-21T10:40:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/378: write d9/d15/f2a [4202711,118070] 0 2024-09-21T10:40:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/379: write d9/d15/d18/d20/d55/f58 [619461,112242] 0 2024-09-21T10:40:45.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/380: truncate d9/d15/d18/d3a/d4b/f52 5097263 0 2024-09-21T10:40:45.607 INFO:tasks.workunit.client.1.smithi112.stdout:9/358: creat d1/d2/f75 x:0 0 0 2024-09-21T10:40:45.609 INFO:tasks.workunit.client.1.smithi112.stdout:5/381: dread d9/d15/d18/d20/d47/f49 [0,4194304] 0 2024-09-21T10:40:45.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/382: mknod d9/d15/d18/d3a/c72 0 2024-09-21T10:40:45.611 INFO:tasks.workunit.client.1.smithi112.stdout:4/350: dwrite de/d33/d2f/d71/d40/f5a [0,4194304] 0 2024-09-21T10:40:45.613 INFO:tasks.workunit.client.1.smithi112.stdout:5/383: creat d9/d57/f73 x:0 0 0 2024-09-21T10:40:45.615 INFO:tasks.workunit.client.1.smithi112.stdout:5/384: unlink l1 0 2024-09-21T10:40:45.616 INFO:tasks.workunit.client.1.smithi112.stdout:5/385: write d9/f54 [4292635,51257] 0 2024-09-21T10:40:45.616 INFO:tasks.workunit.client.1.smithi112.stdout:9/359: write d1/d2/d27/d3a/d6b/d30/f54 [378373,3749] 0 2024-09-21T10:40:45.616 INFO:tasks.workunit.client.1.smithi112.stdout:5/386: mkdir d9/d15/d18/d3a/d4b/d74 0 2024-09-21T10:40:45.620 INFO:tasks.workunit.client.1.smithi112.stdout:1/483: dwrite d8/d1a/d31/d37/f77 [4194304,4194304] 0 2024-09-21T10:40:45.621 INFO:tasks.workunit.client.1.smithi112.stdout:6/340: dwrite d4/dc/d1a/d31/d56/d64/f48 [0,4194304] 0 2024-09-21T10:40:45.626 INFO:tasks.workunit.client.1.smithi112.stdout:6/341: dread d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:45.626 INFO:tasks.workunit.client.1.smithi112.stdout:6/342: write d4/d6/da/f12 [205835,67987] 0 2024-09-21T10:40:45.627 INFO:tasks.workunit.client.1.smithi112.stdout:6/343: symlink d4/d6/da/d14/d49/d73/l80 0 2024-09-21T10:40:45.629 INFO:tasks.workunit.client.1.smithi112.stdout:6/344: symlink d4/dc/d1a/l81 0 2024-09-21T10:40:45.629 INFO:tasks.workunit.client.1.smithi112.stdout:6/345: write d4/d3e/f4c [909497,21378] 0 2024-09-21T10:40:45.630 INFO:tasks.workunit.client.1.smithi112.stdout:6/346: mknod d4/dc/d1a/d31/d3c/c82 0 2024-09-21T10:40:45.634 INFO:tasks.workunit.client.1.smithi112.stdout:4/351: dwrite de/d33/d2f/d71/d40/d4f/f6b [0,4194304] 0 2024-09-21T10:40:45.634 INFO:tasks.workunit.client.1.smithi112.stdout:4/352: creat de/d33/d2f/d35/f78 x:0 0 0 2024-09-21T10:40:45.634 INFO:tasks.workunit.client.1.smithi112.stdout:4/353: write de/f12 [4202191,37560] 0 2024-09-21T10:40:45.637 INFO:tasks.workunit.client.1.smithi112.stdout:4/354: link c3 de/d33/c79 0 2024-09-21T10:40:45.637 INFO:tasks.workunit.client.1.smithi112.stdout:4/355: write de/d33/d2f/f52 [609147,115929] 0 2024-09-21T10:40:45.638 INFO:tasks.workunit.client.1.smithi112.stdout:4/356: truncate f0 6513429 0 2024-09-21T10:40:45.641 INFO:tasks.workunit.client.1.smithi112.stdout:4/357: write de/d33/f30 [988856,122735] 0 2024-09-21T10:40:45.654 INFO:tasks.workunit.client.1.smithi112.stdout:6/347: write d4/d4f/f66 [15851,129227] 0 2024-09-21T10:40:45.664 INFO:tasks.workunit.client.1.smithi112.stdout:6/348: write d4/dc/d1a/d31/d39/f78 [446612,119255] 0 2024-09-21T10:40:45.664 INFO:tasks.workunit.client.1.smithi112.stdout:1/484: write d8/d1a/d31/d37/f77 [2590107,15749] 0 2024-09-21T10:40:45.665 INFO:tasks.workunit.client.1.smithi112.stdout:6/349: creat d4/dc/d7e/f83 x:0 0 0 2024-09-21T10:40:45.665 INFO:tasks.workunit.client.1.smithi112.stdout:6/350: chown d4/d6/da/d11/d37/c50 1 1 2024-09-21T10:40:45.666 INFO:tasks.workunit.client.1.smithi112.stdout:6/351: unlink d4/dc/d1a/d31/d39/f78 0 2024-09-21T10:40:45.667 INFO:tasks.workunit.client.1.smithi112.stdout:6/352: mkdir d4/dc/d1a/d31/d56/d64/d84 0 2024-09-21T10:40:45.667 INFO:tasks.workunit.client.1.smithi112.stdout:6/353: chown d4/dc/d1a/d31/d3c/l77 15571083 1 2024-09-21T10:40:45.668 INFO:tasks.workunit.client.1.smithi112.stdout:2/311: dwrite d0/dd/f5c [0,4194304] 0 2024-09-21T10:40:45.670 INFO:tasks.workunit.client.1.smithi112.stdout:4/358: dwrite de/f15 [4194304,4194304] 0 2024-09-21T10:40:45.671 INFO:tasks.workunit.client.1.smithi112.stdout:9/360: dwrite d1/f43 [0,4194304] 0 2024-09-21T10:40:45.672 INFO:tasks.workunit.client.1.smithi112.stdout:9/361: fdatasync d1/d2/d27/d3a/d6b/d30/f57 0 2024-09-21T10:40:45.672 INFO:tasks.workunit.client.1.smithi112.stdout:5/387: dwrite d9/d15/d18/d20/d47/f49 [0,4194304] 0 2024-09-21T10:40:45.673 INFO:tasks.workunit.client.1.smithi112.stdout:1/485: write d8/f63 [2280358,24960] 0 2024-09-21T10:40:45.673 INFO:tasks.workunit.client.1.smithi112.stdout:2/312: creat d0/d12/d1b/d51/d57/f67 x:0 0 0 2024-09-21T10:40:45.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/359: dread de/d33/d2f/d35/f36 [4194304,4194304] 0 2024-09-21T10:40:45.682 INFO:tasks.workunit.client.1.smithi112.stdout:6/354: dread d4/d6/da/f47 [0,4194304] 0 2024-09-21T10:40:45.683 INFO:tasks.workunit.client.1.smithi112.stdout:5/388: rename d9/d15/f3e to d9/d15/d18/d20/d47/f75 0 2024-09-21T10:40:45.683 INFO:tasks.workunit.client.1.smithi112.stdout:9/362: dread d1/d2/d27/d37/d3b/f53 [0,4194304] 0 2024-09-21T10:40:45.685 INFO:tasks.workunit.client.1.smithi112.stdout:2/313: mknod d0/d12/c68 0 2024-09-21T10:40:45.685 INFO:tasks.workunit.client.1.smithi112.stdout:2/314: truncate d0/d12/d1b/d51/d57/f40 539999 0 2024-09-21T10:40:45.685 INFO:tasks.workunit.client.1.smithi112.stdout:2/315: dread - d0/d12/d1b/d51/d57/f67 zero size 2024-09-21T10:40:45.686 INFO:tasks.workunit.client.1.smithi112.stdout:9/363: write d1/d2/f1e [584389,114909] 0 2024-09-21T10:40:45.686 INFO:tasks.workunit.client.1.smithi112.stdout:9/364: readlink d1/d2/d27/d3a/l31 0 2024-09-21T10:40:45.687 INFO:tasks.workunit.client.1.smithi112.stdout:1/486: dwrite d8/d20/f4a [0,4194304] 0 2024-09-21T10:40:45.688 INFO:tasks.workunit.client.1.smithi112.stdout:6/355: link d4/d6/da/d14/d49/d62/f69 d4/d3e/f85 0 2024-09-21T10:40:45.688 INFO:tasks.workunit.client.1.smithi112.stdout:6/356: fsync d4/d6/da/f2c 0 2024-09-21T10:40:45.690 INFO:tasks.workunit.client.1.smithi112.stdout:4/360: rename de/d2a/d3d/d3e/d57/f77 to de/d2a/d3d/f7a 0 2024-09-21T10:40:45.694 INFO:tasks.workunit.client.1.smithi112.stdout:5/389: link d9/d15/d18/c2b d9/d15/d18/d20/d55/c76 0 2024-09-21T10:40:45.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:45 smithi060 ceph-mon[28215]: pgmap v9: 65 pgs: 65 active+clean; 723 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 61 MiB/s rd, 88 MiB/s wr, 738 op/s 2024-09-21T10:40:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:45 smithi112 ceph-mon[35117]: pgmap v9: 65 pgs: 65 active+clean; 723 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 61 MiB/s rd, 88 MiB/s wr, 738 op/s 2024-09-21T10:40:45.701 INFO:tasks.workunit.client.1.smithi112.stdout:2/316: dwrite d0/d12/f28 [0,4194304] 0 2024-09-21T10:40:45.701 INFO:tasks.workunit.client.1.smithi112.stdout:2/317: stat d0/dd/d49/f3f 0 2024-09-21T10:40:45.705 INFO:tasks.workunit.client.1.smithi112.stdout:9/365: link d1/d2/d27/d3a/f23 d1/d2/d42/f76 0 2024-09-21T10:40:45.705 INFO:tasks.workunit.client.1.smithi112.stdout:9/366: chown d1/l18 27884 1 2024-09-21T10:40:45.705 INFO:tasks.workunit.client.1.smithi112.stdout:9/367: readlink d1/d2/l1a 0 2024-09-21T10:40:45.706 INFO:tasks.workunit.client.1.smithi112.stdout:9/368: stat d1/f43 0 2024-09-21T10:40:45.710 INFO:tasks.workunit.client.1.smithi112.stdout:4/361: dwrite de/d33/d2f/d35/f36 [4194304,4194304] 0 2024-09-21T10:40:45.731 INFO:tasks.workunit.client.1.smithi112.stdout:9/369: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:45.736 INFO:tasks.workunit.client.1.smithi112.stdout:1/487: truncate d8/d1a/d31/d37/f5e 634994 0 2024-09-21T10:40:45.736 INFO:tasks.workunit.client.1.smithi112.stdout:1/488: dread - d8/f9a zero size 2024-09-21T10:40:45.736 INFO:tasks.workunit.client.1.smithi112.stdout:1/489: chown d8/d1a/d53/d57/d83 3907 1 2024-09-21T10:40:45.736 INFO:tasks.workunit.client.1.smithi112.stdout:6/357: mkdir d4/d6/da/d11/d1f/d22/d86 0 2024-09-21T10:40:45.737 INFO:tasks.workunit.client.1.smithi112.stdout:6/358: chown d4/d6/d75 809234 1 2024-09-21T10:40:45.737 INFO:tasks.workunit.client.1.smithi112.stdout:6/359: dread - d4/dc/d1a/d31/d56/f7b zero size 2024-09-21T10:40:45.739 INFO:tasks.workunit.client.1.smithi112.stdout:1/490: dread d8/d20/f5f [0,4194304] 0 2024-09-21T10:40:45.748 INFO:tasks.workunit.client.1.smithi112.stdout:2/318: unlink d0/dd/f4e 0 2024-09-21T10:40:45.760 INFO:tasks.workunit.client.1.smithi112.stdout:6/360: dwrite d4/d6/da/f6f [0,4194304] 0 2024-09-21T10:40:45.761 INFO:tasks.workunit.client.1.smithi112.stdout:1/491: dwrite d8/d54/f8c [4194304,4194304] 0 2024-09-21T10:40:45.761 INFO:tasks.workunit.client.1.smithi112.stdout:1/492: read d8/f38 [1099319,75222] 0 2024-09-21T10:40:45.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/362: getdents de/d2a/d3d 0 2024-09-21T10:40:45.789 INFO:tasks.workunit.client.1.smithi112.stdout:4/363: dread de/d33/f38 [0,4194304] 0 2024-09-21T10:40:45.805 INFO:tasks.workunit.client.1.smithi112.stdout:4/364: dwrite de/d33/d2f/d71/f4a [0,4194304] 0 2024-09-21T10:40:45.809 INFO:tasks.workunit.client.1.smithi112.stdout:9/370: mkdir d1/d2/d27/d37/d3b/d69/d77 0 2024-09-21T10:40:45.817 INFO:tasks.workunit.client.1.smithi112.stdout:9/371: dread d1/d2/d27/d3a/f23 [0,4194304] 0 2024-09-21T10:40:45.818 INFO:tasks.workunit.client.1.smithi112.stdout:5/390: creat d9/d15/d18/f77 x:0 0 0 2024-09-21T10:40:45.819 INFO:tasks.workunit.client.1.smithi112.stdout:2/319: creat d0/dd/d49/d62/d63/f69 x:0 0 0 2024-09-21T10:40:45.819 INFO:tasks.workunit.client.1.smithi112.stdout:2/320: creat d0/dd/f6a x:0 0 0 2024-09-21T10:40:45.822 INFO:tasks.workunit.client.1.smithi112.stdout:5/391: mknod d9/d6e/c78 0 2024-09-21T10:40:45.824 INFO:tasks.workunit.client.1.smithi112.stdout:2/321: link d0/dd/d49/d62/d63/f17 d0/dd/d47/f6b 0 2024-09-21T10:40:45.826 INFO:tasks.workunit.client.1.smithi112.stdout:4/365: dwrite de/d18/f21 [0,4194304] 0 2024-09-21T10:40:45.827 INFO:tasks.workunit.client.1.smithi112.stdout:5/392: symlink d9/d15/d1d/l79 0 2024-09-21T10:40:45.827 INFO:tasks.workunit.client.1.smithi112.stdout:5/393: chown d9/d15/d18/d20/d47 26066542 1 2024-09-21T10:40:45.829 INFO:tasks.workunit.client.1.smithi112.stdout:4/366: rename de/d33/d2f/d71/d40/d4f/c54 to de/d33/d2f/c7b 0 2024-09-21T10:40:45.830 INFO:tasks.workunit.client.1.smithi112.stdout:5/394: mknod d9/d15/d18/d20/c7a 0 2024-09-21T10:40:45.830 INFO:tasks.workunit.client.1.smithi112.stdout:4/367: mknod de/d18/d6d/d6e/c7c 0 2024-09-21T10:40:45.832 INFO:tasks.workunit.client.1.smithi112.stdout:4/368: creat de/d33/d6f/f7d x:0 0 0 2024-09-21T10:40:45.833 INFO:tasks.workunit.client.1.smithi112.stdout:9/372: dwrite d1/d2/d27/d62/d70/f21 [0,4194304] 0 2024-09-21T10:40:45.834 INFO:tasks.workunit.client.1.smithi112.stdout:9/373: fsync d1/d2/f48 0 2024-09-21T10:40:45.835 INFO:tasks.workunit.client.1.smithi112.stdout:9/374: link d1/f6d d1/d2/d27/d37/d3b/f78 0 2024-09-21T10:40:45.835 INFO:tasks.workunit.client.1.smithi112.stdout:9/375: getdents d1/d2/d27/d37/d3b/d69/d77 0 2024-09-21T10:40:45.838 INFO:tasks.workunit.client.1.smithi112.stdout:4/369: dread f5 [0,4194304] 0 2024-09-21T10:40:45.841 INFO:tasks.workunit.client.1.smithi112.stdout:4/370: truncate de/f24 3106060 0 2024-09-21T10:40:45.851 INFO:tasks.workunit.client.1.smithi112.stdout:5/395: dwrite d9/d15/d1d/f21 [0,4194304] 0 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:4/371: dwrite de/d33/d2f/d71/d40/d4f/f6b [0,4194304] 0 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:4/372: creat de/d18/d6d/f7e x:0 0 0 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:4/373: readlink de/d2a/d31/l4b 0 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:4/374: stat de/l20 0 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:7/311: sync 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:8/375: sync 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:8/376: stat d8/d9/dd/d1a/f26 0 2024-09-21T10:40:45.860 INFO:tasks.workunit.client.1.smithi112.stdout:8/377: chown d8/d18/f24 56886910 1 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/378: dread - d8/d9/dd/d2b/d31/f39 zero size 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:4/375: write de/d33/f30 [2362079,129901] 0 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/379: truncate d8/d9/d3c/d6d/f74 4655330 0 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:4/376: fdatasync de/d2a/d3d/f7a 0 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/380: creat d8/d9/dd/d2a/f77 x:0 0 0 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/381: fdatasync d8/d9/dd/f5f 0 2024-09-21T10:40:45.861 INFO:tasks.workunit.client.1.smithi112.stdout:8/382: fdatasync d8/d9/dd/d1a/f67 0 2024-09-21T10:40:45.862 INFO:tasks.workunit.client.1.smithi112.stdout:7/312: mkdir d7/d22/d65 0 2024-09-21T10:40:45.863 INFO:tasks.workunit.client.1.smithi112.stdout:4/377: mknod de/d2a/d3d/c7f 0 2024-09-21T10:40:45.864 INFO:tasks.workunit.client.1.smithi112.stdout:7/313: dread d7/f1e [0,4194304] 0 2024-09-21T10:40:45.864 INFO:tasks.workunit.client.1.smithi112.stdout:7/314: stat d7/d22/d41/d54/l5b 0 2024-09-21T10:40:45.864 INFO:tasks.workunit.client.1.smithi112.stdout:8/383: unlink d8/d9/dd/d1a/c61 0 2024-09-21T10:40:45.866 INFO:tasks.workunit.client.1.smithi112.stdout:7/315: creat d7/d22/d47/d4a/f66 x:0 0 0 2024-09-21T10:40:45.866 INFO:tasks.workunit.client.1.smithi112.stdout:7/316: chown d7/f1c 93827075 1 2024-09-21T10:40:45.867 INFO:tasks.workunit.client.1.smithi112.stdout:8/384: getdents d8/d9/dd 0 2024-09-21T10:40:45.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/385: dread d8/d9/dd/d2b/d31/f41 [0,4194304] 0 2024-09-21T10:40:45.874 INFO:tasks.workunit.client.1.smithi112.stdout:0/420: sync 2024-09-21T10:40:45.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/375: sync 2024-09-21T10:40:45.877 INFO:tasks.workunit.client.1.smithi112.stdout:3/376: rename d2/fe to d2/d22/d31/d2a/d39/f81 0 2024-09-21T10:40:45.882 INFO:tasks.workunit.client.1.smithi112.stdout:7/317: dwrite d7/d22/f23 [0,4194304] 0 2024-09-21T10:40:45.884 INFO:tasks.workunit.client.1.smithi112.stdout:7/318: link d7/d22/f38 d7/d3d/f67 0 2024-09-21T10:40:45.886 INFO:tasks.workunit.client.1.smithi112.stdout:7/319: rename d7/f34 to d7/d22/d47/f68 0 2024-09-21T10:40:45.890 INFO:tasks.workunit.client.1.smithi112.stdout:7/320: dread d7/f13 [0,4194304] 0 2024-09-21T10:40:45.891 INFO:tasks.workunit.client.1.smithi112.stdout:7/321: symlink d7/d22/d47/d4a/l69 0 2024-09-21T10:40:45.893 INFO:tasks.workunit.client.1.smithi112.stdout:7/322: mknod d7/d22/d41/d4b/d5e/c6a 0 2024-09-21T10:40:45.893 INFO:tasks.workunit.client.1.smithi112.stdout:7/323: write d7/f3f [1697979,121934] 0 2024-09-21T10:40:45.893 INFO:tasks.workunit.client.1.smithi112.stdout:7/324: read d7/ff [975568,127549] 0 2024-09-21T10:40:45.894 INFO:tasks.workunit.client.1.smithi112.stdout:7/325: rmdir d7/d22/d41/d4b 39 2024-09-21T10:40:45.895 INFO:tasks.workunit.client.1.smithi112.stdout:7/326: rmdir d7/d22/d65 0 2024-09-21T10:40:45.895 INFO:tasks.workunit.client.1.smithi112.stdout:7/327: truncate d7/f13 3773378 0 2024-09-21T10:40:45.896 INFO:tasks.workunit.client.1.smithi112.stdout:7/328: mknod d7/d22/d41/c6b 0 2024-09-21T10:40:45.897 INFO:tasks.workunit.client.1.smithi112.stdout:7/329: symlink d7/l6c 0 2024-09-21T10:40:45.897 INFO:tasks.workunit.client.1.smithi112.stdout:7/330: chown d7/d3d/f3e 0 1 2024-09-21T10:40:45.897 INFO:tasks.workunit.client.1.smithi112.stdout:7/331: write d7/f1e [1496902,103434] 0 2024-09-21T10:40:45.898 INFO:tasks.workunit.client.1.smithi112.stdout:0/421: dwrite d3/d4/d10/f35 [0,4194304] 0 2024-09-21T10:40:45.898 INFO:tasks.workunit.client.1.smithi112.stdout:0/422: chown d3/d4/d43/l51 598066 1 2024-09-21T10:40:45.898 INFO:tasks.workunit.client.1.smithi112.stdout:0/423: fdatasync d3/d4/d1a/d21/d46/f58 0 2024-09-21T10:40:45.899 INFO:tasks.workunit.client.1.smithi112.stdout:0/424: write d3/d18/d52/d55/f5e [535387,49583] 0 2024-09-21T10:40:45.899 INFO:tasks.workunit.client.1.smithi112.stdout:0/425: chown d3/d18/d52/d55/f5e 6001 1 2024-09-21T10:40:45.899 INFO:tasks.workunit.client.1.smithi112.stdout:7/332: rmdir d7/d5a 0 2024-09-21T10:40:45.901 INFO:tasks.workunit.client.1.smithi112.stdout:7/333: rename l0 to d7/d22/d41/d54/d4d/l6d 0 2024-09-21T10:40:45.901 INFO:tasks.workunit.client.1.smithi112.stdout:7/334: dread - d7/f49 zero size 2024-09-21T10:40:45.902 INFO:tasks.workunit.client.1.smithi112.stdout:7/335: mknod d7/d22/d47/d4a/c6e 0 2024-09-21T10:40:45.904 INFO:tasks.workunit.client.1.smithi112.stdout:7/336: mknod d7/d22/d41/d4b/c6f 0 2024-09-21T10:40:45.904 INFO:tasks.workunit.client.1.smithi112.stdout:7/337: dread - d7/d22/f63 zero size 2024-09-21T10:40:45.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/338: dread d7/d22/d41/d54/f4e [0,4194304] 0 2024-09-21T10:40:45.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/339: truncate d7/f1a 871943 0 2024-09-21T10:40:45.905 INFO:tasks.workunit.client.1.smithi112.stdout:8/386: creat d8/f78 x:0 0 0 2024-09-21T10:40:45.906 INFO:tasks.workunit.client.1.smithi112.stdout:7/340: symlink d7/d22/d41/d54/l70 0 2024-09-21T10:40:45.906 INFO:tasks.workunit.client.1.smithi112.stdout:7/341: chown d7/d22/d41/d56/d58 9 1 2024-09-21T10:40:45.907 INFO:tasks.workunit.client.1.smithi112.stdout:8/387: getdents d8/d9/dd/d2a/d43 0 2024-09-21T10:40:45.908 INFO:tasks.workunit.client.1.smithi112.stdout:0/426: write d3/d4/d43/f44 [3984045,5295] 0 2024-09-21T10:40:45.908 INFO:tasks.workunit.client.1.smithi112.stdout:6/361: creat d4/d6/f87 x:0 0 0 2024-09-21T10:40:45.909 INFO:tasks.workunit.client.1.smithi112.stdout:8/388: creat d8/d9/dd/d76/f79 x:0 0 0 2024-09-21T10:40:45.911 INFO:tasks.workunit.client.1.smithi112.stdout:7/342: dread d7/f1e [0,4194304] 0 2024-09-21T10:40:45.911 INFO:tasks.workunit.client.1.smithi112.stdout:7/343: chown f6 403 1 2024-09-21T10:40:45.912 INFO:tasks.workunit.client.1.smithi112.stdout:7/344: creat d7/f71 x:0 0 0 2024-09-21T10:40:45.912 INFO:tasks.workunit.client.1.smithi112.stdout:7/345: dread - d7/d22/f63 zero size 2024-09-21T10:40:45.912 INFO:tasks.workunit.client.1.smithi112.stdout:0/427: mkdir d3/d4a/d4e/d72/d8e 0 2024-09-21T10:40:45.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/362: link d4/d6/da/d11/d1f/d22/f33 d4/dc/d7e/f88 0 2024-09-21T10:40:45.912 INFO:tasks.workunit.client.1.smithi112.stdout:6/363: stat d4/dc/d1a/d31/d56/d64/c59 0 2024-09-21T10:40:45.913 INFO:tasks.workunit.client.1.smithi112.stdout:6/364: read d4/d6/da/d11/d1f/d22/f33 [4138168,92269] 0 2024-09-21T10:40:45.915 INFO:tasks.workunit.client.1.smithi112.stdout:2/322: mkdir d0/d12/d6c 0 2024-09-21T10:40:45.915 INFO:tasks.workunit.client.1.smithi112.stdout:7/346: mkdir d7/d22/d41/d56/d72 0 2024-09-21T10:40:45.916 INFO:tasks.workunit.client.1.smithi112.stdout:0/428: mknod d3/d4a/d4e/d72/d8e/c8f 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:6/365: dread d4/d6/da/d14/d49/d62/f69 [0,4194304] 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:0/429: write d3/d4a/f70 [783164,87413] 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:6/366: creat d4/d6/da/d11/d1f/d22/f89 x:0 0 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:0/430: dread - d3/d4/d10/d8b/f7d zero size 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:6/367: write d4/dc/d7e/f83 [488321,2016] 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:6/368: creat d4/d6/da/d11/d1f/d22/f8a x:0 0 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:6/369: stat d4/dc/l6b 0 2024-09-21T10:40:45.917 INFO:tasks.workunit.client.1.smithi112.stdout:8/389: getdents d8/d9/dd/d2b 0 2024-09-21T10:40:45.918 INFO:tasks.workunit.client.1.smithi112.stdout:8/390: fdatasync d8/d9/dd/d2b/f44 0 2024-09-21T10:40:45.918 INFO:tasks.workunit.client.1.smithi112.stdout:2/323: link d0/dd/d49/d62/d63/f17 d0/d12/d1b/d51/d66/f6d 0 2024-09-21T10:40:45.920 INFO:tasks.workunit.client.1.smithi112.stdout:5/396: unlink d9/f12 0 2024-09-21T10:40:45.921 INFO:tasks.workunit.client.1.smithi112.stdout:5/397: fdatasync d9/d15/d18/f77 0 2024-09-21T10:40:45.921 INFO:tasks.workunit.client.1.smithi112.stdout:5/398: chown d9/d15/d18/d3a/d4b/c4c 158 1 2024-09-21T10:40:45.921 INFO:tasks.workunit.client.1.smithi112.stdout:7/347: mkdir d7/d22/d73 0 2024-09-21T10:40:45.923 INFO:tasks.workunit.client.1.smithi112.stdout:7/348: write d7/f19 [950103,55758] 0 2024-09-21T10:40:45.923 INFO:tasks.workunit.client.1.smithi112.stdout:0/431: rmdir d3/d18 39 2024-09-21T10:40:45.924 INFO:tasks.workunit.client.1.smithi112.stdout:0/432: chown d3/d4/d10/d8b/f7d 408767344 1 2024-09-21T10:40:45.924 INFO:tasks.workunit.client.1.smithi112.stdout:0/433: readlink d3/d4a/l60 0 2024-09-21T10:40:45.924 INFO:tasks.workunit.client.1.smithi112.stdout:0/434: write d3/d4/d1a/d21/d46/f87 [1084506,96677] 0 2024-09-21T10:40:45.925 INFO:tasks.workunit.client.1.smithi112.stdout:6/370: mkdir d4/d6/da/d11/d37/d8b 0 2024-09-21T10:40:45.926 INFO:tasks.workunit.client.1.smithi112.stdout:8/391: symlink d8/d9/dd/d2b/l7a 0 2024-09-21T10:40:45.927 INFO:tasks.workunit.client.1.smithi112.stdout:5/399: truncate d9/f11 3856446 0 2024-09-21T10:40:45.931 INFO:tasks.workunit.client.1.smithi112.stdout:0/435: mkdir d3/d4/d10/d8b/d90 0 2024-09-21T10:40:45.932 INFO:tasks.workunit.client.1.smithi112.stdout:6/371: rename d4/d6/da/d11/d1f/d22/f8a to d4/d4f/f8c 0 2024-09-21T10:40:45.933 INFO:tasks.workunit.client.1.smithi112.stdout:8/392: rmdir d8/d9/dd/d2b/d31 39 2024-09-21T10:40:45.934 INFO:tasks.workunit.client.1.smithi112.stdout:7/349: dread d7/d3d/f40 [4194304,4194304] 0 2024-09-21T10:40:45.934 INFO:tasks.workunit.client.1.smithi112.stdout:2/324: dwrite d0/dd/f61 [0,4194304] 0 2024-09-21T10:40:45.934 INFO:tasks.workunit.client.1.smithi112.stdout:0/436: creat d3/d23/d7b/f91 x:0 0 0 2024-09-21T10:40:45.936 INFO:tasks.workunit.client.1.smithi112.stdout:6/372: unlink d4/dc/d1a/d31/d3c/l42 0 2024-09-21T10:40:45.936 INFO:tasks.workunit.client.1.smithi112.stdout:0/437: dread d3/d18/f75 [0,4194304] 0 2024-09-21T10:40:45.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/325: symlink d0/l6e 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:6/373: mknod d4/dc/d1a/d31/d3c/c8d 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:7/350: dread d7/d22/d41/d56/d58/f61 [0,4194304] 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:7/351: dread - d7/d22/f2e zero size 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:7/352: write d7/d22/f38 [501123,94341] 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:7/353: write d7/d22/f33 [501793,66590] 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:7/354: creat d7/d22/d41/d56/d58/f74 x:0 0 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:0/438: creat d3/f92 x:0 0 0 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:0/439: chown d3/d23/l5d 20321 1 2024-09-21T10:40:45.938 INFO:tasks.workunit.client.1.smithi112.stdout:0/440: truncate d3/d23/f67 1180557 0 2024-09-21T10:40:45.939 INFO:tasks.workunit.client.1.smithi112.stdout:4/378: unlink cc 0 2024-09-21T10:40:45.941 INFO:tasks.workunit.client.1.smithi112.stdout:6/374: truncate d4/d6/da/f47 2966615 0 2024-09-21T10:40:45.941 INFO:tasks.workunit.client.1.smithi112.stdout:6/375: creat d4/d6/da/d14/f8e x:0 0 0 2024-09-21T10:40:45.941 INFO:tasks.workunit.client.1.smithi112.stdout:8/393: dread d8/d9/f13 [0,4194304] 0 2024-09-21T10:40:45.942 INFO:tasks.workunit.client.1.smithi112.stdout:0/441: dread d3/d4/f13 [0,4194304] 0 2024-09-21T10:40:45.942 INFO:tasks.workunit.client.1.smithi112.stdout:7/355: creat d7/d22/d41/d56/f75 x:0 0 0 2024-09-21T10:40:45.942 INFO:tasks.workunit.client.1.smithi112.stdout:7/356: truncate d7/f49 263717 0 2024-09-21T10:40:45.944 INFO:tasks.workunit.client.1.smithi112.stdout:2/326: rename d0/dd/f5c to d0/d12/d1b/f6f 0 2024-09-21T10:40:45.944 INFO:tasks.workunit.client.1.smithi112.stdout:2/327: chown d0/d12/d1b/f1e 351114 1 2024-09-21T10:40:45.944 INFO:tasks.workunit.client.1.smithi112.stdout:2/328: chown d0/f2 0 1 2024-09-21T10:40:45.944 INFO:tasks.workunit.client.1.smithi112.stdout:2/329: creat d0/d12/d1b/d51/f70 x:0 0 0 2024-09-21T10:40:45.944 INFO:tasks.workunit.client.1.smithi112.stdout:4/379: stat de/d33/c2d 0 2024-09-21T10:40:45.944 INFO:tasks.workunit.client.1.smithi112.stdout:4/380: fsync de/d2e/f48 0 2024-09-21T10:40:45.946 INFO:tasks.workunit.client.1.smithi112.stdout:6/376: symlink d4/dc/d67/l8f 0 2024-09-21T10:40:45.948 INFO:tasks.workunit.client.1.smithi112.stdout:5/400: dwrite d9/d15/d18/d20/d55/f58 [0,4194304] 0 2024-09-21T10:40:45.949 INFO:tasks.workunit.client.1.smithi112.stdout:5/401: write d9/d57/f73 [184896,66296] 0 2024-09-21T10:40:45.949 INFO:tasks.workunit.client.1.smithi112.stdout:8/394: rename d8/d9/dd/l33 to d8/d9/dd/d2b/d31/d46/l7b 0 2024-09-21T10:40:45.953 INFO:tasks.workunit.client.1.smithi112.stdout:5/402: truncate d9/d15/d18/f29 1024193 0 2024-09-21T10:40:45.956 INFO:tasks.workunit.client.1.smithi112.stdout:2/330: rename d0/d12/d1b/d51/l5d to d0/dd/d49/d62/d63/l71 0 2024-09-21T10:40:45.956 INFO:tasks.workunit.client.1.smithi112.stdout:2/331: write d0/dd/d49/d62/d63/f35 [802378,57091] 0 2024-09-21T10:40:45.956 INFO:tasks.workunit.client.1.smithi112.stdout:5/403: dread d9/ff [0,4194304] 0 2024-09-21T10:40:45.957 INFO:tasks.workunit.client.1.smithi112.stdout:5/404: fsync d9/d15/d1d/f4d 0 2024-09-21T10:40:45.958 INFO:tasks.workunit.client.1.smithi112.stdout:0/442: read d3/d4/d1a/d21/d46/f58 [3360753,33523] 0 2024-09-21T10:40:45.959 INFO:tasks.workunit.client.1.smithi112.stdout:9/376: creat d1/d2/f79 x:0 0 0 2024-09-21T10:40:45.963 INFO:tasks.workunit.client.1.smithi112.stdout:7/357: dwrite d7/d22/d41/d56/d58/f61 [0,4194304] 0 2024-09-21T10:40:45.964 INFO:tasks.workunit.client.1.smithi112.stdout:0/443: creat d3/d18/d52/d55/f93 x:0 0 0 2024-09-21T10:40:45.966 INFO:tasks.workunit.client.1.smithi112.stdout:4/381: dwrite de/d33/d2f/d71/d40/f5a [0,4194304] 0 2024-09-21T10:40:45.966 INFO:tasks.workunit.client.1.smithi112.stdout:4/382: write de/d33/d6f/f7d [516454,2043] 0 2024-09-21T10:40:45.967 INFO:tasks.workunit.client.1.smithi112.stdout:2/332: rmdir d0/dd/d47 39 2024-09-21T10:40:45.969 INFO:tasks.workunit.client.1.smithi112.stdout:9/377: rename d1/l24 to d1/d2/d27/d3a/d6b/d30/l7a 0 2024-09-21T10:40:45.969 INFO:tasks.workunit.client.1.smithi112.stdout:9/378: creat d1/d2/f7b x:0 0 0 2024-09-21T10:40:45.969 INFO:tasks.workunit.client.1.smithi112.stdout:9/379: stat d1/d2 0 2024-09-21T10:40:45.973 INFO:tasks.workunit.client.1.smithi112.stdout:1/493: rmdir d8/d1a/d31/d66 39 2024-09-21T10:40:45.981 INFO:tasks.workunit.client.1.smithi112.stdout:6/377: dwrite d4/dc/d7e/f88 [0,4194304] 0 2024-09-21T10:40:45.982 INFO:tasks.workunit.client.1.smithi112.stdout:0/444: dwrite d3/d4/d1a/d21/f86 [0,4194304] 0 2024-09-21T10:40:45.985 INFO:tasks.workunit.client.1.smithi112.stdout:1/494: dread d8/f15 [0,4194304] 0 2024-09-21T10:40:45.985 INFO:tasks.workunit.client.1.smithi112.stdout:1/495: fdatasync d8/d1a/d53/f60 0 2024-09-21T10:40:45.990 INFO:tasks.workunit.client.1.smithi112.stdout:2/333: unlink d0/dd/f21 0 2024-09-21T10:40:45.990 INFO:tasks.workunit.client.1.smithi112.stdout:2/334: fdatasync d0/d12/d1b/d51/d57/f37 0 2024-09-21T10:40:45.991 INFO:tasks.workunit.client.1.smithi112.stdout:7/358: rename d7/d22/d47/d4a/f66 to d7/d22/d41/d4b/d52/f76 0 2024-09-21T10:40:45.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/380: truncate d1/d2/d27/f2f 600894 0 2024-09-21T10:40:45.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/381: fsync d1/d2/d27/d3a/d6b/f3c 0 2024-09-21T10:40:45.994 INFO:tasks.workunit.client.1.smithi112.stdout:6/378: dread d4/dc/d1a/d31/d56/d64/f48 [0,4194304] 0 2024-09-21T10:40:45.995 INFO:tasks.workunit.client.1.smithi112.stdout:1/496: symlink d8/d45/la0 0 2024-09-21T10:40:45.996 INFO:tasks.workunit.client.1.smithi112.stdout:2/335: mknod d0/dd/d49/c72 0 2024-09-21T10:40:45.998 INFO:tasks.workunit.client.1.smithi112.stdout:7/359: truncate d7/d22/f23 1256711 0 2024-09-21T10:40:45.999 INFO:tasks.workunit.client.1.smithi112.stdout:9/382: mkdir d1/d2/d27/d3a/d6b/d30/d5c/d7c 0 2024-09-21T10:40:45.999 INFO:tasks.workunit.client.1.smithi112.stdout:2/336: write d0/f11 [1680886,68374] 0 2024-09-21T10:40:46.000 INFO:tasks.workunit.client.1.smithi112.stdout:6/379: truncate d4/d6/da/d11/d1f/d22/f26 3498186 0 2024-09-21T10:40:46.001 INFO:tasks.workunit.client.1.smithi112.stdout:1/497: truncate d8/f17 6161588 0 2024-09-21T10:40:46.001 INFO:tasks.workunit.client.1.smithi112.stdout:0/445: dwrite d3/d23/f67 [0,4194304] 0 2024-09-21T10:40:46.002 INFO:tasks.workunit.client.1.smithi112.stdout:7/360: mkdir d7/d22/d41/d4b/d52/d77 0 2024-09-21T10:40:46.003 INFO:tasks.workunit.client.1.smithi112.stdout:9/383: creat d1/d2/d27/f7d x:0 0 0 2024-09-21T10:40:46.003 INFO:tasks.workunit.client.1.smithi112.stdout:9/384: chown d1/d2/d27/f2f 5527047 1 2024-09-21T10:40:46.004 INFO:tasks.workunit.client.1.smithi112.stdout:1/498: unlink d8/d1a/d31/d37/l3d 0 2024-09-21T10:40:46.006 INFO:tasks.workunit.client.1.smithi112.stdout:7/361: mkdir d7/d22/d78 0 2024-09-21T10:40:46.008 INFO:tasks.workunit.client.1.smithi112.stdout:9/385: rename d1/d2/d27/d3a/d6b/c67 to d1/d2/d27/d3a/d6b/d30/d5c/d7c/c7e 0 2024-09-21T10:40:46.010 INFO:tasks.workunit.client.1.smithi112.stdout:1/499: mkdir d8/d1a/d31/da1 0 2024-09-21T10:40:46.010 INFO:tasks.workunit.client.1.smithi112.stdout:1/500: chown d8/d45/c51 109 1 2024-09-21T10:40:46.012 INFO:tasks.workunit.client.1.smithi112.stdout:7/362: mkdir d7/d22/d41/d56/d72/d79 0 2024-09-21T10:40:46.013 INFO:tasks.workunit.client.1.smithi112.stdout:1/501: dread d8/d1a/d53/d57/f90 [0,4194304] 0 2024-09-21T10:40:46.013 INFO:tasks.workunit.client.1.smithi112.stdout:1/502: fdatasync d8/d1a/d53/f5c 0 2024-09-21T10:40:46.013 INFO:tasks.workunit.client.1.smithi112.stdout:1/503: write d8/d1a/d53/f60 [294008,90672] 0 2024-09-21T10:40:46.014 INFO:tasks.workunit.client.1.smithi112.stdout:6/380: dread d4/d4f/f5d [0,4194304] 0 2024-09-21T10:40:46.014 INFO:tasks.workunit.client.1.smithi112.stdout:9/386: truncate d1/d2/d42/f72 6660084 0 2024-09-21T10:40:46.015 INFO:tasks.workunit.client.1.smithi112.stdout:9/387: chown d1/d2/d27/d3a/f33 39 1 2024-09-21T10:40:46.015 INFO:tasks.workunit.client.1.smithi112.stdout:0/446: dread d3/d4/d10/f24 [4194304,4194304] 0 2024-09-21T10:40:46.015 INFO:tasks.workunit.client.1.smithi112.stdout:5/405: rmdir d9/d15/d18 39 2024-09-21T10:40:46.017 INFO:tasks.workunit.client.1.smithi112.stdout:7/363: mkdir d7/d22/d41/d7a 0 2024-09-21T10:40:46.017 INFO:tasks.workunit.client.1.smithi112.stdout:7/364: dread - d7/d22/f63 zero size 2024-09-21T10:40:46.017 INFO:tasks.workunit.client.1.smithi112.stdout:7/365: creat d7/d22/d41/f7b x:0 0 0 2024-09-21T10:40:46.019 INFO:tasks.workunit.client.1.smithi112.stdout:7/366: dread d7/d22/f46 [0,4194304] 0 2024-09-21T10:40:46.019 INFO:tasks.workunit.client.1.smithi112.stdout:6/381: dread d4/d4f/f66 [0,4194304] 0 2024-09-21T10:40:46.019 INFO:tasks.workunit.client.1.smithi112.stdout:6/382: chown d4/dc/d1a/d31 20401 1 2024-09-21T10:40:46.019 INFO:tasks.workunit.client.1.smithi112.stdout:6/383: chown d4/d6/da/d11/d1f/d22 6109054 1 2024-09-21T10:40:46.020 INFO:tasks.workunit.client.1.smithi112.stdout:1/504: link d8/d54/d6d/l92 d8/d1a/d31/d66/d87/la2 0 2024-09-21T10:40:46.022 INFO:tasks.workunit.client.1.smithi112.stdout:1/505: write d8/d1a/d53/f5c [151294,43734] 0 2024-09-21T10:40:46.024 INFO:tasks.workunit.client.1.smithi112.stdout:2/337: dwrite d0/dd/d49/f5a [0,4194304] 0 2024-09-21T10:40:46.024 INFO:tasks.workunit.client.1.smithi112.stdout:2/338: creat d0/dd/d49/f73 x:0 0 0 2024-09-21T10:40:46.025 INFO:tasks.workunit.client.1.smithi112.stdout:7/367: symlink d7/d22/l7c 0 2024-09-21T10:40:46.025 INFO:tasks.workunit.client.1.smithi112.stdout:7/368: write f5 [1770356,11929] 0 2024-09-21T10:40:46.027 INFO:tasks.workunit.client.1.smithi112.stdout:6/384: unlink d4/dc/d1a/d31/d3c/f52 0 2024-09-21T10:40:46.029 INFO:tasks.workunit.client.1.smithi112.stdout:5/406: link d9/c5d d9/c7b 0 2024-09-21T10:40:46.036 INFO:tasks.workunit.client.1.smithi112.stdout:5/407: unlink d9/d57/f73 0 2024-09-21T10:40:46.042 INFO:tasks.workunit.client.1.smithi112.stdout:5/408: write d9/d15/d18/d3a/d4b/f52 [4160626,76915] 0 2024-09-21T10:40:46.046 INFO:tasks.workunit.client.1.smithi112.stdout:5/409: dread d9/d15/d1d/f46 [0,4194304] 0 2024-09-21T10:40:46.048 INFO:tasks.workunit.client.1.smithi112.stdout:7/369: getdents d7/d22/d41/d4b/d52 0 2024-09-21T10:40:46.048 INFO:tasks.workunit.client.1.smithi112.stdout:7/370: creat d7/d22/d41/d56/d58/f7d x:0 0 0 2024-09-21T10:40:46.053 INFO:tasks.workunit.client.1.smithi112.stdout:7/371: creat d7/d22/d47/f7e x:0 0 0 2024-09-21T10:40:46.056 INFO:tasks.workunit.client.1.smithi112.stdout:9/388: dwrite d1/d2/d27/d37/f59 [0,4194304] 0 2024-09-21T10:40:46.056 INFO:tasks.workunit.client.1.smithi112.stdout:9/389: fsync d1/d2/d27/d3a/d6b/d30/d5e/f66 0 2024-09-21T10:40:46.056 INFO:tasks.workunit.client.1.smithi112.stdout:2/339: dwrite d0/f2d [0,4194304] 0 2024-09-21T10:40:46.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/447: dwrite d3/d18/f80 [0,4194304] 0 2024-09-21T10:40:46.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/448: fsync d3/d18/f3b 0 2024-09-21T10:40:46.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/449: write d3/d4a/f6a [489181,1936] 0 2024-09-21T10:40:46.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/450: dread - d3/d18/d52/d55/f93 zero size 2024-09-21T10:40:46.062 INFO:tasks.workunit.client.1.smithi112.stdout:0/451: truncate d3/d18/f3b 1101185 0 2024-09-21T10:40:46.067 INFO:tasks.workunit.client.1.smithi112.stdout:6/385: dwrite d4/dc/d7e/f88 [0,4194304] 0 2024-09-21T10:40:46.067 INFO:tasks.workunit.client.1.smithi112.stdout:6/386: fsync d4/d6/da/d11/d37/f70 0 2024-09-21T10:40:46.071 INFO:tasks.workunit.client.1.smithi112.stdout:9/390: dread d1/d2/d27/d3a/f56 [0,4194304] 0 2024-09-21T10:40:46.075 INFO:tasks.workunit.client.1.smithi112.stdout:9/391: mkdir d1/d7f 0 2024-09-21T10:40:46.080 INFO:tasks.workunit.client.1.smithi112.stdout:9/392: creat d1/d2/d27/d37/d68/f80 x:0 0 0 2024-09-21T10:40:46.083 INFO:tasks.workunit.client.1.smithi112.stdout:9/393: mkdir d1/d81 0 2024-09-21T10:40:46.107 INFO:tasks.workunit.client.1.smithi112.stdout:5/410: dwrite d9/d15/d18/d3a/f5b [0,4194304] 0 2024-09-21T10:40:46.107 INFO:tasks.workunit.client.1.smithi112.stdout:6/387: dwrite d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:46.107 INFO:tasks.workunit.client.1.smithi112.stdout:6/388: fsync d4/d4f/f8c 0 2024-09-21T10:40:46.111 INFO:tasks.workunit.client.1.smithi112.stdout:1/506: dwrite d8/f17 [0,4194304] 0 2024-09-21T10:40:46.112 INFO:tasks.workunit.client.1.smithi112.stdout:1/507: readlink d8/d1a/d31/d66/d87/l8d 0 2024-09-21T10:40:46.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/452: dwrite d3/d4/d1a/d21/f6d [0,4194304] 0 2024-09-21T10:40:46.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/453: stat d3/d4/d1a/d21/f4d 0 2024-09-21T10:40:46.112 INFO:tasks.workunit.client.1.smithi112.stdout:7/372: dwrite d7/d22/f38 [0,4194304] 0 2024-09-21T10:40:46.112 INFO:tasks.workunit.client.1.smithi112.stdout:7/373: chown d7/d22/d41/d4b 7168 1 2024-09-21T10:40:46.112 INFO:tasks.workunit.client.1.smithi112.stdout:2/340: dwrite d0/f10 [0,4194304] 0 2024-09-21T10:40:46.113 INFO:tasks.workunit.client.1.smithi112.stdout:9/394: dwrite d1/d2/d27/d3a/d6b/d30/d5e/f66 [0,4194304] 0 2024-09-21T10:40:46.121 INFO:tasks.workunit.client.1.smithi112.stdout:2/341: dread d0/fe [4194304,4194304] 0 2024-09-21T10:40:46.121 INFO:tasks.workunit.client.1.smithi112.stdout:2/342: write d0/d12/d1b/d51/d57/f37 [827737,30969] 0 2024-09-21T10:40:46.123 INFO:tasks.workunit.client.1.smithi112.stdout:9/395: dread d1/d2/d27/d62/d70/f21 [0,4194304] 0 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 -- 172.21.15.60:0/3530220449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 msgr2=0x7f9750102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 --2- 172.21.15.60:0/3530220449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f9750102a80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9740009880 tx=0x7f974002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 -- 172.21.15.60:0/3530220449 shutdown_connections 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 --2- 172.21.15.60:0/3530220449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9750102fc0 0x7f97501053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 --2- 172.21.15.60:0/3530220449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f9750102a80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 -- 172.21.15.60:0/3530220449 >> 172.21.15.60:0/3530220449 conn(0x7f97500fa250 msgr2=0x7f97500fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 -- 172.21.15.60:0/3530220449 shutdown_connections 2024-09-21T10:40:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.142+0000 7f9754e4b640 1 -- 172.21.15.60:0/3530220449 wait complete. 2024-09-21T10:40:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f9754e4b640 1 Processor -- start 2024-09-21T10:40:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f9754e4b640 1 -- start start 2024-09-21T10:40:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f9754e4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f97501956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f9754e4b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9750102fc0 0x7f9750195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f9754e4b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501961e0 con 0x7f9750100690 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f9754e4b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9750196350 con 0x7f9750102fc0 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f974e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f97501956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f974e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f97501956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34362/0 (socket says 172.21.15.60:34362) 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f974e59c640 1 -- 172.21.15.60:0/970791536 learned_addr learned my addr 172.21.15.60:0/970791536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.143+0000 7f974dd9b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9750102fc0 0x7f9750195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f974e59c640 1 -- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9750102fc0 msgr2=0x7f9750195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f974e59c640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9750102fc0 0x7f9750195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f974e59c640 1 -- 172.21.15.60:0/970791536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740009560 con 0x7f9750100690 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f974e59c640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f97501956d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9740005640 tx=0x7f9740005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9740004ba0 con 0x7f9750100690 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9740004d00 con 0x7f9750100690 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975019adf0 con 0x7f9750100690 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9740003b70 con 0x7f9750100690 2024-09-21T10:40:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.144+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975019b340 con 0x7f9750100690 2024-09-21T10:40:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.145+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750100af0 con 0x7f9750100690 2024-09-21T10:40:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.146+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f9740031640 con 0x7f9750100690 2024-09-21T10:40:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.146+0000 7f97477fe640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f973c073ee0 0x7f973c0763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.147+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f97400b6460 con 0x7f9750100690 2024-09-21T10:40:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.147+0000 7f974dd9b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f973c073ee0 0x7f973c0763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.147+0000 7f974dd9b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f973c073ee0 0x7f973c0763a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9750196bf0 tx=0x7f9738009110 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.151+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f9740079880 con 0x7f9750100690 2024-09-21T10:40:46.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/411: unlink d9/d6e/c78 0 2024-09-21T10:40:46.205 INFO:tasks.workunit.client.1.smithi112.stdout:1/508: rename d8/d1a/d31/f68 to d8/d1a/d53/fa3 0 2024-09-21T10:40:46.211 INFO:tasks.workunit.client.1.smithi112.stdout:1/509: write d8/d20/f5b [2544307,63902] 0 2024-09-21T10:40:46.212 INFO:tasks.workunit.client.1.smithi112.stdout:0/454: mknod d3/d18/d45/c94 0 2024-09-21T10:40:46.214 INFO:tasks.workunit.client.1.smithi112.stdout:7/374: link d7/d22/f46 d7/d22/d78/f7f 0 2024-09-21T10:40:46.214 INFO:tasks.workunit.client.1.smithi112.stdout:0/455: dread d3/d4/f1d [4194304,4194304] 0 2024-09-21T10:40:46.234 INFO:tasks.workunit.client.1.smithi112.stdout:9/396: mknod d1/d2/d27/d3a/d6b/c82 0 2024-09-21T10:40:46.234 INFO:tasks.workunit.client.1.smithi112.stdout:9/397: fsync d1/d2/f1e 0 2024-09-21T10:40:46.242 INFO:tasks.workunit.client.1.smithi112.stdout:5/412: rename f3 to d9/d15/d18/d3a/d4b/d74/f7c 0 2024-09-21T10:40:46.245 INFO:tasks.workunit.client.1.smithi112.stdout:1/510: link d8/d1a/d31/d66/d87/l8d d8/d1a/d31/d37/la4 0 2024-09-21T10:40:46.245 INFO:tasks.workunit.client.1.smithi112.stdout:1/511: fsync d8/f1f 0 2024-09-21T10:40:46.248 INFO:tasks.workunit.client.1.smithi112.stdout:5/413: dread d9/f11 [0,4194304] 0 2024-09-21T10:40:46.248 INFO:tasks.workunit.client.1.smithi112.stdout:7/375: rmdir d7/d22/d41/d7a 0 2024-09-21T10:40:46.251 INFO:tasks.workunit.client.1.smithi112.stdout:2/343: symlink d0/d12/d1b/l74 0 2024-09-21T10:40:46.253 INFO:tasks.workunit.client.1.smithi112.stdout:9/398: symlink d1/d7f/l83 0 2024-09-21T10:40:46.256 INFO:tasks.workunit.client.1.smithi112.stdout:1/512: link d8/cc d8/d20/ca5 0 2024-09-21T10:40:46.258 INFO:tasks.workunit.client.1.smithi112.stdout:2/344: read d0/d12/d46/f65 [3969775,33345] 0 2024-09-21T10:40:46.273 INFO:tasks.workunit.client.1.smithi112.stdout:0/456: rmdir d3 39 2024-09-21T10:40:46.276 INFO:tasks.workunit.client.1.smithi112.stdout:9/399: link d1/d2/d27/d3a/c4b d1/d2/d27/d3a/d6b/d30/d5e/c84 0 2024-09-21T10:40:46.276 INFO:tasks.workunit.client.1.smithi112.stdout:9/400: fsync d1/d2/d27/f2f 0 2024-09-21T10:40:46.278 INFO:tasks.workunit.client.1.smithi112.stdout:1/513: rename d8/f85 to d8/d54/fa6 0 2024-09-21T10:40:46.279 INFO:tasks.workunit.client.1.smithi112.stdout:5/414: mknod d9/c7d 0 2024-09-21T10:40:46.279 INFO:tasks.workunit.client.1.smithi112.stdout:5/415: rename d9/d15 to d9/d15/d18/d20/d7e 22 2024-09-21T10:40:46.281 INFO:tasks.workunit.client.1.smithi112.stdout:2/345: link d0/d12/c68 d0/dd/d47/c75 0 2024-09-21T10:40:46.284 INFO:tasks.workunit.client.1.smithi112.stdout:0/457: link d3/d4/d10/f3c d3/d4a/d4e/d72/d8e/f95 0 2024-09-21T10:40:46.284 INFO:tasks.workunit.client.1.smithi112.stdout:0/458: chown d3/d4a/d4e 2 1 2024-09-21T10:40:46.286 INFO:tasks.workunit.client.1.smithi112.stdout:9/401: mknod d1/d2/d27/d3a/d6b/d30/d5c/d7c/c85 0 2024-09-21T10:40:46.289 INFO:tasks.workunit.client.1.smithi112.stdout:5/416: chown d9/d15/f63 54312964 1 2024-09-21T10:40:46.289 INFO:tasks.workunit.client.1.smithi112.stdout:9/402: write d1/d2/d27/d3a/d6b/d30/d5e/f66 [4868509,102364] 0 2024-09-21T10:40:46.289 INFO:tasks.workunit.client.1.smithi112.stdout:9/403: fdatasync d1/d2/d27/d3a/d6b/f3c 0 2024-09-21T10:40:46.290 INFO:tasks.workunit.client.1.smithi112.stdout:2/346: truncate d0/f6 5350576 0 2024-09-21T10:40:46.292 INFO:tasks.workunit.client.1.smithi112.stdout:1/514: dwrite d8/f40 [0,4194304] 0 2024-09-21T10:40:46.293 INFO:tasks.workunit.client.1.smithi112.stdout:5/417: dread d9/d15/d1d/f4d [0,4194304] 0 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/404: symlink d1/d2/d27/d62/l86 0 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/405: write d1/d2/d27/f44 [2407393,25] 0 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/406: chown d1/d2/l6f 163 1 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/407: write d1/d2/d27/f2f [1462531,68207] 0 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/408: chown d1/c4 42 1 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/409: chown d1/d2/d42/c74 5812252 1 2024-09-21T10:40:46.296 INFO:tasks.workunit.client.1.smithi112.stdout:9/410: write d1/d2/d27/f2f [123450,91915] 0 2024-09-21T10:40:46.298 INFO:tasks.workunit.client.1.smithi112.stdout:1/515: creat d8/d20/fa7 x:0 0 0 2024-09-21T10:40:46.300 INFO:tasks.workunit.client.1.smithi112.stdout:5/418: symlink d9/d15/d18/d3a/d4b/l7f 0 2024-09-21T10:40:46.300 INFO:tasks.workunit.client.1.smithi112.stdout:0/459: dwrite d3/d4/d43/f44 [4194304,4194304] 0 2024-09-21T10:40:46.300 INFO:tasks.workunit.client.1.smithi112.stdout:0/460: chown d3/d4/c4b 12 1 2024-09-21T10:40:46.302 INFO:tasks.workunit.client.1.smithi112.stdout:3/377: sync 2024-09-21T10:40:46.302 INFO:tasks.workunit.client.1.smithi112.stdout:3/378: readlink d2/d22/d31/d2a/l54 0 2024-09-21T10:40:46.302 INFO:tasks.workunit.client.1.smithi112.stdout:4/383: sync 2024-09-21T10:40:46.302 INFO:tasks.workunit.client.1.smithi112.stdout:6/389: sync 2024-09-21T10:40:46.302 INFO:tasks.workunit.client.1.smithi112.stdout:8/395: sync 2024-09-21T10:40:46.303 INFO:tasks.workunit.client.1.smithi112.stdout:8/396: fdatasync d8/d9/d3c/d6d/f74 0 2024-09-21T10:40:46.303 INFO:tasks.workunit.client.1.smithi112.stdout:8/397: stat d8/d9/dd/d2a/d43/c6b 0 2024-09-21T10:40:46.303 INFO:tasks.workunit.client.1.smithi112.stdout:8/398: chown d8/c60 1082 1 2024-09-21T10:40:46.303 INFO:tasks.workunit.client.1.smithi112.stdout:8/399: truncate d8/d9/dd/d1a/f72 208870 0 2024-09-21T10:40:46.303 INFO:tasks.workunit.client.1.smithi112.stdout:9/411: rename d1/l18 to d1/d2/d27/d37/d68/l87 0 2024-09-21T10:40:46.304 INFO:tasks.workunit.client.1.smithi112.stdout:0/461: dread d3/d23/f29 [0,4194304] 0 2024-09-21T10:40:46.306 INFO:tasks.workunit.client.1.smithi112.stdout:5/419: creat d9/d15/d18/d3a/d4b/d71/f80 x:0 0 0 2024-09-21T10:40:46.306 INFO:tasks.workunit.client.1.smithi112.stdout:5/420: chown d9/d15/d18/d20/d47/l59 1975 1 2024-09-21T10:40:46.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/379: creat d2/d22/d31/d37/f82 x:0 0 0 2024-09-21T10:40:46.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/380: readlink d2/d22/d31/d2a/l4e 0 2024-09-21T10:40:46.312 INFO:tasks.workunit.client.1.smithi112.stdout:8/400: dread d8/f63 [0,4194304] 0 2024-09-21T10:40:46.312 INFO:tasks.workunit.client.1.smithi112.stdout:6/390: unlink d4/d6/da/d14/d49/d62/f69 0 2024-09-21T10:40:46.312 INFO:tasks.workunit.client.1.smithi112.stdout:6/391: fsync d4/dc/d1a/d31/d3c/f76 0 2024-09-21T10:40:46.313 INFO:tasks.workunit.client.1.smithi112.stdout:1/516: dread d8/d1a/d31/f4e [0,4194304] 0 2024-09-21T10:40:46.314 INFO:tasks.workunit.client.1.smithi112.stdout:4/384: mknod de/d33/d2f/d35/d4c/c80 0 2024-09-21T10:40:46.314 INFO:tasks.workunit.client.1.smithi112.stdout:4/385: write de/d33/d2f/d71/f6a [748625,71880] 0 2024-09-21T10:40:46.316 INFO:tasks.workunit.client.1.smithi112.stdout:9/412: mkdir d1/d2/d27/d37/d3b/d69/d88 0 2024-09-21T10:40:46.316 INFO:tasks.workunit.client.1.smithi112.stdout:2/347: dwrite d0/d12/d1b/d51/d57/f37 [0,4194304] 0 2024-09-21T10:40:46.316 INFO:tasks.workunit.client.1.smithi112.stdout:2/348: write d0/dd/d49/f73 [550053,50425] 0 2024-09-21T10:40:46.325 INFO:tasks.workunit.client.1.smithi112.stdout:3/381: creat d2/d22/d31/d37/f83 x:0 0 0 2024-09-21T10:40:46.325 INFO:tasks.workunit.client.1.smithi112.stdout:3/382: fdatasync d2/f51 0 2024-09-21T10:40:46.325 INFO:tasks.workunit.client.1.smithi112.stdout:3/383: write d2/d22/d31/d2a/d39/f81 [8296709,31199] 0 2024-09-21T10:40:46.328 INFO:tasks.workunit.client.1.smithi112.stdout:5/421: dwrite d9/ff [0,4194304] 0 2024-09-21T10:40:46.329 INFO:tasks.workunit.client.1.smithi112.stdout:1/517: creat d8/d1a/d53/d57/d83/fa8 x:0 0 0 2024-09-21T10:40:46.330 INFO:tasks.workunit.client.1.smithi112.stdout:2/349: dread d0/dd/f2e [0,4194304] 0 2024-09-21T10:40:46.330 INFO:tasks.workunit.client.1.smithi112.stdout:2/350: truncate d0/f2a 487799 0 2024-09-21T10:40:46.330 INFO:tasks.workunit.client.1.smithi112.stdout:2/351: stat d0/dd/d49/f52 0 2024-09-21T10:40:46.330 INFO:tasks.workunit.client.1.smithi112.stdout:2/352: chown d0/dd 485 1 2024-09-21T10:40:46.331 INFO:tasks.workunit.client.1.smithi112.stdout:4/386: symlink de/d18/l81 0 2024-09-21T10:40:46.334 INFO:tasks.workunit.client.1.smithi112.stdout:9/413: link d1/d2/f79 d1/f89 0 2024-09-21T10:40:46.334 INFO:tasks.workunit.client.1.smithi112.stdout:9/414: chown d1/d2/d27/d3a/d6b/d30/f57 9240419 1 2024-09-21T10:40:46.336 INFO:tasks.workunit.client.1.smithi112.stdout:3/384: rename d2/d1f/l3c to d2/d2f/d3f/l84 0 2024-09-21T10:40:46.339 INFO:tasks.workunit.client.1.smithi112.stdout:8/401: getdents d8/d9/dd/d1a 0 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/353: dread d0/dd/f61 [0,4194304] 0 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/354: chown d0/fe 4 1 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/355: stat d0/dd/d49/d62/d63/f35 0 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/356: read d0/dd/d49/d62/d63/f4f [1498876,90363] 0 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/357: write d0/dd/d49/d62/d63/f4f [1897276,98839] 0 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:7/376: dwrite d7/f1a [0,4194304] 0 2024-09-21T10:40:46.343 INFO:tasks.workunit.client.1.smithi112.stdout:7/377: read d7/d22/f46 [662883,87296] 0 2024-09-21T10:40:46.345 INFO:tasks.workunit.client.1.smithi112.stdout:5/422: unlink d9/d15/d1d/f32 0 2024-09-21T10:40:46.346 INFO:tasks.workunit.client.1.smithi112.stdout:5/423: fsync d9/f54 0 2024-09-21T10:40:46.348 INFO:tasks.workunit.client.1.smithi112.stdout:1/518: creat d8/d1a/d31/d37/d9e/fa9 x:0 0 0 2024-09-21T10:40:46.348 INFO:tasks.workunit.client.1.smithi112.stdout:1/519: creat d8/d1a/d31/d37/d9e/faa x:0 0 0 2024-09-21T10:40:46.349 INFO:tasks.workunit.client.1.smithi112.stdout:4/387: mkdir de/d18/d6d/d6e/d82 0 2024-09-21T10:40:46.351 INFO:tasks.workunit.client.1.smithi112.stdout:2/358: write d0/f2 [5504000,111572] 0 2024-09-21T10:40:46.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/415: creat d1/d2/d27/d37/d3b/d69/f8a x:0 0 0 2024-09-21T10:40:46.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/416: chown d1/l6 26228 1 2024-09-21T10:40:46.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/417: fdatasync d1/d2/f60 0 2024-09-21T10:40:46.353 INFO:tasks.workunit.client.1.smithi112.stdout:9/418: dread - d1/d2/d27/d37/d68/f80 zero size 2024-09-21T10:40:46.357 INFO:tasks.workunit.client.1.smithi112.stdout:6/392: dwrite d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:46.357 INFO:tasks.workunit.client.1.smithi112.stdout:6/393: fsync d4/dc/d1a/d31/d56/d64/f48 0 2024-09-21T10:40:46.357 INFO:tasks.workunit.client.1.smithi112.stdout:7/378: dread d7/d22/f35 [0,4194304] 0 2024-09-21T10:40:46.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/520: write d8/d20/f32 [1347989,38218] 0 2024-09-21T10:40:46.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/521: write d8/f1f [925976,87326] 0 2024-09-21T10:40:46.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/522: fdatasync d8/d1a/d31/d37/f77 0 2024-09-21T10:40:46.363 INFO:tasks.workunit.client.1.smithi112.stdout:4/388: write de/f12 [844974,88852] 0 2024-09-21T10:40:46.363 INFO:tasks.workunit.client.1.smithi112.stdout:4/389: write de/f15 [9032636,21208] 0 2024-09-21T10:40:46.366 INFO:tasks.workunit.client.1.smithi112.stdout:5/424: mknod d9/d15/d18/d20/d47/c81 0 2024-09-21T10:40:46.368 INFO:tasks.workunit.client.1.smithi112.stdout:2/359: mkdir d0/d12/d76 0 2024-09-21T10:40:46.370 INFO:tasks.workunit.client.1.smithi112.stdout:9/419: creat d1/d2/d27/d3a/d6b/d30/f8b x:0 0 0 2024-09-21T10:40:46.374 INFO:tasks.workunit.client.1.smithi112.stdout:3/385: rmdir d2/d22/d31/d2a/d39 39 2024-09-21T10:40:46.374 INFO:tasks.workunit.client.1.smithi112.stdout:3/386: chown d2/d22/d31/d37/f68 179 1 2024-09-21T10:40:46.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/394: mknod d4/d6/d75/c90 0 2024-09-21T10:40:46.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/395: write d4/d6/f15 [2055019,67678] 0 2024-09-21T10:40:46.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/396: getdents d4/d6/da/d11/d37/d8b 0 2024-09-21T10:40:46.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/397: chown d4/d6/da/d11/d1f/c3b 329725 1 2024-09-21T10:40:46.377 INFO:tasks.workunit.client.1.smithi112.stdout:4/390: dwrite de/d18/d6d/f7e [0,4194304] 0 2024-09-21T10:40:46.377 INFO:tasks.workunit.client.1.smithi112.stdout:4/391: fsync de/d33/d2f/d35/f3b 0 2024-09-21T10:40:46.378 INFO:tasks.workunit.client.1.smithi112.stdout:7/379: mkdir d7/d22/d41/d80 0 2024-09-21T10:40:46.379 INFO:tasks.workunit.client.1.smithi112.stdout:8/402: getdents d8 0 2024-09-21T10:40:46.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/392: dread de/d18/d6d/f7e [0,4194304] 0 2024-09-21T10:40:46.389 INFO:tasks.workunit.client.1.smithi112.stdout:5/425: rmdir d9/d15/d18 39 2024-09-21T10:40:46.389 INFO:tasks.workunit.client.1.smithi112.stdout:5/426: truncate d9/d15/d1d/f46 1203866 0 2024-09-21T10:40:46.390 INFO:tasks.workunit.client.1.smithi112.stdout:3/387: dwrite d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:46.391 INFO:tasks.workunit.client.1.smithi112.stdout:2/360: mkdir d0/d12/d77 0 2024-09-21T10:40:46.392 INFO:tasks.workunit.client.1.smithi112.stdout:2/361: dread - d0/dd/d49/f52 zero size 2024-09-21T10:40:46.395 INFO:tasks.workunit.client.1.smithi112.stdout:9/420: link d1/d2/d27/d37/d3b/c5b d1/d2/d27/c8c 0 2024-09-21T10:40:46.404 INFO:tasks.workunit.client.1.smithi112.stdout:6/398: symlink d4/dc/d1a/d31/d39/l91 0 2024-09-21T10:40:46.412 INFO:tasks.workunit.client.1.smithi112.stdout:7/380: link d7/d22/d41/d54/l4f d7/l81 0 2024-09-21T10:40:46.413 INFO:tasks.workunit.client.1.smithi112.stdout:3/388: dwrite d2/d22/d31/d2a/d39/d3a/f59 [0,4194304] 0 2024-09-21T10:40:46.413 INFO:tasks.workunit.client.1.smithi112.stdout:2/362: dwrite d0/dd/d47/f50 [0,4194304] 0 2024-09-21T10:40:46.414 INFO:tasks.workunit.client.1.smithi112.stdout:8/403: creat d8/d9/dd/d2a/d43/f7c x:0 0 0 2024-09-21T10:40:46.417 INFO:tasks.workunit.client.1.smithi112.stdout:4/393: symlink de/d33/d2f/d35/d4c/l83 0 2024-09-21T10:40:46.417 INFO:tasks.workunit.client.1.smithi112.stdout:4/394: chown de/d2a/d3d/d3e/d75 128983057 1 2024-09-21T10:40:46.417 INFO:tasks.workunit.client.1.smithi112.stdout:4/395: read de/d2e/f48 [331040,101616] 0 2024-09-21T10:40:46.418 INFO:tasks.workunit.client.1.smithi112.stdout:5/427: truncate d9/d15/d18/d20/f34 2754465 0 2024-09-21T10:40:46.419 INFO:tasks.workunit.client.1.smithi112.stdout:5/428: write d9/d15/d18/d3a/f2d [2071024,17779] 0 2024-09-21T10:40:46.423 INFO:tasks.workunit.client.1.smithi112.stdout:9/421: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:46.434 INFO:tasks.workunit.client.1.smithi112.stdout:6/399: unlink d4/d6/da/d14/c17 0 2024-09-21T10:40:46.434 INFO:tasks.workunit.client.1.smithi112.stdout:6/400: chown d4/d6/da/d14/d49/d73/f7f 14 1 2024-09-21T10:40:46.434 INFO:tasks.workunit.client.1.smithi112.stdout:6/401: fsync d4/d6/da/d14/f27 0 2024-09-21T10:40:46.434 INFO:tasks.workunit.client.1.smithi112.stdout:6/402: chown d4/dc/d1a/d31/d56/d64/l51 438 1 2024-09-21T10:40:46.436 INFO:tasks.workunit.client.1.smithi112.stdout:7/381: creat d7/d22/d41/d4b/d5e/f82 x:0 0 0 2024-09-21T10:40:46.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/389: truncate d2/d1f/f25 920580 0 2024-09-21T10:40:46.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/390: dread - d2/d22/d31/d2a/d39/f7a zero size 2024-09-21T10:40:46.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.442+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9750103a60 con 0x7f973c073ee0 2024-09-21T10:40:46.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.444+0000 7f97477fe640 1 -- 172.21.15.60:0/970791536 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9750103a60 con 0x7f973c073ee0 2024-09-21T10:40:46.448 INFO:tasks.workunit.client.1.smithi112.stdout:2/363: mkdir d0/d12/d77/d78 0 2024-09-21T10:40:46.451 INFO:tasks.workunit.client.1.smithi112.stdout:8/404: creat d8/d9/dd/d2b/d31/f7d x:0 0 0 2024-09-21T10:40:46.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f973c073ee0 msgr2=0x7f973c0763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f973c073ee0 0x7f973c0763a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9750196bf0 tx=0x7f9738009110 comp rx=0 tx=0).stop 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 msgr2=0x7f97501956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f97501956d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9740005640 tx=0x7f9740005670 comp rx=0 tx=0).stop 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 shutdown_connections 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f973c073ee0 0x7f973c0763a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9750102fc0 0x7f9750195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 --2- 172.21.15.60:0/970791536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9750100690 0x7f97501956d0 secure :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9740005640 tx=0x7f9740005670 comp rx=0 tx=0).stop 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 >> 172.21.15.60:0/970791536 conn(0x7f97500fa250 msgr2=0x7f97500fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.448+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 shutdown_connections 2024-09-21T10:40:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.449+0000 7f9754e4b640 1 -- 172.21.15.60:0/970791536 wait complete. 2024-09-21T10:40:46.453 INFO:tasks.workunit.client.1.smithi112.stdout:4/396: symlink de/d18/d6d/d6e/d82/l84 0 2024-09-21T10:40:46.453 INFO:tasks.workunit.client.1.smithi112.stdout:4/397: chown de/d18/d6d/f7e 856878384 1 2024-09-21T10:40:46.453 INFO:tasks.workunit.client.1.smithi112.stdout:4/398: chown ca 13 1 2024-09-21T10:40:46.457 INFO:tasks.workunit.client.1.smithi112.stdout:5/429: creat d9/d15/d18/f82 x:0 0 0 2024-09-21T10:40:46.458 INFO:tasks.workunit.client.1.smithi112.stdout:9/422: symlink d1/d2/d27/d3a/d6b/d30/d5c/d7c/l8d 0 2024-09-21T10:40:46.458 INFO:tasks.workunit.client.1.smithi112.stdout:9/423: readlink d1/d2/d27/d37/d3b/l5d 0 2024-09-21T10:40:46.459 INFO:tasks.workunit.client.1.smithi112.stdout:6/403: dwrite d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:46.459 INFO:tasks.workunit.client.1.smithi112.stdout:6/404: write d4/dc/d1a/d31/d56/f72 [398569,96529] 0 2024-09-21T10:40:46.460 INFO:tasks.workunit.client.1.smithi112.stdout:7/382: mknod d7/d22/d41/d56/d72/d79/c83 0 2024-09-21T10:40:46.460 INFO:tasks.workunit.client.1.smithi112.stdout:3/391: dwrite f1 [0,4194304] 0 2024-09-21T10:40:46.463 INFO:tasks.workunit.client.1.smithi112.stdout:2/364: symlink d0/d12/d1b/d51/l79 0 2024-09-21T10:40:46.463 INFO:tasks.workunit.client.1.smithi112.stdout:2/365: chown d0/d12/d76 2195568 1 2024-09-21T10:40:46.463 INFO:tasks.workunit.client.1.smithi112.stdout:2/366: write d0/dd/d49/f52 [780311,15873] 0 2024-09-21T10:40:46.464 INFO:tasks.workunit.client.1.smithi112.stdout:4/399: creat de/d2a/d3d/d3e/d75/f85 x:0 0 0 2024-09-21T10:40:46.465 INFO:tasks.workunit.client.1.smithi112.stdout:4/400: write de/d2a/d3d/d3e/f64 [455243,79936] 0 2024-09-21T10:40:46.465 INFO:tasks.workunit.client.1.smithi112.stdout:4/401: chown de/d18 2641126 1 2024-09-21T10:40:46.465 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:40:46.467 INFO:tasks.workunit.client.1.smithi112.stdout:5/430: rename d9/d15/d18/d3a/c72 to d9/d15/d18/d3a/d4b/d71/c83 0 2024-09-21T10:40:46.469 INFO:tasks.workunit.client.1.smithi112.stdout:7/383: write d7/d22/f38 [4000758,97068] 0 2024-09-21T10:40:46.470 INFO:tasks.workunit.client.1.smithi112.stdout:9/424: mknod d1/d2/d27/d37/d3b/d69/c8e 0 2024-09-21T10:40:46.473 INFO:tasks.workunit.client.1.smithi112.stdout:6/405: link f1 d4/dc/d7e/f92 0 2024-09-21T10:40:46.476 INFO:tasks.workunit.client.1.smithi112.stdout:2/367: truncate d0/f2 1129858 0 2024-09-21T10:40:46.478 INFO:tasks.workunit.client.1.smithi112.stdout:4/402: symlink de/d33/d6f/l86 0 2024-09-21T10:40:46.483 INFO:tasks.workunit.client.1.smithi112.stdout:5/431: rename d9/d15/d1d/l5c to d9/d15/d18/d20/d55/l84 0 2024-09-21T10:40:46.485 INFO:tasks.workunit.client.1.smithi112.stdout:7/384: dwrite d7/d22/d41/d4b/f64 [0,4194304] 0 2024-09-21T10:40:46.485 INFO:tasks.workunit.client.1.smithi112.stdout:7/385: creat d7/d22/d41/f84 x:0 0 0 2024-09-21T10:40:46.486 INFO:tasks.workunit.client.1.smithi112.stdout:9/425: getdents d1/d2/d27/d3a/d6b 0 2024-09-21T10:40:46.488 INFO:tasks.workunit.client.1.smithi112.stdout:4/403: write de/d18/f21 [2055736,53706] 0 2024-09-21T10:40:46.490 INFO:tasks.workunit.client.1.smithi112.stdout:5/432: write d9/d15/d1d/f1f [3314364,2019] 0 2024-09-21T10:40:46.491 INFO:tasks.workunit.client.1.smithi112.stdout:7/386: creat d7/d22/d73/f85 x:0 0 0 2024-09-21T10:40:46.491 INFO:tasks.workunit.client.1.smithi112.stdout:7/387: truncate d7/d3d/f3e 5167743 0 2024-09-21T10:40:46.493 INFO:tasks.workunit.client.1.smithi112.stdout:4/404: creat de/d18/d6d/d6e/d82/f87 x:0 0 0 2024-09-21T10:40:46.493 INFO:tasks.workunit.client.1.smithi112.stdout:4/405: creat de/d33/d2f/d71/d40/f88 x:0 0 0 2024-09-21T10:40:46.496 INFO:tasks.workunit.client.1.smithi112.stdout:2/368: symlink d0/d12/d1b/l7a 0 2024-09-21T10:40:46.503 INFO:tasks.workunit.client.1.smithi112.stdout:4/406: mknod de/d33/d6f/c89 0 2024-09-21T10:40:46.509 INFO:tasks.workunit.client.1.smithi112.stdout:5/433: dwrite d9/fe [4194304,4194304] 0 2024-09-21T10:40:46.511 INFO:tasks.workunit.client.1.smithi112.stdout:7/388: rename d7/d22/d41/d56/d58 to d7/d22/d86 0 2024-09-21T10:40:46.511 INFO:tasks.workunit.client.1.smithi112.stdout:7/389: chown d7/d22/f46 139819345 1 2024-09-21T10:40:46.514 INFO:tasks.workunit.client.1.smithi112.stdout:5/434: symlink d9/d15/d18/d3a/l85 0 2024-09-21T10:40:46.515 INFO:tasks.workunit.client.1.smithi112.stdout:7/390: truncate d7/f49 47993 0 2024-09-21T10:40:46.518 INFO:tasks.workunit.client.1.smithi112.stdout:5/435: unlink d9/d15/d18/d20/d47/c4a 0 2024-09-21T10:40:46.518 INFO:tasks.workunit.client.1.smithi112.stdout:5/436: chown d9/d15/d18/d3a/d4b/d71/f80 0 1 2024-09-21T10:40:46.518 INFO:tasks.workunit.client.1.smithi112.stdout:5/437: chown d9/d15/d1d/f5a 128309 1 2024-09-21T10:40:46.520 INFO:tasks.workunit.client.1.smithi112.stdout:5/438: creat d9/d15/d18/d3a/d61/d62/f86 x:0 0 0 2024-09-21T10:40:46.522 INFO:tasks.workunit.client.1.smithi112.stdout:6/406: dread d4/d6/da/fb [0,4194304] 0 2024-09-21T10:40:46.522 INFO:tasks.workunit.client.1.smithi112.stdout:6/407: write d4/d6/da/d14/d49/d73/f7f [160320,83650] 0 2024-09-21T10:40:46.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/391: dread d7/d22/d78/f7f [0,4194304] 0 2024-09-21T10:40:46.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/392: chown d7/f3f 37042 1 2024-09-21T10:40:46.525 INFO:tasks.workunit.client.1.smithi112.stdout:6/408: symlink d4/dc/d67/l93 0 2024-09-21T10:40:46.525 INFO:tasks.workunit.client.1.smithi112.stdout:6/409: write d4/d6/f15 [3523143,71186] 0 2024-09-21T10:40:46.529 INFO:tasks.workunit.client.1.smithi112.stdout:4/407: dread de/d18/d6d/f7e [0,4194304] 0 2024-09-21T10:40:46.530 INFO:tasks.workunit.client.1.smithi112.stdout:7/393: creat d7/d22/d41/d54/f87 x:0 0 0 2024-09-21T10:40:46.530 INFO:tasks.workunit.client.1.smithi112.stdout:7/394: readlink d7/d22/l7c 0 2024-09-21T10:40:46.530 INFO:tasks.workunit.client.1.smithi112.stdout:7/395: getdents d7/d22/d41/d4b/d52/d77 0 2024-09-21T10:40:46.534 INFO:tasks.workunit.client.1.smithi112.stdout:9/426: dwrite d1/d2/d27/d3a/f71 [0,4194304] 0 2024-09-21T10:40:46.535 INFO:tasks.workunit.client.1.smithi112.stdout:4/408: mknod de/d18/c8a 0 2024-09-21T10:40:46.538 INFO:tasks.workunit.client.1.smithi112.stdout:7/396: mknod d7/d22/d41/c88 0 2024-09-21T10:40:46.538 INFO:tasks.workunit.client.1.smithi112.stdout:7/397: truncate d7/d22/f28 5127728 0 2024-09-21T10:40:46.539 INFO:tasks.workunit.client.1.smithi112.stdout:4/409: dread de/d33/f38 [0,4194304] 0 2024-09-21T10:40:46.543 INFO:tasks.workunit.client.1.smithi112.stdout:6/410: dwrite d4/dc/d1a/d31/d56/f72 [0,4194304] 0 2024-09-21T10:40:46.543 INFO:tasks.workunit.client.1.smithi112.stdout:6/411: truncate d4/dc/d1a/d31/d56/f79 810724 0 2024-09-21T10:40:46.547 INFO:tasks.workunit.client.1.smithi112.stdout:5/439: getdents d9/d15/d18/d3a/d4b/d71 0 2024-09-21T10:40:46.547 INFO:tasks.workunit.client.1.smithi112.stdout:5/440: fdatasync d9/d15/d18/f39 0 2024-09-21T10:40:46.547 INFO:tasks.workunit.client.1.smithi112.stdout:5/441: chown d9/d15/d18/f82 1479 1 2024-09-21T10:40:46.548 INFO:tasks.workunit.client.1.smithi112.stdout:5/442: dread d9/d15/f63 [0,4194304] 0 2024-09-21T10:40:46.559 INFO:tasks.workunit.client.1.smithi112.stdout:9/427: dwrite d1/d2/f3e [0,4194304] 0 2024-09-21T10:40:46.561 INFO:tasks.workunit.client.1.smithi112.stdout:4/410: mknod de/d33/d2f/d35/c8b 0 2024-09-21T10:40:46.567 INFO:tasks.workunit.client.1.smithi112.stdout:6/412: creat d4/dc/d1a/d31/d56/d64/f94 x:0 0 0 2024-09-21T10:40:46.578 INFO:tasks.workunit.client.1.smithi112.stdout:9/428: creat d1/d2/d27/d62/f8f x:0 0 0 2024-09-21T10:40:46.582 INFO:tasks.workunit.client.1.smithi112.stdout:5/443: mknod d9/d15/c87 0 2024-09-21T10:40:46.584 INFO:tasks.workunit.client.1.smithi112.stdout:9/429: symlink d1/d2/d27/d3a/l90 0 2024-09-21T10:40:46.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 -- 172.21.15.60:0/14174029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 msgr2=0x7fb8081053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 --2- 172.21.15.60:0/14174029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8081053a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0098b0 tx=0x7fb7fc02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 -- 172.21.15.60:0/14174029 shutdown_connections 2024-09-21T10:40:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 --2- 172.21.15.60:0/14174029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8081053a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 --2- 172.21.15.60:0/14174029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb808102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 -- 172.21.15.60:0/14174029 >> 172.21.15.60:0/14174029 conn(0x7fb8080fa280 msgr2=0x7fb8080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 -- 172.21.15.60:0/14174029 shutdown_connections 2024-09-21T10:40:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.583+0000 7fb80cd31640 1 -- 172.21.15.60:0/14174029 wait complete. 2024-09-21T10:40:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.584+0000 7fb80cd31640 1 Processor -- start 2024-09-21T10:40:46.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.584+0000 7fb80cd31640 1 -- start start 2024-09-21T10:40:46.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80cd31640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb8080fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:46.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80cd31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8080fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:46.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80cd31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080feb70 con 0x7fb808102fb0 2024-09-21T10:40:46.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80cd31640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080fece0 con 0x7fb808100680 2024-09-21T10:40:46.588 INFO:tasks.workunit.client.1.smithi112.stdout:4/411: getdents de/d2e 0 2024-09-21T10:40:46.588 INFO:tasks.workunit.client.1.smithi112.stdout:4/412: truncate de/d18/f76 1851798 0 2024-09-21T10:40:46.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb805d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8080fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb8080fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb8080fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:35824/0 (socket says 172.21.15.60:35824) 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80659c640 1 -- 172.21.15.60:0/2134043469 learned_addr learned my addr 172.21.15.60:0/2134043469 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb805d9b640 1 -- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 msgr2=0x7fb8080fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb805d9b640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb8080fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb805d9b640 1 -- 172.21.15.60:0/2134043469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009560 con 0x7fb808102fb0 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.585+0000 7fb80659c640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb8080fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.586+0000 7fb805d9b640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8080fe630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc02a9f0 tx=0x7fb7fc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:46.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.586+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7fc004aa0 con 0x7fb808102fb0 2024-09-21T10:40:46.590 INFO:tasks.workunit.client.1.smithi112.stdout:6/413: symlink d4/d3e/l95 0 2024-09-21T10:40:46.590 INFO:tasks.workunit.client.1.smithi112.stdout:6/414: truncate d4/d4f/f66 332048 0 2024-09-21T10:40:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.586+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8080fef60 con 0x7fb808102fb0 2024-09-21T10:40:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.586+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8080ff450 con 0x7fb808102fb0 2024-09-21T10:40:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.587+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7fc005d50 con 0x7fb808102fb0 2024-09-21T10:40:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.587+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7fc0039b0 con 0x7fb808102fb0 2024-09-21T10:40:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.588+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8005280 con 0x7fb808102fb0 2024-09-21T10:40:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.588+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7fb7fc003c20 con 0x7fb808102fb0 2024-09-21T10:40:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.589+0000 7fb7f77fe640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb7f0073ee0 0x7fb7f00763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.589+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb7fc0b6040 con 0x7fb808102fb0 2024-09-21T10:40:46.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.590+0000 7fb80659c640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb7f0073ee0 0x7fb7f00763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:46.592 INFO:tasks.workunit.client.1.smithi112.stdout:5/444: unlink d9/d15/d1d/l26 0 2024-09-21T10:40:46.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.590+0000 7fb80659c640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb7f0073ee0 0x7fb7f00763a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8011550 tx=0x7fb7f8005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:46.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/430: mknod d1/d2/d27/d3a/d4c/c91 0 2024-09-21T10:40:46.596 INFO:tasks.workunit.client.1.smithi112.stdout:4/413: truncate de/d2a/d3d/f7a 3747006 0 2024-09-21T10:40:46.596 INFO:tasks.workunit.client.1.smithi112.stdout:4/414: write de/d2e/f48 [181459,90110] 0 2024-09-21T10:40:46.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.595+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fb7fc079590 con 0x7fb808102fb0 2024-09-21T10:40:46.597 INFO:tasks.workunit.client.1.smithi112.stdout:5/445: write d9/f54 [1466725,85006] 0 2024-09-21T10:40:46.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/431: mkdir d1/d2/d27/d3a/d6b/d30/d5c/d92 0 2024-09-21T10:40:46.601 INFO:tasks.workunit.client.1.smithi112.stdout:4/415: rename de/d2a/d3d/d3e/d75/f85 to de/d18/d6d/f8c 0 2024-09-21T10:40:46.604 INFO:tasks.workunit.client.1.smithi112.stdout:4/416: read de/d2a/d3d/d3e/f64 [141412,120994] 0 2024-09-21T10:40:46.605 INFO:tasks.workunit.client.1.smithi112.stdout:9/432: mknod d1/d7f/c93 0 2024-09-21T10:40:46.605 INFO:tasks.workunit.client.1.smithi112.stdout:9/433: write d1/d2/d27/d3a/d6b/f3c [3088592,33534] 0 2024-09-21T10:40:46.606 INFO:tasks.workunit.client.1.smithi112.stdout:9/434: creat d1/d2/d27/d37/d3b/d69/f94 x:0 0 0 2024-09-21T10:40:46.606 INFO:tasks.workunit.client.1.smithi112.stdout:9/435: write d1/d2/d27/d62/d70/f21 [4756905,40847] 0 2024-09-21T10:40:46.611 INFO:tasks.workunit.client.1.smithi112.stdout:5/446: write d9/d15/f2a [2147582,121199] 0 2024-09-21T10:40:46.616 INFO:tasks.workunit.client.1.smithi112.stdout:6/415: dwrite d4/d3e/f4c [0,4194304] 0 2024-09-21T10:40:46.625 INFO:tasks.workunit.client.1.smithi112.stdout:1/523: sync 2024-09-21T10:40:46.625 INFO:tasks.workunit.client.1.smithi112.stdout:0/462: sync 2024-09-21T10:40:46.625 INFO:tasks.workunit.client.1.smithi112.stdout:0/463: truncate d3/d18/d52/d55/f93 7417 0 2024-09-21T10:40:46.625 INFO:tasks.workunit.client.1.smithi112.stdout:0/464: chown d3/d23/c27 130215361 1 2024-09-21T10:40:46.626 INFO:tasks.workunit.client.1.smithi112.stdout:6/416: dread d4/dc/d1a/d31/d56/d64/f48 [0,4194304] 0 2024-09-21T10:40:46.626 INFO:tasks.workunit.client.1.smithi112.stdout:6/417: chown d4/d6/da/d11/d1f/d22/f58 36511019 1 2024-09-21T10:40:46.627 INFO:tasks.workunit.client.1.smithi112.stdout:5/447: rename d9/d15/d18/d20/c45 to d9/d15/d18/d3a/d4b/d71/c88 0 2024-09-21T10:40:46.627 INFO:tasks.workunit.client.1.smithi112.stdout:5/448: chown d9/d15/d1d/f1f 273164 1 2024-09-21T10:40:46.627 INFO:tasks.workunit.client.1.smithi112.stdout:5/449: fsync d9/d15/d18/f29 0 2024-09-21T10:40:46.627 INFO:tasks.workunit.client.1.smithi112.stdout:4/417: dwrite de/f12 [4194304,4194304] 0 2024-09-21T10:40:46.627 INFO:tasks.workunit.client.1.smithi112.stdout:4/418: dread - de/d2a/d3d/f49 zero size 2024-09-21T10:40:46.636 INFO:tasks.workunit.client.1.smithi112.stdout:0/465: link d3/d4/d10/d8b/f7d d3/d4a/f96 0 2024-09-21T10:40:46.638 INFO:tasks.workunit.client.1.smithi112.stdout:6/418: mkdir d4/d6/da/d14/d49/d62/d96 0 2024-09-21T10:40:46.638 INFO:tasks.workunit.client.1.smithi112.stdout:6/419: dread - d4/d6/f87 zero size 2024-09-21T10:40:46.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/419: mkdir de/d2a/d31/d8d 0 2024-09-21T10:40:46.640 INFO:tasks.workunit.client.1.smithi112.stdout:4/420: stat de/d2e 0 2024-09-21T10:40:46.642 INFO:tasks.workunit.client.1.smithi112.stdout:6/420: mkdir d4/d6/d75/d97 0 2024-09-21T10:40:46.642 INFO:tasks.workunit.client.1.smithi112.stdout:6/421: chown d4/d3e/l95 71665986 1 2024-09-21T10:40:46.644 INFO:tasks.workunit.client.1.smithi112.stdout:9/436: dwrite d1/d2/d27/f7d [0,4194304] 0 2024-09-21T10:40:46.645 INFO:tasks.workunit.client.1.smithi112.stdout:6/422: creat d4/d6/d75/f98 x:0 0 0 2024-09-21T10:40:46.648 INFO:tasks.workunit.client.1.smithi112.stdout:4/421: dread de/d33/d2f/d71/d40/f5a [0,4194304] 0 2024-09-21T10:40:46.656 INFO:tasks.workunit.client.1.smithi112.stdout:4/422: write f8 [488323,55156] 0 2024-09-21T10:40:46.658 INFO:tasks.workunit.client.1.smithi112.stdout:0/466: dread d3/d4/d1a/d21/d46/f58 [0,4194304] 0 2024-09-21T10:40:46.658 INFO:tasks.workunit.client.1.smithi112.stdout:1/524: dwrite d8/d1a/f2c [0,4194304] 0 2024-09-21T10:40:46.658 INFO:tasks.workunit.client.1.smithi112.stdout:1/525: chown d8/d1a/d53/d57/c9d 663 1 2024-09-21T10:40:46.658 INFO:tasks.workunit.client.1.smithi112.stdout:4/423: write de/d33/d6f/f7d [151118,107208] 0 2024-09-21T10:40:46.667 INFO:tasks.workunit.client.1.smithi112.stdout:9/437: unlink d1/d2/c4f 0 2024-09-21T10:40:46.667 INFO:tasks.workunit.client.1.smithi112.stdout:9/438: stat d1/d2/d27/d3a/f56 0 2024-09-21T10:40:46.667 INFO:tasks.workunit.client.1.smithi112.stdout:9/439: readlink d1/d2/d27/d3a/d6b/l6e 0 2024-09-21T10:40:46.670 INFO:tasks.workunit.client.1.smithi112.stdout:6/423: link d4/d6/da/d11/d1f/d22/c35 d4/dc/c99 0 2024-09-21T10:40:46.670 INFO:tasks.workunit.client.1.smithi112.stdout:6/424: creat d4/dc/d1a/d31/d56/f9a x:0 0 0 2024-09-21T10:40:46.674 INFO:tasks.workunit.client.1.smithi112.stdout:1/526: rmdir d8/d1a/d53 39 2024-09-21T10:40:46.674 INFO:tasks.workunit.client.1.smithi112.stdout:0/467: dwrite d3/f1b [0,4194304] 0 2024-09-21T10:40:46.676 INFO:tasks.workunit.client.1.smithi112.stdout:4/424: creat de/d2a/d3d/d3e/d57/f8e x:0 0 0 2024-09-21T10:40:46.681 INFO:tasks.workunit.client.1.smithi112.stdout:6/425: mkdir d4/dc/d1a/d31/d56/d64/d9b 0 2024-09-21T10:40:46.682 INFO:tasks.workunit.client.1.smithi112.stdout:4/425: read de/d2a/d3d/f7a [1417272,114951] 0 2024-09-21T10:40:46.684 INFO:tasks.workunit.client.1.smithi112.stdout:1/527: rmdir d8/d1a/d31/d66 39 2024-09-21T10:40:46.684 INFO:tasks.workunit.client.1.smithi112.stdout:1/528: readlink d8/d20/l2b 0 2024-09-21T10:40:46.686 INFO:tasks.workunit.client.1.smithi112.stdout:9/440: truncate d1/d2/d27/d62/d70/f21 2541239 0 2024-09-21T10:40:46.686 INFO:tasks.workunit.client.1.smithi112.stdout:9/441: creat d1/d2/d27/d37/f95 x:0 0 0 2024-09-21T10:40:46.688 INFO:tasks.workunit.client.1.smithi112.stdout:4/426: symlink de/d33/d2f/d71/d40/d4f/l8f 0 2024-09-21T10:40:46.688 INFO:tasks.workunit.client.1.smithi112.stdout:4/427: write de/d2e/f32 [411613,117573] 0 2024-09-21T10:40:46.689 INFO:tasks.workunit.client.1.smithi112.stdout:6/426: read d4/d6/da/d11/d1f/d22/f33 [3326232,113843] 0 2024-09-21T10:40:46.690 INFO:tasks.workunit.client.1.smithi112.stdout:1/529: link d8/d1a/c36 d8/d1a/d31/d66/d87/cab 0 2024-09-21T10:40:46.691 INFO:tasks.workunit.client.1.smithi112.stdout:0/468: dwrite d3/f92 [0,4194304] 0 2024-09-21T10:40:46.693 INFO:tasks.workunit.client.1.smithi112.stdout:9/442: symlink d1/d2/d27/d3a/d6b/d30/d5e/l96 0 2024-09-21T10:40:46.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/428: rename de/d2a/d3d/d3e/l53 to de/d33/d2f/d71/d40/d4f/l90 0 2024-09-21T10:40:46.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/429: write de/d18/d6d/f70 [798755,86713] 0 2024-09-21T10:40:46.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/430: chown de/d18/c27 797227 1 2024-09-21T10:40:46.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/431: fsync f5 0 2024-09-21T10:40:46.698 INFO:tasks.workunit.client.1.smithi112.stdout:1/530: rmdir d8/d1a/d31/d37 39 2024-09-21T10:40:46.698 INFO:tasks.workunit.client.1.smithi112.stdout:1/531: readlink d8/d1a/d31/d66/d87/la2 0 2024-09-21T10:40:46.698 INFO:tasks.workunit.client.1.smithi112.stdout:1/532: stat d8/d45/f94 0 2024-09-21T10:40:46.702 INFO:tasks.workunit.client.1.smithi112.stdout:6/427: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:46.705 INFO:tasks.workunit.client.1.smithi112.stdout:9/443: creat d1/d2/d27/d3a/d6b/f97 x:0 0 0 2024-09-21T10:40:46.707 INFO:tasks.workunit.client.1.smithi112.stdout:9/444: write d1/d2/d27/f3d [703169,25487] 0 2024-09-21T10:40:46.708 INFO:tasks.workunit.client.1.smithi112.stdout:1/533: rename d8/d1a/l52 to d8/lac 0 2024-09-21T10:40:46.710 INFO:tasks.workunit.client.1.smithi112.stdout:6/428: truncate d4/d6/da/f6f 3819762 0 2024-09-21T10:40:46.716 INFO:tasks.workunit.client.1.smithi112.stdout:0/469: dwrite d3/d4a/d4e/f6e [0,4194304] 0 2024-09-21T10:40:46.716 INFO:tasks.workunit.client.1.smithi112.stdout:0/470: dread - d3/d4a/d4e/f78 zero size 2024-09-21T10:40:46.718 INFO:tasks.workunit.client.1.smithi112.stdout:4/432: dwrite de/d33/d6f/f7d [0,4194304] 0 2024-09-21T10:40:46.720 INFO:tasks.workunit.client.1.smithi112.stdout:9/445: symlink d1/d2/d27/d3a/d6b/l98 0 2024-09-21T10:40:46.723 INFO:tasks.workunit.client.1.smithi112.stdout:1/534: creat d8/d1a/fad x:0 0 0 2024-09-21T10:40:46.724 INFO:tasks.workunit.client.1.smithi112.stdout:6/429: mkdir d4/d6/d9c 0 2024-09-21T10:40:46.724 INFO:tasks.workunit.client.1.smithi112.stdout:6/430: write d4/d6/d75/f98 [134085,114827] 0 2024-09-21T10:40:46.728 INFO:tasks.workunit.client.1.smithi112.stdout:8/405: sync 2024-09-21T10:40:46.737 INFO:tasks.workunit.client.1.smithi112.stdout:8/406: read f3 [1762069,65010] 0 2024-09-21T10:40:46.737 INFO:tasks.workunit.client.1.smithi112.stdout:8/407: chown d8/d9/dd/d76/f79 9505424 1 2024-09-21T10:40:46.737 INFO:tasks.workunit.client.1.smithi112.stdout:0/471: unlink d3/d4/d10/d8b/f7d 0 2024-09-21T10:40:46.741 INFO:tasks.workunit.client.1.smithi112.stdout:4/433: link de/d33/d2f/d71/d40/d4f/c65 de/d18/c91 0 2024-09-21T10:40:46.741 INFO:tasks.workunit.client.1.smithi112.stdout:4/434: write de/d2e/f32 [719103,126256] 0 2024-09-21T10:40:46.744 INFO:tasks.workunit.client.1.smithi112.stdout:9/446: creat d1/d2/d27/d37/d3b/d69/d73/f99 x:0 0 0 2024-09-21T10:40:46.744 INFO:tasks.workunit.client.1.smithi112.stdout:9/447: creat d1/d2/d27/f9a x:0 0 0 2024-09-21T10:40:46.744 INFO:tasks.workunit.client.1.smithi112.stdout:9/448: fsync d1/d2/d27/d62/d70/f21 0 2024-09-21T10:40:46.747 INFO:tasks.workunit.client.1.smithi112.stdout:1/535: truncate d8/d1a/f67 1278009 0 2024-09-21T10:40:46.747 INFO:tasks.workunit.client.1.smithi112.stdout:1/536: fdatasync d8/d1a/d31/d37/f5e 0 2024-09-21T10:40:46.754 INFO:tasks.workunit.client.1.smithi112.stdout:4/435: creat de/d18/d6d/d6e/f92 x:0 0 0 2024-09-21T10:40:46.755 INFO:tasks.workunit.client.1.smithi112.stdout:4/436: fsync de/d33/f30 0 2024-09-21T10:40:46.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/449: rename d1/d2/d27/d3a/f23 to d1/d7f/f9b 0 2024-09-21T10:40:46.758 INFO:tasks.workunit.client.1.smithi112.stdout:8/408: dwrite d8/f69 [0,4194304] 0 2024-09-21T10:40:46.760 INFO:tasks.workunit.client.1.smithi112.stdout:1/537: getdents d8 0 2024-09-21T10:40:46.762 INFO:tasks.workunit.client.1.smithi112.stdout:6/431: getdents d4/d6/da/d14 0 2024-09-21T10:40:46.762 INFO:tasks.workunit.client.1.smithi112.stdout:6/432: chown d4/d6/da/d11/d1f/d22 26 1 2024-09-21T10:40:46.765 INFO:tasks.workunit.client.1.smithi112.stdout:0/472: dwrite d3/d4/d1a/f65 [0,4194304] 0 2024-09-21T10:40:46.767 INFO:tasks.workunit.client.1.smithi112.stdout:4/437: mknod de/d33/d6f/c93 0 2024-09-21T10:40:46.768 INFO:tasks.workunit.client.1.smithi112.stdout:4/438: fdatasync de/d18/f21 0 2024-09-21T10:40:46.773 INFO:tasks.workunit.client.1.smithi112.stdout:8/409: rmdir d8/d9/dd/d2a/d43/d58 39 2024-09-21T10:40:46.774 INFO:tasks.workunit.client.1.smithi112.stdout:8/410: chown f3 453855 1 2024-09-21T10:40:46.775 INFO:tasks.workunit.client.1.smithi112.stdout:1/538: mkdir d8/d45/dae 0 2024-09-21T10:40:46.777 INFO:tasks.workunit.client.1.smithi112.stdout:6/433: link d4/dc/d1a/d31/d56/d64/c59 d4/d6/da/d14/d49/d62/c9d 0 2024-09-21T10:40:46.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/439: link ca de/d33/d2f/d71/d40/c94 0 2024-09-21T10:40:46.780 INFO:tasks.workunit.client.1.smithi112.stdout:4/440: write f5 [1674282,43481] 0 2024-09-21T10:40:46.781 INFO:tasks.workunit.client.1.smithi112.stdout:9/450: dwrite d1/f36 [0,4194304] 0 2024-09-21T10:40:46.781 INFO:tasks.workunit.client.1.smithi112.stdout:9/451: chown d1/c49 750795 1 2024-09-21T10:40:46.781 INFO:tasks.workunit.client.1.smithi112.stdout:0/473: dwrite d3/d4a/f6a [0,4194304] 0 2024-09-21T10:40:46.781 INFO:tasks.workunit.client.1.smithi112.stdout:0/474: write d3/d18/d52/d55/f93 [301723,9490] 0 2024-09-21T10:40:46.783 INFO:tasks.workunit.client.1.smithi112.stdout:8/411: rename d8/d9/dd/d2b/d31/l3f to d8/d9/dd/d2b/d31/l7e 0 2024-09-21T10:40:46.783 INFO:tasks.workunit.client.1.smithi112.stdout:2/369: sync 2024-09-21T10:40:46.783 INFO:tasks.workunit.client.1.smithi112.stdout:7/398: sync 2024-09-21T10:40:46.783 INFO:tasks.workunit.client.1.smithi112.stdout:3/392: sync 2024-09-21T10:40:46.784 INFO:tasks.workunit.client.1.smithi112.stdout:7/399: write d7/d22/d41/d54/f87 [716891,66593] 0 2024-09-21T10:40:46.786 INFO:tasks.workunit.client.1.smithi112.stdout:9/452: dread d1/d2/d27/f44 [0,4194304] 0 2024-09-21T10:40:46.790 INFO:tasks.workunit.client.1.smithi112.stdout:4/441: rename f8 to de/d18/d6d/d6e/d82/f95 0 2024-09-21T10:40:46.790 INFO:tasks.workunit.client.1.smithi112.stdout:4/442: creat de/d33/d2f/d35/f96 x:0 0 0 2024-09-21T10:40:46.798 INFO:tasks.workunit.client.1.smithi112.stdout:0/475: dwrite d3/d4a/d4e/f6e [0,4194304] 0 2024-09-21T10:40:46.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/412: truncate d8/d9/dd/d2b/d31/f41 442047 0 2024-09-21T10:40:46.810 INFO:tasks.workunit.client.1.smithi112.stdout:8/413: write d8/d9/f25 [1013893,32851] 0 2024-09-21T10:40:46.812 INFO:tasks.workunit.client.1.smithi112.stdout:3/393: creat d2/d22/d31/d2a/f85 x:0 0 0 2024-09-21T10:40:46.814 INFO:tasks.workunit.client.1.smithi112.stdout:2/370: creat d0/d12/f7b x:0 0 0 2024-09-21T10:40:46.814 INFO:tasks.workunit.client.1.smithi112.stdout:2/371: chown d0/d12/f39 1 1 2024-09-21T10:40:46.814 INFO:tasks.workunit.client.1.smithi112.stdout:2/372: chown d0/d12/d1b/d51/d57 1 1 2024-09-21T10:40:46.817 INFO:tasks.workunit.client.1.smithi112.stdout:1/539: rmdir d8/d20 39 2024-09-21T10:40:46.817 INFO:tasks.workunit.client.1.smithi112.stdout:1/540: chown d8/d1a/d53/f5c 561 1 2024-09-21T10:40:46.817 INFO:tasks.workunit.client.1.smithi112.stdout:1/541: write d8/f38 [1801390,12428] 0 2024-09-21T10:40:46.819 INFO:tasks.workunit.client.1.smithi112.stdout:9/453: symlink d1/d2/d27/d37/l9c 0 2024-09-21T10:40:46.819 INFO:tasks.workunit.client.1.smithi112.stdout:9/454: fsync d1/d2/f79 0 2024-09-21T10:40:46.819 INFO:tasks.workunit.client.1.smithi112.stdout:6/434: getdents d4/dc/d1a/d31/d3c 0 2024-09-21T10:40:46.823 INFO:tasks.workunit.client.1.smithi112.stdout:4/443: creat de/d33/d2f/d35/d4c/f97 x:0 0 0 2024-09-21T10:40:46.823 INFO:tasks.workunit.client.1.smithi112.stdout:4/444: dread - de/d18/d6d/f8c zero size 2024-09-21T10:40:46.830 INFO:tasks.workunit.client.1.smithi112.stdout:3/394: mkdir d2/d22/d31/d2a/d39/d60/d86 0 2024-09-21T10:40:46.832 INFO:tasks.workunit.client.1.smithi112.stdout:2/373: symlink d0/d12/d1b/d51/d66/l7c 0 2024-09-21T10:40:46.832 INFO:tasks.workunit.client.1.smithi112.stdout:2/374: truncate d0/d12/d1b/d51/f70 643615 0 2024-09-21T10:40:46.832 INFO:tasks.workunit.client.1.smithi112.stdout:5/450: sync 2024-09-21T10:40:46.833 INFO:tasks.workunit.client.1.smithi112.stdout:7/400: getdents d7/d22/d47 0 2024-09-21T10:40:46.833 INFO:tasks.workunit.client.1.smithi112.stdout:7/401: chown d7/d22/d86 2714768 1 2024-09-21T10:40:46.835 INFO:tasks.workunit.client.1.smithi112.stdout:1/542: truncate d8/fe 5550681 0 2024-09-21T10:40:46.836 INFO:tasks.workunit.client.1.smithi112.stdout:5/451: dread d9/d15/d1d/f5a [0,4194304] 0 2024-09-21T10:40:46.836 INFO:tasks.workunit.client.1.smithi112.stdout:9/455: link d1/d2/d27/d3a/d6b/c82 d1/d2/d27/d3a/d6b/d30/d5e/c9d 0 2024-09-21T10:40:46.837 INFO:tasks.workunit.client.1.smithi112.stdout:3/395: dread d2/d22/d31/f67 [0,4194304] 0 2024-09-21T10:40:46.839 INFO:tasks.workunit.client.1.smithi112.stdout:6/435: rename d4/dc/d1a/d31/d3c/f76 to d4/dc/d1a/d31/d3c/f9e 0 2024-09-21T10:40:46.841 INFO:tasks.workunit.client.1.smithi112.stdout:4/445: rename de/d33/c2d to de/d33/d2f/d35/c98 0 2024-09-21T10:40:46.843 INFO:tasks.workunit.client.1.smithi112.stdout:0/476: rmdir d3/d4a/d4e/d72 39 2024-09-21T10:40:46.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/375: mknod d0/dd/d49/d62/c7d 0 2024-09-21T10:40:46.845 INFO:tasks.workunit.client.1.smithi112.stdout:1/543: read d8/f40 [3426780,94918] 0 2024-09-21T10:40:46.845 INFO:tasks.workunit.client.1.smithi112.stdout:7/402: unlink d7/d22/d41/d54/l5b 0 2024-09-21T10:40:46.845 INFO:tasks.workunit.client.1.smithi112.stdout:7/403: stat d7/d22/f63 0 2024-09-21T10:40:46.846 INFO:tasks.workunit.client.1.smithi112.stdout:9/456: mknod d1/d2/d27/d37/d3b/d69/d88/c9e 0 2024-09-21T10:40:46.846 INFO:tasks.workunit.client.1.smithi112.stdout:9/457: readlink d1/d2/d27/d3a/l90 0 2024-09-21T10:40:46.847 INFO:tasks.workunit.client.1.smithi112.stdout:5/452: write d9/d15/d18/d3a/f5b [2137196,33747] 0 2024-09-21T10:40:46.848 INFO:tasks.workunit.client.1.smithi112.stdout:6/436: rename d4/dc/d1a/d31/c54 to d4/d6/da/d14/d49/d73/d74/c9f 0 2024-09-21T10:40:46.849 INFO:tasks.workunit.client.1.smithi112.stdout:4/446: mknod de/d2a/d3d/d3e/d75/c99 0 2024-09-21T10:40:46.849 INFO:tasks.workunit.client.1.smithi112.stdout:4/447: dread - de/d33/d2f/d35/f78 zero size 2024-09-21T10:40:46.850 INFO:tasks.workunit.client.1.smithi112.stdout:0/477: symlink d3/d23/d7b/l97 0 2024-09-21T10:40:46.850 INFO:tasks.workunit.client.1.smithi112.stdout:0/478: read - d3/d4a/d4e/f5c zero size 2024-09-21T10:40:46.851 INFO:tasks.workunit.client.1.smithi112.stdout:2/376: mkdir d0/d12/d6c/d7e 0 2024-09-21T10:40:46.851 INFO:tasks.workunit.client.1.smithi112.stdout:2/377: write d0/f2 [1293319,117902] 0 2024-09-21T10:40:46.854 INFO:tasks.workunit.client.1.smithi112.stdout:5/453: creat d9/d15/d18/d3a/d61/f89 x:0 0 0 2024-09-21T10:40:46.854 INFO:tasks.workunit.client.1.smithi112.stdout:6/437: mkdir d4/d6/da/d11/d37/d8b/da0 0 2024-09-21T10:40:46.855 INFO:tasks.workunit.client.1.smithi112.stdout:1/544: write d8/d20/f4a [3443186,71412] 0 2024-09-21T10:40:46.855 INFO:tasks.workunit.client.1.smithi112.stdout:1/545: write d8/d1a/d31/d37/f46 [5006618,113261] 0 2024-09-21T10:40:46.856 INFO:tasks.workunit.client.1.smithi112.stdout:4/448: mknod de/d33/d2f/d35/d4c/c9a 0 2024-09-21T10:40:46.857 INFO:tasks.workunit.client.1.smithi112.stdout:0/479: mknod d3/d4/c98 0 2024-09-21T10:40:46.857 INFO:tasks.workunit.client.1.smithi112.stdout:0/480: fsync d3/d23/f29 0 2024-09-21T10:40:46.857 INFO:tasks.workunit.client.1.smithi112.stdout:0/481: write d3/d4/d43/f59 [858938,110003] 0 2024-09-21T10:40:46.857 INFO:tasks.workunit.client.1.smithi112.stdout:2/378: stat d0/dd/d49/d62/d63/l31 0 2024-09-21T10:40:46.857 INFO:tasks.workunit.client.1.smithi112.stdout:2/379: fdatasync d0/dd/d49/f3f 0 2024-09-21T10:40:46.857 INFO:tasks.workunit.client.1.smithi112.stdout:2/380: getdents d0/d12/d77/d78 0 2024-09-21T10:40:46.863 INFO:tasks.workunit.client.1.smithi112.stdout:7/404: dwrite d7/d22/d47/f7e [0,4194304] 0 2024-09-21T10:40:46.864 INFO:tasks.workunit.client.1.smithi112.stdout:1/546: unlink d8/d1a/d31/d37/l55 0 2024-09-21T10:40:46.864 INFO:tasks.workunit.client.1.smithi112.stdout:1/547: chown d8/d1a/d31/d66/d87/l93 1436172 1 2024-09-21T10:40:46.864 INFO:tasks.workunit.client.1.smithi112.stdout:1/548: chown d8/f24 43011 1 2024-09-21T10:40:46.865 INFO:tasks.workunit.client.1.smithi112.stdout:4/449: mknod de/d2a/d31/d8d/c9b 0 2024-09-21T10:40:46.865 INFO:tasks.workunit.client.1.smithi112.stdout:4/450: chown de/d18/d6d/d6e/f92 532 1 2024-09-21T10:40:46.867 INFO:tasks.workunit.client.1.smithi112.stdout:2/381: symlink d0/dd/d49/d62/l7f 0 2024-09-21T10:40:46.869 INFO:tasks.workunit.client.1.smithi112.stdout:6/438: dread d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:46.869 INFO:tasks.workunit.client.1.smithi112.stdout:5/454: mkdir d9/d8a 0 2024-09-21T10:40:46.870 INFO:tasks.workunit.client.1.smithi112.stdout:5/455: chown d9/d15/d18/c2b 3141 1 2024-09-21T10:40:46.870 INFO:tasks.workunit.client.1.smithi112.stdout:5/456: truncate d9/d15/d18/f82 672895 0 2024-09-21T10:40:46.872 INFO:tasks.workunit.client.1.smithi112.stdout:0/482: write d3/f1b [3735566,48760] 0 2024-09-21T10:40:46.885 INFO:tasks.workunit.client.1.smithi112.stdout:7/405: dwrite d7/d22/f2e [0,4194304] 0 2024-09-21T10:40:46.888 INFO:tasks.workunit.client.1.smithi112.stdout:5/457: dwrite d9/f1c [4194304,4194304] 0 2024-09-21T10:40:46.888 INFO:tasks.workunit.client.1.smithi112.stdout:1/549: rmdir d8/d1a/d31/d66/d87 39 2024-09-21T10:40:46.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/382: dwrite d0/d12/d1b/d51/d57/f67 [0,4194304] 0 2024-09-21T10:40:46.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/383: readlink d0/l56 0 2024-09-21T10:40:46.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/384: fsync d0/d12/d1b/d51/f54 0 2024-09-21T10:40:46.892 INFO:tasks.workunit.client.1.smithi112.stdout:2/385: readlink d0/d12/d1b/d51/d57/l34 0 2024-09-21T10:40:46.898 INFO:tasks.workunit.client.1.smithi112.stdout:6/439: creat d4/dc/d1a/d31/d56/d64/d84/fa1 x:0 0 0 2024-09-21T10:40:46.901 INFO:tasks.workunit.client.1.smithi112.stdout:0/483: creat d3/d4a/f99 x:0 0 0 2024-09-21T10:40:46.912 INFO:tasks.workunit.client.1.smithi112.stdout:1/550: mknod d8/d20/caf 0 2024-09-21T10:40:46.912 INFO:tasks.workunit.client.1.smithi112.stdout:1/551: readlink d8/d20/l2b 0 2024-09-21T10:40:46.913 INFO:tasks.workunit.client.1.smithi112.stdout:1/552: chown d8/d1a/d31/d37/f47 138 1 2024-09-21T10:40:46.917 INFO:tasks.workunit.client.1.smithi112.stdout:4/451: rename de/d2a/d3d to de/d33/d6f/d9c 0 2024-09-21T10:40:46.917 INFO:tasks.workunit.client.1.smithi112.stdout:4/452: fsync de/d2e/f48 0 2024-09-21T10:40:46.919 INFO:tasks.workunit.client.1.smithi112.stdout:0/484: dwrite d3/d23/f26 [0,4194304] 0 2024-09-21T10:40:46.919 INFO:tasks.workunit.client.1.smithi112.stdout:0/485: write d3/d4/d43/f59 [1486214,16764] 0 2024-09-21T10:40:46.921 INFO:tasks.workunit.client.1.smithi112.stdout:2/386: symlink d0/d12/l80 0 2024-09-21T10:40:46.922 INFO:tasks.workunit.client.1.smithi112.stdout:5/458: write d9/d15/f2e [56261,38271] 0 2024-09-21T10:40:46.922 INFO:tasks.workunit.client.1.smithi112.stdout:5/459: write d9/d15/d18/f77 [879921,104121] 0 2024-09-21T10:40:46.924 INFO:tasks.workunit.client.1.smithi112.stdout:7/406: getdents d7/d3d 0 2024-09-21T10:40:46.926 INFO:tasks.workunit.client.1.smithi112.stdout:1/553: mkdir d8/d54/db0 0 2024-09-21T10:40:46.928 INFO:tasks.workunit.client.1.smithi112.stdout:4/453: mkdir de/d2a/d31/d8d/d9d 0 2024-09-21T10:40:46.934 INFO:tasks.workunit.client.1.smithi112.stdout:7/407: dread d7/f13 [0,4194304] 0 2024-09-21T10:40:46.934 INFO:tasks.workunit.client.1.smithi112.stdout:0/486: creat d3/d4/d10/d8b/f9a x:0 0 0 2024-09-21T10:40:46.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/387: creat d0/d12/d6c/d7e/f81 x:0 0 0 2024-09-21T10:40:46.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/388: readlink d0/l6e 0 2024-09-21T10:40:46.940 INFO:tasks.workunit.client.1.smithi112.stdout:5/460: dwrite d9/d15/d1d/f5a [0,4194304] 0 2024-09-21T10:40:46.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/440: mknod d4/d3e/ca2 0 2024-09-21T10:40:46.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/441: write d4/d3e/f4c [5006569,13742] 0 2024-09-21T10:40:46.940 INFO:tasks.workunit.client.1.smithi112.stdout:6/442: stat d4 0 2024-09-21T10:40:46.942 INFO:tasks.workunit.client.1.smithi112.stdout:1/554: getdents d8/d1a/d53 0 2024-09-21T10:40:46.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.942+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7e8000bf0 con 0x7fb7f0073ee0 2024-09-21T10:40:46.945 INFO:tasks.workunit.client.1.smithi112.stdout:4/454: creat de/d33/d2f/d71/f9e x:0 0 0 2024-09-21T10:40:46.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.944+0000 7fb7f77fe640 1 -- 172.21.15.60:0/2134043469 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fb7e8000bf0 con 0x7fb7f0073ee0 2024-09-21T10:40:46.947 INFO:tasks.workunit.client.1.smithi112.stdout:2/389: dread d0/d12/d1b/d51/d57/f37 [0,4194304] 0 2024-09-21T10:40:46.947 INFO:tasks.workunit.client.1.smithi112.stdout:2/390: fsync d0/dd/f61 0 2024-09-21T10:40:46.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb7f0073ee0 msgr2=0x7fb7f00763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb7f0073ee0 0x7fb7f00763a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8011550 tx=0x7fb7f8005f90 comp rx=0 tx=0).stop 2024-09-21T10:40:46.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 msgr2=0x7fb8080fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8080fe630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc02a9f0 tx=0x7fb7fc0055a0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 shutdown_connections 2024-09-21T10:40:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb7f0073ee0 0x7fb7f00763a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb808102fb0 0x7fb8080fe630 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 --2- 172.21.15.60:0/2134043469 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb808100680 0x7fb8080fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 >> 172.21.15.60:0/2134043469 conn(0x7fb8080fa280 msgr2=0x7fb8080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:46.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 shutdown_connections 2024-09-21T10:40:46.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:46.948+0000 7fb80cd31640 1 -- 172.21.15.60:0/2134043469 wait complete. 2024-09-21T10:40:46.952 INFO:tasks.workunit.client.1.smithi112.stdout:2/391: write d0/dd/d47/f6b [2547919,88420] 0 2024-09-21T10:40:46.952 INFO:tasks.workunit.client.1.smithi112.stdout:7/408: symlink d7/d22/d41/d54/l89 0 2024-09-21T10:40:46.952 INFO:tasks.workunit.client.1.smithi112.stdout:7/409: readlink d7/d22/d41/d54/l4f 0 2024-09-21T10:40:46.958 INFO:tasks.workunit.client.1.smithi112.stdout:5/461: write d9/d15/f35 [829562,35054] 0 2024-09-21T10:40:46.958 INFO:tasks.workunit.client.1.smithi112.stdout:2/392: dread d0/f2d [0,4194304] 0 2024-09-21T10:40:46.963 INFO:tasks.workunit.client.1.smithi112.stdout:2/393: write d0/f2d [1907770,41985] 0 2024-09-21T10:40:46.963 INFO:tasks.workunit.client.1.smithi112.stdout:2/394: write d0/d12/d1b/f1e [4309907,40119] 0 2024-09-21T10:40:46.963 INFO:tasks.workunit.client.1.smithi112.stdout:2/395: chown d0/dd/l48 122 1 2024-09-21T10:40:46.963 INFO:tasks.workunit.client.1.smithi112.stdout:2/396: readlink d0/l6e 0 2024-09-21T10:40:46.964 INFO:tasks.workunit.client.1.smithi112.stdout:1/555: mkdir d8/d54/db0/db1 0 2024-09-21T10:40:46.966 INFO:tasks.workunit.client.1.smithi112.stdout:4/455: creat de/d2a/d31/d8d/d9d/f9f x:0 0 0 2024-09-21T10:40:46.969 INFO:tasks.workunit.client.1.smithi112.stdout:4/456: dread de/d18/f26 [0,4194304] 0 2024-09-21T10:40:46.978 INFO:tasks.workunit.client.1.smithi112.stdout:6/443: rmdir d4/d6 39 2024-09-21T10:40:46.979 INFO:tasks.workunit.client.1.smithi112.stdout:6/444: dread d4/d4f/f66 [0,4194304] 0 2024-09-21T10:40:46.984 INFO:tasks.workunit.client.1.smithi112.stdout:1/556: stat d8/d1a/l4b 0 2024-09-21T10:40:46.984 INFO:tasks.workunit.client.1.smithi112.stdout:1/557: fsync d8/d20/fa7 0 2024-09-21T10:40:46.986 INFO:tasks.workunit.client.1.smithi112.stdout:7/410: truncate d7/d22/f2e 2754586 0 2024-09-21T10:40:46.989 INFO:tasks.workunit.client.1.smithi112.stdout:4/457: dwrite de/d18/d6d/d6e/f92 [0,4194304] 0 2024-09-21T10:40:46.989 INFO:tasks.workunit.client.1.smithi112.stdout:1/558: unlink d8/l1b 0 2024-09-21T10:40:46.992 INFO:tasks.workunit.client.1.smithi112.stdout:4/458: dread de/d18/f76 [0,4194304] 0 2024-09-21T10:40:46.992 INFO:tasks.workunit.client.1.smithi112.stdout:4/459: chown de/d18/d6d/d6e/d82/l84 0 1 2024-09-21T10:40:46.992 INFO:tasks.workunit.client.1.smithi112.stdout:6/445: dwrite f1 [0,4194304] 0 2024-09-21T10:40:46.995 INFO:tasks.workunit.client.1.smithi112.stdout:1/559: symlink d8/d45/dae/lb2 0 2024-09-21T10:40:46.998 INFO:tasks.workunit.client.1.smithi112.stdout:4/460: getdents de/d33/d6f/d9c 0 2024-09-21T10:40:47.003 INFO:tasks.workunit.client.1.smithi112.stdout:1/560: creat d8/d54/db0/fb3 x:0 0 0 2024-09-21T10:40:47.003 INFO:tasks.workunit.client.1.smithi112.stdout:1/561: readlink d8/l48 0 2024-09-21T10:40:47.006 INFO:tasks.workunit.client.1.smithi112.stdout:1/562: link d8/d20/f5f d8/d45/fb4 0 2024-09-21T10:40:47.007 INFO:tasks.workunit.client.1.smithi112.stdout:1/563: write d8/d1a/d53/f60 [216449,93485] 0 2024-09-21T10:40:47.009 INFO:tasks.workunit.client.1.smithi112.stdout:1/564: getdents d8/d1a/d31/d66 0 2024-09-21T10:40:47.011 INFO:tasks.workunit.client.1.smithi112.stdout:6/446: dwrite d4/dc/d1a/d31/d56/f7b [0,4194304] 0 2024-09-21T10:40:47.012 INFO:tasks.workunit.client.1.smithi112.stdout:6/447: readlink d4/d6/da/d11/d1f/d22/l6e 0 2024-09-21T10:40:47.012 INFO:tasks.workunit.client.1.smithi112.stdout:6/448: write d4/d6/da/f60 [4496733,70213] 0 2024-09-21T10:40:47.015 INFO:tasks.workunit.client.1.smithi112.stdout:4/461: dwrite f0 [4194304,4194304] 0 2024-09-21T10:40:47.020 INFO:tasks.workunit.client.1.smithi112.stdout:4/462: creat de/d2a/d31/d8d/fa0 x:0 0 0 2024-09-21T10:40:47.020 INFO:tasks.workunit.client.1.smithi112.stdout:4/463: chown de/d33/d6f/d9c/c43 1349963 1 2024-09-21T10:40:47.020 INFO:tasks.workunit.client.1.smithi112.stdout:4/464: read de/f24 [2575194,112646] 0 2024-09-21T10:40:47.026 INFO:tasks.workunit.client.1.smithi112.stdout:1/565: dwrite d8/d1a/d53/d57/f90 [0,4194304] 0 2024-09-21T10:40:47.028 INFO:tasks.workunit.client.1.smithi112.stdout:1/566: mkdir d8/d54/d6d/db5 0 2024-09-21T10:40:47.056 INFO:tasks.workunit.client.1.smithi112.stdout:1/567: dwrite d8/d1a/d31/f4e [0,4194304] 0 2024-09-21T10:40:47.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/411: dwrite d7/d22/f2e [0,4194304] 0 2024-09-21T10:40:47.060 INFO:tasks.workunit.client.1.smithi112.stdout:1/568: mknod d8/d7a/cb6 0 2024-09-21T10:40:47.068 INFO:tasks.workunit.client.1.smithi112.stdout:7/412: mkdir d7/d22/d41/d56/d72/d79/d8a 0 2024-09-21T10:40:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 -- 172.21.15.60:0/2456775727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fee10 msgr2=0x7f53600ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2456775727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fee10 0x7f53600ff270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f534c009880 tx=0x7f534c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 -- 172.21.15.60:0/2456775727 shutdown_connections 2024-09-21T10:40:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2456775727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fee10 0x7f53600ff270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2456775727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fe4d0 0x7f53600fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 -- 172.21.15.60:0/2456775727 >> 172.21.15.60:0/2456775727 conn(0x7f53600fa280 msgr2=0x7f53600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 -- 172.21.15.60:0/2456775727 shutdown_connections 2024-09-21T10:40:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.066+0000 7f5366f5f640 1 -- 172.21.15.60:0/2456775727 wait complete. 2024-09-21T10:40:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.067+0000 7f5366f5f640 1 Processor -- start 2024-09-21T10:40:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.067+0000 7f5366f5f640 1 -- start start 2024-09-21T10:40:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.067+0000 7f5366f5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 0x7f536019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.067+0000 7f5366f5f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fee10 0x7f536019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.067+0000 7f5366f5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536019c7f0 con 0x7f53600fe4d0 2024-09-21T10:40:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.067+0000 7f5366f5f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536019c960 con 0x7f53600fee10 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 0x7f536019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 0x7f536019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34394/0 (socket says 172.21.15.60:34394) 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 -- 172.21.15.60:0/2587113870 learned_addr learned my addr 172.21.15.60:0/2587113870 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 -- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fee10 msgr2=0x7f536019c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f535ffff640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fee10 0x7f536019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fee10 0x7f536019c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 -- 172.21.15.60:0/2587113870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009560 con 0x7f53600fe4d0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f535ffff640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fee10 0x7f536019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f5364cfb640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 0x7f536019bcb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f535400e970 tx=0x7f535400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.068+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535400cc90 con 0x7f53600fe4d0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.069+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f535400cdf0 con 0x7f53600fe4d0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.069+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5354018810 con 0x7f53600fe4d0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.069+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601a13a0 con 0x7f53600fe4d0 2024-09-21T10:40:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.069+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53601a18a0 con 0x7f53600fe4d0 2024-09-21T10:40:47.073 INFO:tasks.workunit.client.1.smithi112.stdout:1/569: rmdir d8/d20 39 2024-09-21T10:40:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.070+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360101df0 con 0x7f53600fe4d0 2024-09-21T10:40:47.074 INFO:tasks.workunit.client.1.smithi112.stdout:1/570: creat d8/d1a/d31/fb7 x:0 0 0 2024-09-21T10:40:47.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.072+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f5354010c10 con 0x7f53600fe4d0 2024-09-21T10:40:47.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.072+0000 7f535dffb640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f5350073ed0 0x7f5350076390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:47.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.073+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5354014070 con 0x7f53600fe4d0 2024-09-21T10:40:47.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.073+0000 7f535ffff640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f5350073ed0 0x7f5350076390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:47.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.073+0000 7f535ffff640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f5350073ed0 0x7f5350076390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f534c031540 tx=0x7f534c000bc0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:47.076 INFO:tasks.workunit.client.1.smithi112.stdout:1/571: mkdir d8/d1a/db8 0 2024-09-21T10:40:47.076 INFO:tasks.workunit.client.1.smithi112.stdout:1/572: fdatasync d8/d1a/d31/f4e 0 2024-09-21T10:40:47.078 INFO:tasks.workunit.client.1.smithi112.stdout:1/573: creat d8/d1a/db8/fb9 x:0 0 0 2024-09-21T10:40:47.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.080+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f5354059130 con 0x7f53600fe4d0 2024-09-21T10:40:47.082 INFO:tasks.workunit.client.1.smithi112.stdout:1/574: read d8/d54/fa6 [2871510,23012] 0 2024-09-21T10:40:47.082 INFO:tasks.workunit.client.1.smithi112.stdout:1/575: truncate d8/d1a/d31/d66/f82 1046785 0 2024-09-21T10:40:47.088 INFO:tasks.workunit.client.1.smithi112.stdout:1/576: dread d8/d20/f5b [0,4194304] 0 2024-09-21T10:40:47.101 INFO:tasks.workunit.client.1.smithi112.stdout:1/577: dwrite d8/d54/fa6 [0,4194304] 0 2024-09-21T10:40:47.103 INFO:tasks.workunit.client.1.smithi112.stdout:1/578: unlink d8/d54/f8c 0 2024-09-21T10:40:47.103 INFO:tasks.workunit.client.1.smithi112.stdout:1/579: write d8/f40 [797662,122354] 0 2024-09-21T10:40:47.103 INFO:tasks.workunit.client.1.smithi112.stdout:1/580: chown d8/f38 516559 1 2024-09-21T10:40:47.106 INFO:tasks.workunit.client.1.smithi112.stdout:8/414: sync 2024-09-21T10:40:47.107 INFO:tasks.workunit.client.1.smithi112.stdout:9/458: sync 2024-09-21T10:40:47.107 INFO:tasks.workunit.client.1.smithi112.stdout:3/396: sync 2024-09-21T10:40:47.107 INFO:tasks.workunit.client.1.smithi112.stdout:8/415: truncate d8/f63 4250531 0 2024-09-21T10:40:47.107 INFO:tasks.workunit.client.1.smithi112.stdout:9/459: write d1/d7f/f9b [5950453,37455] 0 2024-09-21T10:40:47.108 INFO:tasks.workunit.client.1.smithi112.stdout:3/397: truncate d2/f17 1014284 0 2024-09-21T10:40:47.111 INFO:tasks.workunit.client.1.smithi112.stdout:8/416: creat d8/d9/dd/d1a/f7f x:0 0 0 2024-09-21T10:40:47.111 INFO:tasks.workunit.client.1.smithi112.stdout:8/417: write d8/d9/dd/d2b/d31/f39 [786664,81770] 0 2024-09-21T10:40:47.111 INFO:tasks.workunit.client.1.smithi112.stdout:8/418: creat d8/d9/dd/d1a/f80 x:0 0 0 2024-09-21T10:40:47.111 INFO:tasks.workunit.client.1.smithi112.stdout:8/419: chown d8/d9/dd/d1a/f80 519235 1 2024-09-21T10:40:47.111 INFO:tasks.workunit.client.1.smithi112.stdout:9/460: mkdir d1/d2/d27/d3a/d6b/d30/d5e/d9f 0 2024-09-21T10:40:47.114 INFO:tasks.workunit.client.1.smithi112.stdout:8/420: creat d8/d9/dd/d2a/d43/d58/f81 x:0 0 0 2024-09-21T10:40:47.115 INFO:tasks.workunit.client.1.smithi112.stdout:9/461: unlink d1/d2/d27/d3a/l90 0 2024-09-21T10:40:47.116 INFO:tasks.workunit.client.1.smithi112.stdout:8/421: mkdir d8/d9/dd/d2a/d43/d58/d82 0 2024-09-21T10:40:47.118 INFO:tasks.workunit.client.1.smithi112.stdout:9/462: rename d1/d2/d27/d3a/d6b/d30/d5c/d92 to d1/d2/d27/d37/d3b/d69/d77/da0 0 2024-09-21T10:40:47.118 INFO:tasks.workunit.client.1.smithi112.stdout:9/463: read - d1/d2/d27/d3a/d6b/d30/f8b zero size 2024-09-21T10:40:47.118 INFO:tasks.workunit.client.1.smithi112.stdout:9/464: write d1/d2/d27/d37/d3b/d69/f8a [266388,15862] 0 2024-09-21T10:40:47.120 INFO:tasks.workunit.client.1.smithi112.stdout:9/465: mkdir d1/d2/d27/d62/da1 0 2024-09-21T10:40:47.120 INFO:tasks.workunit.client.1.smithi112.stdout:9/466: readlink d1/d2/l29 0 2024-09-21T10:40:47.125 INFO:tasks.workunit.client.1.smithi112.stdout:9/467: dread d1/d2/d27/d3a/d6b/f3c [0,4194304] 0 2024-09-21T10:40:47.125 INFO:tasks.workunit.client.1.smithi112.stdout:9/468: truncate d1/d2/f3e 5034152 0 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:1/581: dwrite d8/f15 [0,4194304] 0 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:1/582: dread - d8/d1a/fad zero size 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:1/583: read - d8/d1a/d53/d76/f7d zero size 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:1/584: creat d8/d7a/fba x:0 0 0 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:1/585: readlink d8/d1a/l84 0 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:3/398: dwrite d2/d2f/f53 [0,4194304] 0 2024-09-21T10:40:47.126 INFO:tasks.workunit.client.1.smithi112.stdout:3/399: chown d2/d22/d31/d2a/f3b 61 1 2024-09-21T10:40:47.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/586: dread d8/d54/f5d [0,4194304] 0 2024-09-21T10:40:47.129 INFO:tasks.workunit.client.1.smithi112.stdout:1/587: creat d8/d1a/d53/d76/fbb x:0 0 0 2024-09-21T10:40:47.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/422: dread d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:47.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/423: fsync d8/d9/d3c/f52 0 2024-09-21T10:40:47.135 INFO:tasks.workunit.client.1.smithi112.stdout:3/400: write d2/f19 [7492633,59418] 0 2024-09-21T10:40:47.135 INFO:tasks.workunit.client.1.smithi112.stdout:3/401: stat d2/d2f/f64 0 2024-09-21T10:40:47.149 INFO:tasks.workunit.client.1.smithi112.stdout:9/469: dwrite d1/d2/f60 [0,4194304] 0 2024-09-21T10:40:47.149 INFO:tasks.workunit.client.1.smithi112.stdout:9/470: truncate d1/f89 288726 0 2024-09-21T10:40:47.149 INFO:tasks.workunit.client.1.smithi112.stdout:1/588: mkdir d8/d1a/db8/dbc 0 2024-09-21T10:40:47.151 INFO:tasks.workunit.client.1.smithi112.stdout:3/402: mknod d2/d22/d31/d2a/d39/d3a/d76/c87 0 2024-09-21T10:40:47.151 INFO:tasks.workunit.client.1.smithi112.stdout:3/403: chown d2/d1f/f40 236663 1 2024-09-21T10:40:47.157 INFO:tasks.workunit.client.1.smithi112.stdout:9/471: dread d1/d2/d27/d37/d3b/f53 [0,4194304] 0 2024-09-21T10:40:47.157 INFO:tasks.workunit.client.1.smithi112.stdout:9/472: creat d1/d2/d27/d37/d3b/fa2 x:0 0 0 2024-09-21T10:40:47.164 INFO:tasks.workunit.client.1.smithi112.stdout:9/473: symlink d1/d2/d27/d62/la3 0 2024-09-21T10:40:47.164 INFO:tasks.workunit.client.1.smithi112.stdout:1/589: dwrite d8/d1a/d31/f7c [0,4194304] 0 2024-09-21T10:40:47.166 INFO:tasks.workunit.client.1.smithi112.stdout:3/404: rmdir d2/d2f/d3f 39 2024-09-21T10:40:47.166 INFO:tasks.workunit.client.1.smithi112.stdout:3/405: stat d2/d2f/l4d 0 2024-09-21T10:40:47.168 INFO:tasks.workunit.client.1.smithi112.stdout:9/474: mknod d1/d2/d27/d3a/d6b/d30/d5e/d9f/ca4 0 2024-09-21T10:40:47.168 INFO:tasks.workunit.client.1.smithi112.stdout:9/475: truncate d1/d2/d27/f44 2589090 0 2024-09-21T10:40:47.170 INFO:tasks.workunit.client.1.smithi112.stdout:1/590: link d8/l30 d8/d54/db0/lbd 0 2024-09-21T10:40:47.171 INFO:tasks.workunit.client.1.smithi112.stdout:3/406: symlink d2/d22/d31/d2a/d39/d60/l88 0 2024-09-21T10:40:47.172 INFO:tasks.workunit.client.1.smithi112.stdout:3/407: chown d2/d22/d31/l7f 236 1 2024-09-21T10:40:47.174 INFO:tasks.workunit.client.1.smithi112.stdout:9/476: mkdir d1/d2/d27/d3a/d6b/d30/da5 0 2024-09-21T10:40:47.183 INFO:tasks.workunit.client.1.smithi112.stdout:9/477: write d1/d2/d27/d3a/d6b/d30/d5e/f66 [3445720,109471] 0 2024-09-21T10:40:47.183 INFO:tasks.workunit.client.1.smithi112.stdout:9/478: dread - d1/d2/d27/d37/d3b/fa2 zero size 2024-09-21T10:40:47.194 INFO:tasks.workunit.client.1.smithi112.stdout:3/408: dwrite d2/d22/d31/d2a/d39/d3a/f5b [4194304,4194304] 0 2024-09-21T10:40:47.198 INFO:tasks.workunit.client.1.smithi112.stdout:9/479: dread d1/f36 [0,4194304] 0 2024-09-21T10:40:47.198 INFO:tasks.workunit.client.1.smithi112.stdout:1/591: dwrite d8/f63 [0,4194304] 0 2024-09-21T10:40:47.199 INFO:tasks.workunit.client.1.smithi112.stdout:9/480: readlink l0 0 2024-09-21T10:40:47.199 INFO:tasks.workunit.client.1.smithi112.stdout:9/481: chown d1/d2/d27/d3a/d6b/d30/d5e/c9d 18849383 1 2024-09-21T10:40:47.199 INFO:tasks.workunit.client.1.smithi112.stdout:9/482: chown d1/d2/l29 6 1 2024-09-21T10:40:47.199 INFO:tasks.workunit.client.1.smithi112.stdout:1/592: truncate d8/d1a/d31/d37/f5e 1403895 0 2024-09-21T10:40:47.199 INFO:tasks.workunit.client.1.smithi112.stdout:9/483: truncate d1/d2/d27/d3a/f56 4411168 0 2024-09-21T10:40:47.200 INFO:tasks.workunit.client.1.smithi112.stdout:3/409: rename d2/d22/f38 to d2/d2f/d3f/f89 0 2024-09-21T10:40:47.200 INFO:tasks.workunit.client.1.smithi112.stdout:3/410: write d2/d2f/f66 [772245,75733] 0 2024-09-21T10:40:47.202 INFO:tasks.workunit.client.1.smithi112.stdout:9/484: read d1/d2/d27/d3a/f56 [439949,109732] 0 2024-09-21T10:40:47.202 INFO:tasks.workunit.client.1.smithi112.stdout:3/411: dread d2/f17 [0,4194304] 0 2024-09-21T10:40:47.205 INFO:tasks.workunit.client.1.smithi112.stdout:1/593: dread d8/f1f [0,4194304] 0 2024-09-21T10:40:47.212 INFO:tasks.workunit.client.1.smithi112.stdout:1/594: dread d8/d1a/d31/f4e [0,4194304] 0 2024-09-21T10:40:47.218 INFO:tasks.workunit.client.1.smithi112.stdout:3/412: truncate d2/d22/d31/d37/f52 1090867 0 2024-09-21T10:40:47.218 INFO:tasks.workunit.client.1.smithi112.stdout:3/413: truncate d2/d22/d31/d2a/d39/d3a/f47 4623876 0 2024-09-21T10:40:47.225 INFO:tasks.workunit.client.1.smithi112.stdout:1/595: unlink d8/d45/fb4 0 2024-09-21T10:40:47.225 INFO:tasks.workunit.client.1.smithi112.stdout:1/596: write d8/d1a/d53/d76/fbb [777370,40534] 0 2024-09-21T10:40:47.227 INFO:tasks.workunit.client.1.smithi112.stdout:3/414: creat d2/d22/d31/d2a/d39/d60/f8a x:0 0 0 2024-09-21T10:40:47.230 INFO:tasks.workunit.client.1.smithi112.stdout:1/597: link d8/d1a/d31/d37/f77 d8/d1a/d31/da1/fbe 0 2024-09-21T10:40:47.230 INFO:tasks.workunit.client.1.smithi112.stdout:1/598: creat d8/d1a/d31/fbf x:0 0 0 2024-09-21T10:40:47.237 INFO:tasks.workunit.client.1.smithi112.stdout:1/599: creat d8/d1a/d31/d66/d87/fc0 x:0 0 0 2024-09-21T10:40:47.237 INFO:tasks.workunit.client.1.smithi112.stdout:1/600: write d8/d1a/d31/fb7 [460856,129347] 0 2024-09-21T10:40:47.241 INFO:tasks.workunit.client.1.smithi112.stdout:3/415: dwrite d2/f78 [0,4194304] 0 2024-09-21T10:40:47.248 INFO:tasks.workunit.client.1.smithi112.stdout:3/416: rename d2/d2f/d3f/f77 to d2/d22/d31/f8b 0 2024-09-21T10:40:47.251 INFO:tasks.workunit.client.1.smithi112.stdout:1/601: dwrite d8/d54/d6d/f86 [4194304,4194304] 0 2024-09-21T10:40:47.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/602: creat d8/d1a/d31/d66/fc1 x:0 0 0 2024-09-21T10:40:47.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/603: fdatasync d8/d54/d6d/f86 0 2024-09-21T10:40:47.259 INFO:tasks.workunit.client.1.smithi112.stdout:1/604: mkdir d8/d54/d6d/db5/dc2 0 2024-09-21T10:40:47.262 INFO:tasks.workunit.client.1.smithi112.stdout:3/417: dwrite d2/f78 [0,4194304] 0 2024-09-21T10:40:47.264 INFO:tasks.workunit.client.1.smithi112.stdout:3/418: link d2/d22/f5e d2/d1f/f8c 0 2024-09-21T10:40:47.274 INFO:tasks.workunit.client.1.smithi112.stdout:1/605: dwrite d8/d1a/d31/d37/f47 [4194304,4194304] 0 2024-09-21T10:40:47.274 INFO:tasks.workunit.client.1.smithi112.stdout:1/606: fdatasync d8/d1a/d31/d37/f5e 0 2024-09-21T10:40:47.274 INFO:tasks.workunit.client.1.smithi112.stdout:1/607: fdatasync d8/d1a/d53/d57/f90 0 2024-09-21T10:40:47.290 INFO:tasks.workunit.client.1.smithi112.stdout:1/608: dwrite d8/d1a/f3b [0,4194304] 0 2024-09-21T10:40:47.290 INFO:tasks.workunit.client.1.smithi112.stdout:1/609: chown d8/d1a/d53/f5c 5729623 1 2024-09-21T10:40:47.297 INFO:tasks.workunit.client.1.smithi112.stdout:1/610: read d8/d54/fa6 [3027861,117275] 0 2024-09-21T10:40:47.304 INFO:tasks.workunit.client.1.smithi112.stdout:1/611: getdents d8/d1a/d31/d37/d9e 0 2024-09-21T10:40:47.304 INFO:tasks.workunit.client.1.smithi112.stdout:1/612: write d8/d1a/d31/d66/d87/fc0 [865180,24192] 0 2024-09-21T10:40:47.304 INFO:tasks.workunit.client.1.smithi112.stdout:1/613: chown d8/d54/l75 0 1 2024-09-21T10:40:47.304 INFO:tasks.workunit.client.1.smithi112.stdout:1/614: write d8/d1a/d31/fb7 [970841,88404] 0 2024-09-21T10:40:47.307 INFO:tasks.workunit.client.1.smithi112.stdout:1/615: mkdir d8/d1a/d31/da1/dc3 0 2024-09-21T10:40:47.308 INFO:tasks.workunit.client.1.smithi112.stdout:1/616: creat d8/d1a/db8/fc4 x:0 0 0 2024-09-21T10:40:47.308 INFO:tasks.workunit.client.1.smithi112.stdout:1/617: chown d8/d1a/f67 7988374 1 2024-09-21T10:40:47.308 INFO:tasks.workunit.client.1.smithi112.stdout:1/618: readlink d8/d54/d6d/l9c 0 2024-09-21T10:40:47.313 INFO:tasks.workunit.client.1.smithi112.stdout:1/619: creat d8/d20/fc5 x:0 0 0 2024-09-21T10:40:47.313 INFO:tasks.workunit.client.1.smithi112.stdout:1/620: fdatasync d8/f40 0 2024-09-21T10:40:47.323 INFO:tasks.workunit.client.1.smithi112.stdout:1/621: write d8/f63 [2594337,44447] 0 2024-09-21T10:40:47.323 INFO:tasks.workunit.client.1.smithi112.stdout:1/622: chown d8/d1a 3101 1 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:0/487: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:5/462: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:4/465: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:2/397: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:0/488: chown d3/d4/d1a/d21/c40 94263 1 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:4/466: stat de/d33/d2f/d35/d4c/l83 0 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:7/413: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:5/463: fdatasync d9/d15/d18/d3a/d4b/f6f 0 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:5/464: read - d9/d15/d18/d3a/d4b/d71/f80 zero size 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:7/414: write d7/d22/d78/f7f [1622933,25184] 0 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:8/424: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:7/415: dread - d7/d22/d86/f7d zero size 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:6/449: sync 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:7/416: chown d7/d22/d41/d80 154284 1 2024-09-21T10:40:47.324 INFO:tasks.workunit.client.1.smithi112.stdout:7/417: write d7/d22/d47/f7e [4751941,48341] 0 2024-09-21T10:40:47.332 INFO:tasks.workunit.client.1.smithi112.stdout:5/465: link d9/d15/d1d/l79 d9/d15/d1d/l8b 0 2024-09-21T10:40:47.333 INFO:tasks.workunit.client.1.smithi112.stdout:1/623: write d8/d1a/d31/d37/f77 [7150208,115518] 0 2024-09-21T10:40:47.334 INFO:tasks.workunit.client.1.smithi112.stdout:1/624: chown d8/d1a/f2c 3216 1 2024-09-21T10:40:47.334 INFO:tasks.workunit.client.1.smithi112.stdout:8/425: unlink d8/d9/dd/d1a/f32 0 2024-09-21T10:40:47.343 INFO:tasks.workunit.client.1.smithi112.stdout:4/467: getdents de/d33/d6f 0 2024-09-21T10:40:47.344 INFO:tasks.workunit.client.1.smithi112.stdout:4/468: fdatasync f5 0 2024-09-21T10:40:47.344 INFO:tasks.workunit.client.1.smithi112.stdout:4/469: creat de/d33/d2f/d71/fa1 x:0 0 0 2024-09-21T10:40:47.344 INFO:tasks.workunit.client.1.smithi112.stdout:4/470: write de/d33/f30 [3573036,15919] 0 2024-09-21T10:40:47.346 INFO:tasks.workunit.client.1.smithi112.stdout:5/466: symlink d9/d15/d18/d20/d55/l8c 0 2024-09-21T10:40:47.348 INFO:tasks.workunit.client.1.smithi112.stdout:3/419: rmdir d2 39 2024-09-21T10:40:47.348 INFO:tasks.workunit.client.1.smithi112.stdout:3/420: write d2/d22/d31/d2a/d39/f7a [135471,35214] 0 2024-09-21T10:40:47.349 INFO:tasks.workunit.client.1.smithi112.stdout:8/426: symlink d8/d9/dd/d2a/l83 0 2024-09-21T10:40:47.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/471: read de/d18/f26 [7296149,86513] 0 2024-09-21T10:40:47.357 INFO:tasks.workunit.client.1.smithi112.stdout:8/427: mknod d8/d9/d3c/c84 0 2024-09-21T10:40:47.357 INFO:tasks.workunit.client.1.smithi112.stdout:4/472: creat de/d18/d6d/d6e/d82/fa2 x:0 0 0 2024-09-21T10:40:47.357 INFO:tasks.workunit.client.1.smithi112.stdout:8/428: truncate d8/f78 125645 0 2024-09-21T10:40:47.357 INFO:tasks.workunit.client.1.smithi112.stdout:4/473: write de/d33/d2f/d35/f78 [294146,80540] 0 2024-09-21T10:40:47.357 INFO:tasks.workunit.client.1.smithi112.stdout:4/474: stat de/d33/d2f/d71/d40/f88 0 2024-09-21T10:40:47.357 INFO:tasks.workunit.client.1.smithi112.stdout:4/475: write de/d2e/f48 [977626,30910] 0 2024-09-21T10:40:47.362 INFO:tasks.workunit.client.1.smithi112.stdout:8/429: rename d8/d9/dd/d2a/l83 to d8/d9/d3c/d6d/l85 0 2024-09-21T10:40:47.364 INFO:tasks.workunit.client.1.smithi112.stdout:0/489: dwrite d3/d18/f3b [0,4194304] 0 2024-09-21T10:40:47.365 INFO:tasks.workunit.client.1.smithi112.stdout:3/421: write d2/d22/d31/f36 [3129760,2284] 0 2024-09-21T10:40:47.365 INFO:tasks.workunit.client.1.smithi112.stdout:4/476: rename de/f4d to de/d33/d6f/d9c/d3e/d57/fa3 0 2024-09-21T10:40:47.368 INFO:tasks.workunit.client.1.smithi112.stdout:2/398: dwrite d0/dd/d49/f5a [0,4194304] 0 2024-09-21T10:40:47.371 INFO:tasks.workunit.client.1.smithi112.stdout:5/467: dwrite d9/d15/f63 [0,4194304] 0 2024-09-21T10:40:47.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/418: dwrite d7/d3d/f67 [0,4194304] 0 2024-09-21T10:40:47.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/419: read d7/d3d/f50 [782581,5075] 0 2024-09-21T10:40:47.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/420: chown d7/ca 28 1 2024-09-21T10:40:47.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/421: fdatasync d7/d22/f63 0 2024-09-21T10:40:47.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/422: fdatasync d7/d22/d47/f7e 0 2024-09-21T10:40:47.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/450: dwrite d4/d3e/f85 [0,4194304] 0 2024-09-21T10:40:47.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/451: write d4/d6/da/f47 [1385472,125954] 0 2024-09-21T10:40:47.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/452: fsync d4/d6/da/d14/d49/d73/f7f 0 2024-09-21T10:40:47.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/453: fsync d4/d3e/f4c 0 2024-09-21T10:40:47.374 INFO:tasks.workunit.client.1.smithi112.stdout:3/422: dread f0 [0,4194304] 0 2024-09-21T10:40:47.374 INFO:tasks.workunit.client.1.smithi112.stdout:0/490: mknod d3/d4/d10/d8b/c9b 0 2024-09-21T10:40:47.374 INFO:tasks.workunit.client.1.smithi112.stdout:0/491: fsync d3/d4/f13 0 2024-09-21T10:40:47.374 INFO:tasks.workunit.client.1.smithi112.stdout:0/492: dread - d3/d4/d1a/d21/d4f/f7e zero size 2024-09-21T10:40:47.377 INFO:tasks.workunit.client.1.smithi112.stdout:4/477: symlink de/d33/d2f/d35/d4c/d5c/la4 0 2024-09-21T10:40:47.377 INFO:tasks.workunit.client.1.smithi112.stdout:4/478: dread - de/d33/d6f/d9c/f49 zero size 2024-09-21T10:40:47.378 INFO:tasks.workunit.client.1.smithi112.stdout:8/430: getdents d8/d9/dd/d2a/d43/d58 0 2024-09-21T10:40:47.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/399: rename d0/dd/d49/d62/d63/f5f to d0/d12/d76/f82 0 2024-09-21T10:40:47.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/400: readlink d0/d12/d1b/l74 0 2024-09-21T10:40:47.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/401: creat d0/d12/d1b/d51/d57/f83 x:0 0 0 2024-09-21T10:40:47.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/402: chown d0/f2 28115 1 2024-09-21T10:40:47.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/403: creat d0/d12/d1b/d51/d57/f84 x:0 0 0 2024-09-21T10:40:47.392 INFO:tasks.workunit.client.1.smithi112.stdout:7/423: rmdir d7/d22/d41/d56/d72 39 2024-09-21T10:40:47.404 INFO:tasks.workunit.client.1.smithi112.stdout:2/404: dwrite d0/dd/d49/f5a [0,4194304] 0 2024-09-21T10:40:47.411 INFO:tasks.workunit.client.1.smithi112.stdout:6/454: mknod d4/d6/da/d11/d37/ca3 0 2024-09-21T10:40:47.412 INFO:tasks.workunit.client.1.smithi112.stdout:3/423: truncate d2/f19 7713777 0 2024-09-21T10:40:47.412 INFO:tasks.workunit.client.1.smithi112.stdout:3/424: stat d2/d1f/f4f 0 2024-09-21T10:40:47.415 INFO:tasks.workunit.client.1.smithi112.stdout:0/493: mknod d3/d18/d45/c9c 0 2024-09-21T10:40:47.416 INFO:tasks.workunit.client.1.smithi112.stdout:4/479: truncate f5 1143697 0 2024-09-21T10:40:47.416 INFO:tasks.workunit.client.1.smithi112.stdout:4/480: chown de/d33/d6f/d9c/c7f 66 1 2024-09-21T10:40:47.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.418+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f536002c550 con 0x7f5350073ed0 2024-09-21T10:40:47.426 INFO:tasks.workunit.client.1.smithi112.stdout:2/405: mknod d0/d12/d77/d78/c85 0 2024-09-21T10:40:47.429 INFO:tasks.workunit.client.1.smithi112.stdout:6/455: creat d4/d6/da/d14/d49/d73/fa4 x:0 0 0 2024-09-21T10:40:47.430 INFO:tasks.workunit.client.1.smithi112.stdout:6/456: fsync d4/dc/d7e/f83 0 2024-09-21T10:40:47.430 INFO:tasks.workunit.client.1.smithi112.stdout:6/457: write d4/d6/da/d11/d37/d19/f2e [2382658,98329] 0 2024-09-21T10:40:47.430 INFO:tasks.workunit.client.1.smithi112.stdout:6/458: write d4/d6/da/fb [52911,48156] 0 2024-09-21T10:40:47.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.428+0000 7f535dffb640 1 -- 172.21.15.60:0/2587113870 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f536002c550 con 0x7f5350073ed0 2024-09-21T10:40:47.431 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:40:47.431 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (6m) 0s ago 8m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:40:47.431 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (8m) 0s ago 8m 7780k - 18.2.4-871-g6a1bdf85 0adab276c97e 6a6a2a8801c8 2024-09-21T10:40:47.431 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (7m) 8s ago 7m 7411k - 18.2.4-871-g6a1bdf85 0adab276c97e 7163dd4d91a2 2024-09-21T10:40:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (8m) 0s ago 8m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:40:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (7m) 8s ago 7m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:40:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (6m) 0s ago 8m 83.5M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:40:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (2m) 0s ago 2m 185M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:40:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (2m) 0s ago 2m 13.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:40:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (2m) 8s ago 2m 15.2M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:40:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (2m) 8s ago 2m 17.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:40:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:9283,8765,8443 running (9m) 0s ago 9m 319M - 18.2.4-871-g6a1bdf85 0adab276c97e d9748f7fa031 2024-09-21T10:40:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (28s) 8s ago 7m 494M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f97064c83946 2024-09-21T10:40:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (10m) 0s ago 10m 52.8M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:40:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (7m) 8s ago 7m 39.5M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:40:47.433 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (8m) 0s ago 8m 17.0M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (7m) 8s ago 7m 15.0M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 0s ago 6m 126M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 0s ago 5m 138M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 0s ago 5m 120M 3948M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (4m) 8s ago 4m 150M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (4m) 8s ago 4m 130M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:40:47.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (4m) 8s ago 4m 132M 4970M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:40:47.435 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (6m) 0s ago 8m 60.3M - 2.43.0 a07b618ecd1d 9edc141eabb8 2024-09-21T10:40:47.435 INFO:tasks.workunit.client.1.smithi112.stdout:3/425: mkdir d2/d8d 0 2024-09-21T10:40:47.436 INFO:tasks.workunit.client.1.smithi112.stdout:3/426: truncate d2/d22/d31/d37/f52 1634579 0 2024-09-21T10:40:47.436 INFO:tasks.workunit.client.1.smithi112.stdout:0/494: link d3/d4/d43/l73 d3/d4/d1a/d21/d4f/l9d 0 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f5350073ed0 msgr2=0x7f5350076390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f5350073ed0 0x7f5350076390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f534c031540 tx=0x7f534c000bc0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 msgr2=0x7f536019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 0x7f536019bcb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f535400e970 tx=0x7f535400ee30 comp rx=0 tx=0).stop 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 shutdown_connections 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f5350073ed0 0x7f5350076390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53600fee10 0x7f536019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 --2- 172.21.15.60:0/2587113870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53600fe4d0 0x7f536019bcb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 >> 172.21.15.60:0/2587113870 conn(0x7f53600fa280 msgr2=0x7f5360106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 shutdown_connections 2024-09-21T10:40:47.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.431+0000 7f5366f5f640 1 -- 172.21.15.60:0/2587113870 wait complete. 2024-09-21T10:40:47.437 INFO:tasks.workunit.client.1.smithi112.stdout:4/481: mknod de/d33/d6f/ca5 0 2024-09-21T10:40:47.437 INFO:tasks.workunit.client.1.smithi112.stdout:4/482: stat de/l16 0 2024-09-21T10:40:47.437 INFO:tasks.workunit.client.1.smithi112.stdout:4/483: fdatasync de/d33/d6f/d9c/d3e/d57/f8e 0 2024-09-21T10:40:47.438 INFO:tasks.workunit.client.1.smithi112.stdout:2/406: mkdir d0/d12/d46/d86 0 2024-09-21T10:40:47.438 INFO:tasks.workunit.client.1.smithi112.stdout:2/407: write d0/d12/d1b/d51/d57/f37 [5065613,52485] 0 2024-09-21T10:40:47.442 INFO:tasks.workunit.client.1.smithi112.stdout:6/459: dwrite d4/d6/f40 [0,4194304] 0 2024-09-21T10:40:47.442 INFO:tasks.workunit.client.1.smithi112.stdout:6/460: stat d4/d6/d75/f98 0 2024-09-21T10:40:47.443 INFO:tasks.workunit.client.1.smithi112.stdout:3/427: getdents d2/d1f 0 2024-09-21T10:40:47.445 INFO:tasks.workunit.client.1.smithi112.stdout:0/495: unlink d3/d18/f75 0 2024-09-21T10:40:47.448 INFO:tasks.workunit.client.1.smithi112.stdout:2/408: creat d0/dd/d49/d62/f87 x:0 0 0 2024-09-21T10:40:47.448 INFO:tasks.workunit.client.1.smithi112.stdout:2/409: creat d0/dd/d49/d62/f88 x:0 0 0 2024-09-21T10:40:47.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/410: write d0/fe [849192,103169] 0 2024-09-21T10:40:47.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/411: chown d0/dd/f2e 44 1 2024-09-21T10:40:47.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/412: read d0/dd/d49/d62/d63/f17 [4750355,106922] 0 2024-09-21T10:40:47.457 INFO:tasks.workunit.client.1.smithi112.stdout:6/461: mkdir d4/d6/da/d11/d37/d8b/da0/da5 0 2024-09-21T10:40:47.460 INFO:tasks.workunit.client.1.smithi112.stdout:3/428: link d2/d22/d31/f8b d2/d22/d31/d2a/d39/d3a/d76/f8e 0 2024-09-21T10:40:47.460 INFO:tasks.workunit.client.1.smithi112.stdout:3/429: write d2/f51 [59895,103932] 0 2024-09-21T10:40:47.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/484: truncate de/d2e/f48 236958 0 2024-09-21T10:40:47.468 INFO:tasks.workunit.client.1.smithi112.stdout:2/413: rmdir d0/d12/d46 39 2024-09-21T10:40:47.472 INFO:tasks.workunit.client.1.smithi112.stdout:3/430: link d2/d22/d31/d37/f83 d2/d8d/f8f 0 2024-09-21T10:40:47.474 INFO:tasks.workunit.client.1.smithi112.stdout:6/462: dwrite d4/dc/d1a/d31/d56/d64/f48 [0,4194304] 0 2024-09-21T10:40:47.474 INFO:tasks.workunit.client.1.smithi112.stdout:6/463: fdatasync d4/d6/da/f6f 0 2024-09-21T10:40:47.476 INFO:tasks.workunit.client.1.smithi112.stdout:4/485: truncate de/d33/d6f/d9c/f7a 2964270 0 2024-09-21T10:40:47.476 INFO:tasks.workunit.client.1.smithi112.stdout:4/486: fsync de/d33/d2f/d71/d40/f88 0 2024-09-21T10:40:47.477 INFO:tasks.workunit.client.1.smithi112.stdout:2/414: mkdir d0/dd/d49/d62/d89 0 2024-09-21T10:40:47.480 INFO:tasks.workunit.client.1.smithi112.stdout:3/431: rename d2/d22/d31/d2a/d39/l45 to d2/d22/d31/d2a/d39/d3a/d76/l90 0 2024-09-21T10:40:47.480 INFO:tasks.workunit.client.1.smithi112.stdout:3/432: fsync d2/d22/d31/d2a/f85 0 2024-09-21T10:40:47.485 INFO:tasks.workunit.client.1.smithi112.stdout:4/487: write de/d33/d2f/d71/d40/d4f/f6b [1774424,44157] 0 2024-09-21T10:40:47.485 INFO:tasks.workunit.client.1.smithi112.stdout:4/488: dread - de/d33/d2f/d71/d40/f88 zero size 2024-09-21T10:40:47.491 INFO:tasks.workunit.client.1.smithi112.stdout:6/464: mknod d4/d6/ca6 0 2024-09-21T10:40:47.497 INFO:tasks.workunit.client.1.smithi112.stdout:4/489: creat de/d2a/fa6 x:0 0 0 2024-09-21T10:40:47.502 INFO:tasks.workunit.client.1.smithi112.stdout:6/465: link d4/d6/da/d14/d49/d73/f7f d4/d6/da/fa7 0 2024-09-21T10:40:47.504 INFO:tasks.workunit.client.1.smithi112.stdout:3/433: dwrite d2/d22/d31/d37/f82 [0,4194304] 0 2024-09-21T10:40:47.506 INFO:tasks.workunit.client.1.smithi112.stdout:0/496: rmdir d3/d18 39 2024-09-21T10:40:47.506 INFO:tasks.workunit.client.1.smithi112.stdout:0/497: write d3/d23/d7b/d7f/f82 [696942,57889] 0 2024-09-21T10:40:47.507 INFO:tasks.workunit.client.1.smithi112.stdout:0/498: dread d3/d23/f29 [0,4194304] 0 2024-09-21T10:40:47.507 INFO:tasks.workunit.client.1.smithi112.stdout:0/499: truncate d3/d4a/d4e/f63 1985684 0 2024-09-21T10:40:47.509 INFO:tasks.workunit.client.1.smithi112.stdout:6/466: creat d4/d6/da/d14/d49/d73/d74/fa8 x:0 0 0 2024-09-21T10:40:47.509 INFO:tasks.workunit.client.1.smithi112.stdout:6/467: readlink d4/dc/d67/l93 0 2024-09-21T10:40:47.518 INFO:tasks.workunit.client.1.smithi112.stdout:3/434: rename d2/c15 to d2/c91 0 2024-09-21T10:40:47.518 INFO:tasks.workunit.client.1.smithi112.stdout:3/435: chown d2/d22/d31/d2a/c50 1467145 1 2024-09-21T10:40:47.521 INFO:tasks.workunit.client.1.smithi112.stdout:6/468: mknod d4/d6/d75/ca9 0 2024-09-21T10:40:47.521 INFO:tasks.workunit.client.1.smithi112.stdout:0/500: dwrite d3/d4/d1a/d21/f4d [0,4194304] 0 2024-09-21T10:40:47.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/436: fdatasync d2/d2f/f64 0 2024-09-21T10:40:47.522 INFO:tasks.workunit.client.1.smithi112.stdout:3/437: chown d2/d22/d31/d2a/c50 355540 1 2024-09-21T10:40:47.522 INFO:tasks.workunit.client.1.smithi112.stdout:0/501: write d3/d4a/d4e/d72/d8e/f95 [493494,125750] 0 2024-09-21T10:40:47.522 INFO:tasks.workunit.client.1.smithi112.stdout:0/502: read - d3/d23/d7b/f91 zero size 2024-09-21T10:40:47.524 INFO:tasks.workunit.client.1.smithi112.stdout:6/469: mkdir d4/d6/da/d11/d1f/d22/daa 0 2024-09-21T10:40:47.527 INFO:tasks.workunit.client.1.smithi112.stdout:3/438: link d2/f78 d2/d1f/f92 0 2024-09-21T10:40:47.527 INFO:tasks.workunit.client.1.smithi112.stdout:3/439: read - d2/d22/f5e zero size 2024-09-21T10:40:47.529 INFO:tasks.workunit.client.1.smithi112.stdout:0/503: fdatasync d3/d4a/f96 0 2024-09-21T10:40:47.533 INFO:tasks.workunit.client.1.smithi112.stdout:9/485: sync 2024-09-21T10:40:47.536 INFO:tasks.workunit.client.1.smithi112.stdout:9/486: creat d1/d2/d27/d62/d70/fa6 x:0 0 0 2024-09-21T10:40:47.538 INFO:tasks.workunit.client.1.smithi112.stdout:9/487: mknod d1/d2/d27/d37/d3b/d69/ca7 0 2024-09-21T10:40:47.540 INFO:tasks.workunit.client.1.smithi112.stdout:2/415: rename d0/dd/d49 to d0/d12/d8a 0 2024-09-21T10:40:47.540 INFO:tasks.workunit.client.1.smithi112.stdout:6/470: write d4/dc/d1a/d31/d3c/f53 [328145,22931] 0 2024-09-21T10:40:47.541 INFO:tasks.workunit.client.1.smithi112.stdout:9/488: unlink d1/d2/d27/d3a/d6b/d30/f57 0 2024-09-21T10:40:47.543 INFO:tasks.workunit.client.1.smithi112.stdout:4/490: rename de/d33/d2f/d35/f78 to de/d2a/d31/d8d/d9d/fa7 0 2024-09-21T10:40:47.543 INFO:tasks.workunit.client.1.smithi112.stdout:4/491: chown de/d33/d2f/d35/d4c/d5c/l6c 11182 1 2024-09-21T10:40:47.543 INFO:tasks.workunit.client.1.smithi112.stdout:4/492: chown de/d18/d6d/f7e 7242544 1 2024-09-21T10:40:47.544 INFO:tasks.workunit.client.1.smithi112.stdout:1/625: sync 2024-09-21T10:40:47.544 INFO:tasks.workunit.client.1.smithi112.stdout:5/468: sync 2024-09-21T10:40:47.547 INFO:tasks.workunit.client.1.smithi112.stdout:2/416: creat d0/d12/d8a/d62/d63/f8b x:0 0 0 2024-09-21T10:40:47.547 INFO:tasks.workunit.client.1.smithi112.stdout:2/417: readlink d0/d12/d1b/d51/l79 0 2024-09-21T10:40:47.547 INFO:tasks.workunit.client.1.smithi112.stdout:2/418: read d0/d12/d1b/d51/d57/f37 [2007009,52356] 0 2024-09-21T10:40:47.549 INFO:tasks.workunit.client.1.smithi112.stdout:6/471: link f1 d4/d6/da/fab 0 2024-09-21T10:40:47.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/489: mknod d1/d2/d27/d37/d3b/d69/d77/da0/ca8 0 2024-09-21T10:40:47.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/490: chown d1/d2/d27/c47 16754 1 2024-09-21T10:40:47.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/491: fsync d1/d2/f79 0 2024-09-21T10:40:47.553 INFO:tasks.workunit.client.1.smithi112.stdout:9/492: read - d1/d2/d27/d3a/d6b/d30/f8b zero size 2024-09-21T10:40:47.555 INFO:tasks.workunit.client.1.smithi112.stdout:9/493: dread d1/d2/d27/d62/d70/f21 [0,4194304] 0 2024-09-21T10:40:47.556 INFO:tasks.workunit.client.1.smithi112.stdout:3/440: rename d2/d2f/d3f/f75 to d2/f93 0 2024-09-21T10:40:47.556 INFO:tasks.workunit.client.1.smithi112.stdout:3/441: chown d2/ff 143 1 2024-09-21T10:40:47.558 INFO:tasks.workunit.client.1.smithi112.stdout:1/626: creat d8/fc6 x:0 0 0 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 -- 172.21.15.60:0/695506908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 msgr2=0x7f670c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 --2- 172.21.15.60:0/695506908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c0fff90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0097e0 tx=0x7f66fc02a3f0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 -- 172.21.15.60:0/695506908 shutdown_connections 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 --2- 172.21.15.60:0/695506908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c100d90 0x7f670c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 --2- 172.21.15.60:0/695506908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c0fff90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 -- 172.21.15.60:0/695506908 >> 172.21.15.60:0/695506908 conn(0x7f670c0fb320 msgr2=0x7f670c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 -- 172.21.15.60:0/695506908 shutdown_connections 2024-09-21T10:40:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.558+0000 7f6710eeb640 1 -- 172.21.15.60:0/695506908 wait complete. 2024-09-21T10:40:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.559+0000 7f6710eeb640 1 Processor -- start 2024-09-21T10:40:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.559+0000 7f6710eeb640 1 -- start start 2024-09-21T10:40:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f6710eeb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f6710eeb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c100d90 0x7f670c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f6710eeb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c199260 con 0x7f670c100d90 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f6710eeb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c1993d0 con 0x7f670c0ffb90 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f670a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f670a59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:35862/0 (socket says 172.21.15.60:35862) 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f670a59c640 1 -- 172.21.15.60:0/3714581553 learned_addr learned my addr 172.21.15.60:0/3714581553 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f6709d9b640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c100d90 0x7f670c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f670a59c640 1 -- 172.21.15.60:0/3714581553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c100d90 msgr2=0x7f670c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f670a59c640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c100d90 0x7f670c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.560+0000 7f670a59c640 1 -- 172.21.15.60:0/3714581553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc009490 con 0x7f670c0ffb90 2024-09-21T10:40:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.561+0000 7f670a59c640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c074250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66fc000c00 tx=0x7f66fc004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:47.564 INFO:tasks.workunit.client.1.smithi112.stdout:5/469: unlink d9/f54 0 2024-09-21T10:40:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.561+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66fc0037c0 con 0x7f670c0ffb90 2024-09-21T10:40:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.561+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66fc003de0 con 0x7f670c0ffb90 2024-09-21T10:40:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.561+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c072de0 con 0x7f670c0ffb90 2024-09-21T10:40:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.561+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66fc031e10 con 0x7f670c0ffb90 2024-09-21T10:40:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.561+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c073210 con 0x7f670c0ffb90 2024-09-21T10:40:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.563+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c18f710 con 0x7f670c0ffb90 2024-09-21T10:40:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.564+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f66fc003920 con 0x7f670c0ffb90 2024-09-21T10:40:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.564+0000 7f66fb7fe640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f66f4073f70 0x7f66f4076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:47.567 INFO:tasks.workunit.client.1.smithi112.stdout:9/494: dread d1/f36 [0,4194304] 0 2024-09-21T10:40:47.567 INFO:tasks.workunit.client.1.smithi112.stdout:9/495: fsync d1/d2/d27/f5f 0 2024-09-21T10:40:47.567 INFO:tasks.workunit.client.1.smithi112.stdout:9/496: write d1/d2/d42/f45 [1130170,76573] 0 2024-09-21T10:40:47.567 INFO:tasks.workunit.client.1.smithi112.stdout:9/497: chown d1/d2/d27/d3a/d6b/d30/l65 4386 1 2024-09-21T10:40:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.565+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f66fc0b6ac0 con 0x7f670c0ffb90 2024-09-21T10:40:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.565+0000 7f6709d9b640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f66f4073f70 0x7f66f4076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.565+0000 7f6709d9b640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f66f4073f70 0x7f66f4076430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f670c073fd0 tx=0x7f6700009260 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:47.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/472: dwrite d4/d6/da/fb [4194304,4194304] 0 2024-09-21T10:40:47.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/473: readlink d4/d6/l28 0 2024-09-21T10:40:47.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/474: write d4/d6/da/d14/f27 [4505807,16928] 0 2024-09-21T10:40:47.569 INFO:tasks.workunit.client.1.smithi112.stdout:6/475: creat d4/d6/da/d14/d49/d73/fac x:0 0 0 2024-09-21T10:40:47.569 INFO:tasks.workunit.client.1.smithi112.stdout:2/419: mknod d0/d12/d1b/d51/d66/c8c 0 2024-09-21T10:40:47.569 INFO:tasks.workunit.client.1.smithi112.stdout:2/420: creat d0/d12/d1b/d51/f8d x:0 0 0 2024-09-21T10:40:47.569 INFO:tasks.workunit.client.1.smithi112.stdout:2/421: fdatasync d0/d12/d1b/f3c 0 2024-09-21T10:40:47.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.569+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f66fc0b8e60 con 0x7f670c0ffb90 2024-09-21T10:40:47.574 INFO:tasks.workunit.client.1.smithi112.stdout:2/422: dread d0/d12/d8a/f5a [0,4194304] 0 2024-09-21T10:40:47.581 INFO:tasks.workunit.client.1.smithi112.stdout:0/504: rename d3/f20 to d3/d4/d10/d8b/f9e 0 2024-09-21T10:40:47.583 INFO:tasks.workunit.client.1.smithi112.stdout:3/442: link d2/d2f/f53 d2/d2f/d3f/f94 0 2024-09-21T10:40:47.583 INFO:tasks.workunit.client.1.smithi112.stdout:3/443: fdatasync d2/d22/d31/f8b 0 2024-09-21T10:40:47.583 INFO:tasks.workunit.client.1.smithi112.stdout:3/444: read - d2/d22/f5e zero size 2024-09-21T10:40:47.584 INFO:tasks.workunit.client.1.smithi112.stdout:1/627: symlink d8/d54/db0/db1/lc7 0 2024-09-21T10:40:47.584 INFO:tasks.workunit.client.1.smithi112.stdout:1/628: fdatasync d8/d20/fc5 0 2024-09-21T10:40:47.587 INFO:tasks.workunit.client.1.smithi112.stdout:3/445: dread d2/f19 [4194304,4194304] 0 2024-09-21T10:40:47.590 INFO:tasks.workunit.client.1.smithi112.stdout:1/629: dread d8/f40 [0,4194304] 0 2024-09-21T10:40:47.590 INFO:tasks.workunit.client.1.smithi112.stdout:1/630: chown d8/d1a/d53/d57/c9d 1233884 1 2024-09-21T10:40:47.596 INFO:tasks.workunit.client.1.smithi112.stdout:2/423: getdents d0/d12/d76 0 2024-09-21T10:40:47.596 INFO:tasks.workunit.client.1.smithi112.stdout:2/424: write d0/fe [9266754,27206] 0 2024-09-21T10:40:47.597 INFO:tasks.workunit.client.1.smithi112.stdout:1/631: dread d8/d20/f4a [0,4194304] 0 2024-09-21T10:40:47.600 INFO:tasks.workunit.client.1.smithi112.stdout:9/498: rename d1/d2/d27/d3a/d6b/d30/d5c/d7c/c7e to d1/d2/d42/ca9 0 2024-09-21T10:40:47.600 INFO:tasks.workunit.client.1.smithi112.stdout:9/499: chown d1/d2/d27/d3a/c4b 176 1 2024-09-21T10:40:47.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/446: dwrite d2/d22/d31/d2a/d39/f81 [4194304,4194304] 0 2024-09-21T10:40:47.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/470: getdents d9/d15/d1d 0 2024-09-21T10:40:47.608 INFO:tasks.workunit.client.1.smithi112.stdout:1/632: symlink d8/d1a/lc8 0 2024-09-21T10:40:47.608 INFO:tasks.workunit.client.1.smithi112.stdout:2/425: dread d0/d12/d8a/f3f [0,4194304] 0 2024-09-21T10:40:47.608 INFO:tasks.workunit.client.1.smithi112.stdout:2/426: truncate d0/f2a 514953 0 2024-09-21T10:40:47.609 INFO:tasks.workunit.client.1.smithi112.stdout:7/424: sync 2024-09-21T10:40:47.609 INFO:tasks.workunit.client.1.smithi112.stdout:8/431: sync 2024-09-21T10:40:47.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/476: rename d4/d6/f40 to d4/d6/da/d14/d49/fad 0 2024-09-21T10:40:47.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/477: chown d4/d6/da/d14/d49/fad 478486 1 2024-09-21T10:40:47.615 INFO:tasks.workunit.client.1.smithi112.stdout:6/478: stat d4/d6/da/d11/d37/f5e 0 2024-09-21T10:40:47.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/500: truncate d1/d2/d27/d3a/f2d 963745 0 2024-09-21T10:40:47.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/501: fsync d1/d2/d42/f45 0 2024-09-21T10:40:47.620 INFO:tasks.workunit.client.1.smithi112.stdout:0/505: dwrite d3/d4a/f6a [4194304,4194304] 0 2024-09-21T10:40:47.620 INFO:tasks.workunit.client.1.smithi112.stdout:0/506: truncate d3/d4a/d4e/f63 2819401 0 2024-09-21T10:40:47.620 INFO:tasks.workunit.client.1.smithi112.stdout:5/471: chown d9/d15/f16 973279151 1 2024-09-21T10:40:47.621 INFO:tasks.workunit.client.1.smithi112.stdout:9/502: dread d1/d2/d27/f3d [0,4194304] 0 2024-09-21T10:40:47.624 INFO:tasks.workunit.client.1.smithi112.stdout:1/633: creat d8/d1a/d53/fc9 x:0 0 0 2024-09-21T10:40:47.627 INFO:tasks.workunit.client.1.smithi112.stdout:2/427: creat d0/d12/d1b/d51/d66/f8e x:0 0 0 2024-09-21T10:40:47.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/447: dwrite d2/f17 [0,4194304] 0 2024-09-21T10:40:47.629 INFO:tasks.workunit.client.1.smithi112.stdout:3/448: chown d2/d2f/d3f/c69 175320682 1 2024-09-21T10:40:47.631 INFO:tasks.workunit.client.1.smithi112.stdout:8/432: unlink d8/d9/dd/d2b/d31/f41 0 2024-09-21T10:40:47.631 INFO:tasks.workunit.client.1.smithi112.stdout:9/503: write d1/d2/d27/d37/f59 [3701371,112008] 0 2024-09-21T10:40:47.637 INFO:tasks.workunit.client.1.smithi112.stdout:6/479: creat d4/d6/da/d11/d37/d19/fae x:0 0 0 2024-09-21T10:40:47.647 INFO:tasks.workunit.client.1.smithi112.stdout:8/433: dwrite d8/d18/f27 [0,4194304] 0 2024-09-21T10:40:47.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/634: dwrite d8/d1a/d31/da1/fbe [0,4194304] 0 2024-09-21T10:40:47.647 INFO:tasks.workunit.client.1.smithi112.stdout:8/434: readlink d8/l11 0 2024-09-21T10:40:47.647 INFO:tasks.workunit.client.1.smithi112.stdout:1/635: write d8/d1a/d31/d37/f81 [5051108,108803] 0 2024-09-21T10:40:47.647 INFO:tasks.workunit.client.1.smithi112.stdout:0/507: mknod d3/d4/c9f 0 2024-09-21T10:40:47.649 INFO:tasks.workunit.client.1.smithi112.stdout:5/472: mkdir d9/d15/d18/d3a/d4b/d74/d8d 0 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/435: mkdir d8/d9/dd/d2b/d31/d46/d86 0 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/436: fsync d8/d18/f1c 0 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/437: read - d8/d9/dd/d2a/f77 zero size 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/438: dread - d8/d9/dd/d1a/f7f zero size 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/439: write d8/d9/dd/d2a/d43/f7c [938492,34321] 0 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/440: read d8/fc [251020,75516] 0 2024-09-21T10:40:47.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/441: chown d8/d9/dd/d1a/f72 1 1 2024-09-21T10:40:47.660 INFO:tasks.workunit.client.1.smithi112.stdout:1/636: creat d8/d54/fca x:0 0 0 2024-09-21T10:40:47.662 INFO:tasks.workunit.client.1.smithi112.stdout:0/508: mkdir d3/d4a/d4e/d72/da0 0 2024-09-21T10:40:47.664 INFO:tasks.workunit.client.1.smithi112.stdout:5/473: link d9/d15/f63 d9/d6e/f8e 0 2024-09-21T10:40:47.664 INFO:tasks.workunit.client.1.smithi112.stdout:5/474: readlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:47.674 INFO:tasks.workunit.client.1.smithi112.stdout:8/442: unlink d8/d9/dd/f1d 0 2024-09-21T10:40:47.677 INFO:tasks.workunit.client.1.smithi112.stdout:1/637: creat d8/d1a/d53/d57/fcb x:0 0 0 2024-09-21T10:40:47.680 INFO:tasks.workunit.client.1.smithi112.stdout:0/509: creat d3/d23/d7b/d7f/fa1 x:0 0 0 2024-09-21T10:40:47.684 INFO:tasks.workunit.client.1.smithi112.stdout:5/475: dwrite d9/fe [0,4194304] 0 2024-09-21T10:40:47.685 INFO:tasks.workunit.client.1.smithi112.stdout:8/443: creat d8/d9/dd/d2a/d43/d58/d82/f87 x:0 0 0 2024-09-21T10:40:47.692 INFO:tasks.workunit.client.1.smithi112.stdout:0/510: dread d3/d4/d10/d8b/f9e [0,4194304] 0 2024-09-21T10:40:47.696 INFO:tasks.workunit.client.1.smithi112.stdout:5/476: mkdir d9/d15/d18/d3a/d61/d62/d6b/d8f 0 2024-09-21T10:40:47.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:47 smithi060 ceph-mon[28215]: pgmap v10: 65 pgs: 65 active+clean; 723 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 54 MiB/s rd, 78 MiB/s wr, 653 op/s 2024-09-21T10:40:47.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:47 smithi060 ceph-mon[28215]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:47.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:47 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:47.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:47 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:47 smithi112 ceph-mon[35117]: pgmap v10: 65 pgs: 65 active+clean; 723 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 54 MiB/s rd, 78 MiB/s wr, 653 op/s 2024-09-21T10:40:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:47 smithi112 ceph-mon[35117]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:47 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:47 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:47.708 INFO:tasks.workunit.client.1.smithi112.stdout:0/511: unlink d3/d4/d10/d8b/f9e 0 2024-09-21T10:40:47.709 INFO:tasks.workunit.client.1.smithi112.stdout:5/477: creat d9/d15/d18/d3a/d4b/d74/d8d/f90 x:0 0 0 2024-09-21T10:40:47.709 INFO:tasks.workunit.client.1.smithi112.stdout:5/478: readlink d9/l65 0 2024-09-21T10:40:47.714 INFO:tasks.workunit.client.1.smithi112.stdout:8/444: dwrite d8/d9/d3c/f5c [0,4194304] 0 2024-09-21T10:40:47.715 INFO:tasks.workunit.client.1.smithi112.stdout:2/428: rename d0/d12/d1b to d0/d12/d6c/d7e/d8f 0 2024-09-21T10:40:47.720 INFO:tasks.workunit.client.1.smithi112.stdout:5/479: write d9/d15/d1d/f21 [1330995,84071] 0 2024-09-21T10:40:47.734 INFO:tasks.workunit.client.1.smithi112.stdout:0/512: unlink d3/d4/c4b 0 2024-09-21T10:40:47.734 INFO:tasks.workunit.client.1.smithi112.stdout:5/480: dwrite d9/f1e [0,4194304] 0 2024-09-21T10:40:47.740 INFO:tasks.workunit.client.1.smithi112.stdout:8/445: symlink d8/d9/dd/d2a/d43/d58/d82/l88 0 2024-09-21T10:40:47.740 INFO:tasks.workunit.client.1.smithi112.stdout:8/446: dread - d8/d9/dd/d2b/d31/d46/f48 zero size 2024-09-21T10:40:47.740 INFO:tasks.workunit.client.1.smithi112.stdout:8/447: truncate d8/d9/dd/d1a/f7f 849025 0 2024-09-21T10:40:47.742 INFO:tasks.workunit.client.1.smithi112.stdout:9/504: rename d1/d2/d27/d37/l9c to d1/d2/laa 0 2024-09-21T10:40:47.742 INFO:tasks.workunit.client.1.smithi112.stdout:9/505: fdatasync d1/d2/d27/d3a/d6b/f1f 0 2024-09-21T10:40:47.744 INFO:tasks.workunit.client.1.smithi112.stdout:2/429: link d0/dd/d47/f58 d0/f90 0 2024-09-21T10:40:47.751 INFO:tasks.workunit.client.1.smithi112.stdout:8/448: unlink d8/d18/f27 0 2024-09-21T10:40:47.752 INFO:tasks.workunit.client.1.smithi112.stdout:6/480: rename d4/dc/d1a/d31/d56/f79 to d4/d4f/faf 0 2024-09-21T10:40:47.752 INFO:tasks.workunit.client.1.smithi112.stdout:6/481: truncate d4/dc/d1a/d31/d56/f9a 746952 0 2024-09-21T10:40:47.752 INFO:tasks.workunit.client.1.smithi112.stdout:6/482: dread - d4/d4f/f8c zero size 2024-09-21T10:40:47.755 INFO:tasks.workunit.client.1.smithi112.stdout:9/506: link d1/d2/d27/d37/d3b/d69/c8e d1/d2/d27/d3a/d6b/d30/d5c/cab 0 2024-09-21T10:40:47.755 INFO:tasks.workunit.client.1.smithi112.stdout:9/507: creat d1/d2/d27/d3a/d6b/fac x:0 0 0 2024-09-21T10:40:47.755 INFO:tasks.workunit.client.1.smithi112.stdout:9/508: truncate d1/d2/d27/d62/d70/fa6 109591 0 2024-09-21T10:40:47.755 INFO:tasks.workunit.client.1.smithi112.stdout:9/509: creat d1/d2/d27/d37/d3b/fad x:0 0 0 2024-09-21T10:40:47.756 INFO:tasks.workunit.client.1.smithi112.stdout:2/430: truncate d0/dd/d47/f50 1401590 0 2024-09-21T10:40:47.758 INFO:tasks.workunit.client.1.smithi112.stdout:5/481: rename d9/f1e to d9/d6e/f91 0 2024-09-21T10:40:47.759 INFO:tasks.workunit.client.1.smithi112.stdout:5/482: dread d9/d15/d18/d20/f60 [0,4194304] 0 2024-09-21T10:40:47.765 INFO:tasks.workunit.client.1.smithi112.stdout:9/510: mkdir d1/d2/d27/d3a/d6b/d30/d5e/d9f/dae 0 2024-09-21T10:40:47.765 INFO:tasks.workunit.client.1.smithi112.stdout:9/511: chown d1/d2/d27/d62/d70/fa6 426225 1 2024-09-21T10:40:47.765 INFO:tasks.workunit.client.1.smithi112.stdout:9/512: dread - d1/d2/d27/d37/d3b/f78 zero size 2024-09-21T10:40:47.765 INFO:tasks.workunit.client.1.smithi112.stdout:9/513: write d1/d2/d27/d3a/f71 [4346660,56940] 0 2024-09-21T10:40:47.765 INFO:tasks.workunit.client.1.smithi112.stdout:6/483: write f1 [1053740,119302] 0 2024-09-21T10:40:47.766 INFO:tasks.workunit.client.1.smithi112.stdout:2/431: creat d0/d12/d76/f91 x:0 0 0 2024-09-21T10:40:47.766 INFO:tasks.workunit.client.1.smithi112.stdout:2/432: readlink d0/d12/d6c/d7e/d8f/d51/d66/l7c 0 2024-09-21T10:40:47.766 INFO:tasks.workunit.client.1.smithi112.stdout:2/433: chown d0/d12/d6c/d7e/d8f/d51/d57/f40 1469385504 1 2024-09-21T10:40:47.766 INFO:tasks.workunit.client.1.smithi112.stdout:2/434: fdatasync d0/d12/d6c/d7e/d8f/d51/d66/f8e 0 2024-09-21T10:40:47.768 INFO:tasks.workunit.client.1.smithi112.stdout:5/483: read d9/f1c [612402,32761] 0 2024-09-21T10:40:47.769 INFO:tasks.workunit.client.1.smithi112.stdout:2/435: creat d0/d12/d8a/d62/d89/f92 x:0 0 0 2024-09-21T10:40:47.769 INFO:tasks.workunit.client.1.smithi112.stdout:2/436: chown d0/dd/f6a 3278229 1 2024-09-21T10:40:47.771 INFO:tasks.workunit.client.1.smithi112.stdout:8/449: dwrite d8/d9/dd/d1a/f7f [0,4194304] 0 2024-09-21T10:40:47.771 INFO:tasks.workunit.client.1.smithi112.stdout:8/450: dread - d8/d9/d3c/f50 zero size 2024-09-21T10:40:47.771 INFO:tasks.workunit.client.1.smithi112.stdout:0/513: dwrite d3/d4/d10/f35 [0,4194304] 0 2024-09-21T10:40:47.772 INFO:tasks.workunit.client.1.smithi112.stdout:5/484: symlink d9/d15/d18/d20/d55/l92 0 2024-09-21T10:40:47.772 INFO:tasks.workunit.client.1.smithi112.stdout:5/485: chown d9/d15/d1d/f4d 7 1 2024-09-21T10:40:47.780 INFO:tasks.workunit.client.1.smithi112.stdout:9/514: write d1/f43 [3058207,35786] 0 2024-09-21T10:40:47.780 INFO:tasks.workunit.client.1.smithi112.stdout:9/515: read d1/d2/d27/d3a/d6b/f3c [1071557,1309] 0 2024-09-21T10:40:47.780 INFO:tasks.workunit.client.1.smithi112.stdout:9/516: fsync d1/d2/d27/d3a/d6b/f97 0 2024-09-21T10:40:47.780 INFO:tasks.workunit.client.1.smithi112.stdout:9/517: chown d1/d2/d27/d37/d3b/d69/f94 43816321 1 2024-09-21T10:40:47.789 INFO:tasks.workunit.client.1.smithi112.stdout:0/514: creat d3/d4a/d4e/d72/da0/fa2 x:0 0 0 2024-09-21T10:40:47.789 INFO:tasks.workunit.client.1.smithi112.stdout:0/515: fsync d3/f2b 0 2024-09-21T10:40:47.793 INFO:tasks.workunit.client.1.smithi112.stdout:9/518: getdents d1/d2/d27/d37/d3b/d69/d88 0 2024-09-21T10:40:47.793 INFO:tasks.workunit.client.1.smithi112.stdout:9/519: readlink d1/d2/l6f 0 2024-09-21T10:40:47.795 INFO:tasks.workunit.client.1.smithi112.stdout:0/516: rename d3/d4/d10/c11 to d3/d4a/d4e/d72/da0/ca3 0 2024-09-21T10:40:47.795 INFO:tasks.workunit.client.1.smithi112.stdout:0/517: dread - d3/d18/d52/f77 zero size 2024-09-21T10:40:47.795 INFO:tasks.workunit.client.1.smithi112.stdout:0/518: chown d3/d18/c3d 185 1 2024-09-21T10:40:47.797 INFO:tasks.workunit.client.1.smithi112.stdout:9/520: symlink d1/d2/d27/d3a/d6b/laf 0 2024-09-21T10:40:47.800 INFO:tasks.workunit.client.1.smithi112.stdout:9/521: symlink d1/d2/d27/d37/d3b/lb0 0 2024-09-21T10:40:47.800 INFO:tasks.workunit.client.1.smithi112.stdout:9/522: fsync d1/d2/f3e 0 2024-09-21T10:40:47.802 INFO:tasks.workunit.client.1.smithi112.stdout:9/523: creat d1/d2/d27/d3a/d6b/d30/d5c/d7c/fb1 x:0 0 0 2024-09-21T10:40:47.803 INFO:tasks.workunit.client.1.smithi112.stdout:9/524: chown d1/f36 6 1 2024-09-21T10:40:47.803 INFO:tasks.workunit.client.1.smithi112.stdout:0/519: write d3/d4/f1d [3058879,5265] 0 2024-09-21T10:40:47.804 INFO:tasks.workunit.client.1.smithi112.stdout:0/520: write d3/d23/d7b/d7f/f82 [149111,58344] 0 2024-09-21T10:40:47.807 INFO:tasks.workunit.client.1.smithi112.stdout:9/525: getdents d1/d2/d42 0 2024-09-21T10:40:47.811 INFO:tasks.workunit.client.1.smithi112.stdout:0/521: rename d3/d4/d1a/d21/l7c to d3/d18/d52/la4 0 2024-09-21T10:40:47.813 INFO:tasks.workunit.client.1.smithi112.stdout:9/526: creat d1/d2/d27/d3a/d6b/d30/d5e/d9f/dae/fb2 x:0 0 0 2024-09-21T10:40:47.815 INFO:tasks.workunit.client.1.smithi112.stdout:2/437: dwrite d0/f1d [0,4194304] 0 2024-09-21T10:40:47.815 INFO:tasks.workunit.client.1.smithi112.stdout:8/451: dwrite d8/d9/dd/d2b/d31/d46/f48 [0,4194304] 0 2024-09-21T10:40:47.816 INFO:tasks.workunit.client.1.smithi112.stdout:0/522: symlink d3/d23/la5 0 2024-09-21T10:40:47.816 INFO:tasks.workunit.client.1.smithi112.stdout:6/484: dwrite d4/dc/d1a/d31/d56/d64/f94 [0,4194304] 0 2024-09-21T10:40:47.816 INFO:tasks.workunit.client.1.smithi112.stdout:6/485: creat d4/d6/da/d11/d37/d19/fb0 x:0 0 0 2024-09-21T10:40:47.816 INFO:tasks.workunit.client.1.smithi112.stdout:5/486: dwrite d9/d15/d18/d3a/d61/d62/f86 [0,4194304] 0 2024-09-21T10:40:47.816 INFO:tasks.workunit.client.1.smithi112.stdout:5/487: chown d9/d15/d18/d20/d55/c5e 120232 1 2024-09-21T10:40:47.820 INFO:tasks.workunit.client.1.smithi112.stdout:4/493: sync 2024-09-21T10:40:47.820 INFO:tasks.workunit.client.1.smithi112.stdout:4/494: write de/d33/d2f/d35/d4c/f97 [762588,41812] 0 2024-09-21T10:40:47.825 INFO:tasks.workunit.client.1.smithi112.stdout:5/488: read d9/d6e/f91 [942125,54145] 0 2024-09-21T10:40:47.829 INFO:tasks.workunit.client.1.smithi112.stdout:6/486: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:47.831 INFO:tasks.workunit.client.1.smithi112.stdout:8/452: unlink d8/le 0 2024-09-21T10:40:47.839 INFO:tasks.workunit.client.1.smithi112.stdout:9/527: dwrite d1/d2/d27/d3a/f71 [4194304,4194304] 0 2024-09-21T10:40:47.839 INFO:tasks.workunit.client.1.smithi112.stdout:0/523: dwrite d3/d4/d10/d8b/f9a [0,4194304] 0 2024-09-21T10:40:47.839 INFO:tasks.workunit.client.1.smithi112.stdout:0/524: write d3/d23/d7b/d7f/fa1 [923388,66909] 0 2024-09-21T10:40:47.840 INFO:tasks.workunit.client.1.smithi112.stdout:8/453: write d8/d9/d3c/f52 [2177385,90506] 0 2024-09-21T10:40:47.841 INFO:tasks.workunit.client.1.smithi112.stdout:8/454: chown d8/d9/dd/f2f 25141181 1 2024-09-21T10:40:47.841 INFO:tasks.workunit.client.1.smithi112.stdout:8/455: dread - d8/d9/dd/d2a/d43/f6f zero size 2024-09-21T10:40:47.846 INFO:tasks.workunit.client.1.smithi112.stdout:5/489: unlink d9/d15/d18/d3a/d61/d62/f86 0 2024-09-21T10:40:47.847 INFO:tasks.workunit.client.1.smithi112.stdout:5/490: stat d9/d15/d18/f29 0 2024-09-21T10:40:47.848 INFO:tasks.workunit.client.1.smithi112.stdout:0/525: dread d3/d18/f80 [0,4194304] 0 2024-09-21T10:40:47.849 INFO:tasks.workunit.client.1.smithi112.stdout:6/487: mknod d4/dc/d67/cb1 0 2024-09-21T10:40:47.860 INFO:tasks.workunit.client.1.smithi112.stdout:2/438: getdents d0/d12/d8a/d62/d89 0 2024-09-21T10:40:47.861 INFO:tasks.workunit.client.1.smithi112.stdout:9/528: symlink d1/d2/d27/d37/d3b/d69/d73/lb3 0 2024-09-21T10:40:47.861 INFO:tasks.workunit.client.1.smithi112.stdout:9/529: write d1/f1b [111400,59076] 0 2024-09-21T10:40:47.867 INFO:tasks.workunit.client.1.smithi112.stdout:8/456: rename d8/d18/f23 to d8/d9/d3c/d57/f89 0 2024-09-21T10:40:47.869 INFO:tasks.workunit.client.1.smithi112.stdout:5/491: unlink d9/d15/d18/d3a/l3b 0 2024-09-21T10:40:47.871 INFO:tasks.workunit.client.1.smithi112.stdout:0/526: link d3/d4/lf d3/d18/la6 0 2024-09-21T10:40:47.871 INFO:tasks.workunit.client.1.smithi112.stdout:1/638: sync 2024-09-21T10:40:47.871 INFO:tasks.workunit.client.1.smithi112.stdout:3/449: sync 2024-09-21T10:40:47.871 INFO:tasks.workunit.client.1.smithi112.stdout:7/425: sync 2024-09-21T10:40:47.873 INFO:tasks.workunit.client.1.smithi112.stdout:6/488: link d4/d6/c29 d4/dc/d1a/cb2 0 2024-09-21T10:40:47.875 INFO:tasks.workunit.client.1.smithi112.stdout:2/439: creat d0/d12/d46/f93 x:0 0 0 2024-09-21T10:40:47.875 INFO:tasks.workunit.client.1.smithi112.stdout:2/440: creat d0/d12/d76/f94 x:0 0 0 2024-09-21T10:40:47.875 INFO:tasks.workunit.client.1.smithi112.stdout:8/457: dread d8/d9/dd/d2b/d31/d46/f48 [0,4194304] 0 2024-09-21T10:40:47.875 INFO:tasks.workunit.client.1.smithi112.stdout:8/458: fdatasync d8/d9/dd/f2f 0 2024-09-21T10:40:47.875 INFO:tasks.workunit.client.1.smithi112.stdout:8/459: chown d8/d18/f1c 115308 1 2024-09-21T10:40:47.876 INFO:tasks.workunit.client.1.smithi112.stdout:9/530: symlink d1/d2/d27/d37/d3b/lb4 0 2024-09-21T10:40:47.880 INFO:tasks.workunit.client.1.smithi112.stdout:5/492: truncate d9/d15/d18/d3a/d4b/f52 2308395 0 2024-09-21T10:40:47.880 INFO:tasks.workunit.client.1.smithi112.stdout:5/493: read - d9/d15/d18/d3a/d4b/f6f zero size 2024-09-21T10:40:47.880 INFO:tasks.workunit.client.1.smithi112.stdout:1/639: dread d8/d20/f32 [0,4194304] 0 2024-09-21T10:40:47.882 INFO:tasks.workunit.client.1.smithi112.stdout:0/527: rmdir d3/d23/d7b 39 2024-09-21T10:40:47.883 INFO:tasks.workunit.client.1.smithi112.stdout:3/450: rmdir d2/d22/d31/d2a 39 2024-09-21T10:40:47.885 INFO:tasks.workunit.client.1.smithi112.stdout:7/426: creat d7/d22/d41/d56/d72/f8b x:0 0 0 2024-09-21T10:40:47.887 INFO:tasks.workunit.client.1.smithi112.stdout:6/489: creat d4/d6/d75/d7a/fb3 x:0 0 0 2024-09-21T10:40:47.890 INFO:tasks.workunit.client.1.smithi112.stdout:2/441: mkdir d0/d12/d46/d95 0 2024-09-21T10:40:47.890 INFO:tasks.workunit.client.1.smithi112.stdout:2/442: write d0/d12/d76/f94 [588336,38338] 0 2024-09-21T10:40:47.896 INFO:tasks.workunit.client.1.smithi112.stdout:8/460: link d8/d9/dd/d2b/d31/c38 d8/d9/dd/d2b/d31/d46/c8a 0 2024-09-21T10:40:47.896 INFO:tasks.workunit.client.1.smithi112.stdout:9/531: mkdir d1/d2/d27/d37/d3b/d69/d73/db5 0 2024-09-21T10:40:47.896 INFO:tasks.workunit.client.1.smithi112.stdout:5/494: unlink d9/d15/d18/d20/f60 0 2024-09-21T10:40:47.898 INFO:tasks.workunit.client.1.smithi112.stdout:1/640: creat d8/d1a/d31/d37/d9e/fcc x:0 0 0 2024-09-21T10:40:47.901 INFO:tasks.workunit.client.1.smithi112.stdout:0/528: truncate d3/d18/f3b 3196825 0 2024-09-21T10:40:47.903 INFO:tasks.workunit.client.1.smithi112.stdout:3/451: link d2/d22/d31/d37/l7c d2/d22/l95 0 2024-09-21T10:40:47.903 INFO:tasks.workunit.client.1.smithi112.stdout:3/452: readlink d2/d2f/l65 0 2024-09-21T10:40:47.903 INFO:tasks.workunit.client.1.smithi112.stdout:3/453: chown d2/d22/d31/d2a/l4e 3768199 1 2024-09-21T10:40:47.904 INFO:tasks.workunit.client.1.smithi112.stdout:2/443: dwrite d0/dd/d47/f50 [0,4194304] 0 2024-09-21T10:40:47.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/427: mknod d7/d22/d41/d80/c8c 0 2024-09-21T10:40:47.905 INFO:tasks.workunit.client.1.smithi112.stdout:7/428: truncate d7/d22/d41/f84 1028090 0 2024-09-21T10:40:47.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/490: chown d4/d3e/c43 413969 1 2024-09-21T10:40:47.907 INFO:tasks.workunit.client.1.smithi112.stdout:9/532: rename d1/d2/d42/f45 to d1/d2/d27/d3a/fb6 0 2024-09-21T10:40:47.910 INFO:tasks.workunit.client.1.smithi112.stdout:2/444: dread d0/f2f [0,4194304] 0 2024-09-21T10:40:47.910 INFO:tasks.workunit.client.1.smithi112.stdout:2/445: chown d0/d12/d8a/d62/d63/l71 89745837 1 2024-09-21T10:40:47.910 INFO:tasks.workunit.client.1.smithi112.stdout:2/446: creat d0/d12/d6c/d7e/f96 x:0 0 0 2024-09-21T10:40:47.910 INFO:tasks.workunit.client.1.smithi112.stdout:5/495: mkdir d9/d15/d18/d3a/d61/d93 0 2024-09-21T10:40:47.910 INFO:tasks.workunit.client.1.smithi112.stdout:8/461: dread d8/d9/d3c/f52 [0,4194304] 0 2024-09-21T10:40:47.911 INFO:tasks.workunit.client.1.smithi112.stdout:1/641: stat d8/l2d 0 2024-09-21T10:40:47.911 INFO:tasks.workunit.client.1.smithi112.stdout:8/462: dread d8/f78 [0,4194304] 0 2024-09-21T10:40:47.911 INFO:tasks.workunit.client.1.smithi112.stdout:8/463: fsync d8/d9/dd/d2b/d31/f39 0 2024-09-21T10:40:47.914 INFO:tasks.workunit.client.1.smithi112.stdout:7/429: creat d7/d22/d41/d56/d72/d79/d8a/f8d x:0 0 0 2024-09-21T10:40:47.916 INFO:tasks.workunit.client.1.smithi112.stdout:6/491: unlink d4/d6/da/d11/d37/d19/fae 0 2024-09-21T10:40:47.916 INFO:tasks.workunit.client.1.smithi112.stdout:6/492: write d4/dc/d1a/d31/f71 [965784,48238] 0 2024-09-21T10:40:47.916 INFO:tasks.workunit.client.1.smithi112.stdout:0/529: dwrite d3/d18/f42 [0,4194304] 0 2024-09-21T10:40:47.918 INFO:tasks.workunit.client.1.smithi112.stdout:3/454: dread d2/d2f/f44 [4194304,4194304] 0 2024-09-21T10:40:47.918 INFO:tasks.workunit.client.1.smithi112.stdout:9/533: symlink d1/d2/d27/d3a/d6b/d30/da5/lb7 0 2024-09-21T10:40:47.921 INFO:tasks.workunit.client.1.smithi112.stdout:2/447: mkdir d0/d12/d97 0 2024-09-21T10:40:47.926 INFO:tasks.workunit.client.1.smithi112.stdout:5/496: rename c7 to d9/d15/d18/d3a/d4b/c94 0 2024-09-21T10:40:47.930 INFO:tasks.workunit.client.1.smithi112.stdout:1/642: symlink d8/d1a/d31/d66/lcd 0 2024-09-21T10:40:47.930 INFO:tasks.workunit.client.1.smithi112.stdout:1/643: fdatasync d8/f1f 0 2024-09-21T10:40:47.931 INFO:tasks.workunit.client.1.smithi112.stdout:6/493: mkdir d4/dc/d1a/d31/d56/d64/d84/db4 0 2024-09-21T10:40:47.933 INFO:tasks.workunit.client.1.smithi112.stdout:8/464: dwrite d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:47.933 INFO:tasks.workunit.client.1.smithi112.stdout:8/465: readlink d8/d9/dd/d2b/d31/l7e 0 2024-09-21T10:40:47.933 INFO:tasks.workunit.client.1.smithi112.stdout:8/466: write d8/d9/dd/d2b/d31/f7d [534033,104228] 0 2024-09-21T10:40:47.938 INFO:tasks.workunit.client.1.smithi112.stdout:0/530: readlink d3/d4a/l60 0 2024-09-21T10:40:47.940 INFO:tasks.workunit.client.1.smithi112.stdout:5/497: dwrite d9/d15/d18/d3a/f5b [0,4194304] 0 2024-09-21T10:40:47.941 INFO:tasks.workunit.client.1.smithi112.stdout:3/455: symlink d2/d22/d31/d2a/d39/d60/l96 0 2024-09-21T10:40:47.941 INFO:tasks.workunit.client.1.smithi112.stdout:3/456: chown d2/d22/d31/d2a/d39/d60/l79 3 1 2024-09-21T10:40:47.941 INFO:tasks.workunit.client.1.smithi112.stdout:6/494: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:47.941 INFO:tasks.workunit.client.1.smithi112.stdout:7/430: dwrite d7/d22/d86/f74 [0,4194304] 0 2024-09-21T10:40:47.942 INFO:tasks.workunit.client.1.smithi112.stdout:9/534: mknod d1/d2/d27/d37/d3b/cb8 0 2024-09-21T10:40:47.943 INFO:tasks.workunit.client.1.smithi112.stdout:1/644: write d8/d1a/f3b [2008728,59351] 0 2024-09-21T10:40:47.944 INFO:tasks.workunit.client.1.smithi112.stdout:1/645: truncate d8/d20/fa7 363657 0 2024-09-21T10:40:47.946 INFO:tasks.workunit.client.1.smithi112.stdout:8/467: symlink d8/d9/dd/d1a/d5d/l8b 0 2024-09-21T10:40:47.948 INFO:tasks.workunit.client.1.smithi112.stdout:0/531: symlink d3/d18/d52/d55/la7 0 2024-09-21T10:40:47.948 INFO:tasks.workunit.client.1.smithi112.stdout:0/532: readlink d3/d23/d7b/l97 0 2024-09-21T10:40:47.953 INFO:tasks.workunit.client.1.smithi112.stdout:5/498: creat d9/d8a/f95 x:0 0 0 2024-09-21T10:40:47.955 INFO:tasks.workunit.client.1.smithi112.stdout:6/495: mkdir d4/d6/da/d14/d49/d73/d74/db5 0 2024-09-21T10:40:47.961 INFO:tasks.workunit.client.1.smithi112.stdout:3/457: dwrite d2/fa [0,4194304] 0 2024-09-21T10:40:47.962 INFO:tasks.workunit.client.1.smithi112.stdout:7/431: mkdir d7/d22/d41/d54/d4d/d8e 0 2024-09-21T10:40:47.964 INFO:tasks.workunit.client.1.smithi112.stdout:7/432: read d7/d3d/f3e [5035930,23476] 0 2024-09-21T10:40:47.966 INFO:tasks.workunit.client.1.smithi112.stdout:1/646: truncate d8/d54/d6d/f86 5582066 0 2024-09-21T10:40:47.969 INFO:tasks.workunit.client.1.smithi112.stdout:2/448: symlink d0/d12/d6c/d7e/d8f/l98 0 2024-09-21T10:40:47.969 INFO:tasks.workunit.client.1.smithi112.stdout:2/449: fdatasync d0/d12/d6c/d7e/d8f/d51/f53 0 2024-09-21T10:40:47.969 INFO:tasks.workunit.client.1.smithi112.stdout:2/450: fdatasync d0/f10 0 2024-09-21T10:40:47.969 INFO:tasks.workunit.client.1.smithi112.stdout:2/451: truncate d0/d12/d8a/d62/d63/f4c 607230 0 2024-09-21T10:40:47.970 INFO:tasks.workunit.client.1.smithi112.stdout:8/468: truncate d8/d9/d3c/d6d/f74 1854193 0 2024-09-21T10:40:47.972 INFO:tasks.workunit.client.1.smithi112.stdout:6/496: dwrite d4/d6/da/d14/d49/fad [0,4194304] 0 2024-09-21T10:40:47.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.985+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f670c108850 con 0x7f670c0ffb90 2024-09-21T10:40:47.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.986+0000 7f66fb7fe640 1 -- 172.21.15.60:0/3714581553 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f66fc079fe0 con 0x7f670c0ffb90 2024-09-21T10:40:47.988 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:40:47.988 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:40:47.988 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:40:47.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 1, 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 13, 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:40:47.989 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:40:47.990 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f66f4073f70 msgr2=0x7f66f4076430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f66f4073f70 0x7f66f4076430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f670c073fd0 tx=0x7f6700009260 comp rx=0 tx=0).stop 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 msgr2=0x7f670c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c074250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66fc000c00 tx=0x7f66fc004610 comp rx=0 tx=0).stop 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 shutdown_connections 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f66f4073f70 0x7f66f4076430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c100d90 0x7f670c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 --2- 172.21.15.60:0/3714581553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f670c0ffb90 0x7f670c074250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 >> 172.21.15.60:0/3714581553 conn(0x7f670c0fb320 msgr2=0x7f670c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.989+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 shutdown_connections 2024-09-21T10:40:47.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:47.990+0000 7f6710eeb640 1 -- 172.21.15.60:0/3714581553 wait complete. 2024-09-21T10:40:47.997 INFO:tasks.workunit.client.1.smithi112.stdout:3/458: creat d2/d22/d31/f97 x:0 0 0 2024-09-21T10:40:47.998 INFO:tasks.workunit.client.1.smithi112.stdout:3/459: dread - d2/d22/d31/d2a/d39/d3a/d76/f80 zero size 2024-09-21T10:40:48.002 INFO:tasks.workunit.client.1.smithi112.stdout:7/433: creat d7/d22/d41/d56/d72/d79/f8f x:0 0 0 2024-09-21T10:40:48.007 INFO:tasks.workunit.client.1.smithi112.stdout:6/497: mknod d4/d6/da/d11/d37/d19/cb6 0 2024-09-21T10:40:48.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/533: rename d3/d23/d7b to d3/d4/da8 0 2024-09-21T10:40:48.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/534: fsync d3/f66 0 2024-09-21T10:40:48.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/535: read - d3/d4a/f96 zero size 2024-09-21T10:40:48.013 INFO:tasks.workunit.client.1.smithi112.stdout:5/499: unlink d9/d15/l19 0 2024-09-21T10:40:48.013 INFO:tasks.workunit.client.1.smithi112.stdout:5/500: chown d9/d15/d1d/f5a 35 1 2024-09-21T10:40:48.020 INFO:tasks.workunit.client.1.smithi112.stdout:3/460: mkdir d2/d22/d31/d2a/d39/d60/d86/d98 0 2024-09-21T10:40:48.020 INFO:tasks.workunit.client.1.smithi112.stdout:3/461: fsync d2/d2f/f6a 0 2024-09-21T10:40:48.020 INFO:tasks.workunit.client.1.smithi112.stdout:5/501: write d9/fe [3679104,82744] 0 2024-09-21T10:40:48.020 INFO:tasks.workunit.client.1.smithi112.stdout:5/502: fdatasync d9/d15/d18/d3a/d4b/d71/f80 0 2024-09-21T10:40:48.023 INFO:tasks.workunit.client.1.smithi112.stdout:7/434: rmdir d7/d22/d41/d54/d4d/d8e 0 2024-09-21T10:40:48.024 INFO:tasks.workunit.client.1.smithi112.stdout:7/435: chown d7/d22/d78/f7f 50 1 2024-09-21T10:40:48.024 INFO:tasks.workunit.client.1.smithi112.stdout:9/535: getdents d1/d2/d27/d37/d3b 0 2024-09-21T10:40:48.025 INFO:tasks.workunit.client.1.smithi112.stdout:9/536: creat d1/d2/d27/d3a/d6b/fb9 x:0 0 0 2024-09-21T10:40:48.025 INFO:tasks.workunit.client.1.smithi112.stdout:9/537: chown d1/d2/d27/d37/d3b/d69/d73/f99 5861 1 2024-09-21T10:40:48.026 INFO:tasks.workunit.client.1.smithi112.stdout:1/647: getdents d8/d45 0 2024-09-21T10:40:48.030 INFO:tasks.workunit.client.1.smithi112.stdout:6/498: unlink d4/dc/d1a/d31/d56/d64/f94 0 2024-09-21T10:40:48.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/462: dwrite f1 [0,4194304] 0 2024-09-21T10:40:48.034 INFO:tasks.workunit.client.1.smithi112.stdout:2/452: rename d0/d12/d77/d78 to d0/d12/d8a/d62/d63/d99 0 2024-09-21T10:40:48.034 INFO:tasks.workunit.client.1.smithi112.stdout:2/453: chown d0/d12/d77 177 1 2024-09-21T10:40:48.036 INFO:tasks.workunit.client.1.smithi112.stdout:0/536: creat d3/d4a/d4e/d72/fa9 x:0 0 0 2024-09-21T10:40:48.038 INFO:tasks.workunit.client.1.smithi112.stdout:1/648: write d8/d45/f59 [224360,42820] 0 2024-09-21T10:40:48.042 INFO:tasks.workunit.client.1.smithi112.stdout:5/503: mknod d9/d15/d1d/c96 0 2024-09-21T10:40:48.042 INFO:tasks.workunit.client.1.smithi112.stdout:5/504: write d9/d15/d18/d3a/d4b/f52 [195095,93277] 0 2024-09-21T10:40:48.045 INFO:tasks.workunit.client.1.smithi112.stdout:7/436: unlink d7/l12 0 2024-09-21T10:40:48.045 INFO:tasks.workunit.client.1.smithi112.stdout:7/437: readlink d7/d22/d41/d54/l70 0 2024-09-21T10:40:48.048 INFO:tasks.workunit.client.1.smithi112.stdout:5/505: dread d9/f1b [0,4194304] 0 2024-09-21T10:40:48.050 INFO:tasks.workunit.client.1.smithi112.stdout:9/538: symlink d1/lba 0 2024-09-21T10:40:48.051 INFO:tasks.workunit.client.1.smithi112.stdout:5/506: dread d9/d15/f35 [0,4194304] 0 2024-09-21T10:40:48.051 INFO:tasks.workunit.client.1.smithi112.stdout:2/454: dwrite d0/d12/d6c/d7e/d8f/f3c [0,4194304] 0 2024-09-21T10:40:48.053 INFO:tasks.workunit.client.1.smithi112.stdout:3/463: unlink d2/d22/d31/l70 0 2024-09-21T10:40:48.057 INFO:tasks.workunit.client.1.smithi112.stdout:1/649: dwrite d8/f40 [0,4194304] 0 2024-09-21T10:40:48.057 INFO:tasks.workunit.client.1.smithi112.stdout:1/650: chown d8/d45/f94 0 1 2024-09-21T10:40:48.057 INFO:tasks.workunit.client.1.smithi112.stdout:1/651: write d8/d1a/d53/f60 [1095790,98188] 0 2024-09-21T10:40:48.057 INFO:tasks.workunit.client.1.smithi112.stdout:1/652: dread - d8/fc6 zero size 2024-09-21T10:40:48.059 INFO:tasks.workunit.client.1.smithi112.stdout:0/537: creat d3/d4a/d4e/faa x:0 0 0 2024-09-21T10:40:48.061 INFO:tasks.workunit.client.1.smithi112.stdout:7/438: mknod d7/d22/d41/c90 0 2024-09-21T10:40:48.061 INFO:tasks.workunit.client.1.smithi112.stdout:7/439: readlink d7/d22/d41/l43 0 2024-09-21T10:40:48.061 INFO:tasks.workunit.client.1.smithi112.stdout:7/440: chown d7/l11 7301406 1 2024-09-21T10:40:48.067 INFO:tasks.workunit.client.1.smithi112.stdout:3/464: creat d2/d2f/d3f/f99 x:0 0 0 2024-09-21T10:40:48.068 INFO:tasks.workunit.client.1.smithi112.stdout:5/507: dwrite d9/d15/f2e [0,4194304] 0 2024-09-21T10:40:48.068 INFO:tasks.workunit.client.1.smithi112.stdout:5/508: chown d9/d15/d18/f39 1746 1 2024-09-21T10:40:48.075 INFO:tasks.workunit.client.1.smithi112.stdout:7/441: getdents d7/d22/d41/d4b 0 2024-09-21T10:40:48.075 INFO:tasks.workunit.client.1.smithi112.stdout:7/442: chown d7/d22/d41/c55 10 1 2024-09-21T10:40:48.083 INFO:tasks.workunit.client.1.smithi112.stdout:5/509: mknod d9/d15/d18/c97 0 2024-09-21T10:40:48.085 INFO:tasks.workunit.client.1.smithi112.stdout:6/499: rename d4/dc/d1a/d31/d39 to d4/d6/d75/db7 0 2024-09-21T10:40:48.086 INFO:tasks.workunit.client.1.smithi112.stdout:7/443: mknod d7/d3d/c91 0 2024-09-21T10:40:48.086 INFO:tasks.workunit.client.1.smithi112.stdout:7/444: truncate d7/d22/d41/d4b/d5e/f82 621930 0 2024-09-21T10:40:48.086 INFO:tasks.workunit.client.1.smithi112.stdout:7/445: chown d7/d22/l39 2237 1 2024-09-21T10:40:48.090 INFO:tasks.workunit.client.1.smithi112.stdout:5/510: creat d9/d15/d18/d3a/d61/d93/f98 x:0 0 0 2024-09-21T10:40:48.092 INFO:tasks.workunit.client.1.smithi112.stdout:5/511: dread d9/d15/d1d/f46 [0,4194304] 0 2024-09-21T10:40:48.093 INFO:tasks.workunit.client.1.smithi112.stdout:0/538: rename d3/d4/d43/f44 to d3/d4a/d4e/d72/d8e/fab 0 2024-09-21T10:40:48.093 INFO:tasks.workunit.client.1.smithi112.stdout:0/539: chown d3/d23/f3f 5737 1 2024-09-21T10:40:48.093 INFO:tasks.workunit.client.1.smithi112.stdout:0/540: fsync d3/f1b 0 2024-09-21T10:40:48.093 INFO:tasks.workunit.client.1.smithi112.stdout:0/541: dread - d3/d4a/d4e/faa zero size 2024-09-21T10:40:48.093 INFO:tasks.workunit.client.1.smithi112.stdout:0/542: chown d3/d4a 7 1 2024-09-21T10:40:48.095 INFO:tasks.workunit.client.1.smithi112.stdout:7/446: creat d7/d22/d41/d56/d5c/f92 x:0 0 0 2024-09-21T10:40:48.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/512: mknod d9/d15/d18/d20/d55/c99 0 2024-09-21T10:40:48.099 INFO:tasks.workunit.client.1.smithi112.stdout:0/543: creat d3/d4/d10/d8b/d90/fac x:0 0 0 2024-09-21T10:40:48.102 INFO:tasks.workunit.client.1.smithi112.stdout:6/500: dwrite d4/d6/d75/d7a/fb3 [0,4194304] 0 2024-09-21T10:40:48.104 INFO:tasks.workunit.client.1.smithi112.stdout:0/544: creat d3/d4/d1a/d21/fad x:0 0 0 2024-09-21T10:40:48.111 INFO:tasks.workunit.client.1.smithi112.stdout:6/501: truncate d4/d4f/faf 174532 0 2024-09-21T10:40:48.114 INFO:tasks.workunit.client.1.smithi112.stdout:6/502: rename d4/d6/da/d11/d1f/d22/daa to d4/d6/da/d11/d37/db8 0 2024-09-21T10:40:48.115 INFO:tasks.workunit.client.1.smithi112.stdout:7/447: dwrite d7/f14 [0,4194304] 0 2024-09-21T10:40:48.115 INFO:tasks.workunit.client.1.smithi112.stdout:5/513: dwrite d9/d15/d18/d3a/d61/f89 [0,4194304] 0 2024-09-21T10:40:48.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.115+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/1794999490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 msgr2=0x7f8b84100880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.115+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/1794999490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b84100880 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009880 tx=0x7f8b8002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.115+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/1794999490 shutdown_connections 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.115+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/1794999490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 0x7f8b84103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.115+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/1794999490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b84100880 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.115+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/1794999490 >> 172.21.15.60:0/1794999490 conn(0x7f8b840fa280 msgr2=0x7f8b840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.116+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/1794999490 shutdown_connections 2024-09-21T10:40:48.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.116+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/1794999490 wait complete. 2024-09-21T10:40:48.119 INFO:tasks.workunit.client.1.smithi112.stdout:6/503: mknod d4/d6/da/d11/d37/cb9 0 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.116+0000 7f8b8b6fc640 1 Processor -- start 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b8b6fc640 1 -- start start 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b8b6fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b8419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b8b6fc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 0x7f8b8419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b8b6fc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8419c780 con 0x7f8b840fe470 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b8b6fc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8419c8f0 con 0x7f8b84100dc0 2024-09-21T10:40:48.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b89498640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b8419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:48.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b88c97640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 0x7f8b8419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:48.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b89498640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b8419bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34422/0 (socket says 172.21.15.60:34422) 2024-09-21T10:40:48.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.117+0000 7f8b89498640 1 -- 172.21.15.60:0/961510884 learned_addr learned my addr 172.21.15.60:0/961510884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:48.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b88c97640 1 -- 172.21.15.60:0/961510884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 msgr2=0x7f8b8419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:48.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b88c97640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b8419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b88c97640 1 -- 172.21.15.60:0/961510884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80009560 con 0x7f8b84100dc0 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b89498640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b8419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b88c97640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 0x7f8b8419c1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400e970 tx=0x7f8b7400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b74009640 con 0x7f8b84100dc0 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b7400cc90 con 0x7f8b84100dc0 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b841a1380 con 0x7f8b84100dc0 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b74018810 con 0x7f8b84100dc0 2024-09-21T10:40:48.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.118+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841a18d0 con 0x7f8b84100dc0 2024-09-21T10:40:48.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.120+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8410edc0 con 0x7f8b84100dc0 2024-09-21T10:40:48.123 INFO:tasks.workunit.client.1.smithi112.stdout:7/448: write d7/d22/f38 [416341,44179] 0 2024-09-21T10:40:48.123 INFO:tasks.workunit.client.1.smithi112.stdout:7/449: write d7/d22/d73/f85 [494041,117597] 0 2024-09-21T10:40:48.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.121+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f8b74018970 con 0x7f8b84100dc0 2024-09-21T10:40:48.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.122+0000 7f8b7a7fc640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8b70073ed0 0x7f8b70076390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:48.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.122+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8b74014070 con 0x7f8b84100dc0 2024-09-21T10:40:48.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.123+0000 7f8b89498640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8b70073ed0 0x7f8b70076390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:48.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.124+0000 7f8b89498640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8b70073ed0 0x7f8b70076390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b800314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:48.126 INFO:tasks.workunit.client.1.smithi112.stdout:5/514: dread d9/d15/f2e [0,4194304] 0 2024-09-21T10:40:48.127 INFO:tasks.workunit.client.1.smithi112.stdout:6/504: dread d4/dc/d1a/d31/d56/d64/f48 [0,4194304] 0 2024-09-21T10:40:48.127 INFO:tasks.workunit.client.1.smithi112.stdout:6/505: write d4/d6/da/d11/d1f/d22/f58 [999292,68976] 0 2024-09-21T10:40:48.128 INFO:tasks.workunit.client.1.smithi112.stdout:4/495: sync 2024-09-21T10:40:48.128 INFO:tasks.workunit.client.1.smithi112.stdout:4/496: creat de/d18/fa8 x:0 0 0 2024-09-21T10:40:48.128 INFO:tasks.workunit.client.1.smithi112.stdout:7/450: symlink d7/d22/d86/l93 0 2024-09-21T10:40:48.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.128+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f8b74055ce0 con 0x7f8b84100dc0 2024-09-21T10:40:48.131 INFO:tasks.workunit.client.1.smithi112.stdout:5/515: mkdir d9/d15/d18/d3a/d4b/d74/d8d/d9a 0 2024-09-21T10:40:48.131 INFO:tasks.workunit.client.1.smithi112.stdout:5/516: write d9/d15/d1d/f21 [4366069,39782] 0 2024-09-21T10:40:48.135 INFO:tasks.workunit.client.1.smithi112.stdout:5/517: mkdir d9/d15/d18/d3a/d61/d62/d9b 0 2024-09-21T10:40:48.136 INFO:tasks.workunit.client.1.smithi112.stdout:6/506: write d4/d6/da/f2c [1134900,111046] 0 2024-09-21T10:40:48.136 INFO:tasks.workunit.client.1.smithi112.stdout:6/507: stat d4/d6/da/d11/d37/d19/l4d 0 2024-09-21T10:40:48.137 INFO:tasks.workunit.client.1.smithi112.stdout:6/508: write d4/d6/da/d14/f8e [5462,127730] 0 2024-09-21T10:40:48.138 INFO:tasks.workunit.client.1.smithi112.stdout:4/497: dread de/d33/d6f/f7d [0,4194304] 0 2024-09-21T10:40:48.138 INFO:tasks.workunit.client.1.smithi112.stdout:5/518: creat d9/d15/d18/d3a/f9c x:0 0 0 2024-09-21T10:40:48.139 INFO:tasks.workunit.client.1.smithi112.stdout:7/451: write f5 [4636532,115272] 0 2024-09-21T10:40:48.140 INFO:tasks.workunit.client.1.smithi112.stdout:3/465: truncate d2/d22/d31/d2a/d39/d3a/f47 1694817 0 2024-09-21T10:40:48.140 INFO:tasks.workunit.client.1.smithi112.stdout:3/466: fsync d2/d2f/f30 0 2024-09-21T10:40:48.141 INFO:tasks.workunit.client.1.smithi112.stdout:6/509: unlink d4/d6/da/d14/l32 0 2024-09-21T10:40:48.146 INFO:tasks.workunit.client.1.smithi112.stdout:5/519: dread d9/d15/d18/d3a/d4b/d74/f7c [0,4194304] 0 2024-09-21T10:40:48.149 INFO:tasks.workunit.client.1.smithi112.stdout:4/498: symlink de/d33/d6f/d9c/la9 0 2024-09-21T10:40:48.149 INFO:tasks.workunit.client.1.smithi112.stdout:4/499: creat de/d18/d6d/faa x:0 0 0 2024-09-21T10:40:48.149 INFO:tasks.workunit.client.1.smithi112.stdout:4/500: write de/d18/d6d/f8c [500785,41361] 0 2024-09-21T10:40:48.151 INFO:tasks.workunit.client.1.smithi112.stdout:7/452: truncate d7/f1c 6712376 0 2024-09-21T10:40:48.154 INFO:tasks.workunit.client.1.smithi112.stdout:6/510: creat d4/d6/da/d11/d1f/d22/fba x:0 0 0 2024-09-21T10:40:48.156 INFO:tasks.workunit.client.1.smithi112.stdout:6/511: symlink d4/d6/da/d14/d49/d73/d74/lbb 0 2024-09-21T10:40:48.158 INFO:tasks.workunit.client.1.smithi112.stdout:5/520: write d9/f11 [3035608,101259] 0 2024-09-21T10:40:48.158 INFO:tasks.workunit.client.1.smithi112.stdout:5/521: chown d9/d15/d18/d3a/d4b/c4c 0 1 2024-09-21T10:40:48.158 INFO:tasks.workunit.client.1.smithi112.stdout:3/467: dwrite d2/f17 [4194304,4194304] 0 2024-09-21T10:40:48.159 INFO:tasks.workunit.client.1.smithi112.stdout:4/501: fdatasync de/d18/d6d/f8c 0 2024-09-21T10:40:48.162 INFO:tasks.workunit.client.1.smithi112.stdout:5/522: creat d9/d15/d18/d3a/d4b/f9d x:0 0 0 2024-09-21T10:40:48.165 INFO:tasks.workunit.client.1.smithi112.stdout:4/502: write de/d33/d6f/f7d [3132911,36392] 0 2024-09-21T10:40:48.165 INFO:tasks.workunit.client.1.smithi112.stdout:4/503: readlink de/d18/l23 0 2024-09-21T10:40:48.177 INFO:tasks.workunit.client.1.smithi112.stdout:5/523: rmdir d9/d15/d18/d3a/d4b/d74/d8d 39 2024-09-21T10:40:48.177 INFO:tasks.workunit.client.1.smithi112.stdout:5/524: creat d9/d15/d18/f9e x:0 0 0 2024-09-21T10:40:48.179 INFO:tasks.workunit.client.1.smithi112.stdout:5/525: truncate d9/d15/f6a 254057 0 2024-09-21T10:40:48.180 INFO:tasks.workunit.client.1.smithi112.stdout:5/526: stat d9/d15/d18/d20/l25 0 2024-09-21T10:40:48.182 INFO:tasks.workunit.client.1.smithi112.stdout:8/469: sync 2024-09-21T10:40:48.183 INFO:tasks.workunit.client.1.smithi112.stdout:6/512: dwrite d4/d6/da/f2c [0,4194304] 0 2024-09-21T10:40:48.183 INFO:tasks.workunit.client.1.smithi112.stdout:6/513: getdents d4/dc/d1a/d31/d56/d64/d84/db4 0 2024-09-21T10:40:48.183 INFO:tasks.workunit.client.1.smithi112.stdout:4/504: dwrite de/d2a/d31/d8d/fa0 [0,4194304] 0 2024-09-21T10:40:48.186 INFO:tasks.workunit.client.1.smithi112.stdout:6/514: mknod d4/d6/da/d11/cbc 0 2024-09-21T10:40:48.186 INFO:tasks.workunit.client.1.smithi112.stdout:6/515: stat d4/dc/d1a/d31/d3c/f9e 0 2024-09-21T10:40:48.190 INFO:tasks.workunit.client.1.smithi112.stdout:5/527: dread d9/d15/d1d/f5a [0,4194304] 0 2024-09-21T10:40:48.190 INFO:tasks.workunit.client.1.smithi112.stdout:5/528: readlink d9/l65 0 2024-09-21T10:40:48.191 INFO:tasks.workunit.client.1.smithi112.stdout:3/468: link f1 d2/d22/d31/d2a/d39/d60/f9a 0 2024-09-21T10:40:48.191 INFO:tasks.workunit.client.1.smithi112.stdout:8/470: rmdir d8/d18 39 2024-09-21T10:40:48.193 INFO:tasks.workunit.client.1.smithi112.stdout:6/516: link d4/dc/d1a/cb2 d4/dc/d1a/cbd 0 2024-09-21T10:40:48.193 INFO:tasks.workunit.client.1.smithi112.stdout:6/517: fsync d4/d6/f87 0 2024-09-21T10:40:48.193 INFO:tasks.workunit.client.1.smithi112.stdout:6/518: chown d4/dc/d1a/d31/d3c/f9e 54810669 1 2024-09-21T10:40:48.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/505: rmdir de/d33/d2f/d71/d40 39 2024-09-21T10:40:48.195 INFO:tasks.workunit.client.1.smithi112.stdout:5/529: dread d9/d15/d18/f29 [0,4194304] 0 2024-09-21T10:40:48.195 INFO:tasks.workunit.client.1.smithi112.stdout:5/530: write d9/d15/d1d/f4d [2079664,54851] 0 2024-09-21T10:40:48.195 INFO:tasks.workunit.client.1.smithi112.stdout:5/531: creat d9/d57/f9f x:0 0 0 2024-09-21T10:40:48.195 INFO:tasks.workunit.client.1.smithi112.stdout:8/471: creat d8/f8c x:0 0 0 2024-09-21T10:40:48.196 INFO:tasks.workunit.client.1.smithi112.stdout:7/453: write d7/f1c [4714579,7650] 0 2024-09-21T10:40:48.196 INFO:tasks.workunit.client.1.smithi112.stdout:7/454: dread - d7/f3a zero size 2024-09-21T10:40:48.196 INFO:tasks.workunit.client.1.smithi112.stdout:7/455: read - d7/d22/d41/d56/f75 zero size 2024-09-21T10:40:48.198 INFO:tasks.workunit.client.1.smithi112.stdout:6/519: rename d4/d4f/l57 to d4/d6/d75/lbe 0 2024-09-21T10:40:48.198 INFO:tasks.workunit.client.1.smithi112.stdout:6/520: truncate d4/d4f/f8c 542340 0 2024-09-21T10:40:48.198 INFO:tasks.workunit.client.1.smithi112.stdout:6/521: write d4/d6/da/d11/d37/d19/f2e [3346813,92072] 0 2024-09-21T10:40:48.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/532: truncate d9/d6e/f8e 3253962 0 2024-09-21T10:40:48.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/533: creat d9/d8a/fa0 x:0 0 0 2024-09-21T10:40:48.205 INFO:tasks.workunit.client.1.smithi112.stdout:5/534: chown d9/d8a/f95 2775 1 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:8/26: sync 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/4: sync 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/5: write - no filename 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/6: chown c0 231570 1 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:9/36: sync 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:9/37: fsync d3/fc 0 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:6/13: sync 2024-09-21T10:40:48.206 INFO:tasks.workunit.client.0.smithi060.stdout:6/14: stat f2 0 2024-09-21T10:40:48.207 INFO:tasks.workunit.client.1.smithi112.stdout:8/472: dread d8/d9/dd/f2f [0,4194304] 0 2024-09-21T10:40:48.208 INFO:tasks.workunit.client.0.smithi060.stdout:7/18: sync 2024-09-21T10:40:48.208 INFO:tasks.workunit.client.0.smithi060.stdout:7/19: chown f1 88927 1 2024-09-21T10:40:48.208 INFO:tasks.workunit.client.0.smithi060.stdout:1/10: sync 2024-09-21T10:40:48.208 INFO:tasks.workunit.client.0.smithi060.stdout:3/2: sync 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:2/13: sync 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:2/14: truncate f2 384345 0 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:0/3: sync 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:0/4: chown f0 223014 1 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:0/5: chown f0 2 1 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:4/19: sync 2024-09-21T10:40:48.209 INFO:tasks.workunit.client.0.smithi060.stdout:4/20: chown d0 44170 1 2024-09-21T10:40:48.210 INFO:tasks.workunit.client.1.smithi112.stdout:6/522: link d4/d3e/f4c d4/d6/da/d11/d37/d8b/fbf 0 2024-09-21T10:40:48.210 INFO:tasks.workunit.client.1.smithi112.stdout:6/523: creat d4/d6/da/d11/d1f/d22/fc0 x:0 0 0 2024-09-21T10:40:48.211 INFO:tasks.workunit.client.1.smithi112.stdout:4/506: rmdir de/d33/d2f/d71 39 2024-09-21T10:40:48.211 INFO:tasks.workunit.client.0.smithi060.stdout:2/15: dread f2 [0,4194304] 0 2024-09-21T10:40:48.211 INFO:tasks.workunit.client.0.smithi060.stdout:2/16: getdents d3 0 2024-09-21T10:40:48.217 INFO:tasks.workunit.client.0.smithi060.stdout:9/38: mknod d3/c13 0 2024-09-21T10:40:48.217 INFO:tasks.workunit.client.0.smithi060.stdout:9/39: creat d3/f14 x:0 0 0 2024-09-21T10:40:48.217 INFO:tasks.workunit.client.0.smithi060.stdout:9/40: chown d3/fe 9802 1 2024-09-21T10:40:48.217 INFO:tasks.workunit.client.1.smithi112.stdout:3/469: dwrite f0 [0,4194304] 0 2024-09-21T10:40:48.218 INFO:tasks.workunit.client.1.smithi112.stdout:7/456: dwrite d7/d22/d41/d4b/f64 [0,4194304] 0 2024-09-21T10:40:48.221 INFO:tasks.workunit.client.0.smithi060.stdout:7/20: symlink l4 0 2024-09-21T10:40:48.223 INFO:tasks.workunit.client.0.smithi060.stdout:8/27: dread d2/f3 [0,4194304] 0 2024-09-21T10:40:48.223 INFO:tasks.workunit.client.0.smithi060.stdout:8/28: truncate f1 2514123 0 2024-09-21T10:40:48.224 INFO:tasks.workunit.client.1.smithi112.stdout:4/507: rmdir de/d33/d6f/d9c/d3e 39 2024-09-21T10:40:48.224 INFO:tasks.workunit.client.0.smithi060.stdout:1/11: symlink l4 0 2024-09-21T10:40:48.224 INFO:tasks.workunit.client.0.smithi060.stdout:1/12: truncate f3 407567 0 2024-09-21T10:40:48.225 INFO:tasks.workunit.client.0.smithi060.stdout:1/13: dread f3 [0,4194304] 0 2024-09-21T10:40:48.226 INFO:tasks.workunit.client.0.smithi060.stdout:3/3: mkdir d0/d1 0 2024-09-21T10:40:48.226 INFO:tasks.workunit.client.0.smithi060.stdout:3/4: dwrite - no filename 2024-09-21T10:40:48.226 INFO:tasks.workunit.client.0.smithi060.stdout:3/5: dwrite - no filename 2024-09-21T10:40:48.226 INFO:tasks.workunit.client.0.smithi060.stdout:3/6: read - no filename 2024-09-21T10:40:48.228 INFO:tasks.workunit.client.0.smithi060.stdout:6/15: dread f2 [0,4194304] 0 2024-09-21T10:40:48.228 INFO:tasks.workunit.client.0.smithi060.stdout:0/6: symlink l1 0 2024-09-21T10:40:48.228 INFO:tasks.workunit.client.0.smithi060.stdout:0/7: creat f2 x:0 0 0 2024-09-21T10:40:48.229 INFO:tasks.workunit.client.1.smithi112.stdout:7/457: read d7/f26 [4139424,120805] 0 2024-09-21T10:40:48.230 INFO:tasks.workunit.client.1.smithi112.stdout:3/470: mkdir d2/d22/d31/d2a/d9b 0 2024-09-21T10:40:48.230 INFO:tasks.workunit.client.0.smithi060.stdout:8/29: dread d2/f3 [0,4194304] 0 2024-09-21T10:40:48.230 INFO:tasks.workunit.client.0.smithi060.stdout:8/30: creat d2/f8 x:0 0 0 2024-09-21T10:40:48.231 INFO:tasks.workunit.client.0.smithi060.stdout:4/21: rename d0/f1 to d0/f7 0 2024-09-21T10:40:48.233 INFO:tasks.workunit.client.0.smithi060.stdout:2/17: unlink c0 0 2024-09-21T10:40:48.234 INFO:tasks.workunit.client.1.smithi112.stdout:7/458: dread d7/d22/f48 [0,4194304] 0 2024-09-21T10:40:48.238 INFO:tasks.workunit.client.0.smithi060.stdout:9/41: mkdir d3/d15 0 2024-09-21T10:40:48.240 INFO:tasks.workunit.client.0.smithi060.stdout:4/22: dread d0/f4 [0,4194304] 0 2024-09-21T10:40:48.240 INFO:tasks.workunit.client.1.smithi112.stdout:8/473: dwrite d8/d9/dd/f16 [0,4194304] 0 2024-09-21T10:40:48.240 INFO:tasks.workunit.client.0.smithi060.stdout:7/21: unlink f3 0 2024-09-21T10:40:48.241 INFO:tasks.workunit.client.0.smithi060.stdout:7/22: fdatasync f1 0 2024-09-21T10:40:48.245 INFO:tasks.workunit.client.0.smithi060.stdout:1/14: link f3 f5 0 2024-09-21T10:40:48.248 INFO:tasks.workunit.client.0.smithi060.stdout:3/7: symlink d0/l2 0 2024-09-21T10:40:48.253 INFO:tasks.workunit.client.1.smithi112.stdout:6/524: rename d4/dc/d1a/d31/d56/d64/d84/fa1 to d4/dc/d1a/d31/d3c/fc1 0 2024-09-21T10:40:48.253 INFO:tasks.workunit.client.1.smithi112.stdout:6/525: fdatasync d4/dc/d1a/d31/d56/d64/f48 0 2024-09-21T10:40:48.254 INFO:tasks.workunit.client.1.smithi112.stdout:4/508: mkdir de/d18/d6d/d6e/dab 0 2024-09-21T10:40:48.254 INFO:tasks.workunit.client.1.smithi112.stdout:4/509: chown de/d2a/fa6 14 1 2024-09-21T10:40:48.254 INFO:tasks.workunit.client.0.smithi060.stdout:6/16: dwrite f2 [0,4194304] 0 2024-09-21T10:40:48.255 INFO:tasks.workunit.client.0.smithi060.stdout:6/17: readlink - no filename 2024-09-21T10:40:48.255 INFO:tasks.workunit.client.1.smithi112.stdout:3/471: symlink d2/d22/d31/d2a/d39/d3a/l9c 0 2024-09-21T10:40:48.257 INFO:tasks.workunit.client.0.smithi060.stdout:2/18: creat d3/f4 x:0 0 0 2024-09-21T10:40:48.257 INFO:tasks.workunit.client.0.smithi060.stdout:2/19: write d3/f4 [1003823,31282] 0 2024-09-21T10:40:48.258 INFO:tasks.workunit.client.1.smithi112.stdout:7/459: mknod d7/d22/d78/c94 0 2024-09-21T10:40:48.259 INFO:tasks.workunit.client.0.smithi060.stdout:9/42: mkdir d3/d16 0 2024-09-21T10:40:48.259 INFO:tasks.workunit.client.0.smithi060.stdout:9/43: truncate d3/fe 896610 0 2024-09-21T10:40:48.259 INFO:tasks.workunit.client.0.smithi060.stdout:9/44: getdents d3/d15 0 2024-09-21T10:40:48.261 INFO:tasks.workunit.client.0.smithi060.stdout:4/23: truncate d0/f7 2508580 0 2024-09-21T10:40:48.262 INFO:tasks.workunit.client.1.smithi112.stdout:8/474: dwrite f3 [0,4194304] 0 2024-09-21T10:40:48.263 INFO:tasks.workunit.client.1.smithi112.stdout:6/526: rename d4/d3e/ca2 to d4/d6/d75/d97/cc2 0 2024-09-21T10:40:48.263 INFO:tasks.workunit.client.1.smithi112.stdout:6/527: creat d4/dc/d1a/d31/d56/fc3 x:0 0 0 2024-09-21T10:40:48.264 INFO:tasks.workunit.client.0.smithi060.stdout:7/23: dwrite f1 [0,4194304] 0 2024-09-21T10:40:48.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/8: rename d0/l2 to d0/d1/l3 0 2024-09-21T10:40:48.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/9: chown d0 13905330 1 2024-09-21T10:40:48.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/10: write - no filename 2024-09-21T10:40:48.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/11: dread - no filename 2024-09-21T10:40:48.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/12: stat d0 0 2024-09-21T10:40:48.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/13: dread - no filename 2024-09-21T10:40:48.270 INFO:tasks.workunit.client.1.smithi112.stdout:8/475: read d8/d9/dd/f2f [430269,42913] 0 2024-09-21T10:40:48.270 INFO:tasks.workunit.client.1.smithi112.stdout:4/510: creat de/fac x:0 0 0 2024-09-21T10:40:48.270 INFO:tasks.workunit.client.1.smithi112.stdout:4/511: stat de/d33/d2f/c29 0 2024-09-21T10:40:48.274 INFO:tasks.workunit.client.0.smithi060.stdout:6/18: mkdir d3 0 2024-09-21T10:40:48.276 INFO:tasks.workunit.client.1.smithi112.stdout:4/512: mkdir de/d2a/d31/d8d/d9d/dad 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.1.smithi112.stdout:8/476: write d8/d9/dd/d1a/f51 [405175,32758] 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.1.smithi112.stdout:8/477: stat d8/d9/dd/d2b 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.1.smithi112.stdout:8/478: write d8/d9/dd/d2a/d43/d58/d82/f87 [162873,47175] 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.1.smithi112.stdout:8/479: fdatasync d8/f78 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.1.smithi112.stdout:8/480: write d8/d9/dd/d2a/d43/f6f [649419,72592] 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.0.smithi060.stdout:9/45: creat d3/d15/f17 x:0 0 0 2024-09-21T10:40:48.280 INFO:tasks.workunit.client.0.smithi060.stdout:9/46: chown d3/fc 48354094 1 2024-09-21T10:40:48.281 INFO:tasks.workunit.client.1.smithi112.stdout:4/513: creat de/d2e/fae x:0 0 0 2024-09-21T10:40:48.281 INFO:tasks.workunit.client.1.smithi112.stdout:4/514: fsync de/d33/d2f/d35/f36 0 2024-09-21T10:40:48.281 INFO:tasks.workunit.client.1.smithi112.stdout:4/515: read de/d33/d6f/d9c/f7a [2718624,82779] 0 2024-09-21T10:40:48.281 INFO:tasks.workunit.client.0.smithi060.stdout:4/24: symlink d0/l8 0 2024-09-21T10:40:48.282 INFO:tasks.workunit.client.1.smithi112.stdout:3/472: dwrite d2/d22/d31/d2a/d39/d3a/f47 [0,4194304] 0 2024-09-21T10:40:48.282 INFO:tasks.workunit.client.1.smithi112.stdout:3/473: chown d2/d1f/f35 8963 1 2024-09-21T10:40:48.283 INFO:tasks.workunit.client.1.smithi112.stdout:6/528: write d4/d6/da/f60 [741266,108611] 0 2024-09-21T10:40:48.283 INFO:tasks.workunit.client.1.smithi112.stdout:4/516: dread de/d18/f3f [0,4194304] 0 2024-09-21T10:40:48.283 INFO:tasks.workunit.client.1.smithi112.stdout:6/529: stat d4/d6/da/d11/d37/d8b/fbf 0 2024-09-21T10:40:48.284 INFO:tasks.workunit.client.1.smithi112.stdout:4/517: stat de/d33/d2f/d35/c8b 0 2024-09-21T10:40:48.284 INFO:tasks.workunit.client.1.smithi112.stdout:6/530: write d4/d6/f87 [1007242,1504] 0 2024-09-21T10:40:48.285 INFO:tasks.workunit.client.0.smithi060.stdout:0/8: getdents . 0 2024-09-21T10:40:48.285 INFO:tasks.workunit.client.1.smithi112.stdout:8/481: symlink d8/d9/d3c/d6d/l8d 0 2024-09-21T10:40:48.285 INFO:tasks.workunit.client.1.smithi112.stdout:8/482: readlink d8/d18/l73 0 2024-09-21T10:40:48.288 INFO:tasks.workunit.client.1.smithi112.stdout:3/474: truncate d2/d22/d31/d37/f82 3970801 0 2024-09-21T10:40:48.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/31: getdents d2 0 2024-09-21T10:40:48.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/32: dread - d2/f8 zero size 2024-09-21T10:40:48.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/33: write d2/f8 [904250,93373] 0 2024-09-21T10:40:48.290 INFO:tasks.workunit.client.1.smithi112.stdout:9/539: sync 2024-09-21T10:40:48.291 INFO:tasks.workunit.client.1.smithi112.stdout:4/518: symlink de/d18/d6d/laf 0 2024-09-21T10:40:48.292 INFO:tasks.workunit.client.1.smithi112.stdout:4/519: chown de/d33/d2f/d71/d40/l63 2 1 2024-09-21T10:40:48.292 INFO:tasks.workunit.client.1.smithi112.stdout:4/520: fdatasync de/d18/f26 0 2024-09-21T10:40:48.292 INFO:tasks.workunit.client.1.smithi112.stdout:4/521: chown de/l73 8640496 1 2024-09-21T10:40:48.292 INFO:tasks.workunit.client.1.smithi112.stdout:4/522: dread - de/d2a/d31/d8d/d9d/f9f zero size 2024-09-21T10:40:48.292 INFO:tasks.workunit.client.1.smithi112.stdout:4/523: stat de/d33/d6f/c89 0 2024-09-21T10:40:48.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/475: dread d2/f18 [0,4194304] 0 2024-09-21T10:40:48.293 INFO:tasks.workunit.client.1.smithi112.stdout:3/476: fdatasync d2/d22/d31/d2a/d39/d3a/f5b 0 2024-09-21T10:40:48.294 INFO:tasks.workunit.client.1.smithi112.stdout:6/531: unlink d4/c5 0 2024-09-21T10:40:48.296 INFO:tasks.workunit.client.0.smithi060.stdout:6/19: unlink f2 0 2024-09-21T10:40:48.297 INFO:tasks.workunit.client.0.smithi060.stdout:6/20: chown d3 1 1 2024-09-21T10:40:48.298 INFO:tasks.workunit.client.1.smithi112.stdout:4/524: rename de/d33/d6f/d9c/d3e/d57/fa3 to de/d33/d6f/d9c/d3e/fb0 0 2024-09-21T10:40:48.299 INFO:tasks.workunit.client.1.smithi112.stdout:6/532: dread d4/d6/da/d14/f8e [0,4194304] 0 2024-09-21T10:40:48.300 INFO:tasks.workunit.client.1.smithi112.stdout:3/477: truncate d2/d1f/f25 583483 0 2024-09-21T10:40:48.300 INFO:tasks.workunit.client.1.smithi112.stdout:9/540: dread d1/d2/d42/f72 [0,4194304] 0 2024-09-21T10:40:48.301 INFO:tasks.workunit.client.0.smithi060.stdout:9/47: mknod d3/d16/c18 0 2024-09-21T10:40:48.301 INFO:tasks.workunit.client.0.smithi060.stdout:9/48: write f2 [688488,40006] 0 2024-09-21T10:40:48.301 INFO:tasks.workunit.client.0.smithi060.stdout:9/49: chown d3/c13 1500 1 2024-09-21T10:40:48.302 INFO:tasks.workunit.client.0.smithi060.stdout:9/50: dread d3/f9 [0,4194304] 0 2024-09-21T10:40:48.303 INFO:tasks.workunit.client.1.smithi112.stdout:4/525: creat de/d33/d2f/d71/fb1 x:0 0 0 2024-09-21T10:40:48.304 INFO:tasks.workunit.client.0.smithi060.stdout:4/25: symlink d0/l9 0 2024-09-21T10:40:48.304 INFO:tasks.workunit.client.0.smithi060.stdout:4/26: write d0/f2 [2522325,65064] 0 2024-09-21T10:40:48.304 INFO:tasks.workunit.client.0.smithi060.stdout:4/27: read - d0/f6 zero size 2024-09-21T10:40:48.305 INFO:tasks.workunit.client.0.smithi060.stdout:3/14: getdents d0/d1 0 2024-09-21T10:40:48.305 INFO:tasks.workunit.client.0.smithi060.stdout:3/15: readlink d0/d1/l3 0 2024-09-21T10:40:48.305 INFO:tasks.workunit.client.0.smithi060.stdout:3/16: dread - no filename 2024-09-21T10:40:48.305 INFO:tasks.workunit.client.0.smithi060.stdout:3/17: rename d0 to d0/d4 22 2024-09-21T10:40:48.307 INFO:tasks.workunit.client.0.smithi060.stdout:0/9: symlink l3 0 2024-09-21T10:40:48.309 INFO:tasks.workunit.client.0.smithi060.stdout:6/21: creat d3/f4 x:0 0 0 2024-09-21T10:40:48.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/460: dwrite f6 [0,4194304] 0 2024-09-21T10:40:48.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/461: chown d7/f14 3492575 1 2024-09-21T10:40:48.309 INFO:tasks.workunit.client.1.smithi112.stdout:7/462: creat d7/d22/d41/d4b/d5e/f95 x:0 0 0 2024-09-21T10:40:48.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/478: mknod d2/d1f/c9d 0 2024-09-21T10:40:48.310 INFO:tasks.workunit.client.1.smithi112.stdout:3/479: truncate d2/f51 1456010 0 2024-09-21T10:40:48.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/51: symlink d3/l19 0 2024-09-21T10:40:48.311 INFO:tasks.workunit.client.1.smithi112.stdout:8/483: dwrite d8/d9/dd/d2a/d43/f47 [0,4194304] 0 2024-09-21T10:40:48.311 INFO:tasks.workunit.client.0.smithi060.stdout:2/20: dwrite d3/f4 [0,4194304] 0 2024-09-21T10:40:48.313 INFO:tasks.workunit.client.1.smithi112.stdout:8/484: write d8/d9/d3c/d57/f89 [1055597,122332] 0 2024-09-21T10:40:48.314 INFO:tasks.workunit.client.1.smithi112.stdout:8/485: write d8/d9/dd/d2b/f4d [729810,30291] 0 2024-09-21T10:40:48.316 INFO:tasks.workunit.client.0.smithi060.stdout:4/28: mknod d0/d5/ca 0 2024-09-21T10:40:48.316 INFO:tasks.workunit.client.0.smithi060.stdout:4/29: chown d0/f2 9 1 2024-09-21T10:40:48.319 INFO:tasks.workunit.client.0.smithi060.stdout:3/18: symlink d0/l5 0 2024-09-21T10:40:48.322 INFO:tasks.workunit.client.0.smithi060.stdout:0/10: read - f0 zero size 2024-09-21T10:40:48.327 INFO:tasks.workunit.client.0.smithi060.stdout:4/30: mkdir d0/d5/db 0 2024-09-21T10:40:48.327 INFO:tasks.workunit.client.0.smithi060.stdout:4/31: write d0/f4 [1133645,119737] 0 2024-09-21T10:40:48.331 INFO:tasks.workunit.client.0.smithi060.stdout:3/19: creat d0/f6 x:0 0 0 2024-09-21T10:40:48.331 INFO:tasks.workunit.client.0.smithi060.stdout:3/20: dread - d0/f6 zero size 2024-09-21T10:40:48.333 INFO:tasks.workunit.client.0.smithi060.stdout:0/11: write f2 [85180,47512] 0 2024-09-21T10:40:48.333 INFO:tasks.workunit.client.0.smithi060.stdout:0/12: dread - f0 zero size 2024-09-21T10:40:48.336 INFO:tasks.workunit.client.0.smithi060.stdout:4/32: rename d0/f2 to d0/fc 0 2024-09-21T10:40:48.337 INFO:tasks.workunit.client.0.smithi060.stdout:6/22: fsync d3/f4 0 2024-09-21T10:40:48.337 INFO:tasks.workunit.client.0.smithi060.stdout:3/21: symlink d0/l7 0 2024-09-21T10:40:48.338 INFO:tasks.workunit.client.1.smithi112.stdout:6/533: dwrite d4/d6/da/d11/d1f/d22/f33 [0,4194304] 0 2024-09-21T10:40:48.338 INFO:tasks.workunit.client.1.smithi112.stdout:9/541: dwrite d1/d2/d27/d62/d70/fa6 [0,4194304] 0 2024-09-21T10:40:48.338 INFO:tasks.workunit.client.1.smithi112.stdout:9/542: chown d1/d2/d27/d3a/d6b/d30/d5e/c9d 7858084 1 2024-09-21T10:40:48.339 INFO:tasks.workunit.client.0.smithi060.stdout:2/21: dwrite f2 [0,4194304] 0 2024-09-21T10:40:48.339 INFO:tasks.workunit.client.0.smithi060.stdout:8/34: dwrite d2/f8 [0,4194304] 0 2024-09-21T10:40:48.339 INFO:tasks.workunit.client.0.smithi060.stdout:8/35: stat d2/c7 0 2024-09-21T10:40:48.341 INFO:tasks.workunit.client.0.smithi060.stdout:4/33: mknod d0/d5/db/cd 0 2024-09-21T10:40:48.344 INFO:tasks.workunit.client.1.smithi112.stdout:3/480: rename d2/d2f/f64 to d2/d22/d31/d2a/f9e 0 2024-09-21T10:40:48.345 INFO:tasks.workunit.client.0.smithi060.stdout:6/23: mknod d3/c5 0 2024-09-21T10:40:48.348 INFO:tasks.workunit.client.0.smithi060.stdout:3/22: symlink d0/d1/l8 0 2024-09-21T10:40:48.348 INFO:tasks.workunit.client.0.smithi060.stdout:3/23: truncate d0/f6 120165 0 2024-09-21T10:40:48.348 INFO:tasks.workunit.client.0.smithi060.stdout:3/24: creat d0/f9 x:0 0 0 2024-09-21T10:40:48.356 INFO:tasks.workunit.client.1.smithi112.stdout:3/481: write d2/d22/d31/d2a/d39/d3a/f5b [3360675,128493] 0 2024-09-21T10:40:48.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/526: getdents de/d18/d6d 0 2024-09-21T10:40:48.356 INFO:tasks.workunit.client.1.smithi112.stdout:4/527: fdatasync de/f15 0 2024-09-21T10:40:48.360 INFO:tasks.workunit.client.1.smithi112.stdout:4/528: dread de/d18/d6d/f8c [0,4194304] 0 2024-09-21T10:40:48.361 INFO:tasks.workunit.client.0.smithi060.stdout:2/22: rename d3/f4 to d3/f5 0 2024-09-21T10:40:48.364 INFO:tasks.workunit.client.1.smithi112.stdout:8/486: truncate d8/d9/d3c/d6d/f74 1606564 0 2024-09-21T10:40:48.364 INFO:tasks.workunit.client.1.smithi112.stdout:8/487: chown d8/d9/dd/d2b/l3a 24 1 2024-09-21T10:40:48.364 INFO:tasks.workunit.client.1.smithi112.stdout:8/488: stat d8/d9/dd/d2a/d43/d58 0 2024-09-21T10:40:48.369 INFO:tasks.workunit.client.0.smithi060.stdout:9/52: dwrite f2 [0,4194304] 0 2024-09-21T10:40:48.373 INFO:tasks.workunit.client.1.smithi112.stdout:7/463: rmdir d7/d22/d41/d54 39 2024-09-21T10:40:48.375 INFO:tasks.workunit.client.1.smithi112.stdout:8/489: write f3 [1736357,78157] 0 2024-09-21T10:40:48.375 INFO:tasks.workunit.client.1.smithi112.stdout:8/490: read d8/d9/dd/d1a/f26 [167770,57942] 0 2024-09-21T10:40:48.375 INFO:tasks.workunit.client.1.smithi112.stdout:8/491: readlink d8/l3e 0 2024-09-21T10:40:48.377 INFO:tasks.workunit.client.0.smithi060.stdout:9/53: dread d3/fa [0,4194304] 0 2024-09-21T10:40:48.380 INFO:tasks.workunit.client.0.smithi060.stdout:8/36: dwrite d2/f3 [0,4194304] 0 2024-09-21T10:40:48.381 INFO:tasks.workunit.client.1.smithi112.stdout:6/534: chown d4/d6/da/d11/d37/d8b/da0 25819653 1 2024-09-21T10:40:48.383 INFO:tasks.workunit.client.1.smithi112.stdout:2/455: sync 2024-09-21T10:40:48.383 INFO:tasks.workunit.client.1.smithi112.stdout:0/545: sync 2024-09-21T10:40:48.383 INFO:tasks.workunit.client.1.smithi112.stdout:1/653: sync 2024-09-21T10:40:48.383 INFO:tasks.workunit.client.1.smithi112.stdout:2/456: chown d0/f1d 185511 1 2024-09-21T10:40:48.387 INFO:tasks.workunit.client.0.smithi060.stdout:0/13: link l1 l4 0 2024-09-21T10:40:48.387 INFO:tasks.workunit.client.0.smithi060.stdout:0/14: fsync f0 0 2024-09-21T10:40:48.394 INFO:tasks.workunit.client.0.smithi060.stdout:3/25: unlink d0/f9 0 2024-09-21T10:40:48.397 INFO:tasks.workunit.client.0.smithi060.stdout:6/24: dwrite d3/f4 [0,4194304] 0 2024-09-21T10:40:48.397 INFO:tasks.workunit.client.0.smithi060.stdout:8/37: symlink d2/l9 0 2024-09-21T10:40:48.405 INFO:tasks.workunit.client.1.smithi112.stdout:9/543: mknod d1/d2/d27/d3a/d6b/d30/d5c/d7c/cbb 0 2024-09-21T10:40:48.405 INFO:tasks.workunit.client.1.smithi112.stdout:9/544: chown d1/d2/d27/d37/d3b/cb8 1 1 2024-09-21T10:40:48.408 INFO:tasks.workunit.client.1.smithi112.stdout:5/535: sync 2024-09-21T10:40:48.409 INFO:tasks.workunit.client.0.smithi060.stdout:6/25: mknod d3/c6 0 2024-09-21T10:40:48.409 INFO:tasks.workunit.client.1.smithi112.stdout:4/529: mknod de/d2a/d31/d8d/cb2 0 2024-09-21T10:40:48.409 INFO:tasks.workunit.client.1.smithi112.stdout:4/530: creat de/d18/d6d/d6e/d82/fb3 x:0 0 0 2024-09-21T10:40:48.412 INFO:tasks.workunit.client.0.smithi060.stdout:8/38: rename d2/l4 to d2/la 0 2024-09-21T10:40:48.412 INFO:tasks.workunit.client.1.smithi112.stdout:8/492: mkdir d8/d9/dd/d1a/d5d/d8e 0 2024-09-21T10:40:48.413 INFO:tasks.workunit.client.0.smithi060.stdout:0/15: mkdir d5 0 2024-09-21T10:40:48.415 INFO:tasks.workunit.client.1.smithi112.stdout:1/654: unlink d8/c7f 0 2024-09-21T10:40:48.417 INFO:tasks.workunit.client.1.smithi112.stdout:2/457: creat d0/d12/d6c/f9a x:0 0 0 2024-09-21T10:40:48.418 INFO:tasks.workunit.client.0.smithi060.stdout:8/39: mknod d2/cb 0 2024-09-21T10:40:48.419 INFO:tasks.workunit.client.1.smithi112.stdout:9/545: symlink d1/d2/d27/d62/lbc 0 2024-09-21T10:40:48.420 INFO:tasks.workunit.client.0.smithi060.stdout:6/26: rmdir d3 39 2024-09-21T10:40:48.422 INFO:tasks.workunit.client.1.smithi112.stdout:4/531: mknod de/d33/cb4 0 2024-09-21T10:40:48.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/482: dwrite d2/d22/d31/d2a/d39/f7a [0,4194304] 0 2024-09-21T10:40:48.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/483: readlink d2/d22/d31/d2a/d39/d60/l96 0 2024-09-21T10:40:48.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/484: chown d2/d22/d31/d2a/d39/d60/l96 658904 1 2024-09-21T10:40:48.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/485: write d2/d22/d31/d37/f83 [871837,107723] 0 2024-09-21T10:40:48.423 INFO:tasks.workunit.client.0.smithi060.stdout:6/27: symlink d3/l7 0 2024-09-21T10:40:48.424 INFO:tasks.workunit.client.1.smithi112.stdout:2/458: symlink d0/l9b 0 2024-09-21T10:40:48.426 INFO:tasks.workunit.client.1.smithi112.stdout:9/546: creat d1/d2/d27/d3a/d4c/fbd x:0 0 0 2024-09-21T10:40:48.427 INFO:tasks.workunit.client.1.smithi112.stdout:1/655: dread d8/d1a/d31/d37/f81 [0,4194304] 0 2024-09-21T10:40:48.427 INFO:tasks.workunit.client.1.smithi112.stdout:1/656: write d8/d1a/d31/d37/d9e/fcc [804034,43614] 0 2024-09-21T10:40:48.428 INFO:tasks.workunit.client.0.smithi060.stdout:6/28: symlink d3/l8 0 2024-09-21T10:40:48.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/34: dwrite d0/f4 [0,4194304] 0 2024-09-21T10:40:48.428 INFO:tasks.workunit.client.1.smithi112.stdout:4/532: mkdir de/d33/db5 0 2024-09-21T10:40:48.430 INFO:tasks.workunit.client.0.smithi060.stdout:6/29: creat d3/f9 x:0 0 0 2024-09-21T10:40:48.432 INFO:tasks.workunit.client.0.smithi060.stdout:8/40: dread f1 [0,4194304] 0 2024-09-21T10:40:48.432 INFO:tasks.workunit.client.0.smithi060.stdout:2/23: dwrite d3/f5 [0,4194304] 0 2024-09-21T10:40:48.432 INFO:tasks.workunit.client.0.smithi060.stdout:3/26: dwrite d0/f6 [0,4194304] 0 2024-09-21T10:40:48.433 INFO:tasks.workunit.client.1.smithi112.stdout:7/464: dwrite d7/f71 [0,4194304] 0 2024-09-21T10:40:48.433 INFO:tasks.workunit.client.1.smithi112.stdout:3/486: rename d2/d22/d31/d2a/f43 to d2/d22/d31/d2a/d39/d3a/d76/f9f 0 2024-09-21T10:40:48.434 INFO:tasks.workunit.client.0.smithi060.stdout:9/54: dwrite d3/f10 [0,4194304] 0 2024-09-21T10:40:48.435 INFO:tasks.workunit.client.1.smithi112.stdout:4/533: dread de/d2e/f32 [0,4194304] 0 2024-09-21T10:40:48.435 INFO:tasks.workunit.client.1.smithi112.stdout:6/535: dwrite d4/d4f/f66 [0,4194304] 0 2024-09-21T10:40:48.435 INFO:tasks.workunit.client.1.smithi112.stdout:6/536: creat d4/d6/da/d11/d1f/d22/fc4 x:0 0 0 2024-09-21T10:40:48.435 INFO:tasks.workunit.client.0.smithi060.stdout:6/30: link d3/c5 d3/ca 0 2024-09-21T10:40:48.436 INFO:tasks.workunit.client.1.smithi112.stdout:4/534: read de/d18/f3f [51028,31093] 0 2024-09-21T10:40:48.437 INFO:tasks.workunit.client.0.smithi060.stdout:4/35: dread d0/f4 [0,4194304] 0 2024-09-21T10:40:48.438 INFO:tasks.workunit.client.1.smithi112.stdout:9/547: dread d1/d2/d27/d3a/d6b/d30/f54 [0,4194304] 0 2024-09-21T10:40:48.438 INFO:tasks.workunit.client.1.smithi112.stdout:9/548: chown d1/d2/d27/d37/d3b/cb8 20972 1 2024-09-21T10:40:48.438 INFO:tasks.workunit.client.1.smithi112.stdout:2/459: unlink d0/d12/d8a/d62/d63/f17 0 2024-09-21T10:40:48.439 INFO:tasks.workunit.client.0.smithi060.stdout:8/41: creat d2/fc x:0 0 0 2024-09-21T10:40:48.441 INFO:tasks.workunit.client.1.smithi112.stdout:1/657: creat d8/d1a/d31/da1/fce x:0 0 0 2024-09-21T10:40:48.441 INFO:tasks.workunit.client.1.smithi112.stdout:1/658: truncate d8/d1a/db8/fc4 814278 0 2024-09-21T10:40:48.441 INFO:tasks.workunit.client.1.smithi112.stdout:1/659: stat d8/d54/fca 0 2024-09-21T10:40:48.444 INFO:tasks.workunit.client.0.smithi060.stdout:2/24: truncate f2 372791 0 2024-09-21T10:40:48.445 INFO:tasks.workunit.client.1.smithi112.stdout:7/465: dread d7/d22/f33 [0,4194304] 0 2024-09-21T10:40:48.445 INFO:tasks.workunit.client.1.smithi112.stdout:0/546: dwrite d3/d18/d52/d55/f5e [0,4194304] 0 2024-09-21T10:40:48.448 INFO:tasks.workunit.client.0.smithi060.stdout:9/55: read d3/f10 [3217809,20374] 0 2024-09-21T10:40:48.448 INFO:tasks.workunit.client.0.smithi060.stdout:9/56: chown l1 1925074945 1 2024-09-21T10:40:48.451 INFO:tasks.workunit.client.1.smithi112.stdout:3/487: mkdir d2/d22/d31/d37/da0 0 2024-09-21T10:40:48.456 INFO:tasks.workunit.client.0.smithi060.stdout:3/27: rename d0/l7 to d0/d1/la 0 2024-09-21T10:40:48.457 INFO:tasks.workunit.client.0.smithi060.stdout:6/31: read d3/f4 [4051237,52610] 0 2024-09-21T10:40:48.458 INFO:tasks.workunit.client.1.smithi112.stdout:7/466: read d7/f14 [939551,75410] 0 2024-09-21T10:40:48.458 INFO:tasks.workunit.client.1.smithi112.stdout:7/467: write d7/d22/d86/f7d [992046,78228] 0 2024-09-21T10:40:48.463 INFO:tasks.workunit.client.1.smithi112.stdout:7/468: dread d7/d22/f23 [0,4194304] 0 2024-09-21T10:40:48.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/16: dwrite f2 [0,4194304] 0 2024-09-21T10:40:48.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/17: getdents d5 0 2024-09-21T10:40:48.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/18: chown l4 357 1 2024-09-21T10:40:48.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/19: fdatasync f0 0 2024-09-21T10:40:48.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/20: dread - f0 zero size 2024-09-21T10:40:48.466 INFO:tasks.workunit.client.0.smithi060.stdout:0/21: write f0 [587678,86055] 0 2024-09-21T10:40:48.467 INFO:tasks.workunit.client.0.smithi060.stdout:2/25: link c1 d3/c6 0 2024-09-21T10:40:48.467 INFO:tasks.workunit.client.0.smithi060.stdout:2/26: fdatasync d3/f5 0 2024-09-21T10:40:48.468 INFO:tasks.workunit.client.0.smithi060.stdout:3/28: write d0/f6 [3890671,93471] 0 2024-09-21T10:40:48.468 INFO:tasks.workunit.client.0.smithi060.stdout:3/29: write d0/f6 [2387170,10224] 0 2024-09-21T10:40:48.468 INFO:tasks.workunit.client.0.smithi060.stdout:3/30: creat d0/fb x:0 0 0 2024-09-21T10:40:48.468 INFO:tasks.workunit.client.0.smithi060.stdout:3/31: dread - d0/fb zero size 2024-09-21T10:40:48.468 INFO:tasks.workunit.client.0.smithi060.stdout:4/36: dwrite d0/f7 [0,4194304] 0 2024-09-21T10:40:48.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/535: creat de/d33/db5/fb6 x:0 0 0 2024-09-21T10:40:48.469 INFO:tasks.workunit.client.1.smithi112.stdout:4/536: truncate de/d18/d6d/d6e/d82/fb3 108872 0 2024-09-21T10:40:48.469 INFO:tasks.workunit.client.1.smithi112.stdout:6/537: dread d4/d6/da/fa7 [0,4194304] 0 2024-09-21T10:40:48.469 INFO:tasks.workunit.client.1.smithi112.stdout:6/538: chown d4/d6/d75/f98 764669 1 2024-09-21T10:40:48.471 INFO:tasks.workunit.client.1.smithi112.stdout:9/549: unlink d1/d2/d42/l58 0 2024-09-21T10:40:48.474 INFO:tasks.workunit.client.0.smithi060.stdout:9/57: dwrite d3/fb [0,4194304] 0 2024-09-21T10:40:48.474 INFO:tasks.workunit.client.0.smithi060.stdout:9/58: write d3/ff [837010,34440] 0 2024-09-21T10:40:48.478 INFO:tasks.workunit.client.1.smithi112.stdout:1/660: creat d8/d1a/db8/dbc/fcf x:0 0 0 2024-09-21T10:40:48.479 INFO:tasks.workunit.client.0.smithi060.stdout:4/37: read d0/f7 [489906,76889] 0 2024-09-21T10:40:48.479 INFO:tasks.workunit.client.0.smithi060.stdout:4/38: write d0/f7 [3511629,39190] 0 2024-09-21T10:40:48.479 INFO:tasks.workunit.client.0.smithi060.stdout:4/39: dread - d0/f6 zero size 2024-09-21T10:40:48.479 INFO:tasks.workunit.client.0.smithi060.stdout:2/27: write d3/f5 [3437093,84256] 0 2024-09-21T10:40:48.479 INFO:tasks.workunit.client.0.smithi060.stdout:2/28: chown d3/c6 175 1 2024-09-21T10:40:48.480 INFO:tasks.workunit.client.0.smithi060.stdout:0/22: mknod d5/c6 0 2024-09-21T10:40:48.480 INFO:tasks.workunit.client.0.smithi060.stdout:0/23: chown d5/c6 125291903 1 2024-09-21T10:40:48.485 INFO:tasks.workunit.client.0.smithi060.stdout:3/32: link d0/d1/la d0/lc 0 2024-09-21T10:40:48.485 INFO:tasks.workunit.client.0.smithi060.stdout:3/33: write d0/f6 [1696547,12498] 0 2024-09-21T10:40:48.485 INFO:tasks.workunit.client.0.smithi060.stdout:3/34: creat d0/fd x:0 0 0 2024-09-21T10:40:48.487 INFO:tasks.workunit.client.0.smithi060.stdout:6/32: rmdir d3 39 2024-09-21T10:40:48.487 INFO:tasks.workunit.client.0.smithi060.stdout:6/33: write d3/f9 [648682,73023] 0 2024-09-21T10:40:48.489 INFO:tasks.workunit.client.1.smithi112.stdout:0/547: mknod d3/d4a/d4e/cae 0 2024-09-21T10:40:48.489 INFO:tasks.workunit.client.0.smithi060.stdout:4/40: dread d0/f4 [0,4194304] 0 2024-09-21T10:40:48.489 INFO:tasks.workunit.client.0.smithi060.stdout:8/42: truncate d2/f8 734002 0 2024-09-21T10:40:48.489 INFO:tasks.workunit.client.0.smithi060.stdout:8/43: chown d2/la 14754172 1 2024-09-21T10:40:48.495 INFO:tasks.workunit.client.1.smithi112.stdout:3/488: mkdir d2/d22/d31/d2a/da1 0 2024-09-21T10:40:48.495 INFO:tasks.workunit.client.1.smithi112.stdout:3/489: chown d2/d22/d31/d37/f83 8026 1 2024-09-21T10:40:48.495 INFO:tasks.workunit.client.0.smithi060.stdout:0/24: mkdir d5/d7 0 2024-09-21T10:40:48.495 INFO:tasks.workunit.client.0.smithi060.stdout:0/25: fsync f0 0 2024-09-21T10:40:48.496 INFO:tasks.workunit.client.1.smithi112.stdout:7/469: getdents d7/d22/d86 0 2024-09-21T10:40:48.502 INFO:tasks.workunit.client.1.smithi112.stdout:4/537: rename de/d33/d2f/c46 to de/d18/cb7 0 2024-09-21T10:40:48.502 INFO:tasks.workunit.client.1.smithi112.stdout:4/538: stat de/d33/d6f/d9c 0 2024-09-21T10:40:48.502 INFO:tasks.workunit.client.1.smithi112.stdout:4/539: stat de/f12 0 2024-09-21T10:40:48.502 INFO:tasks.workunit.client.1.smithi112.stdout:4/540: dread - de/d33/d6f/d9c/d3e/d57/f8e zero size 2024-09-21T10:40:48.504 INFO:tasks.workunit.client.1.smithi112.stdout:9/550: unlink d1/d2/l2e 0 2024-09-21T10:40:48.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/460: rmdir d0/d12/d8a/d62/d63 39 2024-09-21T10:40:48.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/461: write d0/d12/d8a/d62/d63/f69 [192316,24289] 0 2024-09-21T10:40:48.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/462: dread - d0/d12/d6c/d7e/f96 zero size 2024-09-21T10:40:48.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/463: fsync d0/f10 0 2024-09-21T10:40:48.505 INFO:tasks.workunit.client.1.smithi112.stdout:2/464: getdents d0/d12/d46/d95 0 2024-09-21T10:40:48.507 INFO:tasks.workunit.client.0.smithi060.stdout:0/26: read f2 [659628,69408] 0 2024-09-21T10:40:48.507 INFO:tasks.workunit.client.1.smithi112.stdout:1/661: mknod d8/d1a/d31/da1/cd0 0 2024-09-21T10:40:48.508 INFO:tasks.workunit.client.0.smithi060.stdout:3/35: link d0/d1/l3 d0/le 0 2024-09-21T10:40:48.509 INFO:tasks.workunit.client.1.smithi112.stdout:0/548: creat d3/d4/d43/faf x:0 0 0 2024-09-21T10:40:48.512 INFO:tasks.workunit.client.1.smithi112.stdout:3/490: link d2/d22/c55 d2/d22/d31/d37/ca2 0 2024-09-21T10:40:48.514 INFO:tasks.workunit.client.0.smithi060.stdout:4/41: dwrite d0/f6 [0,4194304] 0 2024-09-21T10:40:48.514 INFO:tasks.workunit.client.0.smithi060.stdout:4/42: chown d0/l8 140645 1 2024-09-21T10:40:48.514 INFO:tasks.workunit.client.0.smithi060.stdout:4/43: chown d0/d5/db 10 1 2024-09-21T10:40:48.514 INFO:tasks.workunit.client.0.smithi060.stdout:6/34: unlink d3/f4 0 2024-09-21T10:40:48.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/539: rename d4/dc/d1a/d31/d3c/f9e to d4/dc/d1a/d31/d56/fc5 0 2024-09-21T10:40:48.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/540: write d4/dc/d1a/d31/d3c/fc1 [779103,113282] 0 2024-09-21T10:40:48.517 INFO:tasks.workunit.client.1.smithi112.stdout:6/541: dread - d4/d6/da/d11/d37/d19/fb0 zero size 2024-09-21T10:40:48.517 INFO:tasks.workunit.client.0.smithi060.stdout:8/44: truncate f1 410939 0 2024-09-21T10:40:48.517 INFO:tasks.workunit.client.0.smithi060.stdout:8/45: truncate d2/fc 43071 0 2024-09-21T10:40:48.519 INFO:tasks.workunit.client.0.smithi060.stdout:9/59: getdents d3/d15 0 2024-09-21T10:40:48.521 INFO:tasks.workunit.client.0.smithi060.stdout:3/36: link d0/d1/la d0/lf 0 2024-09-21T10:40:48.522 INFO:tasks.workunit.client.1.smithi112.stdout:0/549: stat d3/d4/d10/c16 0 2024-09-21T10:40:48.526 INFO:tasks.workunit.client.1.smithi112.stdout:7/470: rename d7/d22/d47/f68 to d7/d22/d41/d56/d5c/f96 0 2024-09-21T10:40:48.530 INFO:tasks.workunit.client.1.smithi112.stdout:6/542: stat d4/d6/da/d14/d49/d73/d74/fa8 0 2024-09-21T10:40:48.531 INFO:tasks.workunit.client.1.smithi112.stdout:1/662: dwrite d8/d1a/d53/d76/fbb [0,4194304] 0 2024-09-21T10:40:48.531 INFO:tasks.workunit.client.1.smithi112.stdout:1/663: creat d8/d1a/d53/d57/d83/fd1 x:0 0 0 2024-09-21T10:40:48.531 INFO:tasks.workunit.client.1.smithi112.stdout:1/664: stat d8/l48 0 2024-09-21T10:40:48.531 INFO:tasks.workunit.client.1.smithi112.stdout:9/551: dwrite d1/d2/d27/f7d [0,4194304] 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:1/665: creat d8/d1a/d53/d57/fd2 x:0 0 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:9/552: fsync d1/d2/f79 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:9/553: truncate d1/d2/f48 4332021 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:9/554: creat d1/d2/d27/d3a/fbe x:0 0 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:9/555: write d1/d2/d27/d3a/f56 [1216001,107977] 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:9/556: write d1/d2/f75 [895965,39043] 0 2024-09-21T10:40:48.532 INFO:tasks.workunit.client.1.smithi112.stdout:9/557: stat d1/d2/d27/d3a/d4c/fbd 0 2024-09-21T10:40:48.533 INFO:tasks.workunit.client.0.smithi060.stdout:4/44: creat d0/d5/fe x:0 0 0 2024-09-21T10:40:48.533 INFO:tasks.workunit.client.0.smithi060.stdout:4/45: write d0/fc [4504714,94862] 0 2024-09-21T10:40:48.533 INFO:tasks.workunit.client.1.smithi112.stdout:0/550: creat d3/d4/d1a/d21/d4f/d83/fb0 x:0 0 0 2024-09-21T10:40:48.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/35: link d3/f9 d3/fb 0 2024-09-21T10:40:48.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.532+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b8410ef80 con 0x7f8b84100dc0 2024-09-21T10:40:48.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.534+0000 7f8b7a7fc640 1 -- 172.21.15.60:0/961510884 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f8b74058b00 con 0x7f8b84100dc0 2024-09-21T10:40:48.536 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:40:48.536 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:40:48.536 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:40:48.536 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:40:48.536 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:40:48.537 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:40:48.538 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:40:48.539 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:40:48.540 INFO:tasks.workunit.client.0.smithi060.stdout:8/46: symlink d2/ld 0 2024-09-21T10:40:48.540 INFO:tasks.workunit.client.0.smithi060.stdout:8/47: creat d2/fe x:0 0 0 2024-09-21T10:40:48.540 INFO:tasks.workunit.client.1.smithi112.stdout:4/541: rename de/d2a/l2c to de/d18/d6d/d6e/lb8 0 2024-09-21T10:40:48.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8b70073ed0 msgr2=0x7f8b70076390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:48.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8b70073ed0 0x7f8b70076390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b800314e0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 msgr2=0x7f8b8419c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 0x7f8b8419c1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400e970 tx=0x7f8b7400ee30 comp rx=0 tx=0).stop 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 shutdown_connections 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8b70073ed0 0x7f8b70076390 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b84100dc0 0x7f8b8419c1b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 --2- 172.21.15.60:0/961510884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b840fe470 0x7f8b8419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.538+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 >> 172.21.15.60:0/961510884 conn(0x7f8b840fa280 msgr2=0x7f8b840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.539+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 shutdown_connections 2024-09-21T10:40:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.539+0000 7f8b8b6fc640 1 -- 172.21.15.60:0/961510884 wait complete. 2024-09-21T10:40:48.543 INFO:tasks.workunit.client.1.smithi112.stdout:1/666: write d8/d1a/d31/d37/f8a [2798734,54180] 0 2024-09-21T10:40:48.545 INFO:tasks.workunit.client.0.smithi060.stdout:3/37: unlink d0/f6 0 2024-09-21T10:40:48.547 INFO:tasks.workunit.client.1.smithi112.stdout:1/667: write d8/d1a/d31/d37/f81 [971298,101468] 0 2024-09-21T10:40:48.548 INFO:tasks.workunit.client.1.smithi112.stdout:1/668: read d8/d20/fa7 [49136,89369] 0 2024-09-21T10:40:48.550 INFO:tasks.workunit.client.1.smithi112.stdout:6/543: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:48.560 INFO:tasks.workunit.client.0.smithi060.stdout:9/60: dwrite d3/fc [0,4194304] 0 2024-09-21T10:40:48.561 INFO:tasks.workunit.client.0.smithi060.stdout:0/27: truncate f2 3723715 0 2024-09-21T10:40:48.561 INFO:tasks.workunit.client.0.smithi060.stdout:0/28: chown l4 365 1 2024-09-21T10:40:48.563 INFO:tasks.workunit.client.1.smithi112.stdout:9/558: rename d1/d2/d27/d3a/d6b/l98 to d1/d2/d27/d3a/d6b/lbf 0 2024-09-21T10:40:48.563 INFO:tasks.workunit.client.1.smithi112.stdout:9/559: fsync d1/d2/d27/d3a/fb6 0 2024-09-21T10:40:48.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/551: getdents d3 0 2024-09-21T10:40:48.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/552: chown d3/d18/d52/la4 1 1 2024-09-21T10:40:48.566 INFO:tasks.workunit.client.1.smithi112.stdout:2/465: rename d0/d12/d8a/d62/d63/d99/c85 to d0/d12/c9c 0 2024-09-21T10:40:48.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/544: mkdir d4/d6/d75/db7/dc6 0 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:9/560: symlink d1/d2/d27/d37/d68/lc0 0 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:9/561: readlink d1/d2/d27/d3a/l2b 0 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/536: sync 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:8/493: sync 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:8/494: stat d8/d9/dd/d76 0 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:8/495: chown d8/d9/dd/d76 0 1 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:5/537: fdatasync d9/d15/d18/d20/d55/f58 0 2024-09-21T10:40:48.571 INFO:tasks.workunit.client.1.smithi112.stdout:8/496: chown d8/d9/dd/cf 92280 1 2024-09-21T10:40:48.574 INFO:tasks.workunit.client.1.smithi112.stdout:0/553: rename d3/d4/d1a/f17 to d3/d4/d43/fb1 0 2024-09-21T10:40:48.575 INFO:tasks.workunit.client.1.smithi112.stdout:9/562: dread d1/d2/d27/f44 [0,4194304] 0 2024-09-21T10:40:48.575 INFO:tasks.workunit.client.1.smithi112.stdout:9/563: fsync d1/f6d 0 2024-09-21T10:40:48.575 INFO:tasks.workunit.client.1.smithi112.stdout:3/491: dwrite d2/d2f/d3f/f99 [0,4194304] 0 2024-09-21T10:40:48.575 INFO:tasks.workunit.client.0.smithi060.stdout:4/46: dread d0/f7 [4194304,4194304] 0 2024-09-21T10:40:48.575 INFO:tasks.workunit.client.0.smithi060.stdout:6/36: fdatasync d3/fb 0 2024-09-21T10:40:48.576 INFO:tasks.workunit.client.0.smithi060.stdout:6/37: fdatasync d3/fb 0 2024-09-21T10:40:48.576 INFO:tasks.workunit.client.1.smithi112.stdout:2/466: link d0/d12/d8a/d62/d63/l31 d0/d12/d46/l9d 0 2024-09-21T10:40:48.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/471: dwrite d7/d22/d41/d56/d72/d79/d8a/f8d [0,4194304] 0 2024-09-21T10:40:48.579 INFO:tasks.workunit.client.1.smithi112.stdout:4/542: dwrite de/d33/d6f/d9c/f7a [0,4194304] 0 2024-09-21T10:40:48.579 INFO:tasks.workunit.client.1.smithi112.stdout:1/669: dwrite d8/d1a/d53/d57/f90 [4194304,4194304] 0 2024-09-21T10:40:48.579 INFO:tasks.workunit.client.1.smithi112.stdout:1/670: creat d8/d1a/d53/d57/fd3 x:0 0 0 2024-09-21T10:40:48.579 INFO:tasks.workunit.client.0.smithi060.stdout:3/38: dwrite d0/fb [0,4194304] 0 2024-09-21T10:40:48.582 INFO:tasks.workunit.client.0.smithi060.stdout:4/47: getdents d0/d5/db 0 2024-09-21T10:40:48.582 INFO:tasks.workunit.client.0.smithi060.stdout:4/48: write d0/f7 [4648908,109767] 0 2024-09-21T10:40:48.583 INFO:tasks.workunit.client.0.smithi060.stdout:8/48: dwrite d2/f3 [0,4194304] 0 2024-09-21T10:40:48.584 INFO:tasks.workunit.client.0.smithi060.stdout:8/49: creat d2/ff x:0 0 0 2024-09-21T10:40:48.584 INFO:tasks.workunit.client.0.smithi060.stdout:8/50: truncate d2/ff 857386 0 2024-09-21T10:40:48.584 INFO:tasks.workunit.client.0.smithi060.stdout:8/51: readlink d2/l9 0 2024-09-21T10:40:48.584 INFO:tasks.workunit.client.0.smithi060.stdout:8/52: write d2/fe [616920,92898] 0 2024-09-21T10:40:48.584 INFO:tasks.workunit.client.0.smithi060.stdout:8/53: write d2/fe [1562101,8922] 0 2024-09-21T10:40:48.588 INFO:tasks.workunit.client.0.smithi060.stdout:6/38: symlink d3/lc 0 2024-09-21T10:40:48.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/492: rmdir d2/d22/d31/d2a/d39 39 2024-09-21T10:40:48.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/493: readlink d2/d22/l63 0 2024-09-21T10:40:48.590 INFO:tasks.workunit.client.1.smithi112.stdout:8/497: dwrite d8/f78 [0,4194304] 0 2024-09-21T10:40:48.593 INFO:tasks.workunit.client.1.smithi112.stdout:5/538: dread d9/d15/d18/d20/d47/f75 [0,4194304] 0 2024-09-21T10:40:48.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/564: symlink d1/d2/d27/d37/d3b/d69/d77/lc1 0 2024-09-21T10:40:48.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/565: chown d1/d2/d27/d3a/d4c/c91 20194491 1 2024-09-21T10:40:48.595 INFO:tasks.workunit.client.1.smithi112.stdout:2/467: write d0/dd/d47/f6b [2288228,92615] 0 2024-09-21T10:40:48.596 INFO:tasks.workunit.client.0.smithi060.stdout:3/39: mkdir d0/d10 0 2024-09-21T10:40:48.600 INFO:tasks.workunit.client.1.smithi112.stdout:0/554: dwrite d3/d4a/d4e/f63 [0,4194304] 0 2024-09-21T10:40:48.602 INFO:tasks.workunit.client.0.smithi060.stdout:4/49: mkdir d0/df 0 2024-09-21T10:40:48.610 INFO:tasks.workunit.client.0.smithi060.stdout:3/40: dread d0/fb [0,4194304] 0 2024-09-21T10:40:48.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/41: dread - d0/fd zero size 2024-09-21T10:40:48.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/42: write d0/fd [194887,124368] 0 2024-09-21T10:40:48.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/43: truncate d0/fd 818100 0 2024-09-21T10:40:48.619 INFO:tasks.workunit.client.0.smithi060.stdout:8/54: symlink d2/l10 0 2024-09-21T10:40:48.620 INFO:tasks.workunit.client.0.smithi060.stdout:6/39: mkdir d3/dd 0 2024-09-21T10:40:48.621 INFO:tasks.workunit.client.1.smithi112.stdout:7/472: mkdir d7/d22/d41/d56/d97 0 2024-09-21T10:40:48.622 INFO:tasks.workunit.client.1.smithi112.stdout:7/473: read - d7/d22/d41/d4b/d5e/f95 zero size 2024-09-21T10:40:48.625 INFO:tasks.workunit.client.0.smithi060.stdout:6/40: symlink d3/dd/le 0 2024-09-21T10:40:48.626 INFO:tasks.workunit.client.1.smithi112.stdout:5/539: dwrite d9/d15/d18/d3a/d61/d93/f98 [0,4194304] 0 2024-09-21T10:40:48.626 INFO:tasks.workunit.client.1.smithi112.stdout:8/498: dwrite d8/d9/dd/f16 [4194304,4194304] 0 2024-09-21T10:40:48.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/50: rmdir d0/d5 39 2024-09-21T10:40:48.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/51: write d0/f7 [3745601,71504] 0 2024-09-21T10:40:48.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/52: truncate d0/d5/fe 746418 0 2024-09-21T10:40:48.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/53: write d0/d5/fe [1294225,109777] 0 2024-09-21T10:40:48.628 INFO:tasks.workunit.client.0.smithi060.stdout:6/41: creat d3/ff x:0 0 0 2024-09-21T10:40:48.628 INFO:tasks.workunit.client.0.smithi060.stdout:6/42: chown d3/lc 8358568 1 2024-09-21T10:40:48.629 INFO:tasks.workunit.client.0.smithi060.stdout:9/61: dwrite d3/fe [0,4194304] 0 2024-09-21T10:40:48.631 INFO:tasks.workunit.client.0.smithi060.stdout:0/29: dwrite f2 [0,4194304] 0 2024-09-21T10:40:48.632 INFO:tasks.workunit.client.0.smithi060.stdout:0/30: write f0 [1365485,98625] 0 2024-09-21T10:40:48.632 INFO:tasks.workunit.client.1.smithi112.stdout:2/468: dwrite d0/d12/d8a/f52 [0,4194304] 0 2024-09-21T10:40:48.633 INFO:tasks.workunit.client.0.smithi060.stdout:6/43: mknod d3/c10 0 2024-09-21T10:40:48.636 INFO:tasks.workunit.client.1.smithi112.stdout:2/469: dread d0/d12/d8a/d62/d63/f69 [0,4194304] 0 2024-09-21T10:40:48.636 INFO:tasks.workunit.client.1.smithi112.stdout:2/470: write d0/d12/d8a/f5a [4260282,59305] 0 2024-09-21T10:40:48.636 INFO:tasks.workunit.client.1.smithi112.stdout:2/471: write d0/f2f [1017519,52502] 0 2024-09-21T10:40:48.641 INFO:tasks.workunit.client.0.smithi060.stdout:8/55: dread d2/f3 [0,4194304] 0 2024-09-21T10:40:48.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/62: rmdir d3/d16 39 2024-09-21T10:40:48.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/63: chown d3/f14 77526 1 2024-09-21T10:40:48.644 INFO:tasks.workunit.client.0.smithi060.stdout:0/31: unlink l1 0 2024-09-21T10:40:48.649 INFO:tasks.workunit.client.0.smithi060.stdout:0/32: getdents d5 0 2024-09-21T10:40:48.650 INFO:tasks.workunit.client.1.smithi112.stdout:9/566: unlink d1/d7f/l83 0 2024-09-21T10:40:48.651 INFO:tasks.workunit.client.0.smithi060.stdout:8/56: rmdir d2 39 2024-09-21T10:40:48.653 INFO:tasks.workunit.client.1.smithi112.stdout:0/555: symlink d3/d23/lb2 0 2024-09-21T10:40:48.654 INFO:tasks.workunit.client.0.smithi060.stdout:4/54: dwrite d0/d5/fe [0,4194304] 0 2024-09-21T10:40:48.656 INFO:tasks.workunit.client.1.smithi112.stdout:6/545: link d4/d6/da/l2b d4/d6/da/lc7 0 2024-09-21T10:40:48.656 INFO:tasks.workunit.client.1.smithi112.stdout:6/546: stat d4/d6/ca6 0 2024-09-21T10:40:48.659 INFO:tasks.workunit.client.1.smithi112.stdout:8/499: dwrite d8/d9/dd/d2a/f77 [0,4194304] 0 2024-09-21T10:40:48.660 INFO:tasks.workunit.client.0.smithi060.stdout:8/57: mknod d2/c11 0 2024-09-21T10:40:48.661 INFO:tasks.workunit.client.0.smithi060.stdout:6/44: dwrite d3/ff [0,4194304] 0 2024-09-21T10:40:48.662 INFO:tasks.workunit.client.1.smithi112.stdout:7/474: link d7/f71 d7/d22/d41/d56/d72/d79/f98 0 2024-09-21T10:40:48.662 INFO:tasks.workunit.client.1.smithi112.stdout:7/475: stat d7/d22/f28 0 2024-09-21T10:40:48.663 INFO:tasks.workunit.client.0.smithi060.stdout:9/64: write d3/fb [2532990,30097] 0 2024-09-21T10:40:48.668 INFO:tasks.workunit.client.0.smithi060.stdout:8/58: unlink c0 0 2024-09-21T10:40:48.668 INFO:tasks.workunit.client.0.smithi060.stdout:8/59: stat d2/ld 0 2024-09-21T10:40:48.670 INFO:tasks.workunit.client.1.smithi112.stdout:5/540: mkdir d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1 0 2024-09-21T10:40:48.672 INFO:tasks.workunit.client.0.smithi060.stdout:3/44: dwrite d0/fd [0,4194304] 0 2024-09-21T10:40:48.679 INFO:tasks.workunit.client.0.smithi060.stdout:9/65: mkdir d3/d16/d1a 0 2024-09-21T10:40:48.679 INFO:tasks.workunit.client.0.smithi060.stdout:9/66: chown d3/d16/c18 0 1 2024-09-21T10:40:48.679 INFO:tasks.workunit.client.0.smithi060.stdout:9/67: write d3/f10 [1824703,34731] 0 2024-09-21T10:40:48.679 INFO:tasks.workunit.client.0.smithi060.stdout:9/68: read d3/f10 [1555754,96599] 0 2024-09-21T10:40:48.684 INFO:tasks.workunit.client.1.smithi112.stdout:2/472: getdents d0/d12/d6c/d7e/d8f 0 2024-09-21T10:40:48.687 INFO:tasks.workunit.client.1.smithi112.stdout:5/541: write d9/d6e/f8e [1567765,60299] 0 2024-09-21T10:40:48.689 INFO:tasks.workunit.client.1.smithi112.stdout:9/567: creat d1/d2/d27/d3a/d6b/d30/d5c/fc2 x:0 0 0 2024-09-21T10:40:48.689 INFO:tasks.workunit.client.1.smithi112.stdout:9/568: fdatasync d1/d2/d27/d3a/d6b/d30/f54 0 2024-09-21T10:40:48.689 INFO:tasks.workunit.client.0.smithi060.stdout:6/45: truncate d3/ff 3609094 0 2024-09-21T10:40:48.695 INFO:tasks.workunit.client.0.smithi060.stdout:0/33: dwrite f2 [0,4194304] 0 2024-09-21T10:40:48.698 INFO:tasks.workunit.client.1.smithi112.stdout:0/556: dwrite d3/d4/d10/f24 [4194304,4194304] 0 2024-09-21T10:40:48.698 INFO:tasks.workunit.client.1.smithi112.stdout:0/557: stat d3/d4/d1a/d21/fad 0 2024-09-21T10:40:48.698 INFO:tasks.workunit.client.1.smithi112.stdout:0/558: chown d3/f92 372276435 1 2024-09-21T10:40:48.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/500: symlink d8/d9/l8f 0 2024-09-21T10:40:48.700 INFO:tasks.workunit.client.0.smithi060.stdout:0/34: readlink l4 0 2024-09-21T10:40:48.703 INFO:tasks.workunit.client.1.smithi112.stdout:7/476: symlink d7/d22/d41/d4b/d5e/l99 0 2024-09-21T10:40:48.703 INFO:tasks.workunit.client.1.smithi112.stdout:0/559: dread d3/d4/da8/d7f/f82 [0,4194304] 0 2024-09-21T10:40:48.703 INFO:tasks.workunit.client.0.smithi060.stdout:3/45: dwrite d0/fb [0,4194304] 0 2024-09-21T10:40:48.704 INFO:tasks.workunit.client.1.smithi112.stdout:6/547: write d4/d6/da/fb [6156456,111350] 0 2024-09-21T10:40:48.704 INFO:tasks.workunit.client.1.smithi112.stdout:2/473: truncate d0/dd/f42 2828062 0 2024-09-21T10:40:48.704 INFO:tasks.workunit.client.1.smithi112.stdout:6/548: truncate d4/d6/da/d11/d1f/d22/f33 5132695 0 2024-09-21T10:40:48.704 INFO:tasks.workunit.client.1.smithi112.stdout:6/549: write d4/d6/da/d11/d1f/d22/f58 [1955131,43473] 0 2024-09-21T10:40:48.705 INFO:tasks.workunit.client.1.smithi112.stdout:5/542: symlink d9/d15/d18/d20/la2 0 2024-09-21T10:40:48.705 INFO:tasks.workunit.client.1.smithi112.stdout:5/543: fdatasync d9/ff 0 2024-09-21T10:40:48.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/46: unlink d0/fb 0 2024-09-21T10:40:48.707 INFO:tasks.workunit.client.1.smithi112.stdout:9/569: rename d1/d2/d27/d3a/d6b/d30/d5c/d7c/fb1 to d1/d2/d27/d37/fc3 0 2024-09-21T10:40:48.707 INFO:tasks.workunit.client.1.smithi112.stdout:9/570: creat d1/d2/fc4 x:0 0 0 2024-09-21T10:40:48.708 INFO:tasks.workunit.client.0.smithi060.stdout:4/55: dwrite d0/f6 [0,4194304] 0 2024-09-21T10:40:48.709 INFO:tasks.workunit.client.0.smithi060.stdout:8/60: dwrite f1 [0,4194304] 0 2024-09-21T10:40:48.710 INFO:tasks.workunit.client.0.smithi060.stdout:6/46: dwrite d3/fb [0,4194304] 0 2024-09-21T10:40:48.712 INFO:tasks.workunit.client.0.smithi060.stdout:3/47: unlink d0/d1/la 0 2024-09-21T10:40:48.720 INFO:tasks.workunit.client.0.smithi060.stdout:0/35: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:48.723 INFO:tasks.workunit.client.0.smithi060.stdout:6/47: mknod d3/c11 0 2024-09-21T10:40:48.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.721+0000 7f7167029640 1 -- 172.21.15.60:0/1000149088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71601073f0 msgr2=0x7f7160107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:48.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.721+0000 7f7167029640 1 --2- 172.21.15.60:0/1000149088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71601073f0 0x7f7160107850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097e0 tx=0x7f714c02a3f0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.722+0000 7f7167029640 1 -- 172.21.15.60:0/1000149088 shutdown_connections 2024-09-21T10:40:48.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.722+0000 7f7167029640 1 --2- 172.21.15.60:0/1000149088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71601073f0 0x7f7160107850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.722+0000 7f7167029640 1 --2- 172.21.15.60:0/1000149088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7160106670 0x7f7160106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.722+0000 7f7167029640 1 -- 172.21.15.60:0/1000149088 >> 172.21.15.60:0/1000149088 conn(0x7f7160075530 msgr2=0x7f7160077970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:48.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.722+0000 7f7167029640 1 -- 172.21.15.60:0/1000149088 shutdown_connections 2024-09-21T10:40:48.725 INFO:tasks.workunit.client.1.smithi112.stdout:8/501: mkdir d8/d9/d3c/d90 0 2024-09-21T10:40:48.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.723+0000 7f7167029640 1 -- 172.21.15.60:0/1000149088 wait complete. 2024-09-21T10:40:48.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.724+0000 7f7167029640 1 Processor -- start 2024-09-21T10:40:48.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.724+0000 7f7167029640 1 -- start start 2024-09-21T10:40:48.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.724+0000 7f7167029640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7160106670 0x7f716019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:48.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.724+0000 7f7167029640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 0x7f716019bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:48.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.724+0000 7f7167029640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716019c510 con 0x7f71601073f0 2024-09-21T10:40:48.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.724+0000 7f7167029640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716019c680 con 0x7f7160106670 2024-09-21T10:40:48.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f715ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 0x7f716019bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:48.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f7164dc5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7160106670 0x7f716019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:48.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f715ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 0x7f716019bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34438/0 (socket says 172.21.15.60:34438) 2024-09-21T10:40:48.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f715ffff640 1 -- 172.21.15.60:0/2369280126 learned_addr learned my addr 172.21.15.60:0/2369280126 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:48.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f7164dc5640 1 -- 172.21.15.60:0/2369280126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 msgr2=0x7f716019bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:48.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f7164dc5640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 0x7f716019bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:48.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f7164dc5640 1 -- 172.21.15.60:0/2369280126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009490 con 0x7f7160106670 2024-09-21T10:40:48.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.725+0000 7f715ffff640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 0x7f716019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:40:48.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.726+0000 7f7164dc5640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7160106670 0x7f716019ba00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f715400e710 tx=0x7f715400ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:48.728 INFO:tasks.workunit.client.1.smithi112.stdout:7/477: unlink d7/d22/f33 0 2024-09-21T10:40:48.729 INFO:tasks.workunit.client.1.smithi112.stdout:2/474: mknod d0/dd/c9e 0 2024-09-21T10:40:48.732 INFO:tasks.workunit.client.1.smithi112.stdout:6/550: rmdir d4/d6/da/d11 39 2024-09-21T10:40:48.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.732+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715400ca80 con 0x7f7160106670 2024-09-21T10:40:48.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.732+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f715400cbe0 con 0x7f7160106670 2024-09-21T10:40:48.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.732+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7154018700 con 0x7f7160106670 2024-09-21T10:40:48.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.732+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71601a1120 con 0x7f7160106670 2024-09-21T10:40:48.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.733+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71601a15b0 con 0x7f7160106670 2024-09-21T10:40:48.735 INFO:tasks.workunit.client.1.smithi112.stdout:5/544: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/la3 0 2024-09-21T10:40:48.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.734+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7160195d20 con 0x7f7160106670 2024-09-21T10:40:48.738 INFO:tasks.workunit.client.0.smithi060.stdout:3/48: dwrite d0/fd [0,4194304] 0 2024-09-21T10:40:48.738 INFO:tasks.workunit.client.0.smithi060.stdout:0/36: write f2 [8379973,83670] 0 2024-09-21T10:40:48.738 INFO:tasks.workunit.client.0.smithi060.stdout:6/48: mkdir d3/d12 0 2024-09-21T10:40:48.738 INFO:tasks.workunit.client.0.smithi060.stdout:4/56: truncate d0/f4 4328113 0 2024-09-21T10:40:48.738 INFO:tasks.workunit.client.0.smithi060.stdout:4/57: readlink d0/l9 0 2024-09-21T10:40:48.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.736+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f715400cd50 con 0x7f7160106670 2024-09-21T10:40:48.740 INFO:tasks.workunit.client.1.smithi112.stdout:1/671: sync 2024-09-21T10:40:48.740 INFO:tasks.workunit.client.1.smithi112.stdout:3/494: sync 2024-09-21T10:40:48.740 INFO:tasks.workunit.client.1.smithi112.stdout:4/543: sync 2024-09-21T10:40:48.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.737+0000 7f715dffb640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7150073f70 0x7f7150076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:48.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.737+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7154014070 con 0x7f7160106670 2024-09-21T10:40:48.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.738+0000 7f715ffff640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7150073f70 0x7f7150076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:48.741 INFO:tasks.workunit.client.1.smithi112.stdout:0/560: rename d3/d4/d1a/d21/c40 to d3/d18/d45/cb3 0 2024-09-21T10:40:48.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.739+0000 7f715ffff640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7150073f70 0x7f7150076430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b230 tx=0x7f714c005c90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:48.743 INFO:tasks.workunit.client.1.smithi112.stdout:4/544: dread de/d2e/f32 [0,4194304] 0 2024-09-21T10:40:48.744 INFO:tasks.workunit.client.1.smithi112.stdout:5/545: dread d9/d15/d1d/f21 [0,4194304] 0 2024-09-21T10:40:48.747 INFO:tasks.workunit.client.1.smithi112.stdout:9/571: mkdir d1/d2/d27/dc5 0 2024-09-21T10:40:48.748 INFO:tasks.workunit.client.1.smithi112.stdout:9/572: chown d1/d2/d27/c47 296392326 1 2024-09-21T10:40:48.748 INFO:tasks.workunit.client.0.smithi060.stdout:3/49: chown d0/le 837 1 2024-09-21T10:40:48.748 INFO:tasks.workunit.client.1.smithi112.stdout:8/502: dwrite d8/d9/dd/d1a/f80 [0,4194304] 0 2024-09-21T10:40:48.748 INFO:tasks.workunit.client.1.smithi112.stdout:8/503: write d8/d9/dd/f20 [1287434,115028] 0 2024-09-21T10:40:48.749 INFO:tasks.workunit.client.1.smithi112.stdout:2/475: mknod d0/d12/d76/c9f 0 2024-09-21T10:40:48.751 INFO:tasks.workunit.client.1.smithi112.stdout:3/495: dread d2/d22/d31/d2a/d39/f7a [0,4194304] 0 2024-09-21T10:40:48.751 INFO:tasks.workunit.client.1.smithi112.stdout:6/551: dread - d4/d6/da/d11/d1f/d22/fba zero size 2024-09-21T10:40:48.751 INFO:tasks.workunit.client.0.smithi060.stdout:4/58: write d0/f6 [2596255,9150] 0 2024-09-21T10:40:48.751 INFO:tasks.workunit.client.0.smithi060.stdout:4/59: write d0/f6 [1950984,5270] 0 2024-09-21T10:40:48.752 INFO:tasks.workunit.client.1.smithi112.stdout:7/478: dwrite d7/d22/f38 [4194304,4194304] 0 2024-09-21T10:40:48.753 INFO:tasks.workunit.client.0.smithi060.stdout:6/49: mknod d3/dd/c13 0 2024-09-21T10:40:48.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:48.753+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f7154055ce0 con 0x7f7160106670 2024-09-21T10:40:48.757 INFO:tasks.workunit.client.1.smithi112.stdout:1/672: creat d8/d54/db0/db1/fd4 x:0 0 0 2024-09-21T10:40:48.757 INFO:tasks.workunit.client.1.smithi112.stdout:1/673: creat d8/d1a/d53/fd5 x:0 0 0 2024-09-21T10:40:48.757 INFO:tasks.workunit.client.1.smithi112.stdout:1/674: creat d8/d7a/fd6 x:0 0 0 2024-09-21T10:40:48.757 INFO:tasks.workunit.client.1.smithi112.stdout:1/675: dread - d8/d1a/d53/d57/fd3 zero size 2024-09-21T10:40:48.757 INFO:tasks.workunit.client.1.smithi112.stdout:1/676: getdents d8/d54/d6d/db5/dc2 0 2024-09-21T10:40:48.762 INFO:tasks.workunit.client.0.smithi060.stdout:3/50: chown d0/d10 0 1 2024-09-21T10:40:48.763 INFO:tasks.workunit.client.1.smithi112.stdout:3/496: read d2/d1f/f92 [2244550,58144] 0 2024-09-21T10:40:48.763 INFO:tasks.workunit.client.1.smithi112.stdout:3/497: chown d2/d22/d31/d37/f83 0 1 2024-09-21T10:40:48.763 INFO:tasks.workunit.client.1.smithi112.stdout:3/498: fsync d2/d22/d31/d2a/d39/d3a/f47 0 2024-09-21T10:40:48.764 INFO:tasks.workunit.client.1.smithi112.stdout:0/561: creat d3/d4a/fb4 x:0 0 0 2024-09-21T10:40:48.766 INFO:tasks.workunit.client.0.smithi060.stdout:4/60: dread d0/f6 [0,4194304] 0 2024-09-21T10:40:48.766 INFO:tasks.workunit.client.0.smithi060.stdout:0/37: creat d5/d7/f8 x:0 0 0 2024-09-21T10:40:48.767 INFO:tasks.workunit.client.0.smithi060.stdout:0/38: read f2 [8241922,4411] 0 2024-09-21T10:40:48.767 INFO:tasks.workunit.client.1.smithi112.stdout:2/476: write d0/f90 [765114,128555] 0 2024-09-21T10:40:48.768 INFO:tasks.workunit.client.0.smithi060.stdout:6/50: write d3/fb [1545524,30318] 0 2024-09-21T10:40:48.768 INFO:tasks.workunit.client.0.smithi060.stdout:6/51: stat d3/l8 0 2024-09-21T10:40:48.768 INFO:tasks.workunit.client.0.smithi060.stdout:6/52: readlink d3/l7 0 2024-09-21T10:40:48.768 INFO:tasks.workunit.client.0.smithi060.stdout:6/53: stat d3/ff 0 2024-09-21T10:40:48.769 INFO:tasks.workunit.client.1.smithi112.stdout:5/546: mknod d9/d15/d18/d3a/d4b/d71/ca4 0 2024-09-21T10:40:48.771 INFO:tasks.workunit.client.1.smithi112.stdout:8/504: dwrite d8/d9/dd/d1a/f7f [4194304,4194304] 0 2024-09-21T10:40:48.771 INFO:tasks.workunit.client.1.smithi112.stdout:8/505: chown d8/d9/d3c/f50 154937747 1 2024-09-21T10:40:48.771 INFO:tasks.workunit.client.1.smithi112.stdout:9/573: link d1/d2/d27/d37/d3b/c5b d1/d7f/cc6 0 2024-09-21T10:40:48.771 INFO:tasks.workunit.client.1.smithi112.stdout:9/574: chown d1/d2/d27/d3a/d6b/f97 842 1 2024-09-21T10:40:48.771 INFO:tasks.workunit.client.1.smithi112.stdout:9/575: getdents d1/d81 0 2024-09-21T10:40:48.771 INFO:tasks.workunit.client.1.smithi112.stdout:3/499: dread d2/d22/f29 [0,4194304] 0 2024-09-21T10:40:48.772 INFO:tasks.workunit.client.0.smithi060.stdout:4/61: rename d0/f7 to d0/d5/f10 0 2024-09-21T10:40:48.776 INFO:tasks.workunit.client.0.smithi060.stdout:0/39: read f0 [913472,72099] 0 2024-09-21T10:40:48.776 INFO:tasks.workunit.client.0.smithi060.stdout:0/40: readlink l4 0 2024-09-21T10:40:48.776 INFO:tasks.workunit.client.0.smithi060.stdout:0/41: chown d5 12491 1 2024-09-21T10:40:48.779 INFO:tasks.workunit.client.0.smithi060.stdout:6/54: creat d3/dd/f14 x:0 0 0 2024-09-21T10:40:48.779 INFO:tasks.workunit.client.0.smithi060.stdout:6/55: write d3/f9 [1125479,113092] 0 2024-09-21T10:40:48.781 INFO:tasks.workunit.client.1.smithi112.stdout:6/552: creat d4/d6/da/d14/d49/fc8 x:0 0 0 2024-09-21T10:40:48.782 INFO:tasks.workunit.client.0.smithi060.stdout:3/51: rename d0/d10 to d0/d1/d11 0 2024-09-21T10:40:48.783 INFO:tasks.workunit.client.0.smithi060.stdout:6/56: fsync d3/fb 0 2024-09-21T10:40:48.783 INFO:tasks.workunit.client.0.smithi060.stdout:6/57: chown d3/fb 40440965 1 2024-09-21T10:40:48.783 INFO:tasks.workunit.client.0.smithi060.stdout:4/62: read d0/d5/fe [2533514,56367] 0 2024-09-21T10:40:48.783 INFO:tasks.workunit.client.1.smithi112.stdout:7/479: truncate d7/d22/d41/d4b/f64 245179 0 2024-09-21T10:40:48.784 INFO:tasks.workunit.client.0.smithi060.stdout:3/52: creat d0/d1/f12 x:0 0 0 2024-09-21T10:40:48.788 INFO:tasks.workunit.client.0.smithi060.stdout:6/58: symlink d3/l15 0 2024-09-21T10:40:48.788 INFO:tasks.workunit.client.0.smithi060.stdout:0/42: dread f2 [4194304,4194304] 0 2024-09-21T10:40:48.789 INFO:tasks.workunit.client.1.smithi112.stdout:3/500: dwrite d2/d2f/d3f/f94 [4194304,4194304] 0 2024-09-21T10:40:48.792 INFO:tasks.workunit.client.0.smithi060.stdout:6/59: dread d3/f9 [0,4194304] 0 2024-09-21T10:40:48.795 INFO:tasks.workunit.client.1.smithi112.stdout:0/562: rename d3/d4/d1a/d21/fad to d3/d4/d10/fb5 0 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.800 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi112 to 2240M 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:40:48.801 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3714581553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:40:48.802 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.802 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:48 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.805 INFO:tasks.workunit.client.0.smithi060.stdout:3/53: dread d0/fd [0,4194304] 0 2024-09-21T10:40:48.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/60: rmdir d3 39 2024-09-21T10:40:48.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/61: write d3/f9 [4532502,39474] 0 2024-09-21T10:40:48.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/62: fdatasync d3/ff 0 2024-09-21T10:40:48.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/63: fsync d3/ff 0 2024-09-21T10:40:48.807 INFO:tasks.workunit.client.0.smithi060.stdout:4/63: truncate d0/f6 1727130 0 2024-09-21T10:40:48.810 INFO:tasks.workunit.client.0.smithi060.stdout:3/54: read d0/fd [3066382,65221] 0 2024-09-21T10:40:48.812 INFO:tasks.workunit.client.0.smithi060.stdout:6/64: mkdir d3/d12/d16 0 2024-09-21T10:40:48.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/64: link d0/d5/f10 d0/d5/f11 0 2024-09-21T10:40:48.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/65: write d0/fc [5089032,86865] 0 2024-09-21T10:40:48.815 INFO:tasks.workunit.client.0.smithi060.stdout:3/55: readlink d0/l5 0 2024-09-21T10:40:48.817 INFO:tasks.workunit.client.0.smithi060.stdout:4/66: mkdir d0/d5/d12 0 2024-09-21T10:40:48.819 INFO:tasks.workunit.client.0.smithi060.stdout:6/65: dread d3/fb [0,4194304] 0 2024-09-21T10:40:48.819 INFO:tasks.workunit.client.0.smithi060.stdout:6/66: fsync d3/dd/f14 0 2024-09-21T10:40:48.820 INFO:tasks.workunit.client.0.smithi060.stdout:4/67: truncate d0/f6 726848 0 2024-09-21T10:40:48.822 INFO:tasks.workunit.client.0.smithi060.stdout:6/67: symlink d3/d12/d16/l17 0 2024-09-21T10:40:48.824 INFO:tasks.workunit.client.0.smithi060.stdout:4/68: rmdir d0 39 2024-09-21T10:40:48.825 INFO:tasks.workunit.client.1.smithi112.stdout:4/545: rmdir de 39 2024-09-21T10:40:48.826 INFO:tasks.workunit.client.0.smithi060.stdout:6/68: dread d3/fb [0,4194304] 0 2024-09-21T10:40:48.826 INFO:tasks.workunit.client.0.smithi060.stdout:4/69: symlink d0/l13 0 2024-09-21T10:40:48.827 INFO:tasks.workunit.client.1.smithi112.stdout:5/547: creat d9/fa5 x:0 0 0 2024-09-21T10:40:48.829 INFO:tasks.workunit.client.0.smithi060.stdout:6/69: creat d3/d12/d16/f18 x:0 0 0 2024-09-21T10:40:48.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/70: creat d0/d5/d12/f14 x:0 0 0 2024-09-21T10:40:48.832 INFO:tasks.workunit.client.1.smithi112.stdout:8/506: creat d8/d9/dd/d2b/d31/d46/d86/f91 x:0 0 0 2024-09-21T10:40:48.833 INFO:tasks.workunit.client.1.smithi112.stdout:9/576: rmdir d1/d2/d27/d37/d3b/d69/d88 39 2024-09-21T10:40:48.834 INFO:tasks.workunit.client.0.smithi060.stdout:4/71: mkdir d0/d5/d12/d15 0 2024-09-21T10:40:48.834 INFO:tasks.workunit.client.0.smithi060.stdout:6/70: dread d3/fb [0,4194304] 0 2024-09-21T10:40:48.835 INFO:tasks.workunit.client.1.smithi112.stdout:6/553: mkdir d4/dc/d7e/dc9 0 2024-09-21T10:40:48.835 INFO:tasks.workunit.client.0.smithi060.stdout:3/56: dwrite d0/fd [0,4194304] 0 2024-09-21T10:40:48.835 INFO:tasks.workunit.client.0.smithi060.stdout:3/57: chown d0/fd 4008 1 2024-09-21T10:40:48.837 INFO:tasks.workunit.client.1.smithi112.stdout:7/480: symlink d7/d22/d41/d56/d72/d79/l9a 0 2024-09-21T10:40:48.841 INFO:tasks.workunit.client.0.smithi060.stdout:6/71: creat d3/d12/f19 x:0 0 0 2024-09-21T10:40:48.843 INFO:tasks.workunit.client.1.smithi112.stdout:3/501: mkdir d2/d22/d31/d2a/d39/d3a/d76/da3 0 2024-09-21T10:40:48.844 INFO:tasks.workunit.client.1.smithi112.stdout:1/677: getdents d8/d1a/d31/da1 0 2024-09-21T10:40:48.844 INFO:tasks.workunit.client.1.smithi112.stdout:1/678: write d8/d1a/d53/fd5 [129290,53919] 0 2024-09-21T10:40:48.846 INFO:tasks.workunit.client.1.smithi112.stdout:0/563: mknod d3/d4/d1a/d21/d46/cb6 0 2024-09-21T10:40:48.846 INFO:tasks.workunit.client.1.smithi112.stdout:0/564: chown d3/d4/d43/faf 223327 1 2024-09-21T10:40:48.846 INFO:tasks.workunit.client.1.smithi112.stdout:0/565: chown d3/d4/d43/faf 1029 1 2024-09-21T10:40:48.848 INFO:tasks.workunit.client.0.smithi060.stdout:6/72: unlink d3/d12/f19 0 2024-09-21T10:40:48.848 INFO:tasks.workunit.client.0.smithi060.stdout:6/73: chown d3/lc 7 1 2024-09-21T10:40:48.848 INFO:tasks.workunit.client.1.smithi112.stdout:4/546: getdents de/d2a/d31/d8d 0 2024-09-21T10:40:48.849 INFO:tasks.workunit.client.1.smithi112.stdout:4/547: write de/d18/f21 [4065733,56296] 0 2024-09-21T10:40:48.849 INFO:tasks.workunit.client.1.smithi112.stdout:4/548: chown de 16444 1 2024-09-21T10:40:48.849 INFO:tasks.workunit.client.1.smithi112.stdout:4/549: readlink de/l60 0 2024-09-21T10:40:48.850 INFO:tasks.workunit.client.1.smithi112.stdout:5/548: creat d9/d15/fa6 x:0 0 0 2024-09-21T10:40:48.851 INFO:tasks.workunit.client.1.smithi112.stdout:9/577: dwrite d1/d2/d27/d3a/d6b/fac [0,4194304] 0 2024-09-21T10:40:48.851 INFO:tasks.workunit.client.1.smithi112.stdout:3/502: dread d2/d22/d31/d2a/d39/d3a/f5b [0,4194304] 0 2024-09-21T10:40:48.851 INFO:tasks.workunit.client.1.smithi112.stdout:3/503: readlink d2/d2f/l65 0 2024-09-21T10:40:48.852 INFO:tasks.workunit.client.1.smithi112.stdout:3/504: truncate d2/d22/d31/d2a/d39/d3a/f59 5071812 0 2024-09-21T10:40:48.852 INFO:tasks.workunit.client.1.smithi112.stdout:8/507: symlink d8/d9/d3c/l92 0 2024-09-21T10:40:48.856 INFO:tasks.workunit.client.1.smithi112.stdout:6/554: rename d4/d6/da/d11/d37/c1e to d4/dc/d1a/d31/d56/d64/d84/cca 0 2024-09-21T10:40:48.860 INFO:tasks.workunit.client.1.smithi112.stdout:3/505: read d2/f14 [1788564,130717] 0 2024-09-21T10:40:48.860 INFO:tasks.workunit.client.1.smithi112.stdout:1/679: link d8/d20/l2b d8/d1a/d31/d66/d87/ld7 0 2024-09-21T10:40:48.868 INFO:tasks.workunit.client.0.smithi060.stdout:4/72: truncate d0/f4 4896041 0 2024-09-21T10:40:48.869 INFO:tasks.workunit.client.1.smithi112.stdout:2/477: rmdir d0/d12/d46/d95 0 2024-09-21T10:40:48.869 INFO:tasks.workunit.client.1.smithi112.stdout:4/550: symlink de/d33/d6f/d9c/d3e/d57/lb9 0 2024-09-21T10:40:48.869 INFO:tasks.workunit.client.1.smithi112.stdout:5/549: chown d9/ca 730 1 2024-09-21T10:40:48.871 INFO:tasks.workunit.client.1.smithi112.stdout:9/578: symlink d1/d2/d27/d62/d70/lc7 0 2024-09-21T10:40:48.871 INFO:tasks.workunit.client.1.smithi112.stdout:0/566: dwrite d3/d4a/d4e/f6e [0,4194304] 0 2024-09-21T10:40:48.873 INFO:tasks.workunit.client.1.smithi112.stdout:7/481: truncate d7/d22/d41/d56/d5c/f96 1968945 0 2024-09-21T10:40:48.873 INFO:tasks.workunit.client.0.smithi060.stdout:6/74: dwrite d3/ff [0,4194304] 0 2024-09-21T10:40:48.875 INFO:tasks.workunit.client.1.smithi112.stdout:4/551: dread de/d33/d2f/d35/d4c/f97 [0,4194304] 0 2024-09-21T10:40:48.876 INFO:tasks.workunit.client.1.smithi112.stdout:1/680: rename d8/d1a/l1d to d8/d1a/d31/da1/ld8 0 2024-09-21T10:40:48.877 INFO:tasks.workunit.client.1.smithi112.stdout:1/681: stat d8/c78 0 2024-09-21T10:40:48.879 INFO:tasks.workunit.client.1.smithi112.stdout:5/550: creat d9/d15/d18/d3a/d4b/d71/fa7 x:0 0 0 2024-09-21T10:40:48.880 INFO:tasks.workunit.client.1.smithi112.stdout:5/551: readlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:48.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/555: truncate d4/d6/da/f60 2649692 0 2024-09-21T10:40:48.880 INFO:tasks.workunit.client.1.smithi112.stdout:6/556: stat d4/d6/da/d11/d37/d19/f2e 0 2024-09-21T10:40:48.881 INFO:tasks.workunit.client.1.smithi112.stdout:8/508: dwrite d8/d9/d3c/d57/f89 [0,4194304] 0 2024-09-21T10:40:48.884 INFO:tasks.workunit.client.1.smithi112.stdout:4/552: mknod de/d33/d2f/d35/cba 0 2024-09-21T10:40:48.885 INFO:tasks.workunit.client.1.smithi112.stdout:4/553: write de/d33/d2f/f52 [884159,64870] 0 2024-09-21T10:40:48.887 INFO:tasks.workunit.client.0.smithi060.stdout:4/73: write d0/d5/f10 [663656,93945] 0 2024-09-21T10:40:48.891 INFO:tasks.workunit.client.1.smithi112.stdout:5/552: creat d9/d15/d18/d20/d47/fa8 x:0 0 0 2024-09-21T10:40:48.893 INFO:tasks.workunit.client.1.smithi112.stdout:6/557: mknod d4/dc/d1a/ccb 0 2024-09-21T10:40:48.895 INFO:tasks.workunit.client.0.smithi060.stdout:4/74: unlink d0/l8 0 2024-09-21T10:40:48.895 INFO:tasks.workunit.client.1.smithi112.stdout:0/567: getdents d3/d4a/d4e/d72 0 2024-09-21T10:40:48.898 INFO:tasks.workunit.client.0.smithi060.stdout:4/75: rename d0/d5/db to d0/d5/d12/d16 0 2024-09-21T10:40:48.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/478: dwrite d0/fe [4194304,4194304] 0 2024-09-21T10:40:48.900 INFO:tasks.workunit.client.0.smithi060.stdout:4/76: creat d0/df/f17 x:0 0 0 2024-09-21T10:40:48.900 INFO:tasks.workunit.client.0.smithi060.stdout:4/77: write d0/f6 [291934,81063] 0 2024-09-21T10:40:48.902 INFO:tasks.workunit.client.1.smithi112.stdout:9/579: dwrite d1/d2/d27/d62/d70/fa6 [0,4194304] 0 2024-09-21T10:40:48.902 INFO:tasks.workunit.client.1.smithi112.stdout:9/580: creat d1/d2/d27/d37/d3b/d69/d73/fc8 x:0 0 0 2024-09-21T10:40:48.902 INFO:tasks.workunit.client.1.smithi112.stdout:9/581: creat d1/d2/d27/d3a/fc9 x:0 0 0 2024-09-21T10:40:48.903 INFO:tasks.workunit.client.0.smithi060.stdout:4/78: rename d0/d5/f11 to d0/d5/d12/d15/f18 0 2024-09-21T10:40:48.906 INFO:tasks.workunit.client.1.smithi112.stdout:1/682: dwrite d8/d1a/d53/d57/f90 [0,4194304] 0 2024-09-21T10:40:48.907 INFO:tasks.workunit.client.1.smithi112.stdout:1/683: fsync d8/d1a/d31/fb7 0 2024-09-21T10:40:48.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/75: dwrite d3/ff [4194304,4194304] 0 2024-09-21T10:40:48.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/76: write d3/fb [2115397,92649] 0 2024-09-21T10:40:48.907 INFO:tasks.workunit.client.0.smithi060.stdout:4/79: fdatasync d0/f6 0 2024-09-21T10:40:48.908 INFO:tasks.workunit.client.0.smithi060.stdout:4/80: creat d0/d5/d12/f19 x:0 0 0 2024-09-21T10:40:48.909 INFO:tasks.workunit.client.1.smithi112.stdout:8/509: unlink d8/f63 0 2024-09-21T10:40:48.909 INFO:tasks.workunit.client.1.smithi112.stdout:8/510: readlink d8/l59 0 2024-09-21T10:40:48.909 INFO:tasks.workunit.client.1.smithi112.stdout:8/511: creat d8/d9/d3c/d6d/f93 x:0 0 0 2024-09-21T10:40:48.909 INFO:tasks.workunit.client.1.smithi112.stdout:8/512: fsync d8/d9/d3c/f50 0 2024-09-21T10:40:48.910 INFO:tasks.workunit.client.1.smithi112.stdout:7/482: mkdir d7/d22/d41/d56/d5c/d9b 0 2024-09-21T10:40:48.914 INFO:tasks.workunit.client.1.smithi112.stdout:4/554: creat de/d33/d2f/d71/d40/d4f/fbb x:0 0 0 2024-09-21T10:40:48.914 INFO:tasks.workunit.client.1.smithi112.stdout:4/555: chown de/d2a/d31/d8d/d9d 233 1 2024-09-21T10:40:48.917 INFO:tasks.workunit.client.1.smithi112.stdout:5/553: mknod d9/d15/d1d/ca9 0 2024-09-21T10:40:48.917 INFO:tasks.workunit.client.1.smithi112.stdout:5/554: write d9/d6e/f91 [4936436,68449] 0 2024-09-21T10:40:48.917 INFO:tasks.workunit.client.1.smithi112.stdout:5/555: dread - d9/d15/d18/f9e zero size 2024-09-21T10:40:48.920 INFO:tasks.workunit.client.1.smithi112.stdout:6/558: stat d4/d6/da/l30 0 2024-09-21T10:40:48.922 INFO:tasks.workunit.client.1.smithi112.stdout:6/559: dread d4/dc/f4b [0,4194304] 0 2024-09-21T10:40:48.922 INFO:tasks.workunit.client.0.smithi060.stdout:4/81: creat d0/d5/f1a x:0 0 0 2024-09-21T10:40:48.922 INFO:tasks.workunit.client.0.smithi060.stdout:4/82: write d0/d5/f10 [5072417,8909] 0 2024-09-21T10:40:48.923 INFO:tasks.workunit.client.1.smithi112.stdout:0/568: link d3/d4/d10/f35 d3/d4/d10/d8b/d90/fb7 0 2024-09-21T10:40:48.923 INFO:tasks.workunit.client.1.smithi112.stdout:0/569: creat d3/d4/d1a/d21/d4f/d83/fb8 x:0 0 0 2024-09-21T10:40:48.929 INFO:tasks.workunit.client.1.smithi112.stdout:2/479: truncate d0/d12/d76/f94 199321 0 2024-09-21T10:40:48.938 INFO:tasks.workunit.client.1.smithi112.stdout:8/513: creat d8/d9/dd/d2b/f94 x:0 0 0 2024-09-21T10:40:48.938 INFO:tasks.workunit.client.1.smithi112.stdout:8/514: write d8/d9/dd/d2b/f94 [185382,109192] 0 2024-09-21T10:40:48.939 INFO:tasks.workunit.client.1.smithi112.stdout:8/515: truncate d8/d9/dd/d2a/d43/d58/f81 137143 0 2024-09-21T10:40:48.939 INFO:tasks.workunit.client.1.smithi112.stdout:7/483: mknod d7/d22/d73/c9c 0 2024-09-21T10:40:48.939 INFO:tasks.workunit.client.1.smithi112.stdout:7/484: readlink d7/d22/l36 0 2024-09-21T10:40:48.941 INFO:tasks.workunit.client.1.smithi112.stdout:4/556: mknod de/d33/d2f/d71/d40/d4f/cbc 0 2024-09-21T10:40:48.941 INFO:tasks.workunit.client.1.smithi112.stdout:4/557: chown de/d2a/d31/d8d/d9d/fa7 1854 1 2024-09-21T10:40:48.941 INFO:tasks.workunit.client.0.smithi060.stdout:4/83: dwrite d0/d5/fe [0,4194304] 0 2024-09-21T10:40:48.945 INFO:tasks.workunit.client.1.smithi112.stdout:8/516: dread d8/d9/dd/d2a/d43/f47 [0,4194304] 0 2024-09-21T10:40:48.945 INFO:tasks.workunit.client.1.smithi112.stdout:8/517: truncate d8/f8c 226546 0 2024-09-21T10:40:48.946 INFO:tasks.workunit.client.1.smithi112.stdout:6/560: mknod d4/d6/d75/db7/dc6/ccc 0 2024-09-21T10:40:48.946 INFO:tasks.workunit.client.1.smithi112.stdout:6/561: stat d4/dc/d1a/d31/d3c/fc1 0 2024-09-21T10:40:48.947 INFO:tasks.workunit.client.1.smithi112.stdout:0/570: dwrite d3/d4/da8/d7f/f82 [0,4194304] 0 2024-09-21T10:40:48.947 INFO:tasks.workunit.client.0.smithi060.stdout:6/77: truncate d3/f9 4210186 0 2024-09-21T10:40:48.947 INFO:tasks.workunit.client.0.smithi060.stdout:6/78: dread - d3/d12/d16/f18 zero size 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi112 to 2240M 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:48.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:40:48.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3714581553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:40:48.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.951 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:48 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:48.951 INFO:tasks.workunit.client.0.smithi060.stdout:6/79: mkdir d3/d12/d16/d1a 0 2024-09-21T10:40:48.954 INFO:tasks.workunit.client.1.smithi112.stdout:8/518: read d8/d9/dd/d2a/d43/f66 [1181526,61594] 0 2024-09-21T10:40:48.954 INFO:tasks.workunit.client.1.smithi112.stdout:9/582: rename d1/d2/d27/d3a/d6b/d30/d5e/d9f to d1/d2/d27/d37/d3b/d69/d77/dca 0 2024-09-21T10:40:48.954 INFO:tasks.workunit.client.1.smithi112.stdout:9/583: truncate d1/f1b 4597114 0 2024-09-21T10:40:48.957 INFO:tasks.workunit.client.0.smithi060.stdout:4/84: dwrite d0/d5/d12/f14 [0,4194304] 0 2024-09-21T10:40:48.959 INFO:tasks.workunit.client.0.smithi060.stdout:6/80: getdents d3/d12 0 2024-09-21T10:40:48.961 INFO:tasks.workunit.client.1.smithi112.stdout:4/558: creat de/d33/d6f/d9c/d3e/fbd x:0 0 0 2024-09-21T10:40:48.967 INFO:tasks.workunit.client.1.smithi112.stdout:4/559: dread de/d33/d6f/f7d [0,4194304] 0 2024-09-21T10:40:48.969 INFO:tasks.workunit.client.0.smithi060.stdout:4/85: mknod d0/d5/d12/d15/c1b 0 2024-09-21T10:40:48.974 INFO:tasks.workunit.client.0.smithi060.stdout:4/86: mkdir d0/d1c 0 2024-09-21T10:40:48.974 INFO:tasks.workunit.client.0.smithi060.stdout:4/87: write d0/d5/f10 [2442721,78949] 0 2024-09-21T10:40:48.977 INFO:tasks.workunit.client.1.smithi112.stdout:6/562: dwrite d4/d6/da/d11/d1f/d22/fc4 [0,4194304] 0 2024-09-21T10:40:48.977 INFO:tasks.workunit.client.1.smithi112.stdout:6/563: fsync d4/d6/da/d11/d37/d8b/fbf 0 2024-09-21T10:40:48.977 INFO:tasks.workunit.client.1.smithi112.stdout:8/519: unlink d8/d9/d3c/d57/f89 0 2024-09-21T10:40:48.978 INFO:tasks.workunit.client.1.smithi112.stdout:8/520: chown d8/d9/d3c/d90 2302 1 2024-09-21T10:40:48.980 INFO:tasks.workunit.client.1.smithi112.stdout:9/584: dwrite d1/d2/d27/d3a/d6b/fb9 [0,4194304] 0 2024-09-21T10:40:48.980 INFO:tasks.workunit.client.0.smithi060.stdout:6/81: rename d3/f9 to d3/d12/f1b 0 2024-09-21T10:40:48.982 INFO:tasks.workunit.client.1.smithi112.stdout:1/684: rename d8/d1a/d53/l97 to d8/d7a/ld9 0 2024-09-21T10:40:48.983 INFO:tasks.workunit.client.0.smithi060.stdout:4/88: creat d0/d5/d12/d16/f1d x:0 0 0 2024-09-21T10:40:48.985 INFO:tasks.workunit.client.0.smithi060.stdout:6/82: rename d3/lc to d3/l1c 0 2024-09-21T10:40:48.986 INFO:tasks.workunit.client.1.smithi112.stdout:4/560: dwrite de/d18/d6d/d6e/f92 [0,4194304] 0 2024-09-21T10:40:48.986 INFO:tasks.workunit.client.1.smithi112.stdout:4/561: getdents de/d18/d6d/d6e/dab 0 2024-09-21T10:40:48.987 INFO:tasks.workunit.client.0.smithi060.stdout:6/83: chown d3/d12/d16 990525967 1 2024-09-21T10:40:48.987 INFO:tasks.workunit.client.1.smithi112.stdout:7/485: rmdir d7/d22/d41/d56 39 2024-09-21T10:40:48.991 INFO:tasks.workunit.client.1.smithi112.stdout:0/571: symlink d3/d4a/lb9 0 2024-09-21T10:40:48.991 INFO:tasks.workunit.client.1.smithi112.stdout:2/480: rmdir d0/d12/d8a/d62/d63/d99 0 2024-09-21T10:40:48.998 INFO:tasks.workunit.client.1.smithi112.stdout:8/521: rename d8/d9/d3c/l49 to d8/d9/dd/d2b/d31/d46/d86/l95 0 2024-09-21T10:40:48.999 INFO:tasks.workunit.client.1.smithi112.stdout:1/685: truncate d8/d54/d6d/f70 3725547 0 2024-09-21T10:40:49.007 INFO:tasks.workunit.client.1.smithi112.stdout:4/562: mkdir de/d33/d2f/d71/d40/dbe 0 2024-09-21T10:40:49.007 INFO:tasks.workunit.client.1.smithi112.stdout:7/486: getdents d7/d22/d41/d54 0 2024-09-21T10:40:49.007 INFO:tasks.workunit.client.1.smithi112.stdout:8/522: unlink d8/d9/dd/d2b/f4d 0 2024-09-21T10:40:49.008 INFO:tasks.workunit.client.1.smithi112.stdout:8/523: truncate d8/d9/dd/d2b/d31/d46/d86/f91 855258 0 2024-09-21T10:40:49.010 INFO:tasks.workunit.client.1.smithi112.stdout:4/563: rename de/d18/d6d/d6e to de/d2a/dbf 0 2024-09-21T10:40:49.011 INFO:tasks.workunit.client.1.smithi112.stdout:8/524: truncate d8/d9/dd/d1a/d5d/f65 759913 0 2024-09-21T10:40:49.011 INFO:tasks.workunit.client.1.smithi112.stdout:8/525: read d8/f8c [124811,96244] 0 2024-09-21T10:40:49.012 INFO:tasks.workunit.client.1.smithi112.stdout:4/564: symlink de/d2a/d31/lc0 0 2024-09-21T10:40:49.012 INFO:tasks.workunit.client.1.smithi112.stdout:4/565: chown de/d33/d2f/d71/d40/d4f/fbb 30 1 2024-09-21T10:40:49.013 INFO:tasks.workunit.client.1.smithi112.stdout:1/686: read d8/d1a/d53/d76/fbb [940836,85142] 0 2024-09-21T10:40:49.014 INFO:tasks.workunit.client.0.smithi060.stdout:4/89: dwrite d0/fc [4194304,4194304] 0 2024-09-21T10:40:49.015 INFO:tasks.workunit.client.0.smithi060.stdout:6/84: unlink d3/d12/f1b 0 2024-09-21T10:40:49.017 INFO:tasks.workunit.client.1.smithi112.stdout:8/526: creat d8/d9/d3c/d57/f96 x:0 0 0 2024-09-21T10:40:49.019 INFO:tasks.workunit.client.1.smithi112.stdout:0/572: dwrite d3/d4a/d4e/f63 [0,4194304] 0 2024-09-21T10:40:49.019 INFO:tasks.workunit.client.1.smithi112.stdout:9/585: dwrite d1/d7f/f9b [0,4194304] 0 2024-09-21T10:40:49.020 INFO:tasks.workunit.client.1.smithi112.stdout:1/687: creat d8/d54/d6d/db5/dc2/fda x:0 0 0 2024-09-21T10:40:49.023 INFO:tasks.workunit.client.0.smithi060.stdout:4/90: mknod d0/df/c1e 0 2024-09-21T10:40:49.023 INFO:tasks.workunit.client.0.smithi060.stdout:4/91: write d0/d5/d12/d16/f1d [405697,16286] 0 2024-09-21T10:40:49.025 INFO:tasks.workunit.client.1.smithi112.stdout:0/573: mkdir d3/d4/d1a/dba 0 2024-09-21T10:40:49.026 INFO:tasks.workunit.client.1.smithi112.stdout:1/688: symlink d8/d45/dae/ldb 0 2024-09-21T10:40:49.026 INFO:tasks.workunit.client.1.smithi112.stdout:1/689: creat d8/d1a/d53/d57/fdc x:0 0 0 2024-09-21T10:40:49.027 INFO:tasks.workunit.client.1.smithi112.stdout:1/690: write d8/d7a/fd6 [560531,53894] 0 2024-09-21T10:40:49.027 INFO:tasks.workunit.client.1.smithi112.stdout:0/574: mknod d3/d4/d10/cbb 0 2024-09-21T10:40:49.027 INFO:tasks.workunit.client.1.smithi112.stdout:0/575: chown d3/d4a/f96 478090 1 2024-09-21T10:40:49.027 INFO:tasks.workunit.client.1.smithi112.stdout:2/481: dwrite d0/f9 [8388608,4194304] 0 2024-09-21T10:40:49.029 INFO:tasks.workunit.client.1.smithi112.stdout:8/527: write d8/d9/dd/d1a/f80 [3058616,9087] 0 2024-09-21T10:40:49.033 INFO:tasks.workunit.client.1.smithi112.stdout:1/691: rename d8/d1a/d53/fa3 to d8/d7a/fdd 0 2024-09-21T10:40:49.035 INFO:tasks.workunit.client.1.smithi112.stdout:2/482: mkdir d0/d12/d46/da0 0 2024-09-21T10:40:49.035 INFO:tasks.workunit.client.1.smithi112.stdout:2/483: creat d0/dd/fa1 x:0 0 0 2024-09-21T10:40:49.038 INFO:tasks.workunit.client.1.smithi112.stdout:8/528: mkdir d8/d9/dd/d76/d97 0 2024-09-21T10:40:49.041 INFO:tasks.workunit.client.1.smithi112.stdout:2/484: rmdir d0/d12/d6c/d7e/d8f 39 2024-09-21T10:40:49.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/506: sync 2024-09-21T10:40:49.063 INFO:tasks.workunit.client.1.smithi112.stdout:3/507: truncate d2/d22/d31/d37/f46 1163346 0 2024-09-21T10:40:49.065 INFO:tasks.workunit.client.0.smithi060.stdout:6/85: dwrite d3/dd/f14 [0,4194304] 0 2024-09-21T10:40:49.069 INFO:tasks.workunit.client.0.smithi060.stdout:6/86: write d3/fb [1364038,14476] 0 2024-09-21T10:40:49.069 INFO:tasks.workunit.client.1.smithi112.stdout:9/586: dwrite d1/d2/d27/d3a/f33 [0,4194304] 0 2024-09-21T10:40:49.069 INFO:tasks.workunit.client.1.smithi112.stdout:0/576: dwrite d3/d18/f80 [0,4194304] 0 2024-09-21T10:40:49.069 INFO:tasks.workunit.client.1.smithi112.stdout:0/577: write d3/d4a/d4e/f78 [556269,96046] 0 2024-09-21T10:40:49.072 INFO:tasks.workunit.client.1.smithi112.stdout:1/692: dwrite d8/f17 [0,4194304] 0 2024-09-21T10:40:49.072 INFO:tasks.workunit.client.1.smithi112.stdout:1/693: fdatasync d8/d20/fa7 0 2024-09-21T10:40:49.072 INFO:tasks.workunit.client.1.smithi112.stdout:1/694: dread - d8/fc6 zero size 2024-09-21T10:40:49.072 INFO:tasks.workunit.client.1.smithi112.stdout:1/695: fsync d8/d1a/d31/d37/d9e/fa9 0 2024-09-21T10:40:49.072 INFO:tasks.workunit.client.1.smithi112.stdout:1/696: creat d8/d7a/fde x:0 0 0 2024-09-21T10:40:49.072 INFO:tasks.workunit.client.0.smithi060.stdout:6/87: symlink d3/l1d 0 2024-09-21T10:40:49.073 INFO:tasks.workunit.client.1.smithi112.stdout:2/485: dwrite d0/d12/d6c/d7e/d8f/d51/f70 [0,4194304] 0 2024-09-21T10:40:49.073 INFO:tasks.workunit.client.1.smithi112.stdout:8/529: dwrite d8/d9/dd/d2a/d43/f66 [0,4194304] 0 2024-09-21T10:40:49.074 INFO:tasks.workunit.client.1.smithi112.stdout:8/530: fdatasync d8/d9/dd/d2a/f30 0 2024-09-21T10:40:49.074 INFO:tasks.workunit.client.1.smithi112.stdout:8/531: chown d8/d9/dd/d2a 11838927 1 2024-09-21T10:40:49.075 INFO:tasks.workunit.client.1.smithi112.stdout:3/508: dread d2/d22/d31/d2a/d39/d3a/f59 [0,4194304] 0 2024-09-21T10:40:49.076 INFO:tasks.workunit.client.1.smithi112.stdout:0/578: truncate d3/f2b 7711571 0 2024-09-21T10:40:49.076 INFO:tasks.workunit.client.1.smithi112.stdout:0/579: fdatasync d3/d4a/f99 0 2024-09-21T10:40:49.084 INFO:tasks.workunit.client.1.smithi112.stdout:1/697: rename d8/d1a/d31/fbf to d8/d1a/db8/dbc/fdf 0 2024-09-21T10:40:49.084 INFO:tasks.workunit.client.1.smithi112.stdout:1/698: truncate d8/d1a/d31/d37/f77 9330043 0 2024-09-21T10:40:49.087 INFO:tasks.workunit.client.1.smithi112.stdout:8/532: symlink d8/d9/d3c/d90/l98 0 2024-09-21T10:40:49.088 INFO:tasks.workunit.client.1.smithi112.stdout:3/509: creat d2/fa4 x:0 0 0 2024-09-21T10:40:49.088 INFO:tasks.workunit.client.0.smithi060.stdout:6/88: rmdir d3/dd 39 2024-09-21T10:40:49.090 INFO:tasks.workunit.client.1.smithi112.stdout:0/580: creat d3/d4/da8/fbc x:0 0 0 2024-09-21T10:40:49.091 INFO:tasks.workunit.client.1.smithi112.stdout:8/533: mknod d8/c99 0 2024-09-21T10:40:49.092 INFO:tasks.workunit.client.1.smithi112.stdout:1/699: dread d8/f15 [0,4194304] 0 2024-09-21T10:40:49.094 INFO:tasks.workunit.client.0.smithi060.stdout:6/89: creat d3/d12/d16/d1a/f1e x:0 0 0 2024-09-21T10:40:49.095 INFO:tasks.workunit.client.1.smithi112.stdout:3/510: creat d2/d22/d31/d2a/d39/d60/d86/d98/fa5 x:0 0 0 2024-09-21T10:40:49.095 INFO:tasks.workunit.client.1.smithi112.stdout:0/581: creat d3/d4a/fbd x:0 0 0 2024-09-21T10:40:49.096 INFO:tasks.workunit.client.0.smithi060.stdout:6/90: rmdir d3 39 2024-09-21T10:40:49.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/486: dwrite d0/dd/f3b [0,4194304] 0 2024-09-21T10:40:49.097 INFO:tasks.workunit.client.1.smithi112.stdout:3/511: link d2/c4 d2/d22/d31/d2a/d39/d3a/ca6 0 2024-09-21T10:40:49.098 INFO:tasks.workunit.client.1.smithi112.stdout:3/512: write d2/d2f/f66 [488697,85251] 0 2024-09-21T10:40:49.098 INFO:tasks.workunit.client.1.smithi112.stdout:3/513: chown d2/d22/d31/d2a/d39/d3a/f59 59683014 1 2024-09-21T10:40:49.098 INFO:tasks.workunit.client.1.smithi112.stdout:3/514: fsync d2/d2f/f53 0 2024-09-21T10:40:49.099 INFO:tasks.workunit.client.0.smithi060.stdout:6/91: mknod d3/d12/d16/d1a/c1f 0 2024-09-21T10:40:49.100 INFO:tasks.workunit.client.1.smithi112.stdout:8/534: getdents d8/d9/dd/d76 0 2024-09-21T10:40:49.102 INFO:tasks.workunit.client.1.smithi112.stdout:9/587: dwrite d1/d2/f7b [0,4194304] 0 2024-09-21T10:40:49.103 INFO:tasks.workunit.client.1.smithi112.stdout:1/700: write d8/d1a/d31/d37/f47 [4357357,59999] 0 2024-09-21T10:40:49.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/535: rmdir d8/d9/dd/d76 39 2024-09-21T10:40:49.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/536: write d8/d9/d3c/d6d/f93 [764545,69284] 0 2024-09-21T10:40:49.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/537: chown d8/d9/d3c 11254363 1 2024-09-21T10:40:49.108 INFO:tasks.workunit.client.1.smithi112.stdout:8/538: creat d8/d9/dd/d1a/f9a x:0 0 0 2024-09-21T10:40:49.109 INFO:tasks.workunit.client.1.smithi112.stdout:3/515: read d2/d22/d31/d2a/d39/d3a/f5b [5087605,60203] 0 2024-09-21T10:40:49.109 INFO:tasks.workunit.client.1.smithi112.stdout:5/556: sync 2024-09-21T10:40:49.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/487: write d0/d12/d8a/f52 [3742429,62768] 0 2024-09-21T10:40:49.111 INFO:tasks.workunit.client.0.smithi060.stdout:6/92: unlink d3/ca 0 2024-09-21T10:40:49.111 INFO:tasks.workunit.client.0.smithi060.stdout:6/93: truncate d3/d12/d16/f18 702273 0 2024-09-21T10:40:49.113 INFO:tasks.workunit.client.1.smithi112.stdout:1/701: creat d8/d45/dae/fe0 x:0 0 0 2024-09-21T10:40:49.114 INFO:tasks.workunit.client.1.smithi112.stdout:0/582: fsync d3/d4/da8/fbc 0 2024-09-21T10:40:49.114 INFO:tasks.workunit.client.1.smithi112.stdout:0/583: readlink d3/d4/l8c 0 2024-09-21T10:40:49.119 INFO:tasks.workunit.client.1.smithi112.stdout:3/516: dread d2/d1f/f92 [0,4194304] 0 2024-09-21T10:40:49.120 INFO:tasks.workunit.client.1.smithi112.stdout:1/702: dread d8/d1a/d31/da1/fbe [4194304,4194304] 0 2024-09-21T10:40:49.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/557: rename d9/d15/d18/d3a/d4b/d74/f7c to d9/d15/d18/d3a/d61/d62/d6b/faa 0 2024-09-21T10:40:49.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/558: chown d9/d15/d18/d3a/d61/d62/d6b/d8f 40471 1 2024-09-21T10:40:49.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/559: creat d9/d15/d18/d3a/d4b/fab x:0 0 0 2024-09-21T10:40:49.121 INFO:tasks.workunit.client.1.smithi112.stdout:5/560: write d9/d8a/f95 [513891,74777] 0 2024-09-21T10:40:49.123 INFO:tasks.workunit.client.0.smithi060.stdout:6/94: write d3/dd/f14 [3418053,126015] 0 2024-09-21T10:40:49.125 INFO:tasks.workunit.client.1.smithi112.stdout:0/584: mknod d3/d4/d1a/d21/cbe 0 2024-09-21T10:40:49.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/539: getdents d8/d9/dd/d2a/d43 0 2024-09-21T10:40:49.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/540: truncate d8/d9/d3c/d6d/f74 2345847 0 2024-09-21T10:40:49.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/541: fsync d8/d9/dd/f42 0 2024-09-21T10:40:49.130 INFO:tasks.workunit.client.1.smithi112.stdout:5/561: write d9/d15/d18/d20/d47/f75 [3028651,89931] 0 2024-09-21T10:40:49.131 INFO:tasks.workunit.client.1.smithi112.stdout:7/487: sync 2024-09-21T10:40:49.131 INFO:tasks.workunit.client.1.smithi112.stdout:6/564: sync 2024-09-21T10:40:49.131 INFO:tasks.workunit.client.1.smithi112.stdout:4/566: sync 2024-09-21T10:40:49.134 INFO:tasks.workunit.client.0.smithi060.stdout:6/95: rmdir d3/d12/d16/d1a 39 2024-09-21T10:40:49.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/488: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f83 [0,4194304] 0 2024-09-21T10:40:49.137 INFO:tasks.workunit.client.1.smithi112.stdout:3/517: rename d2/d22/d31/d37/f46 to d2/d22/d31/d2a/d9b/fa7 0 2024-09-21T10:40:49.140 INFO:tasks.workunit.client.1.smithi112.stdout:0/585: creat d3/d18/d45/fbf x:0 0 0 2024-09-21T10:40:49.143 INFO:tasks.workunit.client.1.smithi112.stdout:5/562: symlink d9/d15/d18/d3a/d4b/d74/d8d/lac 0 2024-09-21T10:40:49.143 INFO:tasks.workunit.client.1.smithi112.stdout:5/563: fdatasync d9/d15/d18/d3a/f9c 0 2024-09-21T10:40:49.143 INFO:tasks.workunit.client.1.smithi112.stdout:5/564: creat d9/d15/d18/d3a/fad x:0 0 0 2024-09-21T10:40:49.144 INFO:tasks.workunit.client.0.smithi060.stdout:6/96: unlink d3/c6 0 2024-09-21T10:40:49.144 INFO:tasks.workunit.client.1.smithi112.stdout:6/565: creat d4/dc/d1a/d31/d56/d64/d84/db4/fcd x:0 0 0 2024-09-21T10:40:49.144 INFO:tasks.workunit.client.1.smithi112.stdout:6/566: write d4/d6/da/d11/d1f/d22/fc4 [4919986,126953] 0 2024-09-21T10:40:49.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.145+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71600608f0 con 0x7f7150073f70 2024-09-21T10:40:49.149 INFO:tasks.workunit.client.1.smithi112.stdout:1/703: rmdir d8/d1a/db8 39 2024-09-21T10:40:49.149 INFO:tasks.workunit.client.1.smithi112.stdout:1/704: write d8/d54/db0/fb3 [1021609,87514] 0 2024-09-21T10:40:49.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.149+0000 7f715dffb640 1 -- 172.21.15.60:0/2369280126 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f71600608f0 con 0x7f7150073f70 2024-09-21T10:40:49.151 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:40:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:40:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:40:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:40:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-09-21T10:40:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "1/23 daemons upgraded", 2024-09-21T10:40:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-09-21T10:40:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:40:49.152 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:40:49.152 INFO:tasks.workunit.client.1.smithi112.stdout:4/567: creat de/d2a/d31/d8d/d9d/fc1 x:0 0 0 2024-09-21T10:40:49.152 INFO:tasks.workunit.client.1.smithi112.stdout:4/568: truncate de/d33/d2f/d71/d40/f72 1490854 0 2024-09-21T10:40:49.152 INFO:tasks.workunit.client.1.smithi112.stdout:7/488: dread f5 [0,4194304] 0 2024-09-21T10:40:49.153 INFO:tasks.workunit.client.1.smithi112.stdout:3/518: link d2/f14 d2/d22/d31/d37/fa8 0 2024-09-21T10:40:49.153 INFO:tasks.workunit.client.1.smithi112.stdout:3/519: chown d2/d22/c55 959 1 2024-09-21T10:40:49.153 INFO:tasks.workunit.client.1.smithi112.stdout:3/520: chown d2/d22/d31/d2a/f85 104319659 1 2024-09-21T10:40:49.154 INFO:tasks.workunit.client.1.smithi112.stdout:8/542: dwrite d8/d9/dd/d2a/f77 [0,4194304] 0 2024-09-21T10:40:49.154 INFO:tasks.workunit.client.1.smithi112.stdout:8/543: chown d8/d9/dd/d1a/c36 205 1 2024-09-21T10:40:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.153+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7150073f70 msgr2=0x7f7150076430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.153+0000 7f7167029640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7150073f70 0x7f7150076430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b230 tx=0x7f714c005c90 comp rx=0 tx=0).stop 2024-09-21T10:40:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.153+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7160106670 msgr2=0x7f716019ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.153+0000 7f7167029640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7160106670 0x7f716019ba00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f715400e710 tx=0x7f715400ebd0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.156 INFO:tasks.workunit.client.1.smithi112.stdout:4/569: rmdir de/d33/d2f/d71/d40/dbe 0 2024-09-21T10:40:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 shutdown_connections 2024-09-21T10:40:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7150073f70 0x7f7150076430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71601073f0 0x7f716019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 --2- 172.21.15.60:0/2369280126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7160106670 0x7f716019ba00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 >> 172.21.15.60:0/2369280126 conn(0x7f7160075530 msgr2=0x7f716010a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 shutdown_connections 2024-09-21T10:40:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.154+0000 7f7167029640 1 -- 172.21.15.60:0/2369280126 wait complete. 2024-09-21T10:40:49.158 INFO:tasks.workunit.client.1.smithi112.stdout:7/489: creat d7/d22/d47/f9d x:0 0 0 2024-09-21T10:40:49.160 INFO:tasks.workunit.client.1.smithi112.stdout:3/521: getdents d2/d22 0 2024-09-21T10:40:49.160 INFO:tasks.workunit.client.1.smithi112.stdout:2/489: write d0/d12/d6c/d7e/d8f/f6f [4167253,111414] 0 2024-09-21T10:40:49.162 INFO:tasks.workunit.client.1.smithi112.stdout:8/544: dread d8/d9/dd/d1a/f26 [0,4194304] 0 2024-09-21T10:40:49.163 INFO:tasks.workunit.client.1.smithi112.stdout:0/586: dwrite d3/d18/f42 [0,4194304] 0 2024-09-21T10:40:49.164 INFO:tasks.workunit.client.1.smithi112.stdout:7/490: rename d7/d22/l36 to d7/d22/d41/d54/d4d/l9e 0 2024-09-21T10:40:49.164 INFO:tasks.workunit.client.1.smithi112.stdout:7/491: chown d7/d22/d47/f9d 3577625 1 2024-09-21T10:40:49.167 INFO:tasks.workunit.client.1.smithi112.stdout:8/545: creat d8/d9/dd/d2b/d31/d46/f9b x:0 0 0 2024-09-21T10:40:49.173 INFO:tasks.workunit.client.1.smithi112.stdout:7/492: creat d7/d22/d41/d56/d72/d79/d8a/f9f x:0 0 0 2024-09-21T10:40:49.174 INFO:tasks.workunit.client.1.smithi112.stdout:8/546: creat d8/d9/dd/f9c x:0 0 0 2024-09-21T10:40:49.177 INFO:tasks.workunit.client.1.smithi112.stdout:4/570: rename de/d2a/d31/d8d/d9d to de/d2a/d31/d8d/dc2 0 2024-09-21T10:40:49.177 INFO:tasks.workunit.client.1.smithi112.stdout:4/571: readlink de/l20 0 2024-09-21T10:40:49.187 INFO:tasks.workunit.client.1.smithi112.stdout:7/493: write d7/d22/f38 [7804311,61614] 0 2024-09-21T10:40:49.189 INFO:tasks.workunit.client.1.smithi112.stdout:7/494: creat d7/d22/d78/fa0 x:0 0 0 2024-09-21T10:40:49.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/547: write d8/d9/dd/f5f [2552481,87295] 0 2024-09-21T10:40:49.189 INFO:tasks.workunit.client.1.smithi112.stdout:7/495: write d7/d22/d41/d4b/f64 [874118,115426] 0 2024-09-21T10:40:49.189 INFO:tasks.workunit.client.1.smithi112.stdout:7/496: chown d7/d22/c2c 1588000 1 2024-09-21T10:40:49.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/548: creat d8/d9/d3c/d6d/f9d x:0 0 0 2024-09-21T10:40:49.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/97: dwrite d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:49.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/98: dread - d3/d12/d16/d1a/f1e zero size 2024-09-21T10:40:49.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/99: truncate d3/d12/d16/d1a/f1e 20716 0 2024-09-21T10:40:49.192 INFO:tasks.workunit.client.1.smithi112.stdout:7/497: mkdir d7/d22/d73/da1 0 2024-09-21T10:40:49.193 INFO:tasks.workunit.client.1.smithi112.stdout:8/549: creat d8/d9/dd/d2a/d43/f9e x:0 0 0 2024-09-21T10:40:49.193 INFO:tasks.workunit.client.1.smithi112.stdout:8/550: creat d8/d9/dd/d1a/d5d/f9f x:0 0 0 2024-09-21T10:40:49.194 INFO:tasks.workunit.client.1.smithi112.stdout:7/498: mkdir d7/d22/d41/d4b/da2 0 2024-09-21T10:40:49.195 INFO:tasks.workunit.client.1.smithi112.stdout:7/499: chown d7/l9 1 1 2024-09-21T10:40:49.195 INFO:tasks.workunit.client.1.smithi112.stdout:7/500: fsync d7/d22/d41/d56/f75 0 2024-09-21T10:40:49.196 INFO:tasks.workunit.client.0.smithi060.stdout:6/100: creat d3/d12/d16/d1a/f20 x:0 0 0 2024-09-21T10:40:49.198 INFO:tasks.workunit.client.1.smithi112.stdout:8/551: rename d8/d9/dd/d2a/d43/l75 to d8/d9/dd/d1a/d5d/la0 0 2024-09-21T10:40:49.198 INFO:tasks.workunit.client.1.smithi112.stdout:8/552: fsync d8/d9/d3c/f50 0 2024-09-21T10:40:49.199 INFO:tasks.workunit.client.1.smithi112.stdout:5/565: dwrite d9/d15/d18/d3a/d61/d93/f98 [0,4194304] 0 2024-09-21T10:40:49.202 INFO:tasks.workunit.client.0.smithi060.stdout:6/101: getdents d3/d12 0 2024-09-21T10:40:49.205 INFO:tasks.workunit.client.1.smithi112.stdout:6/567: dwrite d4/dc/d1a/d31/f71 [0,4194304] 0 2024-09-21T10:40:49.205 INFO:tasks.workunit.client.1.smithi112.stdout:6/568: fdatasync d4/dc/d1a/d31/d56/d64/d84/db4/fcd 0 2024-09-21T10:40:49.205 INFO:tasks.workunit.client.1.smithi112.stdout:6/569: fsync d4/d6/da/d11/d1f/d22/f58 0 2024-09-21T10:40:49.205 INFO:tasks.workunit.client.1.smithi112.stdout:3/522: dwrite d2/d22/d31/d2a/d39/f81 [8388608,4194304] 0 2024-09-21T10:40:49.206 INFO:tasks.workunit.client.1.smithi112.stdout:2/490: dwrite d0/dd/fa1 [0,4194304] 0 2024-09-21T10:40:49.206 INFO:tasks.workunit.client.1.smithi112.stdout:2/491: dread - d0/d12/f4d zero size 2024-09-21T10:40:49.206 INFO:tasks.workunit.client.1.smithi112.stdout:5/566: getdents d9/d57 0 2024-09-21T10:40:49.206 INFO:tasks.workunit.client.0.smithi060.stdout:6/102: mkdir d3/d12/d16/d1a/d21 0 2024-09-21T10:40:49.206 INFO:tasks.workunit.client.0.smithi060.stdout:6/103: readlink d3/l1d 0 2024-09-21T10:40:49.207 INFO:tasks.workunit.client.1.smithi112.stdout:8/553: dread f3 [0,4194304] 0 2024-09-21T10:40:49.208 INFO:tasks.workunit.client.0.smithi060.stdout:6/104: mkdir d3/d12/d16/d22 0 2024-09-21T10:40:49.208 INFO:tasks.workunit.client.1.smithi112.stdout:8/554: read d8/d9/dd/d2a/d43/d58/f81 [103230,125391] 0 2024-09-21T10:40:49.210 INFO:tasks.workunit.client.1.smithi112.stdout:1/705: dwrite d8/f63 [4194304,4194304] 0 2024-09-21T10:40:49.210 INFO:tasks.workunit.client.1.smithi112.stdout:1/706: chown d8/d1a/d31/d66/f82 14205127 1 2024-09-21T10:40:49.210 INFO:tasks.workunit.client.1.smithi112.stdout:4/572: dwrite de/d18/d6d/f8c [0,4194304] 0 2024-09-21T10:40:49.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/105: creat d3/d12/d16/d1a/d21/f23 x:0 0 0 2024-09-21T10:40:49.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/106: stat d3/d12/d16/f18 0 2024-09-21T10:40:49.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/107: dread - d3/d12/d16/d1a/d21/f23 zero size 2024-09-21T10:40:49.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/108: write d3/d12/d16/d1a/f1e [599580,62723] 0 2024-09-21T10:40:49.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/109: write d3/d12/d16/d1a/f20 [932299,64444] 0 2024-09-21T10:40:49.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/110: write d3/d12/d16/d1a/d21/f23 [1040440,58422] 0 2024-09-21T10:40:49.212 INFO:tasks.workunit.client.1.smithi112.stdout:6/570: mkdir d4/d6/d9c/dce 0 2024-09-21T10:40:49.212 INFO:tasks.workunit.client.1.smithi112.stdout:6/571: readlink d4/d6/da/lc7 0 2024-09-21T10:40:49.213 INFO:tasks.workunit.client.1.smithi112.stdout:3/523: rmdir d2/d22/d31/d37/da0 0 2024-09-21T10:40:49.214 INFO:tasks.workunit.client.0.smithi060.stdout:6/111: creat d3/d12/d16/d22/f24 x:0 0 0 2024-09-21T10:40:49.216 INFO:tasks.workunit.client.1.smithi112.stdout:7/501: dwrite d7/f3a [0,4194304] 0 2024-09-21T10:40:49.217 INFO:tasks.workunit.client.0.smithi060.stdout:6/112: mkdir d3/d12/d16/d25 0 2024-09-21T10:40:49.217 INFO:tasks.workunit.client.0.smithi060.stdout:6/113: truncate d3/d12/d16/d1a/f20 1358114 0 2024-09-21T10:40:49.219 INFO:tasks.workunit.client.1.smithi112.stdout:2/492: unlink d0/d12/d6c/d7e/d8f/c23 0 2024-09-21T10:40:49.223 INFO:tasks.workunit.client.0.smithi060.stdout:6/114: chown d3/c5 2123656822 1 2024-09-21T10:40:49.223 INFO:tasks.workunit.client.0.smithi060.stdout:6/115: write d3/d12/d16/d1a/f1e [1053365,103652] 0 2024-09-21T10:40:49.224 INFO:tasks.workunit.client.1.smithi112.stdout:5/567: creat d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1/fae x:0 0 0 2024-09-21T10:40:49.226 INFO:tasks.workunit.client.1.smithi112.stdout:8/555: mknod d8/d9/dd/d1a/d5d/ca1 0 2024-09-21T10:40:49.226 INFO:tasks.workunit.client.1.smithi112.stdout:8/556: readlink d8/l59 0 2024-09-21T10:40:49.229 INFO:tasks.workunit.client.1.smithi112.stdout:8/557: write d8/d9/dd/d1a/d5d/f65 [721421,128580] 0 2024-09-21T10:40:49.231 INFO:tasks.workunit.client.1.smithi112.stdout:1/707: creat d8/d1a/db8/dbc/fe1 x:0 0 0 2024-09-21T10:40:49.236 INFO:tasks.workunit.client.1.smithi112.stdout:4/573: mknod de/d33/d6f/d9c/cc3 0 2024-09-21T10:40:49.241 INFO:tasks.workunit.client.1.smithi112.stdout:3/524: dwrite d2/d22/f5e [0,4194304] 0 2024-09-21T10:40:49.246 INFO:tasks.workunit.client.1.smithi112.stdout:7/502: mkdir d7/d22/d41/d4b/d52/da3 0 2024-09-21T10:40:49.247 INFO:tasks.workunit.client.1.smithi112.stdout:2/493: mkdir d0/da2 0 2024-09-21T10:40:49.248 INFO:tasks.workunit.client.0.smithi060.stdout:6/116: dwrite d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:49.248 INFO:tasks.workunit.client.1.smithi112.stdout:6/572: dwrite d4/d6/da/d11/d37/d19/f2e [0,4194304] 0 2024-09-21T10:40:49.249 INFO:tasks.workunit.client.1.smithi112.stdout:5/568: unlink d9/d15/d18/d3a/f9c 0 2024-09-21T10:40:49.252 INFO:tasks.workunit.client.1.smithi112.stdout:8/558: rename d8/d9/dd/d1a/f9a to d8/d18/fa2 0 2024-09-21T10:40:49.252 INFO:tasks.workunit.client.1.smithi112.stdout:8/559: truncate d8/d9/dd/d2a/d43/d58/f68 1424079 0 2024-09-21T10:40:49.252 INFO:tasks.workunit.client.1.smithi112.stdout:8/560: fdatasync d8/f14 0 2024-09-21T10:40:49.257 INFO:tasks.workunit.client.1.smithi112.stdout:3/525: symlink d2/d2f/la9 0 2024-09-21T10:40:49.257 INFO:tasks.workunit.client.1.smithi112.stdout:3/526: creat d2/d22/d31/faa x:0 0 0 2024-09-21T10:40:49.257 INFO:tasks.workunit.client.1.smithi112.stdout:7/503: mkdir d7/d22/d41/d56/da4 0 2024-09-21T10:40:49.258 INFO:tasks.workunit.client.1.smithi112.stdout:7/504: fsync d7/d3d/f67 0 2024-09-21T10:40:49.259 INFO:tasks.workunit.client.1.smithi112.stdout:2/494: dread d0/d12/d46/f65 [0,4194304] 0 2024-09-21T10:40:49.259 INFO:tasks.workunit.client.1.smithi112.stdout:2/495: dread - d0/d12/d46/f93 zero size 2024-09-21T10:40:49.260 INFO:tasks.workunit.client.1.smithi112.stdout:2/496: read - d0/d12/d8a/d62/d63/f8b zero size 2024-09-21T10:40:49.262 INFO:tasks.workunit.client.1.smithi112.stdout:6/573: mkdir d4/d6/da/d14/d49/d62/dcf 0 2024-09-21T10:40:49.262 INFO:tasks.workunit.client.1.smithi112.stdout:5/569: creat d9/d15/d18/d20/faf x:0 0 0 2024-09-21T10:40:49.262 INFO:tasks.workunit.client.1.smithi112.stdout:5/570: dread - d9/d8a/fa0 zero size 2024-09-21T10:40:49.264 INFO:tasks.workunit.client.1.smithi112.stdout:3/527: unlink d2/d22/d31/d2a/l54 0 2024-09-21T10:40:49.264 INFO:tasks.workunit.client.0.smithi060.stdout:6/117: dwrite d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:49.265 INFO:tasks.workunit.client.1.smithi112.stdout:7/505: link d7/d22/l37 d7/d22/d47/la5 0 2024-09-21T10:40:49.265 INFO:tasks.workunit.client.1.smithi112.stdout:7/506: fsync d7/f49 0 2024-09-21T10:40:49.267 INFO:tasks.workunit.client.1.smithi112.stdout:6/574: symlink d4/d6/da/d14/d49/d62/dcf/ld0 0 2024-09-21T10:40:49.268 INFO:tasks.workunit.client.1.smithi112.stdout:2/497: dread d0/d12/d6c/d7e/d8f/d51/d57/f37 [4194304,4194304] 0 2024-09-21T10:40:49.268 INFO:tasks.workunit.client.1.smithi112.stdout:2/498: chown d0/d12/d6c/d7e/d8f/d51/d66/c8c 61 1 2024-09-21T10:40:49.269 INFO:tasks.workunit.client.1.smithi112.stdout:8/561: getdents d8/d9/dd/d2a/d43/d58/d82 0 2024-09-21T10:40:49.271 INFO:tasks.workunit.client.1.smithi112.stdout:3/528: symlink d2/d22/d31/d2a/d39/d3a/d76/lab 0 2024-09-21T10:40:49.271 INFO:tasks.workunit.client.1.smithi112.stdout:3/529: truncate d2/d22/d31/f62 1039576 0 2024-09-21T10:40:49.271 INFO:tasks.workunit.client.1.smithi112.stdout:3/530: chown d2/d22/d31/d2a 3486867 1 2024-09-21T10:40:49.271 INFO:tasks.workunit.client.1.smithi112.stdout:9/588: sync 2024-09-21T10:40:49.272 INFO:tasks.workunit.client.1.smithi112.stdout:6/575: mknod d4/d6/da/d11/d37/db8/cd1 0 2024-09-21T10:40:49.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/571: rename d9/d15/d18/d20/d47/c66 to d9/d15/d18/d3a/d4b/cb0 0 2024-09-21T10:40:49.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/572: chown d9/d6e/f8e 1460059901 1 2024-09-21T10:40:49.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/573: write d9/d15/d18/d20/f34 [2851776,130388] 0 2024-09-21T10:40:49.274 INFO:tasks.workunit.client.1.smithi112.stdout:5/574: write d9/d15/f63 [2281550,7343] 0 2024-09-21T10:40:49.277 INFO:tasks.workunit.client.1.smithi112.stdout:3/531: creat d2/d22/d31/d2a/d39/d3a/fac x:0 0 0 2024-09-21T10:40:49.279 INFO:tasks.workunit.client.1.smithi112.stdout:6/576: unlink d4/d6/da/d14/d49/d73/d74/fa8 0 2024-09-21T10:40:49.279 INFO:tasks.workunit.client.1.smithi112.stdout:6/577: stat d4/d6/d75/c90 0 2024-09-21T10:40:49.280 INFO:tasks.workunit.client.1.smithi112.stdout:6/578: readlink d4/d6/da/d11/d1f/l6a 0 2024-09-21T10:40:49.280 INFO:tasks.workunit.client.0.smithi060.stdout:6/118: dwrite d3/d12/d16/d22/f24 [0,4194304] 0 2024-09-21T10:40:49.281 INFO:tasks.workunit.client.1.smithi112.stdout:6/579: truncate d4/d4f/f8c 687179 0 2024-09-21T10:40:49.281 INFO:tasks.workunit.client.1.smithi112.stdout:6/580: read d4/d6/da/d11/d37/f70 [2944923,130456] 0 2024-09-21T10:40:49.281 INFO:tasks.workunit.client.1.smithi112.stdout:6/581: creat d4/dc/d7e/fd2 x:0 0 0 2024-09-21T10:40:49.282 INFO:tasks.workunit.client.1.smithi112.stdout:7/507: rename d7/f3a to d7/d22/d41/d56/da4/fa6 0 2024-09-21T10:40:49.282 INFO:tasks.workunit.client.1.smithi112.stdout:9/589: write d1/d2/d27/f7d [2801582,129394] 0 2024-09-21T10:40:49.282 INFO:tasks.workunit.client.1.smithi112.stdout:9/590: chown d1/d2/d27/d37/d3b/d69/d77/lc1 5672 1 2024-09-21T10:40:49.282 INFO:tasks.workunit.client.1.smithi112.stdout:9/591: readlink d1/d2/d27/d3a/d6b/laf 0 2024-09-21T10:40:49.282 INFO:tasks.workunit.client.1.smithi112.stdout:9/592: creat d1/d2/d27/d3a/d6b/d30/d5c/d7c/fcb x:0 0 0 2024-09-21T10:40:49.282 INFO:tasks.workunit.client.1.smithi112.stdout:5/575: symlink d9/d15/d18/d3a/d61/d62/lb1 0 2024-09-21T10:40:49.283 INFO:tasks.workunit.client.1.smithi112.stdout:5/576: write d9/fe [2749527,107284] 0 2024-09-21T10:40:49.283 INFO:tasks.workunit.client.1.smithi112.stdout:5/577: chown d9/d15/d18/d3a/d61/d62/d6b/d8f 0 1 2024-09-21T10:40:49.283 INFO:tasks.workunit.client.1.smithi112.stdout:5/578: stat d9/d8a/f95 0 2024-09-21T10:40:49.287 INFO:tasks.workunit.client.0.smithi060.stdout:6/119: readlink d3/l8 0 2024-09-21T10:40:49.289 INFO:tasks.workunit.client.0.smithi060.stdout:6/120: creat d3/f26 x:0 0 0 2024-09-21T10:40:49.290 INFO:tasks.workunit.client.1.smithi112.stdout:8/562: rmdir d8/d9/dd/d2b 39 2024-09-21T10:40:49.292 INFO:tasks.workunit.client.0.smithi060.stdout:6/121: mkdir d3/d12/d16/d25/d27 0 2024-09-21T10:40:49.292 INFO:tasks.workunit.client.1.smithi112.stdout:3/532: read d2/d22/d31/f67 [28075,47719] 0 2024-09-21T10:40:49.294 INFO:tasks.workunit.client.0.smithi060.stdout:6/122: chown d3/l15 1255 1 2024-09-21T10:40:49.295 INFO:tasks.workunit.client.0.smithi060.stdout:6/123: truncate d3/dd/f14 4975765 0 2024-09-21T10:40:49.295 INFO:tasks.workunit.client.0.smithi060.stdout:6/124: write d3/fb [3997889,68687] 0 2024-09-21T10:40:49.295 INFO:tasks.workunit.client.1.smithi112.stdout:6/582: mknod d4/d6/da/d11/d37/db8/cd3 0 2024-09-21T10:40:49.295 INFO:tasks.workunit.client.1.smithi112.stdout:3/533: dread d2/d2f/f30 [0,4194304] 0 2024-09-21T10:40:49.295 INFO:tasks.workunit.client.1.smithi112.stdout:3/534: chown d2/d22/d31/l7f 4 1 2024-09-21T10:40:49.296 INFO:tasks.workunit.client.0.smithi060.stdout:6/125: rename d3/d12/d16/d22/f24 to d3/d12/d16/d25/f28 0 2024-09-21T10:40:49.296 INFO:tasks.workunit.client.0.smithi060.stdout:6/126: readlink d3/l8 0 2024-09-21T10:40:49.297 INFO:tasks.workunit.client.1.smithi112.stdout:5/579: dread d9/d15/d18/d3a/d61/f89 [0,4194304] 0 2024-09-21T10:40:49.298 INFO:tasks.workunit.client.1.smithi112.stdout:9/593: symlink d1/d2/d27/d3a/d6b/d30/lcc 0 2024-09-21T10:40:49.298 INFO:tasks.workunit.client.1.smithi112.stdout:9/594: write d1/d2/d27/d3a/fbe [895246,71711] 0 2024-09-21T10:40:49.298 INFO:tasks.workunit.client.1.smithi112.stdout:9/595: write d1/d2/d27/d3a/f56 [1498567,16260] 0 2024-09-21T10:40:49.300 INFO:tasks.workunit.client.1.smithi112.stdout:6/583: rmdir d4/dc/d7e/dc9 0 2024-09-21T10:40:49.301 INFO:tasks.workunit.client.1.smithi112.stdout:3/535: mkdir d2/d22/dad 0 2024-09-21T10:40:49.301 INFO:tasks.workunit.client.1.smithi112.stdout:3/536: fsync d2/f93 0 2024-09-21T10:40:49.303 INFO:tasks.workunit.client.1.smithi112.stdout:5/580: getdents d9/d15/d18/d3a/d4b/d74/d8d 0 2024-09-21T10:40:49.304 INFO:tasks.workunit.client.0.smithi060.stdout:6/127: dread d3/d12/d16/d25/f28 [0,4194304] 0 2024-09-21T10:40:49.304 INFO:tasks.workunit.client.1.smithi112.stdout:5/581: write d9/d15/f24 [4403083,9758] 0 2024-09-21T10:40:49.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/128: unlink d3/l1d 0 2024-09-21T10:40:49.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/129: write d3/d12/d16/f18 [4198797,128763] 0 2024-09-21T10:40:49.307 INFO:tasks.workunit.client.0.smithi060.stdout:6/130: fdatasync d3/f26 0 2024-09-21T10:40:49.308 INFO:tasks.workunit.client.0.smithi060.stdout:6/131: chown d3/l7 23569909 1 2024-09-21T10:40:49.308 INFO:tasks.workunit.client.1.smithi112.stdout:2/499: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f84 [0,4194304] 0 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 -- 172.21.15.60:0/134040619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664100680 msgr2=0x7f8664102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 --2- 172.21.15.60:0/134040619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664100680 0x7f8664102a70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f86600098b0 tx=0x7f866002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 -- 172.21.15.60:0/134040619 shutdown_connections 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 --2- 172.21.15.60:0/134040619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664102fb0 0x7f86641053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 --2- 172.21.15.60:0/134040619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664100680 0x7f8664102a70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 -- 172.21.15.60:0/134040619 >> 172.21.15.60:0/134040619 conn(0x7f86640fa280 msgr2=0x7f86640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 -- 172.21.15.60:0/134040619 shutdown_connections 2024-09-21T10:40:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.306+0000 7f866c251640 1 -- 172.21.15.60:0/134040619 wait complete. 2024-09-21T10:40:49.310 INFO:tasks.workunit.client.1.smithi112.stdout:5/582: mknod d9/cb2 0 2024-09-21T10:40:49.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.307+0000 7f866c251640 1 Processor -- start 2024-09-21T10:40:49.310 INFO:tasks.workunit.client.0.smithi060.stdout:6/132: fsync d3/ff 0 2024-09-21T10:40:49.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.308+0000 7f866c251640 1 -- start start 2024-09-21T10:40:49.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.308+0000 7f866c251640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 0x7f86641978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:49.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.308+0000 7f866c251640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664102fb0 0x7f8664197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:49.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.308+0000 7f866c251640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664198400 con 0x7f8664102fb0 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.308+0000 7f866c251640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664198570 con 0x7f8664100680 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.308+0000 7f8669fed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 0x7f86641978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.309+0000 7f8669fed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 0x7f86641978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:35918/0 (socket says 172.21.15.60:35918) 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.309+0000 7f8669fed640 1 -- 172.21.15.60:0/2901489584 learned_addr learned my addr 172.21.15.60:0/2901489584 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.309+0000 7f86697ec640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664102fb0 0x7f8664197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.309+0000 7f8669fed640 1 -- 172.21.15.60:0/2901489584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664102fb0 msgr2=0x7f8664197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.309+0000 7f8669fed640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664102fb0 0x7f8664197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.309+0000 7f8669fed640 1 -- 172.21.15.60:0/2901489584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009560 con 0x7f8664100680 2024-09-21T10:40:49.313 INFO:tasks.workunit.client.1.smithi112.stdout:6/584: write d4/d6/da/d14/f27 [2685898,69874] 0 2024-09-21T10:40:49.313 INFO:tasks.workunit.client.1.smithi112.stdout:6/585: dread d4/d4f/f8c [0,4194304] 0 2024-09-21T10:40:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.310+0000 7f8669fed640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 0x7f86641978f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f866002a9f0 tx=0x7f86600054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.310+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8660004b60 con 0x7f8664100680 2024-09-21T10:40:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.310+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8660004cc0 con 0x7f8664100680 2024-09-21T10:40:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.310+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8660004b60 con 0x7f8664100680 2024-09-21T10:40:49.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.310+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866419cfb0 con 0x7f8664100680 2024-09-21T10:40:49.314 INFO:tasks.workunit.client.0.smithi060.stdout:6/133: creat d3/d12/d16/d25/d27/f29 x:0 0 0 2024-09-21T10:40:49.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.310+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866419d3d0 con 0x7f8664100680 2024-09-21T10:40:49.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.312+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8648005280 con 0x7f8664100680 2024-09-21T10:40:49.315 INFO:tasks.workunit.client.1.smithi112.stdout:3/537: dread d2/ff [0,4194304] 0 2024-09-21T10:40:49.315 INFO:tasks.workunit.client.1.smithi112.stdout:3/538: creat d2/d2f/d3f/fae x:0 0 0 2024-09-21T10:40:49.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.313+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f8660031640 con 0x7f8664100680 2024-09-21T10:40:49.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.314+0000 7f865affd640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8650073f90 0x7f8650076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:40:49.316 INFO:tasks.workunit.client.1.smithi112.stdout:2/500: symlink d0/d12/d6c/d7e/d8f/d51/d57/la3 0 2024-09-21T10:40:49.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.314+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f86600b5f50 con 0x7f8664100680 2024-09-21T10:40:49.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.314+0000 7f86697ec640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8650073f90 0x7f8650076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:40:49.317 INFO:tasks.workunit.client.0.smithi060.stdout:6/134: truncate d3/d12/d16/d25/f28 3339693 0 2024-09-21T10:40:49.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.315+0000 7f86697ec640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8650073f90 0x7f8650076450 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8664198e10 tx=0x7f865400b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:40:49.319 INFO:tasks.workunit.client.1.smithi112.stdout:6/586: dread d4/dc/d7e/f83 [0,4194304] 0 2024-09-21T10:40:49.320 INFO:tasks.workunit.client.1.smithi112.stdout:7/508: dwrite d7/d22/d86/f61 [0,4194304] 0 2024-09-21T10:40:49.320 INFO:tasks.workunit.client.1.smithi112.stdout:7/509: getdents d7/d22/d41/d56/d97 0 2024-09-21T10:40:49.321 INFO:tasks.workunit.client.1.smithi112.stdout:2/501: unlink d0/d12/d8a/l59 0 2024-09-21T10:40:49.323 INFO:tasks.workunit.client.0.smithi060.stdout:6/135: getdents d3/d12/d16/d25 0 2024-09-21T10:40:49.323 INFO:tasks.workunit.client.1.smithi112.stdout:5/583: link d9/d15/d18/d20/d47/f49 d9/fb3 0 2024-09-21T10:40:49.323 INFO:tasks.workunit.client.1.smithi112.stdout:5/584: write d9/d15/d18/d20/d47/f49 [3609939,89368] 0 2024-09-21T10:40:49.326 INFO:tasks.workunit.client.1.smithi112.stdout:2/502: mkdir d0/da4 0 2024-09-21T10:40:49.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.324+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f86600ecce0 con 0x7f8664100680 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/596: dwrite d1/d2/d42/f76 [4194304,4194304] 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/597: write d1/d2/d27/d3a/d6b/d30/f54 [5145689,68634] 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/598: fdatasync d1/d2/f5 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/599: chown d1/d2/d27/f7d 67 1 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/600: creat d1/d2/fcd x:0 0 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/601: truncate d1/d2/d27/d3a/f33 4362298 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/602: readlink d1/d2/d27/d3a/d6b/d30/l65 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/603: readlink d1/d2/d27/d3a/d6b/lbf 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/604: creat d1/d2/d27/d3a/d6b/d30/fce x:0 0 0 2024-09-21T10:40:49.329 INFO:tasks.workunit.client.1.smithi112.stdout:9/605: write d1/d2/d27/d3a/d6b/d30/f8b [357127,119025] 0 2024-09-21T10:40:49.331 INFO:tasks.workunit.client.1.smithi112.stdout:7/510: dread d7/d22/f2e [0,4194304] 0 2024-09-21T10:40:49.331 INFO:tasks.workunit.client.1.smithi112.stdout:5/585: rename d9/d15/d18/d3a/d61/d62/d6b/d8f to d9/d15/d18/d3a/d4b/db4 0 2024-09-21T10:40:49.335 INFO:tasks.workunit.client.1.smithi112.stdout:2/503: dread d0/d12/d8a/f52 [0,4194304] 0 2024-09-21T10:40:49.339 INFO:tasks.workunit.client.1.smithi112.stdout:9/606: read d1/d2/d27/d62/d70/f21 [2358060,54400] 0 2024-09-21T10:40:49.340 INFO:tasks.workunit.client.0.smithi060.stdout:6/136: fsync d3/d12/d16/d1a/f1e 0 2024-09-21T10:40:49.340 INFO:tasks.workunit.client.0.smithi060.stdout:6/137: write d3/d12/d16/d25/d27/f29 [948046,1898] 0 2024-09-21T10:40:49.343 INFO:tasks.workunit.client.1.smithi112.stdout:3/539: dwrite d2/d1f/f6d [0,4194304] 0 2024-09-21T10:40:49.343 INFO:tasks.workunit.client.1.smithi112.stdout:3/540: dread - d2/d2f/d3f/fae zero size 2024-09-21T10:40:49.343 INFO:tasks.workunit.client.1.smithi112.stdout:6/587: dwrite d4/dc/d1a/d31/d56/fc3 [0,4194304] 0 2024-09-21T10:40:49.346 INFO:tasks.workunit.client.1.smithi112.stdout:7/511: write d7/d3d/f40 [1913235,57686] 0 2024-09-21T10:40:49.347 INFO:tasks.workunit.client.0.smithi060.stdout:6/138: fdatasync d3/d12/d16/d1a/d21/f23 0 2024-09-21T10:40:49.354 INFO:tasks.workunit.client.0.smithi060.stdout:6/139: dread d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:40:49.354 INFO:tasks.workunit.client.0.smithi060.stdout:6/140: write d3/d12/d16/d1a/f1e [608362,15590] 0 2024-09-21T10:40:49.354 INFO:tasks.workunit.client.0.smithi060.stdout:6/141: chown d3 3 1 2024-09-21T10:40:49.354 INFO:tasks.workunit.client.1.smithi112.stdout:6/588: dread d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:49.355 INFO:tasks.workunit.client.1.smithi112.stdout:2/504: dwrite d0/d12/d8a/d62/d63/f4f [0,4194304] 0 2024-09-21T10:40:49.355 INFO:tasks.workunit.client.1.smithi112.stdout:2/505: chown d0/d12/d6c/d7e/d8f/d51/d57/f83 240832 1 2024-09-21T10:40:49.356 INFO:tasks.workunit.client.0.smithi060.stdout:6/142: symlink d3/d12/d16/l2a 0 2024-09-21T10:40:49.357 INFO:tasks.workunit.client.1.smithi112.stdout:5/586: rmdir d9/d15/d18 39 2024-09-21T10:40:49.357 INFO:tasks.workunit.client.1.smithi112.stdout:5/587: readlink d9/d15/d1d/l79 0 2024-09-21T10:40:49.357 INFO:tasks.workunit.client.1.smithi112.stdout:5/588: write d9/d15/d18/d3a/d4b/d71/f80 [188507,122462] 0 2024-09-21T10:40:49.358 INFO:tasks.workunit.client.0.smithi060.stdout:6/143: read d3/d12/d16/d25/d27/f29 [865234,71960] 0 2024-09-21T10:40:49.358 INFO:tasks.workunit.client.0.smithi060.stdout:6/144: getdents d3/d12 0 2024-09-21T10:40:49.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/607: mknod d1/d2/d27/d62/ccf 0 2024-09-21T10:40:49.364 INFO:tasks.workunit.client.1.smithi112.stdout:3/541: truncate d2/d22/d31/d2a/d39/d3a/f59 34802 0 2024-09-21T10:40:49.364 INFO:tasks.workunit.client.1.smithi112.stdout:0/587: sync 2024-09-21T10:40:49.365 INFO:tasks.workunit.client.1.smithi112.stdout:7/512: mkdir d7/d3d/da7 0 2024-09-21T10:40:49.366 INFO:tasks.workunit.client.1.smithi112.stdout:7/513: write d7/d22/d41/d54/f4e [467787,2295] 0 2024-09-21T10:40:49.366 INFO:tasks.workunit.client.1.smithi112.stdout:7/514: write d7/d22/d41/f7b [718662,14200] 0 2024-09-21T10:40:49.375 INFO:tasks.workunit.client.1.smithi112.stdout:2/506: dwrite d0/d12/d6c/d7e/d8f/f27 [0,4194304] 0 2024-09-21T10:40:49.375 INFO:tasks.workunit.client.1.smithi112.stdout:2/507: truncate d0/dd/f6a 536554 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:7/515: dread d7/f10 [0,4194304] 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:7/516: chown d7/d22/d86/f74 121209 1 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:7/517: write d7/f1c [1189063,50487] 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:7/518: readlink d7/d22/d41/d54/d4d/l9e 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/589: unlink d4/d6/da/d11/d1f/d22/fba 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/590: fdatasync d4/d6/d75/d7a/fb3 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/591: fsync f1 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/592: stat d4/d6/da/d11 0 2024-09-21T10:40:49.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/593: fsync d4/d6/da/d11/d1f/d22/f89 0 2024-09-21T10:40:49.377 INFO:tasks.workunit.client.1.smithi112.stdout:0/588: write d3/f92 [288005,60118] 0 2024-09-21T10:40:49.380 INFO:tasks.workunit.client.1.smithi112.stdout:9/608: mkdir d1/d2/d27/dc5/dd0 0 2024-09-21T10:40:49.382 INFO:tasks.workunit.client.1.smithi112.stdout:3/542: truncate d2/d22/d31/d2a/d39/d3a/f47 1393948 0 2024-09-21T10:40:49.382 INFO:tasks.workunit.client.1.smithi112.stdout:3/543: write d2/f14 [2995305,90869] 0 2024-09-21T10:40:49.383 INFO:tasks.workunit.client.1.smithi112.stdout:7/519: fdatasync d7/d22/f46 0 2024-09-21T10:40:49.385 INFO:tasks.workunit.client.1.smithi112.stdout:2/508: truncate d0/d12/d6c/d7e/d8f/f1e 1860080 0 2024-09-21T10:40:49.386 INFO:tasks.workunit.client.1.smithi112.stdout:2/509: chown d0/d12/d8a/d62/d63/f35 44181577 1 2024-09-21T10:40:49.388 INFO:tasks.workunit.client.1.smithi112.stdout:0/589: mkdir d3/d18/dc0 0 2024-09-21T10:40:49.390 INFO:tasks.workunit.client.1.smithi112.stdout:3/544: unlink d2/d2f/f66 0 2024-09-21T10:40:49.391 INFO:tasks.workunit.client.1.smithi112.stdout:0/590: rename d3/d4/da8/d7f/fa1 to d3/fc1 0 2024-09-21T10:40:49.392 INFO:tasks.workunit.client.1.smithi112.stdout:0/591: chown d3/d4/d10/d8b 3756 1 2024-09-21T10:40:49.392 INFO:tasks.workunit.client.1.smithi112.stdout:9/609: dread d1/d2/f3e [0,4194304] 0 2024-09-21T10:40:49.392 INFO:tasks.workunit.client.1.smithi112.stdout:5/589: dwrite d9/d6e/f91 [4194304,4194304] 0 2024-09-21T10:40:49.393 INFO:tasks.workunit.client.1.smithi112.stdout:5/590: read d9/d15/d1d/f46 [720758,13012] 0 2024-09-21T10:40:49.393 INFO:tasks.workunit.client.1.smithi112.stdout:5/591: chown d9/d15/f24 257026402 1 2024-09-21T10:40:49.393 INFO:tasks.workunit.client.1.smithi112.stdout:3/545: mkdir d2/d2f/daf 0 2024-09-21T10:40:49.394 INFO:tasks.workunit.client.1.smithi112.stdout:0/592: getdents d3/d4/d10 0 2024-09-21T10:40:49.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/520: dread d7/d22/d41/d56/da4/fa6 [0,4194304] 0 2024-09-21T10:40:49.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/521: getdents d7/d22/d41/d4b/da2 0 2024-09-21T10:40:49.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/522: fdatasync d7/d22/d41/d56/d5c/f96 0 2024-09-21T10:40:49.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/523: write d7/d22/f31 [4754545,85518] 0 2024-09-21T10:40:49.395 INFO:tasks.workunit.client.1.smithi112.stdout:7/524: creat d7/d22/d73/fa8 x:0 0 0 2024-09-21T10:40:49.400 INFO:tasks.workunit.client.1.smithi112.stdout:9/610: symlink d1/d2/d27/d37/d3b/d69/d77/ld1 0 2024-09-21T10:40:49.401 INFO:tasks.workunit.client.1.smithi112.stdout:9/611: chown d1/d2/d27/d37/d3b/l40 248563 1 2024-09-21T10:40:49.402 INFO:tasks.workunit.client.1.smithi112.stdout:5/592: creat d9/d15/d18/fb5 x:0 0 0 2024-09-21T10:40:49.402 INFO:tasks.workunit.client.1.smithi112.stdout:5/593: fsync d9/d15/d18/d20/d47/f49 0 2024-09-21T10:40:49.402 INFO:tasks.workunit.client.1.smithi112.stdout:5/594: dread - d9/d15/d18/fb5 zero size 2024-09-21T10:40:49.402 INFO:tasks.workunit.client.1.smithi112.stdout:2/510: dread d0/dd/d47/f6b [0,4194304] 0 2024-09-21T10:40:49.402 INFO:tasks.workunit.client.1.smithi112.stdout:6/594: dwrite d4/d4f/f66 [4194304,4194304] 0 2024-09-21T10:40:49.403 INFO:tasks.workunit.client.1.smithi112.stdout:3/546: rename d2/d22/d31/d2a/d9b to d2/db0 0 2024-09-21T10:40:49.406 INFO:tasks.workunit.client.1.smithi112.stdout:5/595: symlink d9/d15/d18/d3a/d61/d62/d6b/lb6 0 2024-09-21T10:40:49.416 INFO:tasks.workunit.client.1.smithi112.stdout:2/511: getdents d0 0 2024-09-21T10:40:49.416 INFO:tasks.workunit.client.1.smithi112.stdout:3/547: getdents d2/d22/d31/d37 0 2024-09-21T10:40:49.416 INFO:tasks.workunit.client.1.smithi112.stdout:2/512: write d0/d12/d6c/d7e/d8f/d51/f53 [610439,126674] 0 2024-09-21T10:40:49.416 INFO:tasks.workunit.client.1.smithi112.stdout:2/513: readlink d0/dd/l48 0 2024-09-21T10:40:49.416 INFO:tasks.workunit.client.1.smithi112.stdout:2/514: chown d0/d12/d8a/d62/d89/f92 28 1 2024-09-21T10:40:49.425 INFO:tasks.workunit.client.1.smithi112.stdout:0/593: rename d3/d4 to d3/d4a/d4e/dc2 0 2024-09-21T10:40:49.425 INFO:tasks.workunit.client.1.smithi112.stdout:0/594: readlink d3/d23/l5d 0 2024-09-21T10:40:49.426 INFO:tasks.workunit.client.1.smithi112.stdout:6/595: dwrite d4/dc/d1a/d31/d56/f7b [0,4194304] 0 2024-09-21T10:40:49.426 INFO:tasks.workunit.client.1.smithi112.stdout:5/596: rename d9/d15/d1d/ca9 to d9/d8a/cb7 0 2024-09-21T10:40:49.427 INFO:tasks.workunit.client.1.smithi112.stdout:5/597: read - d9/d8a/fa0 zero size 2024-09-21T10:40:49.428 INFO:tasks.workunit.client.1.smithi112.stdout:5/598: symlink d9/d57/lb8 0 2024-09-21T10:40:49.428 INFO:tasks.workunit.client.1.smithi112.stdout:5/599: creat d9/d8a/fb9 x:0 0 0 2024-09-21T10:40:49.433 INFO:tasks.workunit.client.1.smithi112.stdout:6/596: dread f1 [0,4194304] 0 2024-09-21T10:40:49.438 INFO:tasks.workunit.client.1.smithi112.stdout:9/612: dwrite d1/d2/d27/d3a/fb6 [0,4194304] 0 2024-09-21T10:40:49.438 INFO:tasks.workunit.client.1.smithi112.stdout:0/595: dread d3/d4a/d4e/d72/d8e/fab [4194304,4194304] 0 2024-09-21T10:40:49.439 INFO:tasks.workunit.client.1.smithi112.stdout:3/548: dwrite d2/d2f/f44 [4194304,4194304] 0 2024-09-21T10:40:49.439 INFO:tasks.workunit.client.1.smithi112.stdout:3/549: fsync d2/d22/d31/d2a/d39/d60/d86/d98/fa5 0 2024-09-21T10:40:49.443 INFO:tasks.workunit.client.1.smithi112.stdout:3/550: creat d2/d22/d31/d2a/d39/d60/d86/fb1 x:0 0 0 2024-09-21T10:40:49.443 INFO:tasks.workunit.client.1.smithi112.stdout:3/551: write d2/d2f/f6a [449228,94014] 0 2024-09-21T10:40:49.445 INFO:tasks.workunit.client.1.smithi112.stdout:3/552: creat d2/d22/d31/d2a/d39/d3a/d76/da3/fb2 x:0 0 0 2024-09-21T10:40:49.451 INFO:tasks.workunit.client.1.smithi112.stdout:1/708: sync 2024-09-21T10:40:49.452 INFO:tasks.workunit.client.1.smithi112.stdout:0/596: dread d3/d4a/d4e/dc2/d1a/f65 [0,4194304] 0 2024-09-21T10:40:49.452 INFO:tasks.workunit.client.1.smithi112.stdout:2/515: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f37 [0,4194304] 0 2024-09-21T10:40:49.454 INFO:tasks.workunit.client.1.smithi112.stdout:0/597: rename d3/d4a/d4e/dc2/d10/d8b/d90 to d3/d4a/d4e/dc2/d1a/d21/d4f/dc3 0 2024-09-21T10:40:49.454 INFO:tasks.workunit.client.1.smithi112.stdout:0/598: creat d3/d18/d45/fc4 x:0 0 0 2024-09-21T10:40:49.455 INFO:tasks.workunit.client.1.smithi112.stdout:2/516: mkdir d0/dd/da5 0 2024-09-21T10:40:49.456 INFO:tasks.workunit.client.1.smithi112.stdout:8/563: sync 2024-09-21T10:40:49.457 INFO:tasks.workunit.client.1.smithi112.stdout:4/574: sync 2024-09-21T10:40:49.457 INFO:tasks.workunit.client.1.smithi112.stdout:4/575: chown de/d18/d6d/f7e 102 1 2024-09-21T10:40:49.457 INFO:tasks.workunit.client.1.smithi112.stdout:8/564: truncate d8/d9/d3c/f50 565377 0 2024-09-21T10:40:49.459 INFO:tasks.workunit.client.1.smithi112.stdout:5/600: dwrite d9/d15/d18/d20/d47/fa8 [0,4194304] 0 2024-09-21T10:40:49.460 INFO:tasks.workunit.client.1.smithi112.stdout:8/565: creat d8/d9/dd/d76/d97/fa3 x:0 0 0 2024-09-21T10:40:49.460 INFO:tasks.workunit.client.1.smithi112.stdout:9/613: dwrite d1/d2/d27/d3a/d6b/d30/d5c/fc2 [0,4194304] 0 2024-09-21T10:40:49.461 INFO:tasks.workunit.client.1.smithi112.stdout:6/597: dwrite d4/d6/da/d14/d49/fad [0,4194304] 0 2024-09-21T10:40:49.462 INFO:tasks.workunit.client.1.smithi112.stdout:6/598: dread d4/d4f/faf [0,4194304] 0 2024-09-21T10:40:49.462 INFO:tasks.workunit.client.1.smithi112.stdout:6/599: readlink d4/d6/da/d11/d37/d19/l4d 0 2024-09-21T10:40:49.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/599: rmdir d3/d4a/d4e 39 2024-09-21T10:40:49.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/600: write d3/d4a/f99 [730557,844] 0 2024-09-21T10:40:49.467 INFO:tasks.workunit.client.1.smithi112.stdout:8/566: rename d8/d9/dd/d1a/f7f to d8/d9/dd/d2b/d31/d46/fa4 0 2024-09-21T10:40:49.472 INFO:tasks.workunit.client.1.smithi112.stdout:3/553: dwrite d2/d1f/f6d [4194304,4194304] 0 2024-09-21T10:40:49.473 INFO:tasks.workunit.client.1.smithi112.stdout:2/517: read d0/d12/d6c/d7e/d8f/d51/d57/f67 [2080756,61291] 0 2024-09-21T10:40:49.475 INFO:tasks.workunit.client.1.smithi112.stdout:5/601: dread d9/d15/d18/d3a/f5b [0,4194304] 0 2024-09-21T10:40:49.475 INFO:tasks.workunit.client.1.smithi112.stdout:5/602: write d9/d15/d18/f39 [775676,46203] 0 2024-09-21T10:40:49.476 INFO:tasks.workunit.client.1.smithi112.stdout:5/603: truncate d9/d15/d18/d3a/d4b/d71/f80 1016818 0 2024-09-21T10:40:49.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/601: readlink d3/d4a/d4e/dc2/d10/l89 0 2024-09-21T10:40:49.477 INFO:tasks.workunit.client.1.smithi112.stdout:3/554: truncate d2/d22/d31/d2a/d39/f7a 3127474 0 2024-09-21T10:40:49.477 INFO:tasks.workunit.client.1.smithi112.stdout:5/604: dread d9/d8a/f95 [0,4194304] 0 2024-09-21T10:40:49.478 INFO:tasks.workunit.client.1.smithi112.stdout:6/600: write d4/d3e/f85 [3621649,73762] 0 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:6/601: creat d4/d6/da/d14/d49/d73/d74/fd4 x:0 0 0 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:6/602: creat d4/d6/da/d11/d1f/d22/fd5 x:0 0 0 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:6/603: readlink d4/dc/d1a/d31/d56/d64/l51 0 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:2/518: creat d0/d12/d46/d86/fa6 x:0 0 0 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:3/555: symlink d2/d8d/lb3 0 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:3/556: chown d2/d2f/l65 1855348656 1 2024-09-21T10:40:49.479 INFO:tasks.workunit.client.1.smithi112.stdout:3/557: readlink d2/d22/d31/d2a/l4e 0 2024-09-21T10:40:49.480 INFO:tasks.workunit.client.1.smithi112.stdout:5/605: mknod d9/d15/d1d/cba 0 2024-09-21T10:40:49.482 INFO:tasks.workunit.client.1.smithi112.stdout:6/604: read - d4/dc/d1a/d31/d3c/f7c zero size 2024-09-21T10:40:49.482 INFO:tasks.workunit.client.1.smithi112.stdout:6/605: fdatasync d4/dc/d1a/d31/d56/f9a 0 2024-09-21T10:40:49.483 INFO:tasks.workunit.client.1.smithi112.stdout:0/602: link d3/d4a/d4e/dc2/c9f d3/d4a/cc5 0 2024-09-21T10:40:49.484 INFO:tasks.workunit.client.1.smithi112.stdout:3/558: mknod d2/d22/d31/d37/cb4 0 2024-09-21T10:40:49.486 INFO:tasks.workunit.client.1.smithi112.stdout:5/606: mkdir d9/d15/d18/d20/d55/dbb 0 2024-09-21T10:40:49.486 INFO:tasks.workunit.client.1.smithi112.stdout:5/607: truncate d9/d15/d18/d20/faf 281739 0 2024-09-21T10:40:49.486 INFO:tasks.workunit.client.1.smithi112.stdout:5/608: write d9/d15/d18/d3a/d4b/d74/d8d/f90 [687850,50029] 0 2024-09-21T10:40:49.486 INFO:tasks.workunit.client.1.smithi112.stdout:5/609: chown d9/d15/d1d/cba 913400480 1 2024-09-21T10:40:49.486 INFO:tasks.workunit.client.1.smithi112.stdout:5/610: fsync d9/d15/f2a 0 2024-09-21T10:40:49.486 INFO:tasks.workunit.client.1.smithi112.stdout:6/606: creat d4/dc/d67/fd6 x:0 0 0 2024-09-21T10:40:49.488 INFO:tasks.workunit.client.1.smithi112.stdout:0/603: mkdir d3/d4a/d4e/dc2/d10/dc6 0 2024-09-21T10:40:49.489 INFO:tasks.workunit.client.1.smithi112.stdout:6/607: mkdir d4/dc/dd7 0 2024-09-21T10:40:49.489 INFO:tasks.workunit.client.1.smithi112.stdout:6/608: fdatasync d4/d6/d75/d7a/fb3 0 2024-09-21T10:40:49.490 INFO:tasks.workunit.client.1.smithi112.stdout:9/614: dwrite d1/d2/d27/d3a/fb6 [0,4194304] 0 2024-09-21T10:40:49.491 INFO:tasks.workunit.client.1.smithi112.stdout:8/567: dwrite d8/d9/d3c/d6d/f9d [0,4194304] 0 2024-09-21T10:40:49.492 INFO:tasks.workunit.client.1.smithi112.stdout:5/611: rename d9/d15/c1a to d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1/cbc 0 2024-09-21T10:40:49.493 INFO:tasks.workunit.client.1.smithi112.stdout:6/609: rmdir d4/d6/da/d11/d1f 39 2024-09-21T10:40:49.494 INFO:tasks.workunit.client.1.smithi112.stdout:9/615: truncate d1/d2/d27/d3a/d6b/d30/d5e/f66 1372990 0 2024-09-21T10:40:49.497 INFO:tasks.workunit.client.1.smithi112.stdout:2/519: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f83 [0,4194304] 0 2024-09-21T10:40:49.498 INFO:tasks.workunit.client.1.smithi112.stdout:8/568: symlink d8/d9/d3c/la5 0 2024-09-21T10:40:49.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/616: mknod d1/d2/d27/d3a/d4c/cd2 0 2024-09-21T10:40:49.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/617: creat d1/d2/d27/d3a/d6b/d30/fd3 x:0 0 0 2024-09-21T10:40:49.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/618: dread - d1/d2/d27/d37/d3b/d69/d73/fc8 zero size 2024-09-21T10:40:49.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/619: write d1/d2/d27/d3a/fbe [1655937,36035] 0 2024-09-21T10:40:49.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/620: truncate d1/d2/d27/f9a 865280 0 2024-09-21T10:40:49.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/621: creat d1/d2/d27/d3a/d6b/d30/d5c/fd4 x:0 0 0 2024-09-21T10:40:49.500 INFO:tasks.workunit.client.1.smithi112.stdout:5/612: dread d9/d15/d18/f77 [0,4194304] 0 2024-09-21T10:40:49.501 INFO:tasks.workunit.client.1.smithi112.stdout:5/613: write d9/f1b [70751,7352] 0 2024-09-21T10:40:49.501 INFO:tasks.workunit.client.1.smithi112.stdout:5/614: dread - d9/d15/fa6 zero size 2024-09-21T10:40:49.501 INFO:tasks.workunit.client.1.smithi112.stdout:5/615: write d9/d15/d18/f29 [1343531,98366] 0 2024-09-21T10:40:49.502 INFO:tasks.workunit.client.1.smithi112.stdout:2/520: dread d0/f2 [0,4194304] 0 2024-09-21T10:40:49.502 INFO:tasks.workunit.client.1.smithi112.stdout:5/616: write d9/d15/d1d/f46 [1186503,45700] 0 2024-09-21T10:40:49.503 INFO:tasks.workunit.client.1.smithi112.stdout:9/622: mkdir d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5 0 2024-09-21T10:40:49.503 INFO:tasks.workunit.client.1.smithi112.stdout:9/623: write d1/f43 [2537216,110831] 0 2024-09-21T10:40:49.504 INFO:tasks.workunit.client.1.smithi112.stdout:2/521: unlink d0/c2c 0 2024-09-21T10:40:49.505 INFO:tasks.workunit.client.1.smithi112.stdout:6/610: dread f1 [0,4194304] 0 2024-09-21T10:40:49.506 INFO:tasks.workunit.client.1.smithi112.stdout:9/624: mknod d1/d2/d42/cd6 0 2024-09-21T10:40:49.506 INFO:tasks.workunit.client.1.smithi112.stdout:9/625: dread - d1/d2/d27/d37/d3b/d69/f94 zero size 2024-09-21T10:40:49.506 INFO:tasks.workunit.client.1.smithi112.stdout:9/626: truncate d1/f6d 668742 0 2024-09-21T10:40:49.506 INFO:tasks.workunit.client.1.smithi112.stdout:9/627: fdatasync d1/d2/d27/d3a/f2d 0 2024-09-21T10:40:49.506 INFO:tasks.workunit.client.1.smithi112.stdout:2/522: creat d0/d12/d6c/d7e/d8f/d51/d66/fa7 x:0 0 0 2024-09-21T10:40:49.507 INFO:tasks.workunit.client.1.smithi112.stdout:9/628: stat d1/d2/d27/d3a/c4b 0 2024-09-21T10:40:49.507 INFO:tasks.workunit.client.1.smithi112.stdout:9/629: symlink d1/d2/d27/d37/d3b/d69/d77/da0/ld7 0 2024-09-21T10:40:49.508 INFO:tasks.workunit.client.1.smithi112.stdout:8/569: dread d8/d9/d3c/f52 [0,4194304] 0 2024-09-21T10:40:49.509 INFO:tasks.workunit.client.1.smithi112.stdout:8/570: rename d8/d9/dd/d2b/d31/d46/c8a to d8/d9/dd/d1a/d5d/ca6 0 2024-09-21T10:40:49.511 INFO:tasks.workunit.client.1.smithi112.stdout:8/571: creat d8/d9/dd/d2b/d31/fa7 x:0 0 0 2024-09-21T10:40:49.511 INFO:tasks.workunit.client.1.smithi112.stdout:8/572: creat d8/d9/dd/d76/d97/fa8 x:0 0 0 2024-09-21T10:40:49.511 INFO:tasks.workunit.client.1.smithi112.stdout:9/630: dread d1/d2/f75 [0,4194304] 0 2024-09-21T10:40:49.511 INFO:tasks.workunit.client.1.smithi112.stdout:9/631: read - d1/d2/d27/d62/f8f zero size 2024-09-21T10:40:49.512 INFO:tasks.workunit.client.1.smithi112.stdout:6/611: dread d4/d6/da/f60 [0,4194304] 0 2024-09-21T10:40:49.512 INFO:tasks.workunit.client.1.smithi112.stdout:8/573: rename d8/d9/dd/d2b/c4e to d8/d9/dd/d2b/ca9 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:2/523: dread d0/d12/d6c/d7e/d8f/f1e [0,4194304] 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:9/632: truncate d1/f1b 786637 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:8/574: read d8/d9/dd/d2b/d31/d46/d86/f91 [46618,65178] 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:8/575: chown d8/d9/d3c/c84 1031861 1 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:8/576: write d8/d9/dd/d1a/f51 [3908645,72262] 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:8/577: write d8/d9/dd/d76/d97/fa8 [238341,55087] 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:8/578: creat d8/faa x:0 0 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:0/604: dwrite d3/d4a/d4e/dc2/f1d [4194304,4194304] 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:3/559: dwrite d2/d1f/f2c [0,4194304] 0 2024-09-21T10:40:49.514 INFO:tasks.workunit.client.1.smithi112.stdout:0/605: dread - d3/d4a/d4e/dc2/da8/f91 zero size 2024-09-21T10:40:49.516 INFO:tasks.workunit.client.1.smithi112.stdout:6/612: mkdir d4/d6/d75/dd8 0 2024-09-21T10:40:49.523 INFO:tasks.workunit.client.1.smithi112.stdout:0/606: creat d3/d4a/d4e/dc2/d1a/dba/fc7 x:0 0 0 2024-09-21T10:40:49.539 INFO:tasks.workunit.client.1.smithi112.stdout:6/613: truncate d4/d6/da/d11/d37/d8b/fbf 4539061 0 2024-09-21T10:40:49.540 INFO:tasks.workunit.client.1.smithi112.stdout:9/633: getdents d1/d2/d27/d3a 0 2024-09-21T10:40:49.542 INFO:tasks.workunit.client.1.smithi112.stdout:5/617: dwrite d9/d15/d18/f29 [0,4194304] 0 2024-09-21T10:40:49.542 INFO:tasks.workunit.client.1.smithi112.stdout:5/618: chown d9/d15/d18/d20/la2 1592599247 1 2024-09-21T10:40:49.542 INFO:tasks.workunit.client.1.smithi112.stdout:5/619: truncate d9/d15/d18/fb5 701554 0 2024-09-21T10:40:49.542 INFO:tasks.workunit.client.1.smithi112.stdout:3/560: dwrite d2/d22/d31/d2a/d39/f81 [0,4194304] 0 2024-09-21T10:40:49.542 INFO:tasks.workunit.client.1.smithi112.stdout:3/561: read - d2/d2f/d3f/fae zero size 2024-09-21T10:40:49.543 INFO:tasks.workunit.client.1.smithi112.stdout:3/562: dread - d2/d22/d31/d2a/d39/d60/f6f zero size 2024-09-21T10:40:49.543 INFO:tasks.workunit.client.1.smithi112.stdout:0/607: unlink d3/d23/l5d 0 2024-09-21T10:40:49.543 INFO:tasks.workunit.client.1.smithi112.stdout:8/579: dwrite d8/d9/dd/f2f [0,4194304] 0 2024-09-21T10:40:49.543 INFO:tasks.workunit.client.1.smithi112.stdout:6/614: truncate d4/dc/d7e/f92 73919 0 2024-09-21T10:40:49.544 INFO:tasks.workunit.client.1.smithi112.stdout:6/615: truncate d4/dc/d1a/d31/d3c/fc1 1749932 0 2024-09-21T10:40:49.544 INFO:tasks.workunit.client.1.smithi112.stdout:6/616: chown d4/dc/d1a/ccb 15014 1 2024-09-21T10:40:49.547 INFO:tasks.workunit.client.1.smithi112.stdout:6/617: write d4/d6/da/d11/d1f/d22/f33 [4238623,115458] 0 2024-09-21T10:40:49.547 INFO:tasks.workunit.client.1.smithi112.stdout:9/634: rename d1/d2/d27/d37/d3b/c5b to d1/d2/d27/d62/cd8 0 2024-09-21T10:40:49.547 INFO:tasks.workunit.client.1.smithi112.stdout:9/635: dread - d1/d2/d27/d37/fc3 zero size 2024-09-21T10:40:49.551 INFO:tasks.workunit.client.1.smithi112.stdout:3/563: symlink d2/d22/d31/d2a/d39/lb5 0 2024-09-21T10:40:49.554 INFO:tasks.workunit.client.1.smithi112.stdout:0/608: write d3/d4a/f70 [280292,127186] 0 2024-09-21T10:40:49.562 INFO:tasks.workunit.client.1.smithi112.stdout:3/564: truncate d2/d1f/f35 360657 0 2024-09-21T10:40:49.562 INFO:tasks.workunit.client.1.smithi112.stdout:3/565: creat d2/d22/d31/d2a/d39/d3a/fb6 x:0 0 0 2024-09-21T10:40:49.564 INFO:tasks.workunit.client.1.smithi112.stdout:5/620: dwrite d9/d15/d1d/f21 [0,4194304] 0 2024-09-21T10:40:49.566 INFO:tasks.workunit.client.1.smithi112.stdout:0/609: link d3/d4a/d4e/dc2/f5 d3/d4a/d4e/d72/da0/fc8 0 2024-09-21T10:40:49.570 INFO:tasks.workunit.client.1.smithi112.stdout:0/610: creat d3/d23/fc9 x:0 0 0 2024-09-21T10:40:49.570 INFO:tasks.workunit.client.1.smithi112.stdout:0/611: creat d3/d18/d45/fca x:0 0 0 2024-09-21T10:40:49.572 INFO:tasks.workunit.client.1.smithi112.stdout:8/580: rename d8/d9/dd/d1a/d5d to d8/d9/dd/dab 0 2024-09-21T10:40:49.572 INFO:tasks.workunit.client.1.smithi112.stdout:9/636: dwrite d1/d2/d27/d3a/d6b/fac [0,4194304] 0 2024-09-21T10:40:49.572 INFO:tasks.workunit.client.1.smithi112.stdout:2/524: write d0/f2a [288784,69628] 0 2024-09-21T10:40:49.573 INFO:tasks.workunit.client.1.smithi112.stdout:2/525: write d0/f6 [1961240,126403] 0 2024-09-21T10:40:49.573 INFO:tasks.workunit.client.1.smithi112.stdout:2/526: dread - d0/d12/d8a/d62/f87 zero size 2024-09-21T10:40:49.577 INFO:tasks.workunit.client.1.smithi112.stdout:9/637: unlink d1/d2/d27/d37/d3b/cb8 0 2024-09-21T10:40:49.580 INFO:tasks.workunit.client.1.smithi112.stdout:9/638: write d1/d2/f75 [337539,27294] 0 2024-09-21T10:40:49.580 INFO:tasks.workunit.client.1.smithi112.stdout:2/527: creat d0/d12/d8a/d62/fa8 x:0 0 0 2024-09-21T10:40:49.582 INFO:tasks.workunit.client.1.smithi112.stdout:0/612: link d3/d4a/d4e/d72/da0/fa2 d3/d4a/fcb 0 2024-09-21T10:40:49.585 INFO:tasks.workunit.client.1.smithi112.stdout:9/639: rename d1/d2/d27/d3a/d6b/lbf to d1/d2/d27/d3a/d6b/ld9 0 2024-09-21T10:40:49.586 INFO:tasks.workunit.client.1.smithi112.stdout:9/640: creat d1/d2/d27/d3a/d6b/d30/fda x:0 0 0 2024-09-21T10:40:49.586 INFO:tasks.workunit.client.1.smithi112.stdout:6/618: dwrite d4/d6/da/d11/d1f/d22/fd5 [0,4194304] 0 2024-09-21T10:40:49.587 INFO:tasks.workunit.client.1.smithi112.stdout:0/613: rename d3/d4a/d4e/d72/d8e to d3/d18/d52/d55/dcc 0 2024-09-21T10:40:49.587 INFO:tasks.workunit.client.1.smithi112.stdout:3/566: dwrite d2/f18 [0,4194304] 0 2024-09-21T10:40:49.592 INFO:tasks.workunit.client.1.smithi112.stdout:6/619: creat d4/d6/da/d11/d1f/fd9 x:0 0 0 2024-09-21T10:40:49.593 INFO:tasks.workunit.client.1.smithi112.stdout:0/614: creat d3/d4a/d4e/dc2/da8/d7f/fcd x:0 0 0 2024-09-21T10:40:49.594 INFO:tasks.workunit.client.1.smithi112.stdout:3/567: mknod d2/d22/d31/d37/cb7 0 2024-09-21T10:40:49.597 INFO:tasks.workunit.client.1.smithi112.stdout:7/525: sync 2024-09-21T10:40:49.603 INFO:tasks.workunit.client.1.smithi112.stdout:3/568: symlink d2/d22/d31/d2a/d39/lb8 0 2024-09-21T10:40:49.606 INFO:tasks.workunit.client.1.smithi112.stdout:4/576: sync 2024-09-21T10:40:49.606 INFO:tasks.workunit.client.1.smithi112.stdout:1/709: sync 2024-09-21T10:40:49.610 INFO:tasks.workunit.client.1.smithi112.stdout:4/577: creat de/d33/d2f/d71/d40/fc4 x:0 0 0 2024-09-21T10:40:49.611 INFO:tasks.workunit.client.1.smithi112.stdout:1/710: truncate d8/d1a/d53/d76/fbb 217660 0 2024-09-21T10:40:49.611 INFO:tasks.workunit.client.1.smithi112.stdout:1/711: read - d8/d54/fca zero size 2024-09-21T10:40:49.611 INFO:tasks.workunit.client.1.smithi112.stdout:1/712: chown d8/c4d 1104913 1 2024-09-21T10:40:49.611 INFO:tasks.workunit.client.1.smithi112.stdout:1/713: read - d8/d54/fca zero size 2024-09-21T10:40:49.612 INFO:tasks.workunit.client.1.smithi112.stdout:1/714: mkdir d8/d1a/d53/de2 0 2024-09-21T10:40:49.614 INFO:tasks.workunit.client.1.smithi112.stdout:4/578: dread de/d18/d6d/f70 [0,4194304] 0 2024-09-21T10:40:49.615 INFO:tasks.workunit.client.1.smithi112.stdout:2/528: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f83 [0,4194304] 0 2024-09-21T10:40:49.615 INFO:tasks.workunit.client.1.smithi112.stdout:4/579: symlink de/d33/d2f/d35/lc5 0 2024-09-21T10:40:49.616 INFO:tasks.workunit.client.1.smithi112.stdout:8/581: dwrite d8/d9/dd/d2b/d31/d46/fa4 [4194304,4194304] 0 2024-09-21T10:40:49.616 INFO:tasks.workunit.client.1.smithi112.stdout:8/582: readlink d8/d9/dd/d2b/l3a 0 2024-09-21T10:40:49.616 INFO:tasks.workunit.client.1.smithi112.stdout:1/715: dread d8/d1a/d31/d66/d87/fc0 [0,4194304] 0 2024-09-21T10:40:49.616 INFO:tasks.workunit.client.1.smithi112.stdout:8/583: write d8/d9/dd/d2a/d43/f9e [388861,95141] 0 2024-09-21T10:40:49.617 INFO:tasks.workunit.client.1.smithi112.stdout:4/580: rename de/d2e/fae to de/d18/fc6 0 2024-09-21T10:40:49.619 INFO:tasks.workunit.client.1.smithi112.stdout:1/716: link d8/d54/d6d/db5/dc2/fda d8/d1a/fe3 0 2024-09-21T10:40:49.619 INFO:tasks.workunit.client.1.smithi112.stdout:1/717: chown d8/d1a/d53/d57/f6e 171855 1 2024-09-21T10:40:49.619 INFO:tasks.workunit.client.1.smithi112.stdout:1/718: creat d8/d1a/d31/d37/d9e/fe4 x:0 0 0 2024-09-21T10:40:49.620 INFO:tasks.workunit.client.1.smithi112.stdout:1/719: stat d8/f24 0 2024-09-21T10:40:49.620 INFO:tasks.workunit.client.1.smithi112.stdout:1/720: write d8/d7a/fd6 [1370611,63315] 0 2024-09-21T10:40:49.620 INFO:tasks.workunit.client.1.smithi112.stdout:8/584: creat d8/d9/dd/d76/fac x:0 0 0 2024-09-21T10:40:49.620 INFO:tasks.workunit.client.1.smithi112.stdout:8/585: write d8/d9/dd/d76/d97/fa3 [281643,64614] 0 2024-09-21T10:40:49.621 INFO:tasks.workunit.client.1.smithi112.stdout:8/586: chown d8/d9/dd/d2b/d31/d46/fa4 139298 1 2024-09-21T10:40:49.621 INFO:tasks.workunit.client.1.smithi112.stdout:8/587: read f3 [1602552,121755] 0 2024-09-21T10:40:49.621 INFO:tasks.workunit.client.1.smithi112.stdout:8/588: write d8/d9/dd/d2a/d43/f7c [724752,112061] 0 2024-09-21T10:40:49.624 INFO:tasks.workunit.client.1.smithi112.stdout:8/589: truncate d8/d18/f1c 199817 0 2024-09-21T10:40:49.627 INFO:tasks.workunit.client.1.smithi112.stdout:8/590: creat d8/d18/fad x:0 0 0 2024-09-21T10:40:49.627 INFO:tasks.workunit.client.1.smithi112.stdout:8/591: fsync d8/d9/dd/d1a/f80 0 2024-09-21T10:40:49.628 INFO:tasks.workunit.client.1.smithi112.stdout:8/592: getdents d8/d9/dd/d2a/d43/d58 0 2024-09-21T10:40:49.629 INFO:tasks.workunit.client.1.smithi112.stdout:8/593: symlink d8/d9/dd/d2b/d31/d46/d86/lae 0 2024-09-21T10:40:49.631 INFO:tasks.workunit.client.1.smithi112.stdout:2/529: read d0/d12/f39 [3108240,36240] 0 2024-09-21T10:40:49.634 INFO:tasks.workunit.client.1.smithi112.stdout:2/530: link d0/d12/c45 d0/d12/d6c/d7e/d8f/d51/d57/ca9 0 2024-09-21T10:40:49.637 INFO:tasks.workunit.client.1.smithi112.stdout:2/531: creat d0/d12/d97/faa x:0 0 0 2024-09-21T10:40:49.637 INFO:tasks.workunit.client.1.smithi112.stdout:2/532: dread - d0/d12/d97/faa zero size 2024-09-21T10:40:49.637 INFO:tasks.workunit.client.1.smithi112.stdout:9/641: dwrite d1/d2/d27/d62/d70/f21 [0,4194304] 0 2024-09-21T10:40:49.637 INFO:tasks.workunit.client.1.smithi112.stdout:7/526: dwrite d7/d22/d41/d56/d72/d79/d8a/f8d [0,4194304] 0 2024-09-21T10:40:49.638 INFO:tasks.workunit.client.1.smithi112.stdout:6/620: dwrite d4/d4f/f5d [0,4194304] 0 2024-09-21T10:40:49.638 INFO:tasks.workunit.client.1.smithi112.stdout:3/569: dwrite f1 [0,4194304] 0 2024-09-21T10:40:49.639 INFO:tasks.workunit.client.1.smithi112.stdout:9/642: symlink d1/d2/d27/dc5/dd0/ldb 0 2024-09-21T10:40:49.639 INFO:tasks.workunit.client.1.smithi112.stdout:9/643: chown d1/d2/d27/d3a/d6b/d30 0 1 2024-09-21T10:40:49.639 INFO:tasks.workunit.client.1.smithi112.stdout:9/644: write d1/d2/fcd [326336,59558] 0 2024-09-21T10:40:49.639 INFO:tasks.workunit.client.1.smithi112.stdout:9/645: fdatasync d1/f89 0 2024-09-21T10:40:49.640 INFO:tasks.workunit.client.1.smithi112.stdout:0/615: dwrite d3/d4a/d4e/dc2/da8/d7f/f82 [0,4194304] 0 2024-09-21T10:40:49.640 INFO:tasks.workunit.client.1.smithi112.stdout:0/616: readlink d3/d18/d52/d55/la7 0 2024-09-21T10:40:49.640 INFO:tasks.workunit.client.1.smithi112.stdout:8/594: dread d8/d9/d3c/d6d/f74 [0,4194304] 0 2024-09-21T10:40:49.642 INFO:tasks.workunit.client.1.smithi112.stdout:7/527: rename d7/ca to d7/d22/d41/d56/da4/ca9 0 2024-09-21T10:40:49.643 INFO:tasks.workunit.client.1.smithi112.stdout:3/570: symlink d2/d22/d31/d2a/d39/lb9 0 2024-09-21T10:40:49.645 INFO:tasks.workunit.client.1.smithi112.stdout:0/617: dread d3/d18/d52/d55/dcc/f95 [0,4194304] 0 2024-09-21T10:40:49.646 INFO:tasks.workunit.client.1.smithi112.stdout:0/618: fdatasync d3/d4a/d4e/dc2/d1a/d21/f30 0 2024-09-21T10:40:49.646 INFO:tasks.workunit.client.1.smithi112.stdout:0/619: write d3/f92 [115686,46148] 0 2024-09-21T10:40:49.651 INFO:tasks.workunit.client.1.smithi112.stdout:8/595: mknod d8/d9/dd/d2b/caf 0 2024-09-21T10:40:49.654 INFO:tasks.workunit.client.1.smithi112.stdout:6/621: rename d4/dc/d1a/d31/d3c/fc1 to d4/d6/da/d14/d49/d62/fda 0 2024-09-21T10:40:49.654 INFO:tasks.workunit.client.1.smithi112.stdout:9/646: write d1/d2/f48 [1462986,127110] 0 2024-09-21T10:40:49.654 INFO:tasks.workunit.client.1.smithi112.stdout:4/581: dwrite de/d2a/dbf/f92 [0,4194304] 0 2024-09-21T10:40:49.656 INFO:tasks.workunit.client.1.smithi112.stdout:6/622: symlink d4/dc/d1a/d31/d56/ldb 0 2024-09-21T10:40:49.659 INFO:tasks.workunit.client.1.smithi112.stdout:9/647: creat d1/d2/d42/fdc x:0 0 0 2024-09-21T10:40:49.663 INFO:tasks.workunit.client.1.smithi112.stdout:4/582: dread de/d2a/dbf/d82/f95 [0,4194304] 0 2024-09-21T10:40:49.664 INFO:tasks.workunit.client.1.smithi112.stdout:2/533: dwrite d0/dd/f42 [0,4194304] 0 2024-09-21T10:40:49.667 INFO:tasks.workunit.client.1.smithi112.stdout:4/583: mknod de/d2a/d31/cc7 0 2024-09-21T10:40:49.667 INFO:tasks.workunit.client.1.smithi112.stdout:1/721: dwrite d8/d1a/d31/d37/d9e/fcc [0,4194304] 0 2024-09-21T10:40:49.671 INFO:tasks.workunit.client.1.smithi112.stdout:2/534: link d0/d12/d97/faa d0/d12/d46/da0/fab 0 2024-09-21T10:40:49.671 INFO:tasks.workunit.client.1.smithi112.stdout:3/571: dwrite d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:49.675 INFO:tasks.workunit.client.1.smithi112.stdout:4/584: mkdir de/d33/d6f/d9c/dc8 0 2024-09-21T10:40:49.675 INFO:tasks.workunit.client.1.smithi112.stdout:4/585: truncate de/fac 640125 0 2024-09-21T10:40:49.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/722: unlink d8/c89 0 2024-09-21T10:40:49.680 INFO:tasks.workunit.client.1.smithi112.stdout:2/535: rename d0/d12/c68 to d0/d12/d8a/d62/d89/cac 0 2024-09-21T10:40:49.681 INFO:tasks.workunit.client.1.smithi112.stdout:2/536: creat d0/d12/d6c/fad x:0 0 0 2024-09-21T10:40:49.682 INFO:tasks.workunit.client.1.smithi112.stdout:3/572: creat d2/d22/d31/d2a/d39/d3a/d76/fba x:0 0 0 2024-09-21T10:40:49.683 INFO:tasks.workunit.client.1.smithi112.stdout:4/586: creat de/d18/d6d/fc9 x:0 0 0 2024-09-21T10:40:49.683 INFO:tasks.workunit.client.1.smithi112.stdout:4/587: stat de/d2a/d31/d8d/fa0 0 2024-09-21T10:40:49.684 INFO:tasks.workunit.client.1.smithi112.stdout:8/596: dwrite d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:49.685 INFO:tasks.workunit.client.1.smithi112.stdout:2/537: creat d0/d12/d8a/d62/d89/fae x:0 0 0 2024-09-21T10:40:49.685 INFO:tasks.workunit.client.1.smithi112.stdout:3/573: rmdir d2/d8d 39 2024-09-21T10:40:49.686 INFO:tasks.workunit.client.1.smithi112.stdout:4/588: mknod de/d33/d6f/d9c/d3e/d57/cca 0 2024-09-21T10:40:49.686 INFO:tasks.workunit.client.1.smithi112.stdout:4/589: rename de/d33/d2f/d71 to de/d33/d2f/d71/d40/d4f/dcb 22 2024-09-21T10:40:49.689 INFO:tasks.workunit.client.1.smithi112.stdout:8/597: mknod d8/d9/d3c/cb0 0 2024-09-21T10:40:49.689 INFO:tasks.workunit.client.1.smithi112.stdout:0/620: dwrite d3/d4a/d4e/f5c [0,4194304] 0 2024-09-21T10:40:49.690 INFO:tasks.workunit.client.1.smithi112.stdout:6/623: dwrite d4/dc/f3f [4194304,4194304] 0 2024-09-21T10:40:49.690 INFO:tasks.workunit.client.1.smithi112.stdout:6/624: write d4/d6/da/d11/d37/f70 [2453805,86426] 0 2024-09-21T10:40:49.690 INFO:tasks.workunit.client.1.smithi112.stdout:3/574: symlink d2/d2f/lbb 0 2024-09-21T10:40:49.690 INFO:tasks.workunit.client.1.smithi112.stdout:3/575: write d2/d22/d31/d2a/f3b [780202,836] 0 2024-09-21T10:40:49.691 INFO:tasks.workunit.client.1.smithi112.stdout:9/648: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:49.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/598: link d8/d9/dd/d76/fac d8/d9/dd/d2a/fb1 0 2024-09-21T10:40:49.695 INFO:tasks.workunit.client.1.smithi112.stdout:0/621: dread d3/d4a/f99 [0,4194304] 0 2024-09-21T10:40:49.695 INFO:tasks.workunit.client.1.smithi112.stdout:0/622: dread - d3/d4a/d4e/dc2/d1a/d21/d4f/f7e zero size 2024-09-21T10:40:49.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/599: dread d8/d9/dd/d2a/d43/f6f [0,4194304] 0 2024-09-21T10:40:49.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/600: truncate d8/d9/dd/d1a/f72 1244133 0 2024-09-21T10:40:49.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/601: readlink d8/d9/d3c/d90/l98 0 2024-09-21T10:40:49.698 INFO:tasks.workunit.client.1.smithi112.stdout:8/602: chown d8/d9/dd/d76/d97/fa8 107738608 1 2024-09-21T10:40:49.700 INFO:tasks.workunit.client.1.smithi112.stdout:8/603: dread d8/d9/dd/d1a/f72 [0,4194304] 0 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Adjusting osd_memory_target on smithi060 to 1217M 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: pgmap v11: 65 pgs: 65 active+clean; 723 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 54 MiB/s rd, 78 MiB/s wr, 653 op/s 2024-09-21T10:40:49.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/961510884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:49.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:49 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:49.704 INFO:tasks.workunit.client.1.smithi112.stdout:9/649: read d1/d2/f5 [31612,73356] 0 2024-09-21T10:40:49.705 INFO:tasks.workunit.client.1.smithi112.stdout:3/576: creat d2/d22/d31/d2a/da1/fbc x:0 0 0 2024-09-21T10:40:49.705 INFO:tasks.workunit.client.1.smithi112.stdout:6/625: write d4/d6/da/d11/d1f/d22/fd5 [2996955,88778] 0 2024-09-21T10:40:49.705 INFO:tasks.workunit.client.1.smithi112.stdout:6/626: creat d4/d6/da/d14/d49/d73/fdc x:0 0 0 2024-09-21T10:40:49.706 INFO:tasks.workunit.client.1.smithi112.stdout:6/627: truncate d4/d6/da/d11/d1f/fd9 855766 0 2024-09-21T10:40:49.708 INFO:tasks.workunit.client.1.smithi112.stdout:9/650: truncate d1/d2/d27/d3a/f71 6874809 0 2024-09-21T10:40:49.708 INFO:tasks.workunit.client.1.smithi112.stdout:3/577: dread d2/d22/d31/d37/f52 [0,4194304] 0 2024-09-21T10:40:49.711 INFO:tasks.workunit.client.1.smithi112.stdout:6/628: mknod d4/dc/d1a/d31/d56/d64/d9b/cdd 0 2024-09-21T10:40:49.711 INFO:tasks.workunit.client.1.smithi112.stdout:6/629: chown d4/d6/da/d11/d1f/d22/l6e 27821743 1 2024-09-21T10:40:49.712 INFO:tasks.workunit.client.1.smithi112.stdout:8/604: getdents d8 0 2024-09-21T10:40:49.712 INFO:tasks.workunit.client.1.smithi112.stdout:8/605: write d8/d9/d3c/f50 [1295623,125218] 0 2024-09-21T10:40:49.713 INFO:tasks.workunit.client.1.smithi112.stdout:9/651: link d1/f89 d1/d2/d27/d37/d68/fdd 0 2024-09-21T10:40:49.713 INFO:tasks.workunit.client.1.smithi112.stdout:9/652: creat d1/d2/d27/d3a/d4c/fde x:0 0 0 2024-09-21T10:40:49.714 INFO:tasks.workunit.client.1.smithi112.stdout:8/606: unlink d8/d9/d3c/d6d/l85 0 2024-09-21T10:40:49.722 INFO:tasks.workunit.client.1.smithi112.stdout:3/578: read d2/d2f/f44 [11859555,104527] 0 2024-09-21T10:40:49.722 INFO:tasks.workunit.client.1.smithi112.stdout:2/538: dwrite d0/f2f [0,4194304] 0 2024-09-21T10:40:49.732 INFO:tasks.workunit.client.1.smithi112.stdout:4/590: dwrite de/d33/d2f/d71/f6a [0,4194304] 0 2024-09-21T10:40:49.732 INFO:tasks.workunit.client.1.smithi112.stdout:4/591: write de/d33/d2f/d35/f96 [184134,32591] 0 2024-09-21T10:40:49.732 INFO:tasks.workunit.client.1.smithi112.stdout:0/623: dwrite d3/d4a/d4e/dc2/d1a/d21/f86 [0,4194304] 0 2024-09-21T10:40:49.733 INFO:tasks.workunit.client.1.smithi112.stdout:1/723: dwrite d8/d20/f32 [0,4194304] 0 2024-09-21T10:40:49.733 INFO:tasks.workunit.client.1.smithi112.stdout:1/724: creat d8/d1a/db8/dbc/fe5 x:0 0 0 2024-09-21T10:40:49.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/653: dwrite d1/d2/d27/f7d [4194304,4194304] 0 2024-09-21T10:40:49.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/654: stat d1/d2/d27/d3a/d4c/fbd 0 2024-09-21T10:40:49.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/655: chown d1/d2/f60 931 1 2024-09-21T10:40:49.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/656: fsync d1/d2/d27/d37/d3b/d69/d73/f99 0 2024-09-21T10:40:49.734 INFO:tasks.workunit.client.1.smithi112.stdout:6/630: dread d4/d6/da/d11/d37/f70 [0,4194304] 0 2024-09-21T10:40:49.745 INFO:tasks.workunit.client.1.smithi112.stdout:1/725: dread d8/d1a/d31/f4e [0,4194304] 0 2024-09-21T10:40:49.753 INFO:tasks.workunit.client.1.smithi112.stdout:8/607: dwrite d8/d9/dd/f42 [0,4194304] 0 2024-09-21T10:40:49.754 INFO:tasks.workunit.client.1.smithi112.stdout:8/608: creat d8/d9/d3c/d57/fb2 x:0 0 0 2024-09-21T10:40:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.771+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8648005530 con 0x7f8664100680 2024-09-21T10:40:49.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.772+0000 7f865affd640 1 -- 172.21.15.60:0/2901489584 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f86600ecce0 con 0x7f8664100680 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Adjusting osd_memory_target on smithi060 to 1217M 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:40:49.774 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: pgmap v11: 65 pgs: 65 active+clean; 723 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 54 MiB/s rd, 78 MiB/s wr, 653 op/s 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/961510884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:40:49.775 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:49 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:40:49.775 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:40:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8650073f90 msgr2=0x7f8650076450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8650073f90 0x7f8650076450 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8664198e10 tx=0x7f865400b390 comp rx=0 tx=0).stop 2024-09-21T10:40:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 msgr2=0x7f86641978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:40:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 0x7f86641978f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f866002a9f0 tx=0x7f86600054f0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 shutdown_connections 2024-09-21T10:40:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8650073f90 0x7f8650076450 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8664102fb0 0x7f8664197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 --2- 172.21.15.60:0/2901489584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8664100680 0x7f86641978f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:40:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 >> 172.21.15.60:0/2901489584 conn(0x7f86640fa280 msgr2=0x7f86640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:40:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 shutdown_connections 2024-09-21T10:40:49.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:40:49.774+0000 7f866c251640 1 -- 172.21.15.60:0/2901489584 wait complete. 2024-09-21T10:40:49.786 INFO:tasks.workunit.client.1.smithi112.stdout:3/579: creat d2/d1f/fbd x:0 0 0 2024-09-21T10:40:49.788 INFO:tasks.workunit.client.1.smithi112.stdout:2/539: mknod d0/dd/da5/caf 0 2024-09-21T10:40:49.788 INFO:tasks.workunit.client.1.smithi112.stdout:6/631: dwrite d4/d6/da/fa7 [0,4194304] 0 2024-09-21T10:40:49.788 INFO:tasks.workunit.client.1.smithi112.stdout:6/632: read d4/d6/da/fb [5608107,25726] 0 2024-09-21T10:40:49.789 INFO:tasks.workunit.client.1.smithi112.stdout:6/633: fsync d4/d6/f87 0 2024-09-21T10:40:49.802 INFO:tasks.workunit.client.1.smithi112.stdout:2/540: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f83 [0,4194304] 0 2024-09-21T10:40:49.819 INFO:tasks.workunit.client.1.smithi112.stdout:4/592: mkdir de/d2a/d31/d8d/dcc 0 2024-09-21T10:40:49.819 INFO:tasks.workunit.client.1.smithi112.stdout:0/624: mknod d3/d4a/d4e/dc2/d10/dc6/cce 0 2024-09-21T10:40:49.832 INFO:tasks.workunit.client.1.smithi112.stdout:9/657: mknod d1/d2/d27/d37/d3b/d69/cdf 0 2024-09-21T10:40:49.832 INFO:tasks.workunit.client.1.smithi112.stdout:9/658: readlink d1/d2/d27/d3a/d6b/d30/da5/lb7 0 2024-09-21T10:40:49.832 INFO:tasks.workunit.client.1.smithi112.stdout:9/659: chown d1/d2/d27/d37/d68/lc0 27609 1 2024-09-21T10:40:49.833 INFO:tasks.workunit.client.1.smithi112.stdout:1/726: mkdir d8/d54/d6d/db5/dc2/de6 0 2024-09-21T10:40:49.836 INFO:tasks.workunit.client.1.smithi112.stdout:8/609: symlink d8/d9/d3c/d6d/lb3 0 2024-09-21T10:40:49.836 INFO:tasks.workunit.client.1.smithi112.stdout:8/610: chown d8/d9/dd/d2a/d43/d58/d82/l88 59126 1 2024-09-21T10:40:49.836 INFO:tasks.workunit.client.1.smithi112.stdout:8/611: write f3 [2890901,93413] 0 2024-09-21T10:40:49.836 INFO:tasks.workunit.client.1.smithi112.stdout:8/612: read - d8/d9/dd/dab/f9f zero size 2024-09-21T10:40:49.837 INFO:tasks.workunit.client.1.smithi112.stdout:4/593: dwrite de/f12 [0,4194304] 0 2024-09-21T10:40:49.837 INFO:tasks.workunit.client.1.smithi112.stdout:4/594: write de/d33/db5/fb6 [552801,57594] 0 2024-09-21T10:40:49.837 INFO:tasks.workunit.client.1.smithi112.stdout:4/595: fsync de/d2a/d31/d8d/dc2/fc1 0 2024-09-21T10:40:49.837 INFO:tasks.workunit.client.1.smithi112.stdout:4/596: readlink de/d33/d2f/d71/d40/d4f/l90 0 2024-09-21T10:40:49.838 INFO:tasks.workunit.client.1.smithi112.stdout:3/580: creat d2/d22/d31/d2a/d39/d60/fbe x:0 0 0 2024-09-21T10:40:49.841 INFO:tasks.workunit.client.1.smithi112.stdout:6/634: mkdir d4/d6/da/d11/d1f/d22/dde 0 2024-09-21T10:40:49.843 INFO:tasks.workunit.client.1.smithi112.stdout:2/541: rename d0/d12/d46/l9d to d0/d12/d46/lb0 0 2024-09-21T10:40:49.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/542: dread d0/dd/f6a [0,4194304] 0 2024-09-21T10:40:49.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/543: readlink d0/l9b 0 2024-09-21T10:40:49.844 INFO:tasks.workunit.client.1.smithi112.stdout:2/544: write d0/d12/d97/faa [536550,37397] 0 2024-09-21T10:40:49.845 INFO:tasks.workunit.client.1.smithi112.stdout:0/625: link d3/d4a/d4e/dc2/d1a/d21/d46/c7a d3/d18/dc0/ccf 0 2024-09-21T10:40:49.845 INFO:tasks.workunit.client.1.smithi112.stdout:0/626: write d3/d4a/d4e/dc2/d43/faf [46622,70240] 0 2024-09-21T10:40:49.846 INFO:tasks.workunit.client.1.smithi112.stdout:9/660: dwrite d1/f6d [0,4194304] 0 2024-09-21T10:40:49.848 INFO:tasks.workunit.client.1.smithi112.stdout:4/597: unlink de/d33/d2f/c7b 0 2024-09-21T10:40:49.849 INFO:tasks.workunit.client.1.smithi112.stdout:3/581: mknod d2/d2f/d3f/cbf 0 2024-09-21T10:40:49.850 INFO:tasks.workunit.client.1.smithi112.stdout:6/635: creat d4/d6/d9c/dce/fdf x:0 0 0 2024-09-21T10:40:49.855 INFO:tasks.workunit.client.1.smithi112.stdout:0/627: dread d3/d4a/d4e/dc2/d1a/d21/f61 [0,4194304] 0 2024-09-21T10:40:49.855 INFO:tasks.workunit.client.1.smithi112.stdout:9/661: symlink d1/d2/d27/d37/le0 0 2024-09-21T10:40:49.855 INFO:tasks.workunit.client.1.smithi112.stdout:9/662: write d1/d2/d27/d3a/f56 [612869,76344] 0 2024-09-21T10:40:49.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/636: dread d4/dc/f3f [4194304,4194304] 0 2024-09-21T10:40:49.859 INFO:tasks.workunit.client.1.smithi112.stdout:6/637: read - d4/d6/da/d14/d49/d73/fac zero size 2024-09-21T10:40:49.860 INFO:tasks.workunit.client.1.smithi112.stdout:7/528: sync 2024-09-21T10:40:49.860 INFO:tasks.workunit.client.1.smithi112.stdout:5/621: sync 2024-09-21T10:40:49.863 INFO:tasks.workunit.client.1.smithi112.stdout:4/598: creat de/d33/d2f/d35/d4c/fcd x:0 0 0 2024-09-21T10:40:49.863 INFO:tasks.workunit.client.1.smithi112.stdout:5/622: dread d9/d15/d18/f39 [0,4194304] 0 2024-09-21T10:40:49.863 INFO:tasks.workunit.client.1.smithi112.stdout:4/599: write de/d33/d6f/d9c/d3e/fb0 [1351743,98560] 0 2024-09-21T10:40:49.864 INFO:tasks.workunit.client.1.smithi112.stdout:3/582: creat d2/d2f/fc0 x:0 0 0 2024-09-21T10:40:49.864 INFO:tasks.workunit.client.1.smithi112.stdout:9/663: write d1/d2/d27/d3a/f71 [3995245,22555] 0 2024-09-21T10:40:49.865 INFO:tasks.workunit.client.1.smithi112.stdout:0/628: symlink d3/d18/d45/ld0 0 2024-09-21T10:40:49.866 INFO:tasks.workunit.client.1.smithi112.stdout:2/545: dwrite d0/d12/d6c/d7e/d8f/d51/f70 [0,4194304] 0 2024-09-21T10:40:49.867 INFO:tasks.workunit.client.1.smithi112.stdout:2/546: creat d0/d12/d46/fb1 x:0 0 0 2024-09-21T10:40:49.869 INFO:tasks.workunit.client.1.smithi112.stdout:6/638: creat d4/d6/da/d11/d1f/d22/dde/fe0 x:0 0 0 2024-09-21T10:40:49.869 INFO:tasks.workunit.client.1.smithi112.stdout:6/639: fdatasync d4/d6/d75/d7a/fb3 0 2024-09-21T10:40:49.872 INFO:tasks.workunit.client.1.smithi112.stdout:7/529: creat d7/d22/d41/d56/faa x:0 0 0 2024-09-21T10:40:49.873 INFO:tasks.workunit.client.1.smithi112.stdout:3/583: mknod d2/d22/cc1 0 2024-09-21T10:40:49.875 INFO:tasks.workunit.client.1.smithi112.stdout:4/600: dread de/d33/d2f/d35/f36 [0,4194304] 0 2024-09-21T10:40:49.875 INFO:tasks.workunit.client.1.smithi112.stdout:4/601: truncate de/d33/d2f/d71/fb1 283690 0 2024-09-21T10:40:49.875 INFO:tasks.workunit.client.1.smithi112.stdout:4/602: truncate de/d33/d2f/d35/d4c/fcd 869590 0 2024-09-21T10:40:49.875 INFO:tasks.workunit.client.1.smithi112.stdout:4/603: write de/d2e/f32 [769444,26403] 0 2024-09-21T10:40:49.876 INFO:tasks.workunit.client.1.smithi112.stdout:5/623: mknod d9/d15/cbd 0 2024-09-21T10:40:49.876 INFO:tasks.workunit.client.1.smithi112.stdout:2/547: dread d0/d12/d6c/d7e/d8f/d51/d57/f67 [0,4194304] 0 2024-09-21T10:40:49.877 INFO:tasks.workunit.client.1.smithi112.stdout:4/604: mkdir de/d33/d6f/d9c/d3e/dce 0 2024-09-21T10:40:49.880 INFO:tasks.workunit.client.1.smithi112.stdout:0/629: write d3/d23/f26 [1745775,35191] 0 2024-09-21T10:40:49.882 INFO:tasks.workunit.client.1.smithi112.stdout:7/530: dread d7/d3d/f50 [0,4194304] 0 2024-09-21T10:40:49.882 INFO:tasks.workunit.client.1.smithi112.stdout:4/605: rename de/d2a/d31/d8d to de/d33/d2f/dcf 0 2024-09-21T10:40:49.882 INFO:tasks.workunit.client.1.smithi112.stdout:6/640: dread d4/d6/da/d14/d49/fad [0,4194304] 0 2024-09-21T10:40:49.883 INFO:tasks.workunit.client.1.smithi112.stdout:0/630: creat d3/d18/d52/d55/fd1 x:0 0 0 2024-09-21T10:40:49.883 INFO:tasks.workunit.client.1.smithi112.stdout:0/631: readlink d3/d18/d52/d55/l84 0 2024-09-21T10:40:49.885 INFO:tasks.workunit.client.1.smithi112.stdout:3/584: dread d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:49.885 INFO:tasks.workunit.client.1.smithi112.stdout:3/585: chown d2/d22/d31 1 1 2024-09-21T10:40:49.886 INFO:tasks.workunit.client.1.smithi112.stdout:5/624: dread d9/f1c [4194304,4194304] 0 2024-09-21T10:40:49.886 INFO:tasks.workunit.client.1.smithi112.stdout:5/625: fsync d9/f1b 0 2024-09-21T10:40:49.887 INFO:tasks.workunit.client.1.smithi112.stdout:3/586: rename d2/d22/d31/d2a/d39/c74 to d2/d22/d31/d2a/d39/d3a/d76/cc2 0 2024-09-21T10:40:49.889 INFO:tasks.workunit.client.1.smithi112.stdout:5/626: truncate d9/d6e/f91 7733984 0 2024-09-21T10:40:49.890 INFO:tasks.workunit.client.1.smithi112.stdout:3/587: dread d2/d22/d31/f62 [0,4194304] 0 2024-09-21T10:40:49.893 INFO:tasks.workunit.client.1.smithi112.stdout:5/627: creat d9/d15/d18/d20/d55/dbb/fbe x:0 0 0 2024-09-21T10:40:49.893 INFO:tasks.workunit.client.1.smithi112.stdout:5/628: chown d9/d15/f16 5131402 1 2024-09-21T10:40:49.894 INFO:tasks.workunit.client.1.smithi112.stdout:4/606: dread de/f10 [0,4194304] 0 2024-09-21T10:40:49.895 INFO:tasks.workunit.client.1.smithi112.stdout:3/588: mkdir d2/d22/d31/d2a/d39/d60/d86/dc3 0 2024-09-21T10:40:49.895 INFO:tasks.workunit.client.1.smithi112.stdout:3/589: creat d2/d22/d31/d2a/d39/d3a/d76/da3/fc4 x:0 0 0 2024-09-21T10:40:49.895 INFO:tasks.workunit.client.1.smithi112.stdout:3/590: write d2/d22/d31/d37/f52 [2320008,70071] 0 2024-09-21T10:40:49.895 INFO:tasks.workunit.client.1.smithi112.stdout:3/591: dread - d2/d1f/fbd zero size 2024-09-21T10:40:49.895 INFO:tasks.workunit.client.1.smithi112.stdout:0/632: dread d3/d4a/d4e/dc2/f1d [4194304,4194304] 0 2024-09-21T10:40:49.896 INFO:tasks.workunit.client.1.smithi112.stdout:5/629: rename d9/d15/d18/d3a/d61/d62/d9b to d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf 0 2024-09-21T10:40:49.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/607: unlink de/d33/f30 0 2024-09-21T10:40:49.900 INFO:tasks.workunit.client.1.smithi112.stdout:3/592: unlink d2/d22/d31/f8b 0 2024-09-21T10:40:49.901 INFO:tasks.workunit.client.1.smithi112.stdout:0/633: dread d3/d4a/d4e/dc2/d1a/d21/f61 [0,4194304] 0 2024-09-21T10:40:49.901 INFO:tasks.workunit.client.1.smithi112.stdout:0/634: fsync d3/d4a/d4e/dc2/fe 0 2024-09-21T10:40:49.901 INFO:tasks.workunit.client.1.smithi112.stdout:0/635: write d3/d4a/d4e/dc2/d43/f59 [2536870,109584] 0 2024-09-21T10:40:49.901 INFO:tasks.workunit.client.1.smithi112.stdout:5/630: rename d9/d15/d1d/f4d to d9/d15/d18/d3a/d61/d62/d6b/fc0 0 2024-09-21T10:40:49.901 INFO:tasks.workunit.client.1.smithi112.stdout:5/631: truncate d9/d15/d18/d3a/d4b/d71/fa7 730692 0 2024-09-21T10:40:49.902 INFO:tasks.workunit.client.1.smithi112.stdout:5/632: read d9/d15/f24 [3705377,86224] 0 2024-09-21T10:40:49.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/548: dwrite d0/dd/f29 [0,4194304] 0 2024-09-21T10:40:49.902 INFO:tasks.workunit.client.1.smithi112.stdout:4/608: link de/d33/d2f/dcf/c9b de/d33/db5/cd0 0 2024-09-21T10:40:49.903 INFO:tasks.workunit.client.1.smithi112.stdout:6/641: dwrite d4/dc/d67/fd6 [0,4194304] 0 2024-09-21T10:40:49.904 INFO:tasks.workunit.client.1.smithi112.stdout:3/593: mkdir d2/d2f/dc5 0 2024-09-21T10:40:49.905 INFO:tasks.workunit.client.1.smithi112.stdout:5/633: rename d9/d15/d18/d20/d55/f58 to d9/d15/d18/d3a/d4b/d74/fc1 0 2024-09-21T10:40:49.906 INFO:tasks.workunit.client.1.smithi112.stdout:4/609: link de/d33/d6f/d9c/d3e/d75/c99 de/d33/d2f/cd1 0 2024-09-21T10:40:49.910 INFO:tasks.workunit.client.1.smithi112.stdout:6/642: rmdir d4/d6/da/d11/d37 39 2024-09-21T10:40:49.912 INFO:tasks.workunit.client.1.smithi112.stdout:3/594: symlink d2/d22/lc6 0 2024-09-21T10:40:49.913 INFO:tasks.workunit.client.1.smithi112.stdout:2/549: read d0/dd/f2e [6133677,48612] 0 2024-09-21T10:40:49.914 INFO:tasks.workunit.client.1.smithi112.stdout:8/613: dwrite d8/d9/dd/d2a/d43/d58/f68 [0,4194304] 0 2024-09-21T10:40:49.914 INFO:tasks.workunit.client.1.smithi112.stdout:8/614: creat d8/d18/fb4 x:0 0 0 2024-09-21T10:40:49.914 INFO:tasks.workunit.client.1.smithi112.stdout:8/615: readlink d8/d9/d3c/d57/l70 0 2024-09-21T10:40:49.919 INFO:tasks.workunit.client.1.smithi112.stdout:6/643: mkdir d4/d6/da/de1 0 2024-09-21T10:40:49.920 INFO:tasks.workunit.client.1.smithi112.stdout:7/531: dwrite d7/f14 [4194304,4194304] 0 2024-09-21T10:40:49.920 INFO:tasks.workunit.client.1.smithi112.stdout:5/634: dread d9/f1c [0,4194304] 0 2024-09-21T10:40:49.923 INFO:tasks.workunit.client.1.smithi112.stdout:0/636: write d3/d4a/d4e/dc2/d1a/d21/d46/f87 [1275435,97861] 0 2024-09-21T10:40:49.924 INFO:tasks.workunit.client.1.smithi112.stdout:2/550: getdents d0/d12/d76 0 2024-09-21T10:40:49.925 INFO:tasks.workunit.client.1.smithi112.stdout:3/595: rmdir d2/d22/d31/d2a/d39/d60 39 2024-09-21T10:40:49.927 INFO:tasks.workunit.client.1.smithi112.stdout:7/532: creat d7/d22/d86/fab x:0 0 0 2024-09-21T10:40:49.929 INFO:tasks.workunit.client.1.smithi112.stdout:6/644: dread d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:49.931 INFO:tasks.workunit.client.1.smithi112.stdout:5/635: write d9/d15/d18/d3a/d4b/d74/fc1 [3686051,109590] 0 2024-09-21T10:40:49.932 INFO:tasks.workunit.client.1.smithi112.stdout:4/610: dwrite de/d33/d2f/dcf/dc2/f9f [0,4194304] 0 2024-09-21T10:40:49.932 INFO:tasks.workunit.client.1.smithi112.stdout:4/611: readlink de/d33/d2f/d35/lc5 0 2024-09-21T10:40:49.934 INFO:tasks.workunit.client.1.smithi112.stdout:6/645: dread d4/dc/d7e/f83 [0,4194304] 0 2024-09-21T10:40:49.934 INFO:tasks.workunit.client.1.smithi112.stdout:6/646: chown d4/dc/d67/cb1 2 1 2024-09-21T10:40:49.934 INFO:tasks.workunit.client.1.smithi112.stdout:7/533: unlink d7/c1f 0 2024-09-21T10:40:49.934 INFO:tasks.workunit.client.1.smithi112.stdout:2/551: write d0/d12/d8a/d62/d63/f1a [4116488,127767] 0 2024-09-21T10:40:49.936 INFO:tasks.workunit.client.1.smithi112.stdout:4/612: dread de/d18/f76 [0,4194304] 0 2024-09-21T10:40:49.936 INFO:tasks.workunit.client.1.smithi112.stdout:4/613: dread - de/d33/d6f/d9c/d3e/fbd zero size 2024-09-21T10:40:49.939 INFO:tasks.workunit.client.1.smithi112.stdout:5/636: symlink d9/d15/d18/d20/d55/dbb/lc2 0 2024-09-21T10:40:49.940 INFO:tasks.workunit.client.1.smithi112.stdout:7/534: dread d7/f1c [4194304,4194304] 0 2024-09-21T10:40:49.941 INFO:tasks.workunit.client.1.smithi112.stdout:6/647: read d4/d6/da/fab [16808,17662] 0 2024-09-21T10:40:49.942 INFO:tasks.workunit.client.1.smithi112.stdout:3/596: dwrite d2/f18 [0,4194304] 0 2024-09-21T10:40:49.943 INFO:tasks.workunit.client.1.smithi112.stdout:0/637: rmdir d3/d4a 39 2024-09-21T10:40:49.950 INFO:tasks.workunit.client.1.smithi112.stdout:5/637: creat d9/d57/fc3 x:0 0 0 2024-09-21T10:40:49.952 INFO:tasks.workunit.client.1.smithi112.stdout:6/648: unlink d4/d6/da/d11/d1f/c3b 0 2024-09-21T10:40:49.954 INFO:tasks.workunit.client.1.smithi112.stdout:3/597: creat d2/d22/d31/d2a/d39/fc7 x:0 0 0 2024-09-21T10:40:49.955 INFO:tasks.workunit.client.1.smithi112.stdout:3/598: creat d2/d1f/fc8 x:0 0 0 2024-09-21T10:40:49.955 INFO:tasks.workunit.client.1.smithi112.stdout:0/638: creat d3/d4a/d4e/dc2/d10/d8b/fd2 x:0 0 0 2024-09-21T10:40:49.957 INFO:tasks.workunit.client.1.smithi112.stdout:7/535: rename d7/d22/d41/d56/d72/d79 to d7/d22/d86/dac 0 2024-09-21T10:40:49.958 INFO:tasks.workunit.client.1.smithi112.stdout:6/649: mkdir d4/dc/d1a/d31/d56/d64/d9b/de2 0 2024-09-21T10:40:49.958 INFO:tasks.workunit.client.1.smithi112.stdout:6/650: fsync d4/d6/da/d11/d1f/d22/dde/fe0 0 2024-09-21T10:40:49.959 INFO:tasks.workunit.client.1.smithi112.stdout:0/639: creat d3/d4a/d4e/dc2/d43/fd3 x:0 0 0 2024-09-21T10:40:49.960 INFO:tasks.workunit.client.1.smithi112.stdout:5/638: rename d9/d15/d18/d3a/d61/f89 to d9/d15/d18/d3a/d4b/d74/d8d/fc4 0 2024-09-21T10:40:49.962 INFO:tasks.workunit.client.1.smithi112.stdout:7/536: creat d7/d22/d41/d54/d4d/fad x:0 0 0 2024-09-21T10:40:49.964 INFO:tasks.workunit.client.1.smithi112.stdout:0/640: mkdir d3/d4a/d4e/dc2/d10/dd4 0 2024-09-21T10:40:49.966 INFO:tasks.workunit.client.1.smithi112.stdout:7/537: unlink d7/f1c 0 2024-09-21T10:40:49.967 INFO:tasks.workunit.client.1.smithi112.stdout:7/538: write d7/d22/f28 [4311625,14093] 0 2024-09-21T10:40:49.968 INFO:tasks.workunit.client.1.smithi112.stdout:6/651: getdents d4/d6/da/d11/d1f/d22 0 2024-09-21T10:40:49.969 INFO:tasks.workunit.client.1.smithi112.stdout:0/641: getdents d3/d18/d52 0 2024-09-21T10:40:49.974 INFO:tasks.workunit.client.1.smithi112.stdout:7/539: rename d7/d22/d86/dac/d8a/f9f to d7/d22/d41/d56/da4/fae 0 2024-09-21T10:40:49.974 INFO:tasks.workunit.client.1.smithi112.stdout:6/652: rename d4/d6/da to d4/d6/da/d11/d1f/d22/dde/de3 22 2024-09-21T10:40:49.975 INFO:tasks.workunit.client.1.smithi112.stdout:3/599: dwrite d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:49.975 INFO:tasks.workunit.client.1.smithi112.stdout:3/600: chown d2/d22/d31/d2a/d39/d60/f8a 313 1 2024-09-21T10:40:49.976 INFO:tasks.workunit.client.1.smithi112.stdout:7/540: link d7/f26 d7/d22/d73/faf 0 2024-09-21T10:40:49.976 INFO:tasks.workunit.client.1.smithi112.stdout:7/541: stat d7/d22/d41/d56/d5c 0 2024-09-21T10:40:49.977 INFO:tasks.workunit.client.1.smithi112.stdout:5/639: dwrite d9/d15/d18/d3a/d61/d62/d6b/fc0 [0,4194304] 0 2024-09-21T10:40:49.978 INFO:tasks.workunit.client.1.smithi112.stdout:6/653: mknod d4/dc/dd7/ce4 0 2024-09-21T10:40:49.978 INFO:tasks.workunit.client.1.smithi112.stdout:3/601: stat d2/c91 0 2024-09-21T10:40:49.979 INFO:tasks.workunit.client.1.smithi112.stdout:7/542: mknod d7/d22/d78/cb0 0 2024-09-21T10:40:49.981 INFO:tasks.workunit.client.1.smithi112.stdout:5/640: creat d9/d15/d18/d20/d55/fc5 x:0 0 0 2024-09-21T10:40:49.981 INFO:tasks.workunit.client.1.smithi112.stdout:5/641: write d9/d15/d18/d20/d47/f75 [5071342,71449] 0 2024-09-21T10:40:49.984 INFO:tasks.workunit.client.1.smithi112.stdout:6/654: symlink d4/d6/da/d11/d37/d8b/da0/da5/le5 0 2024-09-21T10:40:49.985 INFO:tasks.workunit.client.1.smithi112.stdout:3/602: dread - d2/d22/d31/d2a/d39/d3a/d76/f80 zero size 2024-09-21T10:40:49.985 INFO:tasks.workunit.client.1.smithi112.stdout:3/603: truncate d2/d1f/fbd 54491 0 2024-09-21T10:40:49.987 INFO:tasks.workunit.client.1.smithi112.stdout:6/655: creat d4/d6/da/d14/d49/d62/fe6 x:0 0 0 2024-09-21T10:40:49.987 INFO:tasks.workunit.client.1.smithi112.stdout:0/642: dwrite d3/d4a/f99 [0,4194304] 0 2024-09-21T10:40:49.988 INFO:tasks.workunit.client.1.smithi112.stdout:3/604: creat d2/db0/fc9 x:0 0 0 2024-09-21T10:40:49.990 INFO:tasks.workunit.client.1.smithi112.stdout:5/642: mkdir d9/d15/d18/d20/d47/dc6 0 2024-09-21T10:40:49.990 INFO:tasks.workunit.client.1.smithi112.stdout:5/643: write d9/d15/d18/d3a/d4b/d71/fa7 [795182,19567] 0 2024-09-21T10:40:49.991 INFO:tasks.workunit.client.1.smithi112.stdout:6/656: mkdir d4/d4f/de7 0 2024-09-21T10:40:49.993 INFO:tasks.workunit.client.1.smithi112.stdout:0/643: mkdir d3/d4a/d4e/dc2/d1a/d21/d4f/d83/dd5 0 2024-09-21T10:40:49.993 INFO:tasks.workunit.client.1.smithi112.stdout:0/644: fsync d3/d4a/d4e/dc2/d43/fd3 0 2024-09-21T10:40:49.993 INFO:tasks.workunit.client.1.smithi112.stdout:1/727: sync 2024-09-21T10:40:49.994 INFO:tasks.workunit.client.1.smithi112.stdout:7/543: dwrite d7/f3f [0,4194304] 0 2024-09-21T10:40:49.995 INFO:tasks.workunit.client.1.smithi112.stdout:7/544: fsync d7/f19 0 2024-09-21T10:40:49.995 INFO:tasks.workunit.client.1.smithi112.stdout:3/605: mkdir d2/d2f/daf/dca 0 2024-09-21T10:40:49.996 INFO:tasks.workunit.client.1.smithi112.stdout:7/545: write d7/d22/d86/f7d [804480,82617] 0 2024-09-21T10:40:49.996 INFO:tasks.workunit.client.1.smithi112.stdout:6/657: symlink d4/d6/da/de1/le8 0 2024-09-21T10:40:49.997 INFO:tasks.workunit.client.1.smithi112.stdout:5/644: dread d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:49.997 INFO:tasks.workunit.client.1.smithi112.stdout:0/645: symlink d3/d4a/d4e/dc2/d1a/d21/ld6 0 2024-09-21T10:40:50.003 INFO:tasks.workunit.client.1.smithi112.stdout:3/606: mknod d2/d2f/daf/dca/ccb 0 2024-09-21T10:40:50.004 INFO:tasks.workunit.client.1.smithi112.stdout:7/546: mknod d7/d22/d41/d56/cb1 0 2024-09-21T10:40:50.004 INFO:tasks.workunit.client.1.smithi112.stdout:0/646: dread d3/d4a/d4e/dc2/d1a/f65 [0,4194304] 0 2024-09-21T10:40:50.006 INFO:tasks.workunit.client.1.smithi112.stdout:6/658: creat d4/d6/da/d11/d37/d8b/da0/da5/fe9 x:0 0 0 2024-09-21T10:40:50.008 INFO:tasks.workunit.client.1.smithi112.stdout:3/607: readlink d2/d22/d31/d2a/d39/d3a/d76/lab 0 2024-09-21T10:40:50.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/647: getdents d3/d4a 0 2024-09-21T10:40:50.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/648: stat d3/d18/c3d 0 2024-09-21T10:40:50.010 INFO:tasks.workunit.client.1.smithi112.stdout:0/649: stat d3/d23/c49 0 2024-09-21T10:40:50.012 INFO:tasks.workunit.client.1.smithi112.stdout:6/659: link d4/d6/da/d11/d37/d8b/fbf d4/d4f/fea 0 2024-09-21T10:40:50.013 INFO:tasks.workunit.client.1.smithi112.stdout:3/608: mkdir d2/d2f/dc5/dcc 0 2024-09-21T10:40:50.013 INFO:tasks.workunit.client.1.smithi112.stdout:3/609: truncate d2/d22/d31/d37/f68 526000 0 2024-09-21T10:40:50.014 INFO:tasks.workunit.client.1.smithi112.stdout:8/616: sync 2024-09-21T10:40:50.015 INFO:tasks.workunit.client.1.smithi112.stdout:0/650: creat d3/d4a/d4e/dc2/d1a/d21/fd7 x:0 0 0 2024-09-21T10:40:50.016 INFO:tasks.workunit.client.1.smithi112.stdout:8/617: creat d8/d9/dd/d2b/d31/d46/d86/fb5 x:0 0 0 2024-09-21T10:40:50.017 INFO:tasks.workunit.client.1.smithi112.stdout:1/728: dwrite d8/d1a/d31/d37/f47 [4194304,4194304] 0 2024-09-21T10:40:50.017 INFO:tasks.workunit.client.1.smithi112.stdout:1/729: write d8/d1a/d31/d37/d9e/fe4 [662232,39758] 0 2024-09-21T10:40:50.017 INFO:tasks.workunit.client.1.smithi112.stdout:0/651: creat d3/d4a/d4e/dc2/d1a/d21/d4f/d83/dd5/fd8 x:0 0 0 2024-09-21T10:40:50.019 INFO:tasks.workunit.client.1.smithi112.stdout:6/660: rename d4/d6/da/d11/d37/f5e to d4/d6/da/feb 0 2024-09-21T10:40:50.020 INFO:tasks.workunit.client.1.smithi112.stdout:9/664: sync 2024-09-21T10:40:50.020 INFO:tasks.workunit.client.1.smithi112.stdout:9/665: fsync d1/d2/d27/d37/d3b/d69/f8a 0 2024-09-21T10:40:50.020 INFO:tasks.workunit.client.1.smithi112.stdout:9/666: fdatasync d1/d2/d27/d3a/d6b/d30/d5e/f66 0 2024-09-21T10:40:50.020 INFO:tasks.workunit.client.1.smithi112.stdout:9/667: chown d1/d81 19 1 2024-09-21T10:40:50.020 INFO:tasks.workunit.client.1.smithi112.stdout:1/730: getdents d8/d1a/db8 0 2024-09-21T10:40:50.022 INFO:tasks.workunit.client.1.smithi112.stdout:0/652: getdents d3/d4a/d4e/dc2/d1a 0 2024-09-21T10:40:50.022 INFO:tasks.workunit.client.1.smithi112.stdout:0/653: dread - d3/d18/d52/d55/fd1 zero size 2024-09-21T10:40:50.022 INFO:tasks.workunit.client.1.smithi112.stdout:0/654: truncate d3/d4a/d4e/dc2/da8/d7f/fcd 241865 0 2024-09-21T10:40:50.023 INFO:tasks.workunit.client.1.smithi112.stdout:5/645: dwrite d9/d15/d1d/f1f [0,4194304] 0 2024-09-21T10:40:50.023 INFO:tasks.workunit.client.1.smithi112.stdout:6/661: mkdir d4/dc/d1a/d31/d56/d64/d9b/de2/dec 0 2024-09-21T10:40:50.024 INFO:tasks.workunit.client.1.smithi112.stdout:3/610: dread d2/d22/f5e [0,4194304] 0 2024-09-21T10:40:50.024 INFO:tasks.workunit.client.1.smithi112.stdout:3/611: creat d2/d2f/d3f/fcd x:0 0 0 2024-09-21T10:40:50.024 INFO:tasks.workunit.client.1.smithi112.stdout:3/612: creat d2/d22/d31/d2a/d39/fce x:0 0 0 2024-09-21T10:40:50.024 INFO:tasks.workunit.client.1.smithi112.stdout:1/731: mkdir d8/d1a/d31/da1/de7 0 2024-09-21T10:40:50.024 INFO:tasks.workunit.client.1.smithi112.stdout:1/732: chown d8/l48 310626 1 2024-09-21T10:40:50.026 INFO:tasks.workunit.client.1.smithi112.stdout:0/655: mkdir d3/d18/dc0/dd9 0 2024-09-21T10:40:50.028 INFO:tasks.workunit.client.1.smithi112.stdout:9/668: write d1/d2/d27/d3a/d6b/fac [2015214,14339] 0 2024-09-21T10:40:50.030 INFO:tasks.workunit.client.1.smithi112.stdout:8/618: read d8/d9/dd/d2b/d31/d46/fa4 [2727480,99021] 0 2024-09-21T10:40:50.031 INFO:tasks.workunit.client.1.smithi112.stdout:0/656: creat d3/d18/dc0/fda x:0 0 0 2024-09-21T10:40:50.032 INFO:tasks.workunit.client.1.smithi112.stdout:5/646: mkdir d9/d15/dc7 0 2024-09-21T10:40:50.036 INFO:tasks.workunit.client.1.smithi112.stdout:0/657: link d3/d23/f54 d3/d4a/d4e/dc2/d1a/dba/fdb 0 2024-09-21T10:40:50.038 INFO:tasks.workunit.client.1.smithi112.stdout:9/669: read d1/d2/d27/d62/d70/f21 [3938045,36325] 0 2024-09-21T10:40:50.038 INFO:tasks.workunit.client.1.smithi112.stdout:9/670: write d1/d2/d27/d37/d3b/d69/f94 [169071,61831] 0 2024-09-21T10:40:50.039 INFO:tasks.workunit.client.1.smithi112.stdout:3/613: rename d2/d22/d31/d2a/d39/d3a/d76/da3 to d2/d22/d31/dcf 0 2024-09-21T10:40:50.039 INFO:tasks.workunit.client.1.smithi112.stdout:3/614: creat d2/d2f/d3f/fd0 x:0 0 0 2024-09-21T10:40:50.040 INFO:tasks.workunit.client.1.smithi112.stdout:0/658: rename d3/d4a/d4e/dc2/d1a/d21/d4f/d83/dd5/fd8 to d3/d18/d52/d55/fdc 0 2024-09-21T10:40:50.041 INFO:tasks.workunit.client.1.smithi112.stdout:0/659: chown d3/d23/f67 1701347 1 2024-09-21T10:40:50.044 INFO:tasks.workunit.client.1.smithi112.stdout:3/615: link d2/d22/d31/d2a/d39/d60/d86/d98/fa5 d2/d22/d31/d2a/d39/d60/d86/fd1 0 2024-09-21T10:40:50.045 INFO:tasks.workunit.client.1.smithi112.stdout:3/616: readlink d2/d2f/la9 0 2024-09-21T10:40:50.046 INFO:tasks.workunit.client.1.smithi112.stdout:9/671: dread d1/d2/f3e [0,4194304] 0 2024-09-21T10:40:50.046 INFO:tasks.workunit.client.1.smithi112.stdout:0/660: creat d3/d18/fdd x:0 0 0 2024-09-21T10:40:50.047 INFO:tasks.workunit.client.1.smithi112.stdout:5/647: write d9/d15/d18/d3a/f2d [1946058,85692] 0 2024-09-21T10:40:50.047 INFO:tasks.workunit.client.1.smithi112.stdout:5/648: chown d9/d15/f6a 11 1 2024-09-21T10:40:50.047 INFO:tasks.workunit.client.1.smithi112.stdout:6/662: dwrite d4/d6/da/d14/d49/d73/d74/fd4 [0,4194304] 0 2024-09-21T10:40:50.047 INFO:tasks.workunit.client.1.smithi112.stdout:8/619: dwrite d8/d9/dd/d2b/d31/d46/d86/f91 [0,4194304] 0 2024-09-21T10:40:50.048 INFO:tasks.workunit.client.1.smithi112.stdout:3/617: truncate f1 1291123 0 2024-09-21T10:40:50.050 INFO:tasks.workunit.client.1.smithi112.stdout:9/672: link d1/d2/d27/d37/d68/lc0 d1/d2/le1 0 2024-09-21T10:40:50.050 INFO:tasks.workunit.client.1.smithi112.stdout:9/673: write d1/d2/d27/f7d [547057,113212] 0 2024-09-21T10:40:50.052 INFO:tasks.workunit.client.1.smithi112.stdout:0/661: mkdir d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/dde 0 2024-09-21T10:40:50.055 INFO:tasks.workunit.client.1.smithi112.stdout:5/649: creat d9/d15/d18/d3a/d4b/d74/d8d/fc8 x:0 0 0 2024-09-21T10:40:50.055 INFO:tasks.workunit.client.1.smithi112.stdout:5/650: write d9/d15/d18/d3a/f2d [3305899,91343] 0 2024-09-21T10:40:50.057 INFO:tasks.workunit.client.1.smithi112.stdout:8/620: dread d8/d9/dd/f5f [4194304,4194304] 0 2024-09-21T10:40:50.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/621: dread - d8/faa zero size 2024-09-21T10:40:50.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/662: mkdir d3/d4a/d4e/dc2/da8/ddf 0 2024-09-21T10:40:50.064 INFO:tasks.workunit.client.1.smithi112.stdout:5/651: symlink d9/d15/d18/d3a/d4b/d74/lc9 0 2024-09-21T10:40:50.064 INFO:tasks.workunit.client.1.smithi112.stdout:5/652: write d9/d57/fc3 [595682,98703] 0 2024-09-21T10:40:50.064 INFO:tasks.workunit.client.1.smithi112.stdout:5/653: write d9/f11 [3322669,125511] 0 2024-09-21T10:40:50.065 INFO:tasks.workunit.client.1.smithi112.stdout:9/674: dwrite d1/d2/d27/d37/f95 [0,4194304] 0 2024-09-21T10:40:50.065 INFO:tasks.workunit.client.1.smithi112.stdout:9/675: write d1/d2/fc4 [650451,12109] 0 2024-09-21T10:40:50.065 INFO:tasks.workunit.client.1.smithi112.stdout:6/663: truncate d4/d6/da/f47 239049 0 2024-09-21T10:40:50.068 INFO:tasks.workunit.client.1.smithi112.stdout:8/622: unlink d8/d9/dd/d2b/f94 0 2024-09-21T10:40:50.068 INFO:tasks.workunit.client.1.smithi112.stdout:8/623: chown d8/d18/f1c 56 1 2024-09-21T10:40:50.068 INFO:tasks.workunit.client.1.smithi112.stdout:8/624: fdatasync d8/d9/dd/f20 0 2024-09-21T10:40:50.068 INFO:tasks.workunit.client.1.smithi112.stdout:8/625: dread - d8/d9/dd/d2a/fb1 zero size 2024-09-21T10:40:50.070 INFO:tasks.workunit.client.1.smithi112.stdout:0/663: mkdir d3/d23/de0 0 2024-09-21T10:40:50.070 INFO:tasks.workunit.client.1.smithi112.stdout:0/664: creat d3/d18/fe1 x:0 0 0 2024-09-21T10:40:50.077 INFO:tasks.workunit.client.1.smithi112.stdout:9/676: rename d1/d2/d42/f76 to d1/d2/d27/d37/d3b/d69/d73/db5/fe2 0 2024-09-21T10:40:50.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/665: dread d3/d4a/f70 [0,4194304] 0 2024-09-21T10:40:50.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/666: chown d3/d4a/d4e/dc2/d1a/f65 20 1 2024-09-21T10:40:50.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/667: creat d3/d18/d45/fe2 x:0 0 0 2024-09-21T10:40:50.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/668: write d3/d4a/d4e/dc2/da8/f91 [454359,48813] 0 2024-09-21T10:40:50.078 INFO:tasks.workunit.client.1.smithi112.stdout:8/626: truncate d8/d9/dd/d2b/d31/d46/fa4 5783988 0 2024-09-21T10:40:50.079 INFO:tasks.workunit.client.1.smithi112.stdout:5/654: dwrite d9/d15/d18/f29 [0,4194304] 0 2024-09-21T10:40:50.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/627: mkdir d8/d9/dd/d2a/db6 0 2024-09-21T10:40:50.083 INFO:tasks.workunit.client.1.smithi112.stdout:8/628: fsync d8/d9/dd/d2b/d31/d46/d86/fb5 0 2024-09-21T10:40:50.089 INFO:tasks.workunit.client.1.smithi112.stdout:0/669: dread d3/d18/f42 [0,4194304] 0 2024-09-21T10:40:50.090 INFO:tasks.workunit.client.1.smithi112.stdout:8/629: mknod d8/cb7 0 2024-09-21T10:40:50.091 INFO:tasks.workunit.client.1.smithi112.stdout:0/670: mknod d3/d18/dc0/dd9/ce3 0 2024-09-21T10:40:50.091 INFO:tasks.workunit.client.1.smithi112.stdout:0/671: fdatasync d3/f1b 0 2024-09-21T10:40:50.092 INFO:tasks.workunit.client.1.smithi112.stdout:8/630: mkdir d8/d9/dd/d2b/db8 0 2024-09-21T10:40:50.092 INFO:tasks.workunit.client.1.smithi112.stdout:5/655: write d9/ff [3878151,111254] 0 2024-09-21T10:40:50.092 INFO:tasks.workunit.client.1.smithi112.stdout:0/672: rmdir d3/d4a/d4e/dc2/da8 39 2024-09-21T10:40:50.095 INFO:tasks.workunit.client.1.smithi112.stdout:6/664: dread d4/d6/da/d11/d37/f70 [0,4194304] 0 2024-09-21T10:40:50.095 INFO:tasks.workunit.client.1.smithi112.stdout:6/665: readlink d4/d6/d75/db7/l91 0 2024-09-21T10:40:50.096 INFO:tasks.workunit.client.1.smithi112.stdout:8/631: mkdir d8/d9/dd/d2b/db8/db9 0 2024-09-21T10:40:50.096 INFO:tasks.workunit.client.1.smithi112.stdout:8/632: write d8/d9/d3c/d6d/f93 [873146,10469] 0 2024-09-21T10:40:50.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/656: symlink d9/d15/d18/d3a/d61/d93/lca 0 2024-09-21T10:40:50.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/657: stat d9/ca 0 2024-09-21T10:40:50.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/658: chown d9/d15/d1d/f5a 9930796 1 2024-09-21T10:40:50.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/659: chown d9/d15/d18/d20/d47/f49 254741280 1 2024-09-21T10:40:50.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/660: fsync d9/d15/d18/d3a/f5b 0 2024-09-21T10:40:50.097 INFO:tasks.workunit.client.1.smithi112.stdout:5/661: creat d9/d15/d18/fcb x:0 0 0 2024-09-21T10:40:50.098 INFO:tasks.workunit.client.1.smithi112.stdout:8/633: creat d8/d9/fba x:0 0 0 2024-09-21T10:40:50.098 INFO:tasks.workunit.client.1.smithi112.stdout:8/634: write d8/d9/dd/f2c [4733682,88137] 0 2024-09-21T10:40:50.098 INFO:tasks.workunit.client.1.smithi112.stdout:8/635: readlink d8/d9/dd/d1a/l3b 0 2024-09-21T10:40:50.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/662: rmdir d9/d15/d18/d3a/d61/d62/d6b 39 2024-09-21T10:40:50.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/663: stat d9/c13 0 2024-09-21T10:40:50.104 INFO:tasks.workunit.client.1.smithi112.stdout:8/636: symlink d8/d9/dd/d2b/d31/lbb 0 2024-09-21T10:40:50.106 INFO:tasks.workunit.client.1.smithi112.stdout:5/664: creat d9/fcc x:0 0 0 2024-09-21T10:40:50.106 INFO:tasks.workunit.client.1.smithi112.stdout:5/665: readlink d9/d15/d18/d3a/d61/d62/lb1 0 2024-09-21T10:40:50.112 INFO:tasks.workunit.client.1.smithi112.stdout:9/677: rename d1/d2/d27/d37/d3b/d69/d73 to d1/d2/d27/d3a/de3 0 2024-09-21T10:40:50.112 INFO:tasks.workunit.client.1.smithi112.stdout:0/673: dwrite d3/d4a/d4e/dc2/d1a/f65 [0,4194304] 0 2024-09-21T10:40:50.113 INFO:tasks.workunit.client.1.smithi112.stdout:5/666: getdents d9/d15/d18/d20/d55/dbb 0 2024-09-21T10:40:50.114 INFO:tasks.workunit.client.1.smithi112.stdout:6/666: dwrite d4/d6/da/d11/d1f/d22/fd5 [4194304,4194304] 0 2024-09-21T10:40:50.116 INFO:tasks.workunit.client.1.smithi112.stdout:9/678: mkdir d1/d2/d27/d37/d3b/d69/d77/da0/de4 0 2024-09-21T10:40:50.117 INFO:tasks.workunit.client.1.smithi112.stdout:0/674: mknod d3/d4a/d4e/dc2/d1a/d21/d4f/d83/dd5/ce4 0 2024-09-21T10:40:50.117 INFO:tasks.workunit.client.1.smithi112.stdout:0/675: write d3/d4a/d4e/dc2/d1a/d21/d4f/d83/fb8 [391274,117840] 0 2024-09-21T10:40:50.117 INFO:tasks.workunit.client.1.smithi112.stdout:0/676: stat d3/d4a/d4e/dc2/d10/d8b/c8a 0 2024-09-21T10:40:50.118 INFO:tasks.workunit.client.1.smithi112.stdout:5/667: symlink d9/d15/d18/d20/d55/lcd 0 2024-09-21T10:40:50.118 INFO:tasks.workunit.client.1.smithi112.stdout:5/668: write d9/d15/d18/d3a/fad [109751,47856] 0 2024-09-21T10:40:50.121 INFO:tasks.workunit.client.1.smithi112.stdout:9/679: link d1/d2/d27/d37/d3b/fa2 d1/d2/d27/d3a/d6b/d30/da5/fe5 0 2024-09-21T10:40:50.127 INFO:tasks.workunit.client.1.smithi112.stdout:0/677: rmdir d3/d18 39 2024-09-21T10:40:50.128 INFO:tasks.workunit.client.1.smithi112.stdout:6/667: rename d4/dc/d1a/d31/d56/d64/d84/db4 to d4/d6/d75/db7/ded 0 2024-09-21T10:40:50.130 INFO:tasks.workunit.client.1.smithi112.stdout:8/637: dwrite d8/f14 [0,4194304] 0 2024-09-21T10:40:50.130 INFO:tasks.workunit.client.1.smithi112.stdout:0/678: rmdir d3/d23/de0 0 2024-09-21T10:40:50.131 INFO:tasks.workunit.client.1.smithi112.stdout:5/669: rename d9/d15/d18/d3a/d4b/d74/lc9 to d9/d15/d18/d20/lce 0 2024-09-21T10:40:50.132 INFO:tasks.workunit.client.1.smithi112.stdout:6/668: creat d4/d6/da/d11/d37/fee x:0 0 0 2024-09-21T10:40:50.132 INFO:tasks.workunit.client.1.smithi112.stdout:6/669: fdatasync d4/d6/da/d14/d49/d73/fac 0 2024-09-21T10:40:50.138 INFO:tasks.workunit.client.1.smithi112.stdout:2/552: sync 2024-09-21T10:40:50.138 INFO:tasks.workunit.client.1.smithi112.stdout:4/614: sync 2024-09-21T10:40:50.138 INFO:tasks.workunit.client.1.smithi112.stdout:4/615: read de/d33/d2f/d35/f36 [2073023,75858] 0 2024-09-21T10:40:50.138 INFO:tasks.workunit.client.1.smithi112.stdout:4/616: write de/d18/d6d/f70 [1136762,94926] 0 2024-09-21T10:40:50.139 INFO:tasks.workunit.client.1.smithi112.stdout:0/679: write d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/fb7 [1694061,73085] 0 2024-09-21T10:40:50.139 INFO:tasks.workunit.client.1.smithi112.stdout:0/680: fsync d3/d18/d52/d55/fd1 0 2024-09-21T10:40:50.140 INFO:tasks.workunit.client.1.smithi112.stdout:8/638: mkdir d8/d9/dd/d2b/d31/dbc 0 2024-09-21T10:40:50.140 INFO:tasks.workunit.client.1.smithi112.stdout:8/639: write d8/d9/dd/d2a/fb1 [403076,73728] 0 2024-09-21T10:40:50.143 INFO:tasks.workunit.client.1.smithi112.stdout:0/681: dread d3/d23/f54 [0,4194304] 0 2024-09-21T10:40:50.166 INFO:tasks.workunit.client.1.smithi112.stdout:2/553: dwrite d0/d12/d6c/f9a [0,4194304] 0 2024-09-21T10:40:50.167 INFO:tasks.workunit.client.1.smithi112.stdout:0/682: dwrite d3/d4a/d4e/dc2/d1a/d21/f6d [0,4194304] 0 2024-09-21T10:40:50.168 INFO:tasks.workunit.client.1.smithi112.stdout:8/640: dwrite d8/d18/f5b [0,4194304] 0 2024-09-21T10:40:50.186 INFO:tasks.workunit.client.1.smithi112.stdout:2/554: dwrite d0/d12/d6c/fad [0,4194304] 0 2024-09-21T10:40:50.186 INFO:tasks.workunit.client.1.smithi112.stdout:8/641: dwrite d8/d9/dd/d2a/fb1 [0,4194304] 0 2024-09-21T10:40:50.195 INFO:tasks.workunit.client.1.smithi112.stdout:2/555: write d0/dd/f42 [3690453,74121] 0 2024-09-21T10:40:50.195 INFO:tasks.workunit.client.1.smithi112.stdout:2/556: fdatasync d0/d12/f4d 0 2024-09-21T10:40:50.198 INFO:tasks.workunit.client.1.smithi112.stdout:8/642: dwrite d8/d9/dd/d2a/d43/d58/f81 [0,4194304] 0 2024-09-21T10:40:50.198 INFO:tasks.workunit.client.1.smithi112.stdout:8/643: truncate d8/d9/dd/d1a/f67 426506 0 2024-09-21T10:40:50.300 INFO:tasks.workunit.client.1.smithi112.stdout:5/670: rename d9/d15/f16 to d9/d15/d18/d20/d55/dbb/fcf 0 2024-09-21T10:40:50.301 INFO:tasks.workunit.client.1.smithi112.stdout:6/670: getdents d4/d6/d75/d97 0 2024-09-21T10:40:50.301 INFO:tasks.workunit.client.1.smithi112.stdout:6/671: getdents d4/d6/da/d14/d49/d73/d74/db5 0 2024-09-21T10:40:50.301 INFO:tasks.workunit.client.1.smithi112.stdout:6/672: chown d4/d6/da/l2b 1 1 2024-09-21T10:40:50.306 INFO:tasks.workunit.client.1.smithi112.stdout:0/683: unlink d3/fc1 0 2024-09-21T10:40:50.306 INFO:tasks.workunit.client.1.smithi112.stdout:0/684: readlink d3/d4a/l60 0 2024-09-21T10:40:50.310 INFO:tasks.workunit.client.1.smithi112.stdout:2/557: rmdir d0/dd/da5 39 2024-09-21T10:40:50.311 INFO:tasks.workunit.client.1.smithi112.stdout:7/547: sync 2024-09-21T10:40:50.311 INFO:tasks.workunit.client.1.smithi112.stdout:1/733: sync 2024-09-21T10:40:50.311 INFO:tasks.workunit.client.1.smithi112.stdout:3/618: sync 2024-09-21T10:40:50.320 INFO:tasks.workunit.client.1.smithi112.stdout:8/644: rename d8/d9/dd/d2b/d31/d46/d86/l95 to d8/d9/dd/d2a/d43/lbd 0 2024-09-21T10:40:50.324 INFO:tasks.workunit.client.1.smithi112.stdout:0/685: mkdir d3/d4a/d4e/dc2/da8/ddf/de5 0 2024-09-21T10:40:50.325 INFO:tasks.workunit.client.1.smithi112.stdout:2/558: creat d0/d12/d6c/d7e/d8f/d51/d57/fb2 x:0 0 0 2024-09-21T10:40:50.327 INFO:tasks.workunit.client.1.smithi112.stdout:3/619: truncate d2/d22/d31/d2a/d39/d3a/d76/f8e 854359 0 2024-09-21T10:40:50.328 INFO:tasks.workunit.client.1.smithi112.stdout:5/671: getdents d9/d8a 0 2024-09-21T10:40:50.329 INFO:tasks.workunit.client.1.smithi112.stdout:3/620: dread d2/d2f/f6a [0,4194304] 0 2024-09-21T10:40:50.330 INFO:tasks.workunit.client.1.smithi112.stdout:1/734: read d8/d20/f5f [398591,15199] 0 2024-09-21T10:40:50.330 INFO:tasks.workunit.client.1.smithi112.stdout:6/673: getdents d4/dc/d7e 0 2024-09-21T10:40:50.330 INFO:tasks.workunit.client.1.smithi112.stdout:6/674: write d4/dc/d1a/d31/f68 [30802,25743] 0 2024-09-21T10:40:50.330 INFO:tasks.workunit.client.1.smithi112.stdout:1/735: write d8/d20/f4a [1608732,85685] 0 2024-09-21T10:40:50.332 INFO:tasks.workunit.client.1.smithi112.stdout:7/548: dwrite d7/d22/d41/d54/f4e [0,4194304] 0 2024-09-21T10:40:50.332 INFO:tasks.workunit.client.1.smithi112.stdout:7/549: chown d7/d22/c29 41 1 2024-09-21T10:40:50.333 INFO:tasks.workunit.client.1.smithi112.stdout:4/617: rmdir de/d2a/dbf/dab 0 2024-09-21T10:40:50.334 INFO:tasks.workunit.client.1.smithi112.stdout:0/686: mknod d3/d4a/d4e/dc2/d43/ce6 0 2024-09-21T10:40:50.336 INFO:tasks.workunit.client.1.smithi112.stdout:3/621: creat d2/d22/d31/d37/fd2 x:0 0 0 2024-09-21T10:40:50.337 INFO:tasks.workunit.client.1.smithi112.stdout:6/675: creat d4/dc/d1a/d31/d3c/fef x:0 0 0 2024-09-21T10:40:50.340 INFO:tasks.workunit.client.1.smithi112.stdout:7/550: mknod d7/d22/d41/d54/d4d/cb2 0 2024-09-21T10:40:50.340 INFO:tasks.workunit.client.1.smithi112.stdout:7/551: write d7/d22/d41/f84 [1120532,124721] 0 2024-09-21T10:40:50.341 INFO:tasks.workunit.client.1.smithi112.stdout:0/687: creat d3/d18/d45/fe7 x:0 0 0 2024-09-21T10:40:50.342 INFO:tasks.workunit.client.1.smithi112.stdout:0/688: chown d3/d4a/d4e/dc2/c9f 0 1 2024-09-21T10:40:50.342 INFO:tasks.workunit.client.1.smithi112.stdout:0/689: chown d3/d18/d45/fbf 6371571 1 2024-09-21T10:40:50.342 INFO:tasks.workunit.client.1.smithi112.stdout:0/690: readlink d3/d18/d52/la4 0 2024-09-21T10:40:50.342 INFO:tasks.workunit.client.1.smithi112.stdout:5/672: rmdir d9/d57 39 2024-09-21T10:40:50.343 INFO:tasks.workunit.client.1.smithi112.stdout:4/618: dread de/d33/d2f/d71/d40/d4f/f6b [0,4194304] 0 2024-09-21T10:40:50.344 INFO:tasks.workunit.client.1.smithi112.stdout:4/619: stat de/d33/d6f/d9c/d3e/d57/f8e 0 2024-09-21T10:40:50.346 INFO:tasks.workunit.client.1.smithi112.stdout:4/620: getdents de/d2a/d31 0 2024-09-21T10:40:50.346 INFO:tasks.workunit.client.1.smithi112.stdout:7/552: mknod d7/d3d/cb3 0 2024-09-21T10:40:50.348 INFO:tasks.workunit.client.1.smithi112.stdout:9/680: sync 2024-09-21T10:40:50.361 INFO:tasks.workunit.client.1.smithi112.stdout:1/736: dwrite d8/d45/f94 [0,4194304] 0 2024-09-21T10:40:50.361 INFO:tasks.workunit.client.1.smithi112.stdout:2/559: dwrite d0/d12/d8a/f3f [0,4194304] 0 2024-09-21T10:40:50.361 INFO:tasks.workunit.client.1.smithi112.stdout:2/560: truncate d0/d12/d8a/d62/d63/f8b 204084 0 2024-09-21T10:40:50.364 INFO:tasks.workunit.client.1.smithi112.stdout:1/737: creat d8/d45/fe8 x:0 0 0 2024-09-21T10:40:50.367 INFO:tasks.workunit.client.1.smithi112.stdout:2/561: getdents d0/d12/d6c 0 2024-09-21T10:40:50.367 INFO:tasks.workunit.client.1.smithi112.stdout:9/681: dread d1/d2/f48 [0,4194304] 0 2024-09-21T10:40:50.368 INFO:tasks.workunit.client.1.smithi112.stdout:9/682: creat d1/d2/d27/d3a/fe6 x:0 0 0 2024-09-21T10:40:50.369 INFO:tasks.workunit.client.1.smithi112.stdout:9/683: creat d1/d2/d27/d3a/d4c/fe7 x:0 0 0 2024-09-21T10:40:50.369 INFO:tasks.workunit.client.1.smithi112.stdout:1/738: dread d8/d54/f5d [0,4194304] 0 2024-09-21T10:40:50.370 INFO:tasks.workunit.client.1.smithi112.stdout:9/684: mkdir d1/d81/de8 0 2024-09-21T10:40:50.371 INFO:tasks.workunit.client.1.smithi112.stdout:1/739: unlink d8/d45/dae/fe0 0 2024-09-21T10:40:50.371 INFO:tasks.workunit.client.1.smithi112.stdout:9/685: mknod d1/d81/ce9 0 2024-09-21T10:40:50.372 INFO:tasks.workunit.client.1.smithi112.stdout:1/740: truncate d8/d54/fa6 559832 0 2024-09-21T10:40:50.373 INFO:tasks.workunit.client.1.smithi112.stdout:9/686: creat d1/d2/d27/d3a/de3/db5/fea x:0 0 0 2024-09-21T10:40:50.374 INFO:tasks.workunit.client.1.smithi112.stdout:9/687: mknod d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/ceb 0 2024-09-21T10:40:50.374 INFO:tasks.workunit.client.1.smithi112.stdout:1/741: dread d8/d1a/d31/d37/f5e [0,4194304] 0 2024-09-21T10:40:50.374 INFO:tasks.workunit.client.1.smithi112.stdout:1/742: write d8/d20/f5f [396931,45857] 0 2024-09-21T10:40:50.374 INFO:tasks.workunit.client.1.smithi112.stdout:1/743: truncate d8/d1a/fad 556453 0 2024-09-21T10:40:50.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/688: mkdir d1/d2/d27/d37/d3b/dec 0 2024-09-21T10:40:50.375 INFO:tasks.workunit.client.1.smithi112.stdout:9/689: readlink d1/d2/d42/l4d 0 2024-09-21T10:40:50.375 INFO:tasks.workunit.client.1.smithi112.stdout:4/621: dwrite de/d33/d2f/d71/d40/d4f/f6b [4194304,4194304] 0 2024-09-21T10:40:50.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/690: mknod d1/d2/d27/d37/d68/ced 0 2024-09-21T10:40:50.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/691: write d1/d2/d27/d3a/d6b/d30/fce [123526,85678] 0 2024-09-21T10:40:50.378 INFO:tasks.workunit.client.1.smithi112.stdout:4/622: rename de/d33/d6f/d9c/cc3 to de/d33/d6f/d9c/cd2 0 2024-09-21T10:40:50.378 INFO:tasks.workunit.client.1.smithi112.stdout:9/692: symlink d1/d2/d27/d3a/d4c/lee 0 2024-09-21T10:40:50.379 INFO:tasks.workunit.client.1.smithi112.stdout:9/693: write d1/d2/d27/d3a/d6b/d30/d5c/fd4 [500797,20619] 0 2024-09-21T10:40:50.380 INFO:tasks.workunit.client.1.smithi112.stdout:4/623: link de/d18/f76 de/d33/d2f/d71/d40/d4f/fd3 0 2024-09-21T10:40:50.380 INFO:tasks.workunit.client.1.smithi112.stdout:9/694: mkdir d1/d2/d27/d37/d3b/d69/d77/dca/dae/def 0 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:4/624: creat de/d33/d2f/dcf/dcc/fd4 x:0 0 0 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:4/625: dread - de/d33/d2f/dcf/dcc/fd4 zero size 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:4/626: write de/d2a/fa6 [39670,1389] 0 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:4/627: rename de/d33 to de/d33/d6f/dd5 22 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:2/562: dread d0/f2f [0,4194304] 0 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:9/695: mkdir d1/d7f/df0 0 2024-09-21T10:40:50.382 INFO:tasks.workunit.client.1.smithi112.stdout:9/696: fsync d1/d2/d27/d3a/fb6 0 2024-09-21T10:40:50.383 INFO:tasks.workunit.client.1.smithi112.stdout:4/628: getdents de/d2e 0 2024-09-21T10:40:50.383 INFO:tasks.workunit.client.1.smithi112.stdout:4/629: write f5 [2011965,63412] 0 2024-09-21T10:40:50.383 INFO:tasks.workunit.client.1.smithi112.stdout:4/630: creat de/d33/d2f/d35/d4c/d5c/fd6 x:0 0 0 2024-09-21T10:40:50.384 INFO:tasks.workunit.client.1.smithi112.stdout:4/631: read de/d33/d2f/f52 [534019,46546] 0 2024-09-21T10:40:50.384 INFO:tasks.workunit.client.1.smithi112.stdout:4/632: chown de/d33/d2f/d71/d40/d4f/l8f 1247273 1 2024-09-21T10:40:50.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/633: stat de/d33/d2f/dcf/dc2 0 2024-09-21T10:40:50.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/634: fdatasync de/d33/db5/fb6 0 2024-09-21T10:40:50.385 INFO:tasks.workunit.client.1.smithi112.stdout:2/563: link d0/f2a d0/d12/d6c/d7e/d8f/d51/d57/fb3 0 2024-09-21T10:40:50.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/635: mknod de/d33/d6f/d9c/cd7 0 2024-09-21T10:40:50.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/636: mknod de/d33/d2f/dcf/cd8 0 2024-09-21T10:40:50.386 INFO:tasks.workunit.client.1.smithi112.stdout:7/553: dwrite d7/d22/d41/d54/f4e [0,4194304] 0 2024-09-21T10:40:50.388 INFO:tasks.workunit.client.1.smithi112.stdout:7/554: unlink d7/d22/d73/c9c 0 2024-09-21T10:40:50.394 INFO:tasks.workunit.client.1.smithi112.stdout:9/697: write d1/d2/d27/d3a/fb6 [1935163,112513] 0 2024-09-21T10:40:50.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/555: mknod d7/d22/d41/d4b/d52/d77/cb4 0 2024-09-21T10:40:50.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/556: creat d7/d22/d86/fb5 x:0 0 0 2024-09-21T10:40:50.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/557: readlink d7/d22/d41/d54/l89 0 2024-09-21T10:40:50.394 INFO:tasks.workunit.client.1.smithi112.stdout:7/558: dread - d7/d22/d86/dac/f8f zero size 2024-09-21T10:40:50.395 INFO:tasks.workunit.client.1.smithi112.stdout:9/698: mknod d1/d2/d27/d37/d3b/d69/d88/cf1 0 2024-09-21T10:40:50.396 INFO:tasks.workunit.client.1.smithi112.stdout:7/559: symlink d7/d22/d41/d56/da4/lb6 0 2024-09-21T10:40:50.396 INFO:tasks.workunit.client.1.smithi112.stdout:7/560: truncate d7/d22/d41/d56/d72/f8b 541492 0 2024-09-21T10:40:50.396 INFO:tasks.workunit.client.1.smithi112.stdout:7/561: write d7/d22/d41/d54/f4e [4447138,49583] 0 2024-09-21T10:40:50.397 INFO:tasks.workunit.client.1.smithi112.stdout:9/699: rename d1/d2/d27/f3d to d1/d2/d27/d3a/d6b/d30/d5c/ff2 0 2024-09-21T10:40:50.398 INFO:tasks.workunit.client.1.smithi112.stdout:7/562: mkdir d7/d22/d41/d56/db7 0 2024-09-21T10:40:50.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/563: symlink d7/d22/d41/lb8 0 2024-09-21T10:40:50.399 INFO:tasks.workunit.client.1.smithi112.stdout:7/564: fsync d7/d22/d41/d56/d5c/f92 0 2024-09-21T10:40:50.400 INFO:tasks.workunit.client.1.smithi112.stdout:6/676: dwrite d4/d6/da/fa7 [4194304,4194304] 0 2024-09-21T10:40:50.400 INFO:tasks.workunit.client.1.smithi112.stdout:6/677: dread - d4/dc/d1a/d31/d56/fc5 zero size 2024-09-21T10:40:50.401 INFO:tasks.workunit.client.1.smithi112.stdout:3/622: dwrite d2/d22/d31/d2a/d39/d3a/fac [0,4194304] 0 2024-09-21T10:40:50.401 INFO:tasks.workunit.client.1.smithi112.stdout:3/623: write d2/d1f/f2c [4850204,23467] 0 2024-09-21T10:40:50.401 INFO:tasks.workunit.client.1.smithi112.stdout:5/673: dwrite d9/d15/d18/d20/d55/dbb/fbe [0,4194304] 0 2024-09-21T10:40:50.402 INFO:tasks.workunit.client.1.smithi112.stdout:7/565: rename d7/d22/d86/f74 to d7/d22/d41/d4b/d52/da3/fb9 0 2024-09-21T10:40:50.402 INFO:tasks.workunit.client.1.smithi112.stdout:7/566: dread - d7/d22/d73/fa8 zero size 2024-09-21T10:40:50.402 INFO:tasks.workunit.client.1.smithi112.stdout:7/567: chown d7/d22/d41/d56/db7 28 1 2024-09-21T10:40:50.402 INFO:tasks.workunit.client.1.smithi112.stdout:1/744: dwrite d8/d1a/fad [0,4194304] 0 2024-09-21T10:40:50.404 INFO:tasks.workunit.client.1.smithi112.stdout:6/678: mknod d4/dc/d1a/cf0 0 2024-09-21T10:40:50.405 INFO:tasks.workunit.client.1.smithi112.stdout:6/679: dread - d4/dc/d1a/d31/d3c/fef zero size 2024-09-21T10:40:50.405 INFO:tasks.workunit.client.1.smithi112.stdout:2/564: dwrite d0/f6 [0,4194304] 0 2024-09-21T10:40:50.405 INFO:tasks.workunit.client.1.smithi112.stdout:1/745: dread d8/d1a/d31/d66/d87/fc0 [0,4194304] 0 2024-09-21T10:40:50.410 INFO:tasks.workunit.client.1.smithi112.stdout:5/674: creat d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd0 x:0 0 0 2024-09-21T10:40:50.411 INFO:tasks.workunit.client.1.smithi112.stdout:3/624: dread d2/d22/f5e [0,4194304] 0 2024-09-21T10:40:50.411 INFO:tasks.workunit.client.1.smithi112.stdout:3/625: creat d2/d22/d31/d2a/da1/fd3 x:0 0 0 2024-09-21T10:40:50.411 INFO:tasks.workunit.client.1.smithi112.stdout:3/626: creat d2/d2f/fd4 x:0 0 0 2024-09-21T10:40:50.412 INFO:tasks.workunit.client.1.smithi112.stdout:3/627: chown d2/d2f/d3f/fd0 11568 1 2024-09-21T10:40:50.412 INFO:tasks.workunit.client.1.smithi112.stdout:7/568: creat d7/d22/d41/d4b/da2/fba x:0 0 0 2024-09-21T10:40:50.415 INFO:tasks.workunit.client.1.smithi112.stdout:9/700: dread d1/d2/d27/d3a/fb6 [0,4194304] 0 2024-09-21T10:40:50.418 INFO:tasks.workunit.client.1.smithi112.stdout:6/680: mknod d4/d6/d75/db7/dc6/cf1 0 2024-09-21T10:40:50.421 INFO:tasks.workunit.client.1.smithi112.stdout:1/746: dwrite d8/d1a/d31/d66/f82 [0,4194304] 0 2024-09-21T10:40:50.421 INFO:tasks.workunit.client.1.smithi112.stdout:1/747: creat d8/d1a/d53/d57/fe9 x:0 0 0 2024-09-21T10:40:50.431 INFO:tasks.workunit.client.1.smithi112.stdout:3/628: mkdir d2/dd5 0 2024-09-21T10:40:50.433 INFO:tasks.workunit.client.1.smithi112.stdout:7/569: link d7/d22/l39 d7/d22/d41/d56/d72/lbb 0 2024-09-21T10:40:50.434 INFO:tasks.workunit.client.1.smithi112.stdout:9/701: symlink d1/d2/d27/d37/d3b/d69/d88/lf3 0 2024-09-21T10:40:50.435 INFO:tasks.workunit.client.1.smithi112.stdout:6/681: creat d4/d6/da/d11/d1f/d22/d86/ff2 x:0 0 0 2024-09-21T10:40:50.435 INFO:tasks.workunit.client.1.smithi112.stdout:6/682: stat d4/d6/d75/db7/ded 0 2024-09-21T10:40:50.441 INFO:tasks.workunit.client.1.smithi112.stdout:7/570: mkdir d7/dbc 0 2024-09-21T10:40:50.443 INFO:tasks.workunit.client.1.smithi112.stdout:6/683: mkdir d4/d6/da/d11/d37/d19/df3 0 2024-09-21T10:40:50.443 INFO:tasks.workunit.client.1.smithi112.stdout:3/629: dread d2/d1f/f40 [0,4194304] 0 2024-09-21T10:40:50.443 INFO:tasks.workunit.client.1.smithi112.stdout:5/675: dwrite d9/d15/d18/d3a/f44 [0,4194304] 0 2024-09-21T10:40:50.443 INFO:tasks.workunit.client.1.smithi112.stdout:2/565: dwrite d0/d12/d8a/d62/d89/fae [0,4194304] 0 2024-09-21T10:40:50.443 INFO:tasks.workunit.client.1.smithi112.stdout:2/566: stat d0/d12/f41 0 2024-09-21T10:40:50.443 INFO:tasks.workunit.client.1.smithi112.stdout:2/567: write d0/d12/d6c/d7e/d8f/d51/f53 [1495736,67041] 0 2024-09-21T10:40:50.445 INFO:tasks.workunit.client.1.smithi112.stdout:1/748: dwrite d8/d1a/f2c [4194304,4194304] 0 2024-09-21T10:40:50.446 INFO:tasks.workunit.client.1.smithi112.stdout:3/630: truncate d2/d1f/f8c 1275765 0 2024-09-21T10:40:50.448 INFO:tasks.workunit.client.1.smithi112.stdout:6/684: creat d4/dc/d1a/d31/d3c/ff4 x:0 0 0 2024-09-21T10:40:50.451 INFO:tasks.workunit.client.1.smithi112.stdout:9/702: dwrite d1/d2/d27/d3a/d4c/fe7 [0,4194304] 0 2024-09-21T10:40:50.451 INFO:tasks.workunit.client.1.smithi112.stdout:5/676: unlink d9/d15/d18/d20/d47/f75 0 2024-09-21T10:40:50.453 INFO:tasks.workunit.client.1.smithi112.stdout:1/749: dread d8/d20/f4a [0,4194304] 0 2024-09-21T10:40:50.455 INFO:tasks.workunit.client.1.smithi112.stdout:3/631: mknod d2/d22/d31/dcf/cd6 0 2024-09-21T10:40:50.456 INFO:tasks.workunit.client.1.smithi112.stdout:6/685: unlink d4/d6/da/d11/d37/d8b/da0/da5/fe9 0 2024-09-21T10:40:50.457 INFO:tasks.workunit.client.1.smithi112.stdout:6/686: dread f1 [0,4194304] 0 2024-09-21T10:40:50.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/7: sync 2024-09-21T10:40:50.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/8: dwrite - no filename 2024-09-21T10:40:50.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/9: dwrite - no filename 2024-09-21T10:40:50.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/10: write - no filename 2024-09-21T10:40:50.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/11: write - no filename 2024-09-21T10:40:50.458 INFO:tasks.workunit.client.1.smithi112.stdout:7/571: rmdir d7/d22/d41/d4b/da2 39 2024-09-21T10:40:50.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/15: sync 2024-09-21T10:40:50.461 INFO:tasks.workunit.client.0.smithi060.stdout:5/12: rename c0 to c1 0 2024-09-21T10:40:50.463 INFO:tasks.workunit.client.1.smithi112.stdout:5/677: link d9/d15/d18/d20/d55/c5e d9/d15/d18/d3a/d4b/d74/d8d/cd1 0 2024-09-21T10:40:50.464 INFO:tasks.workunit.client.0.smithi060.stdout:1/16: unlink c1 0 2024-09-21T10:40:50.471 INFO:tasks.workunit.client.1.smithi112.stdout:6/687: link d4/dc/d1a/d31/d56/d64/l51 d4/d6/d75/db7/ded/lf5 0 2024-09-21T10:40:50.471 INFO:tasks.workunit.client.1.smithi112.stdout:5/678: dread d9/d15/d18/d20/d55/dbb/fcf [4194304,4194304] 0 2024-09-21T10:40:50.472 INFO:tasks.workunit.client.1.smithi112.stdout:5/679: write d9/d15/d18/d3a/d4b/f6f [261710,94181] 0 2024-09-21T10:40:50.472 INFO:tasks.workunit.client.1.smithi112.stdout:5/680: chown d9/d15/d18/d20/d47/fa8 12529948 1 2024-09-21T10:40:50.472 INFO:tasks.workunit.client.1.smithi112.stdout:5/681: write d9/d8a/fa0 [496755,11905] 0 2024-09-21T10:40:50.473 INFO:tasks.workunit.client.1.smithi112.stdout:9/703: getdents d1/d2/d27/d3a 0 2024-09-21T10:40:50.474 INFO:tasks.workunit.client.1.smithi112.stdout:1/750: rmdir d8/d1a/d53/d57/d83 39 2024-09-21T10:40:50.477 INFO:tasks.workunit.client.1.smithi112.stdout:7/572: getdents d7/d22/d41/d56/d72 0 2024-09-21T10:40:50.477 INFO:tasks.workunit.client.1.smithi112.stdout:7/573: write d7/d22/d41/d56/f75 [891536,53094] 0 2024-09-21T10:40:50.477 INFO:tasks.workunit.client.1.smithi112.stdout:7/574: fdatasync d7/d22/d41/d54/f87 0 2024-09-21T10:40:50.479 INFO:tasks.workunit.client.0.smithi060.stdout:1/17: dwrite f5 [0,4194304] 0 2024-09-21T10:40:50.481 INFO:tasks.workunit.client.1.smithi112.stdout:6/688: mkdir d4/d6/da/d11/d37/df6 0 2024-09-21T10:40:50.483 INFO:tasks.workunit.client.1.smithi112.stdout:5/682: creat d9/d6e/fd2 x:0 0 0 2024-09-21T10:40:50.486 INFO:tasks.workunit.client.1.smithi112.stdout:9/704: creat d1/d2/d27/d37/d3b/d69/d77/da0/ff4 x:0 0 0 2024-09-21T10:40:50.486 INFO:tasks.workunit.client.1.smithi112.stdout:9/705: write d1/d2/d27/d3a/fe6 [549243,7711] 0 2024-09-21T10:40:50.486 INFO:tasks.workunit.client.1.smithi112.stdout:6/689: write d4/d6/da/d11/d1f/d22/f26 [114553,122992] 0 2024-09-21T10:40:50.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/18: mkdir d6 0 2024-09-21T10:40:50.490 INFO:tasks.workunit.client.1.smithi112.stdout:1/751: rename d8/c96 to d8/d20/cea 0 2024-09-21T10:40:50.493 INFO:tasks.workunit.client.1.smithi112.stdout:6/690: write d4/d6/d75/d7a/fb3 [3587792,98663] 0 2024-09-21T10:40:50.493 INFO:tasks.workunit.client.1.smithi112.stdout:6/691: chown d4/dc/d1a/d31/f68 65073 1 2024-09-21T10:40:50.493 INFO:tasks.workunit.client.1.smithi112.stdout:6/692: chown d4/dc/f3f 3668856 1 2024-09-21T10:40:50.495 INFO:tasks.workunit.client.1.smithi112.stdout:9/706: rename d1/d2/d27/d37/fc3 to d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/ff5 0 2024-09-21T10:40:50.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/752: mknod d8/d54/db0/db1/ceb 0 2024-09-21T10:40:50.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/753: chown d8/d1a/lc8 13557 1 2024-09-21T10:40:50.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/754: dread - d8/d1a/d53/d76/f7d zero size 2024-09-21T10:40:50.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/755: truncate d8/d45/f9b 362297 0 2024-09-21T10:40:50.497 INFO:tasks.workunit.client.1.smithi112.stdout:1/756: fsync d8/d1a/d53/fd5 0 2024-09-21T10:40:50.498 INFO:tasks.workunit.client.1.smithi112.stdout:7/575: getdents d7/d22/d41/d4b/d5e 0 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:7/576: read d7/d22/d41/d56/d72/f8b [147646,7130] 0 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:7/577: dread - d7/d22/d86/fb5 zero size 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:7/578: chown d7/d22/d41/d56/d5c/d9b 111 1 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/632: rmdir d2/d22/d31 39 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/633: dread - d2/d22/d31/d2a/da1/fbc zero size 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/634: chown d2/d22/d31/dcf/fc4 152229 1 2024-09-21T10:40:50.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/635: stat d2/d2f/d3f/f94 0 2024-09-21T10:40:50.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/645: sync 2024-09-21T10:40:50.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/646: dread - d8/d9/dd/d76/f79 zero size 2024-09-21T10:40:50.503 INFO:tasks.workunit.client.1.smithi112.stdout:5/683: dwrite d9/d15/d18/d20/f34 [0,4194304] 0 2024-09-21T10:40:50.503 INFO:tasks.workunit.client.1.smithi112.stdout:5/684: truncate d9/d6e/fd2 999232 0 2024-09-21T10:40:50.505 INFO:tasks.workunit.client.1.smithi112.stdout:1/757: link d8/d1a/d53/d57/d83/f8b d8/d1a/fec 0 2024-09-21T10:40:50.505 INFO:tasks.workunit.client.1.smithi112.stdout:1/758: fsync d8/d20/f5b 0 2024-09-21T10:40:50.505 INFO:tasks.workunit.client.1.smithi112.stdout:1/759: creat d8/d20/fed x:0 0 0 2024-09-21T10:40:50.505 INFO:tasks.workunit.client.1.smithi112.stdout:1/760: creat d8/d54/db0/fee x:0 0 0 2024-09-21T10:40:50.508 INFO:tasks.workunit.client.0.smithi060.stdout:1/19: dwrite f3 [0,4194304] 0 2024-09-21T10:40:50.508 INFO:tasks.workunit.client.0.smithi060.stdout:1/20: fsync f3 0 2024-09-21T10:40:50.509 INFO:tasks.workunit.client.1.smithi112.stdout:3/636: unlink d2/d1f/c9d 0 2024-09-21T10:40:50.509 INFO:tasks.workunit.client.1.smithi112.stdout:3/637: write d2/db0/fc9 [284953,19025] 0 2024-09-21T10:40:50.509 INFO:tasks.workunit.client.1.smithi112.stdout:3/638: creat d2/db0/fd7 x:0 0 0 2024-09-21T10:40:50.509 INFO:tasks.workunit.client.1.smithi112.stdout:3/639: stat d2/d2f/fd4 0 2024-09-21T10:40:50.509 INFO:tasks.workunit.client.1.smithi112.stdout:7/579: write d7/d22/d86/dac/f98 [1174962,123954] 0 2024-09-21T10:40:50.509 INFO:tasks.workunit.client.1.smithi112.stdout:7/580: fsync d7/d22/d41/f51 0 2024-09-21T10:40:50.510 INFO:tasks.workunit.client.0.smithi060.stdout:5/13: rename c1 to c2 0 2024-09-21T10:40:50.510 INFO:tasks.workunit.client.1.smithi112.stdout:3/640: write d2/d22/d31/d2a/d39/d60/f6f [1003786,109178] 0 2024-09-21T10:40:50.510 INFO:tasks.workunit.client.1.smithi112.stdout:3/641: truncate d2/d1f/f2c 5744283 0 2024-09-21T10:40:50.520 INFO:tasks.workunit.client.0.smithi060.stdout:5/14: mknod c3 0 2024-09-21T10:40:50.521 INFO:tasks.workunit.client.0.smithi060.stdout:5/15: fdatasync - no filename 2024-09-21T10:40:50.522 INFO:tasks.workunit.client.0.smithi060.stdout:1/21: write f3 [318222,48267] 0 2024-09-21T10:40:50.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/581: dread d7/d22/d41/d56/da4/fa6 [0,4194304] 0 2024-09-21T10:40:50.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/693: dwrite d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:50.526 INFO:tasks.workunit.client.1.smithi112.stdout:6/694: stat d4/d6/d75/d97 0 2024-09-21T10:40:50.528 INFO:tasks.workunit.client.1.smithi112.stdout:3/642: mkdir d2/d22/d31/d2a/d39/d60/d86/dd8 0 2024-09-21T10:40:50.528 INFO:tasks.workunit.client.1.smithi112.stdout:3/643: chown d2/c1e 1419 1 2024-09-21T10:40:50.529 INFO:tasks.workunit.client.1.smithi112.stdout:7/582: mkdir d7/d22/d41/d4b/d52/d77/dbd 0 2024-09-21T10:40:50.530 INFO:tasks.workunit.client.1.smithi112.stdout:6/695: truncate d4/dc/d1a/d31/f71 3521187 0 2024-09-21T10:40:50.530 INFO:tasks.workunit.client.1.smithi112.stdout:6/696: fsync d4/d6/da/d11/d37/d8b/fbf 0 2024-09-21T10:40:50.530 INFO:tasks.workunit.client.1.smithi112.stdout:6/697: truncate d4/dc/d1a/f61 928254 0 2024-09-21T10:40:50.530 INFO:tasks.workunit.client.1.smithi112.stdout:3/644: creat d2/d2f/daf/dca/fd9 x:0 0 0 2024-09-21T10:40:50.531 INFO:tasks.workunit.client.1.smithi112.stdout:9/707: dwrite d1/d2/d27/d3a/f33 [4194304,4194304] 0 2024-09-21T10:40:50.531 INFO:tasks.workunit.client.1.smithi112.stdout:7/583: creat d7/d22/d41/d4b/d5e/fbe x:0 0 0 2024-09-21T10:40:50.531 INFO:tasks.workunit.client.1.smithi112.stdout:7/584: read d7/f49 [15982,115999] 0 2024-09-21T10:40:50.532 INFO:tasks.workunit.client.1.smithi112.stdout:6/698: mknod d4/d6/da/d11/d1f/d22/cf7 0 2024-09-21T10:40:50.532 INFO:tasks.workunit.client.1.smithi112.stdout:6/699: chown d4/dc/d67/cb1 20 1 2024-09-21T10:40:50.533 INFO:tasks.workunit.client.1.smithi112.stdout:3/645: mknod d2/d22/d31/d2a/d39/d3a/cda 0 2024-09-21T10:40:50.533 INFO:tasks.workunit.client.1.smithi112.stdout:3/646: fdatasync d2/d22/d31/d2a/d39/d3a/f47 0 2024-09-21T10:40:50.533 INFO:tasks.workunit.client.1.smithi112.stdout:5/685: dwrite d9/d15/d18/d20/d47/f49 [0,4194304] 0 2024-09-21T10:40:50.534 INFO:tasks.workunit.client.1.smithi112.stdout:9/708: creat d1/d2/d27/d3a/de3/ff6 x:0 0 0 2024-09-21T10:40:50.534 INFO:tasks.workunit.client.1.smithi112.stdout:8/647: dwrite d8/d9/f25 [0,4194304] 0 2024-09-21T10:40:50.535 INFO:tasks.workunit.client.1.smithi112.stdout:1/761: dwrite d8/fe [0,4194304] 0 2024-09-21T10:40:50.535 INFO:tasks.workunit.client.1.smithi112.stdout:8/648: getdents d8/d9/dd/d2a/d43/d58/d82 0 2024-09-21T10:40:50.535 INFO:tasks.workunit.client.1.smithi112.stdout:8/649: dread - d8/d9/dd/d76/f79 zero size 2024-09-21T10:40:50.535 INFO:tasks.workunit.client.1.smithi112.stdout:1/762: chown d8/d1a/d31/c50 911475508 1 2024-09-21T10:40:50.536 INFO:tasks.workunit.client.1.smithi112.stdout:9/709: read d1/d2/fc4 [471602,55556] 0 2024-09-21T10:40:50.536 INFO:tasks.workunit.client.1.smithi112.stdout:7/585: unlink d7/d22/d41/c5d 0 2024-09-21T10:40:50.536 INFO:tasks.workunit.client.1.smithi112.stdout:9/710: stat d1/d2/d27/d3a/l2b 0 2024-09-21T10:40:50.537 INFO:tasks.workunit.client.1.smithi112.stdout:3/647: truncate d2/d1f/f40 2392837 0 2024-09-21T10:40:50.537 INFO:tasks.workunit.client.1.smithi112.stdout:3/648: truncate d2/d22/d31/d2a/d39/d60/d86/fb1 170591 0 2024-09-21T10:40:50.538 INFO:tasks.workunit.client.1.smithi112.stdout:5/686: dread d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:50.538 INFO:tasks.workunit.client.1.smithi112.stdout:1/763: dread d8/d1a/d53/f60 [0,4194304] 0 2024-09-21T10:40:50.539 INFO:tasks.workunit.client.1.smithi112.stdout:1/764: chown d8/cc 116881552 1 2024-09-21T10:40:50.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/586: rename d7/d22/d41/d4b/d52/d77/cb4 to d7/d22/d78/cbf 0 2024-09-21T10:40:50.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/587: dread - d7/d22/d86/fb5 zero size 2024-09-21T10:40:50.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/588: stat d7/d22/d41/d4b/d5e 0 2024-09-21T10:40:50.544 INFO:tasks.workunit.client.1.smithi112.stdout:9/711: mknod d1/d2/d42/cf7 0 2024-09-21T10:40:50.547 INFO:tasks.workunit.client.1.smithi112.stdout:3/649: creat d2/d2f/dc5/dcc/fdb x:0 0 0 2024-09-21T10:40:50.547 INFO:tasks.workunit.client.1.smithi112.stdout:3/650: fdatasync d2/fa 0 2024-09-21T10:40:50.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/650: getdents d8/d9/dd/d2b/d31/d46/d86 0 2024-09-21T10:40:50.550 INFO:tasks.workunit.client.1.smithi112.stdout:7/589: creat d7/d22/d41/d4b/d52/d77/dbd/fc0 x:0 0 0 2024-09-21T10:40:50.550 INFO:tasks.workunit.client.1.smithi112.stdout:7/590: read d7/d22/f38 [2664450,38947] 0 2024-09-21T10:40:50.551 INFO:tasks.workunit.client.1.smithi112.stdout:9/712: truncate d1/d2/d27/d62/d70/f21 75616 0 2024-09-21T10:40:50.551 INFO:tasks.workunit.client.1.smithi112.stdout:9/713: chown d1/d2/d27/d37/d3b/f53 31 1 2024-09-21T10:40:50.553 INFO:tasks.workunit.client.0.smithi060.stdout:5/16: rename c2 to c4 0 2024-09-21T10:40:50.554 INFO:tasks.workunit.client.1.smithi112.stdout:3/651: mknod d2/d22/d31/d2a/d39/d60/d86/d98/cdc 0 2024-09-21T10:40:50.555 INFO:tasks.workunit.client.0.smithi060.stdout:5/17: mkdir d5 0 2024-09-21T10:40:50.555 INFO:tasks.workunit.client.1.smithi112.stdout:8/651: mknod d8/cbe 0 2024-09-21T10:40:50.556 INFO:tasks.workunit.client.1.smithi112.stdout:6/700: dwrite d4/d6/da/fb [0,4194304] 0 2024-09-21T10:40:50.558 INFO:tasks.workunit.client.1.smithi112.stdout:7/591: getdents d7/d3d/da7 0 2024-09-21T10:40:50.558 INFO:tasks.workunit.client.1.smithi112.stdout:7/592: write d7/d22/d41/d56/f75 [1482481,10460] 0 2024-09-21T10:40:50.560 INFO:tasks.workunit.client.1.smithi112.stdout:6/701: mknod d4/d6/d75/db7/ded/cf8 0 2024-09-21T10:40:50.561 INFO:tasks.workunit.client.1.smithi112.stdout:7/593: link d7/c60 d7/d22/d41/d56/da4/cc1 0 2024-09-21T10:40:50.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/594: symlink d7/d22/d41/d54/d4d/lc2 0 2024-09-21T10:40:50.563 INFO:tasks.workunit.client.1.smithi112.stdout:7/595: stat d7/f19 0 2024-09-21T10:40:50.567 INFO:tasks.workunit.client.1.smithi112.stdout:0/691: sync 2024-09-21T10:40:50.567 INFO:tasks.workunit.client.1.smithi112.stdout:0/692: chown d3/d18/d45/fca 73 1 2024-09-21T10:40:50.570 INFO:tasks.workunit.client.1.smithi112.stdout:0/693: creat d3/d18/d52/fe8 x:0 0 0 2024-09-21T10:40:50.570 INFO:tasks.workunit.client.1.smithi112.stdout:6/702: write d4/d4f/f66 [6765828,69881] 0 2024-09-21T10:40:50.576 INFO:tasks.workunit.client.1.smithi112.stdout:7/596: dread d7/d22/f35 [0,4194304] 0 2024-09-21T10:40:50.576 INFO:tasks.workunit.client.1.smithi112.stdout:7/597: fsync d7/d22/d41/d56/faa 0 2024-09-21T10:40:50.576 INFO:tasks.workunit.client.1.smithi112.stdout:7/598: dread - d7/d22/d41/d56/d5c/f92 zero size 2024-09-21T10:40:50.576 INFO:tasks.workunit.client.1.smithi112.stdout:7/599: write d7/d22/f46 [5031312,44494] 0 2024-09-21T10:40:50.577 INFO:tasks.workunit.client.1.smithi112.stdout:7/600: write d7/d3d/f3e [8849285,57405] 0 2024-09-21T10:40:50.577 INFO:tasks.workunit.client.1.smithi112.stdout:7/601: fsync d7/d22/d73/fa8 0 2024-09-21T10:40:50.579 INFO:tasks.workunit.client.1.smithi112.stdout:8/652: dwrite d8/d9/dd/d76/d97/fa8 [0,4194304] 0 2024-09-21T10:40:50.581 INFO:tasks.workunit.client.1.smithi112.stdout:0/694: write d3/d18/f3b [2881366,102629] 0 2024-09-21T10:40:50.581 INFO:tasks.workunit.client.1.smithi112.stdout:0/695: readlink d3/d4a/d4e/dc2/d1a/l2c 0 2024-09-21T10:40:50.581 INFO:tasks.workunit.client.1.smithi112.stdout:0/696: dread - d3/d18/d45/fe2 zero size 2024-09-21T10:40:50.581 INFO:tasks.workunit.client.1.smithi112.stdout:5/687: dwrite d9/d15/f2e [0,4194304] 0 2024-09-21T10:40:50.581 INFO:tasks.workunit.client.1.smithi112.stdout:5/688: truncate d9/d8a/fa0 1425744 0 2024-09-21T10:40:50.582 INFO:tasks.workunit.client.1.smithi112.stdout:5/689: write d9/d57/fc3 [682125,52029] 0 2024-09-21T10:40:50.582 INFO:tasks.workunit.client.1.smithi112.stdout:8/653: dread d8/d9/dd/d2b/d31/f7d [0,4194304] 0 2024-09-21T10:40:50.582 INFO:tasks.workunit.client.1.smithi112.stdout:8/654: stat d8/d9/dd/d2a/d43/d58/d82/l88 0 2024-09-21T10:40:50.585 INFO:tasks.workunit.client.1.smithi112.stdout:0/697: getdents d3/d4a/d4e/dc2/d1a/d21 0 2024-09-21T10:40:50.585 INFO:tasks.workunit.client.1.smithi112.stdout:6/703: dread d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:50.585 INFO:tasks.workunit.client.1.smithi112.stdout:0/698: chown d3/d4a/d4e/dc2/d1a/d21/d46/c7a 7338566 1 2024-09-21T10:40:50.585 INFO:tasks.workunit.client.0.smithi060.stdout:1/22: dwrite f5 [4194304,4194304] 0 2024-09-21T10:40:50.585 INFO:tasks.workunit.client.0.smithi060.stdout:1/23: fdatasync f5 0 2024-09-21T10:40:50.592 INFO:tasks.workunit.client.1.smithi112.stdout:5/690: dread d9/d15/d1d/f5a [0,4194304] 0 2024-09-21T10:40:50.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/652: dwrite d2/d1f/f8c [0,4194304] 0 2024-09-21T10:40:50.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/653: fsync d2/d2f/d3f/fae 0 2024-09-21T10:40:50.593 INFO:tasks.workunit.client.1.smithi112.stdout:9/714: dwrite d1/d2/d27/d37/d3b/d69/f8a [0,4194304] 0 2024-09-21T10:40:50.594 INFO:tasks.workunit.client.0.smithi060.stdout:5/18: unlink c4 0 2024-09-21T10:40:50.594 INFO:tasks.workunit.client.0.smithi060.stdout:5/19: dread - no filename 2024-09-21T10:40:50.596 INFO:tasks.workunit.client.0.smithi060.stdout:1/24: dread f5 [4194304,4194304] 0 2024-09-21T10:40:50.597 INFO:tasks.workunit.client.1.smithi112.stdout:8/655: write d8/d9/dd/d2a/d43/f47 [1502708,43754] 0 2024-09-21T10:40:50.597 INFO:tasks.workunit.client.1.smithi112.stdout:1/765: dwrite d8/d7a/fde [0,4194304] 0 2024-09-21T10:40:50.597 INFO:tasks.workunit.client.1.smithi112.stdout:1/766: chown d8/d1a/l84 27476106 1 2024-09-21T10:40:50.597 INFO:tasks.workunit.client.1.smithi112.stdout:3/654: mkdir d2/db0/ddd 0 2024-09-21T10:40:50.598 INFO:tasks.workunit.client.0.smithi060.stdout:5/20: mknod d5/c6 0 2024-09-21T10:40:50.598 INFO:tasks.workunit.client.0.smithi060.stdout:5/21: dwrite - no filename 2024-09-21T10:40:50.598 INFO:tasks.workunit.client.0.smithi060.stdout:5/22: truncate - no filename 2024-09-21T10:40:50.598 INFO:tasks.workunit.client.1.smithi112.stdout:0/699: write d3/d4a/d4e/dc2/d1a/f65 [4180199,112378] 0 2024-09-21T10:40:50.599 INFO:tasks.workunit.client.1.smithi112.stdout:0/700: write d3/d4a/d4e/dc2/fe [1858415,107566] 0 2024-09-21T10:40:50.602 INFO:tasks.workunit.client.1.smithi112.stdout:7/602: dwrite d7/d22/d41/d4b/da2/fba [0,4194304] 0 2024-09-21T10:40:50.604 INFO:tasks.workunit.client.1.smithi112.stdout:6/704: dwrite d4/d6/d75/f98 [0,4194304] 0 2024-09-21T10:40:50.606 INFO:tasks.workunit.client.1.smithi112.stdout:9/715: mknod d1/d2/d27/d37/d3b/cf8 0 2024-09-21T10:40:50.607 INFO:tasks.workunit.client.0.smithi060.stdout:5/23: creat d5/f7 x:0 0 0 2024-09-21T10:40:50.607 INFO:tasks.workunit.client.0.smithi060.stdout:5/24: creat d5/f8 x:0 0 0 2024-09-21T10:40:50.612 INFO:tasks.workunit.client.1.smithi112.stdout:7/603: write d7/d22/d41/d56/da4/fa6 [455328,90500] 0 2024-09-21T10:40:50.612 INFO:tasks.workunit.client.1.smithi112.stdout:7/604: readlink d7/d22/d41/d56/d72/lbb 0 2024-09-21T10:40:50.612 INFO:tasks.workunit.client.0.smithi060.stdout:5/25: mkdir d5/d9 0 2024-09-21T10:40:50.613 INFO:tasks.workunit.client.1.smithi112.stdout:5/691: dread d9/d57/fc3 [0,4194304] 0 2024-09-21T10:40:50.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/605: dread d7/d22/d86/dac/d8a/f8d [0,4194304] 0 2024-09-21T10:40:50.624 INFO:tasks.workunit.client.1.smithi112.stdout:7/606: write d7/d22/d86/dac/f8f [1018824,126141] 0 2024-09-21T10:40:50.624 INFO:tasks.workunit.client.1.smithi112.stdout:1/767: dwrite d8/d54/db0/fee [0,4194304] 0 2024-09-21T10:40:50.624 INFO:tasks.workunit.client.0.smithi060.stdout:1/25: dwrite f3 [4194304,4194304] 0 2024-09-21T10:40:50.632 INFO:tasks.workunit.client.0.smithi060.stdout:5/26: dwrite d5/f8 [0,4194304] 0 2024-09-21T10:40:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:50 smithi112 ceph-mon[35117]: Reconfiguring ceph-exporter.smithi060 (dependencies changed)... 2024-09-21T10:40:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:50 smithi112 ceph-mon[35117]: Deploying daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:40:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:50 smithi112 ceph-mon[35117]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:50 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2901489584' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:40:50.734 INFO:tasks.workunit.client.0.smithi060.stdout:1/26: rename c2 to d6/c7 0 2024-09-21T10:40:50.734 INFO:tasks.workunit.client.0.smithi060.stdout:1/27: chown f3 0 1 2024-09-21T10:40:50.738 INFO:tasks.workunit.client.0.smithi060.stdout:5/27: mkdir d5/da 0 2024-09-21T10:40:50.740 INFO:tasks.workunit.client.1.smithi112.stdout:8/656: symlink d8/d9/dd/d2b/d31/d46/d86/lbf 0 2024-09-21T10:40:50.740 INFO:tasks.workunit.client.1.smithi112.stdout:8/657: readlink d8/d9/l6c 0 2024-09-21T10:40:50.746 INFO:tasks.workunit.client.1.smithi112.stdout:0/701: rename d3/d4a/d4e/dc2/d1a/d21/d46/cb6 to d3/d4a/d4e/dc2/d1a/dba/ce9 0 2024-09-21T10:40:50.746 INFO:tasks.workunit.client.1.smithi112.stdout:0/702: write d3/d4a/d4e/dc2/d1a/d21/d4f/f7e [106212,25113] 0 2024-09-21T10:40:50.755 INFO:tasks.workunit.client.1.smithi112.stdout:6/705: unlink d4/d6/da/l30 0 2024-09-21T10:40:50.757 INFO:tasks.workunit.client.1.smithi112.stdout:9/716: truncate d1/d7f/f9b 5964227 0 2024-09-21T10:40:50.759 INFO:tasks.workunit.client.1.smithi112.stdout:9/717: dread d1/d2/d27/d3a/d6b/d30/d5c/fd4 [0,4194304] 0 2024-09-21T10:40:50.759 INFO:tasks.workunit.client.1.smithi112.stdout:9/718: creat d1/d2/d27/d3a/de3/ff9 x:0 0 0 2024-09-21T10:40:50.759 INFO:tasks.workunit.client.1.smithi112.stdout:9/719: write d1/d2/d27/d3a/d6b/d30/d5e/f66 [754736,54688] 0 2024-09-21T10:40:50.761 INFO:tasks.workunit.client.1.smithi112.stdout:5/692: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1/ld3 0 2024-09-21T10:40:50.762 INFO:tasks.workunit.client.1.smithi112.stdout:7/607: mknod d7/d22/d86/dac/d8a/cc3 0 2024-09-21T10:40:50.769 INFO:tasks.workunit.client.1.smithi112.stdout:1/768: link d8/d54/d6d/f70 d8/d54/db0/fef 0 2024-09-21T10:40:50.769 INFO:tasks.workunit.client.1.smithi112.stdout:1/769: write d8/d1a/db8/fc4 [1115791,31645] 0 2024-09-21T10:40:50.769 INFO:tasks.workunit.client.1.smithi112.stdout:1/770: chown d8/d1a/d31/d66/d87 262113485 1 2024-09-21T10:40:50.771 INFO:tasks.workunit.client.0.smithi060.stdout:5/28: mknod d5/cb 0 2024-09-21T10:40:50.777 INFO:tasks.workunit.client.0.smithi060.stdout:5/29: mknod d5/d9/cc 0 2024-09-21T10:40:50.777 INFO:tasks.workunit.client.0.smithi060.stdout:5/30: stat d5/d9/cc 0 2024-09-21T10:40:50.781 INFO:tasks.workunit.client.0.smithi060.stdout:5/31: link d5/cb d5/d9/cd 0 2024-09-21T10:40:50.781 INFO:tasks.workunit.client.0.smithi060.stdout:5/32: dread - d5/f7 zero size 2024-09-21T10:40:50.792 INFO:tasks.workunit.client.0.smithi060.stdout:5/33: dread d5/f8 [0,4194304] 0 2024-09-21T10:40:50.795 INFO:tasks.workunit.client.0.smithi060.stdout:5/34: creat d5/d9/fe x:0 0 0 2024-09-21T10:40:50.795 INFO:tasks.workunit.client.0.smithi060.stdout:5/35: fdatasync d5/f8 0 2024-09-21T10:40:50.796 INFO:tasks.workunit.client.0.smithi060.stdout:5/36: write d5/d9/fe [665134,90080] 0 2024-09-21T10:40:50.796 INFO:tasks.workunit.client.0.smithi060.stdout:5/37: fdatasync d5/f8 0 2024-09-21T10:40:50.797 INFO:tasks.workunit.client.1.smithi112.stdout:2/568: sync 2024-09-21T10:40:50.797 INFO:tasks.workunit.client.1.smithi112.stdout:4/637: sync 2024-09-21T10:40:50.800 INFO:tasks.workunit.client.0.smithi060.stdout:1/28: truncate f5 2728179 0 2024-09-21T10:40:50.804 INFO:tasks.workunit.client.0.smithi060.stdout:7/24: sync 2024-09-21T10:40:50.804 INFO:tasks.workunit.client.0.smithi060.stdout:2/29: sync 2024-09-21T10:40:50.805 INFO:tasks.workunit.client.0.smithi060.stdout:7/25: read f0 [764818,16437] 0 2024-09-21T10:40:50.806 INFO:tasks.workunit.client.0.smithi060.stdout:2/30: read f2 [361890,91327] 0 2024-09-21T10:40:50.806 INFO:tasks.workunit.client.0.smithi060.stdout:2/31: readlink - no filename 2024-09-21T10:40:50.806 INFO:tasks.workunit.client.0.smithi060.stdout:2/32: chown d3/f5 566460694 1 2024-09-21T10:40:50.846 INFO:tasks.workunit.client.0.smithi060.stdout:1/29: mkdir d6/d8 0 2024-09-21T10:40:50.853 INFO:tasks.workunit.client.0.smithi060.stdout:2/33: unlink c1 0 2024-09-21T10:40:50.853 INFO:tasks.workunit.client.0.smithi060.stdout:2/34: write d3/f5 [4639631,1387] 0 2024-09-21T10:40:50.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/26: getdents . 0 2024-09-21T10:40:50.858 INFO:tasks.workunit.client.0.smithi060.stdout:7/27: chown l4 6 1 2024-09-21T10:40:50.861 INFO:tasks.workunit.client.0.smithi060.stdout:7/28: mkdir d5 0 2024-09-21T10:40:50.870 INFO:tasks.workunit.client.0.smithi060.stdout:2/35: dwrite f2 [0,4194304] 0 2024-09-21T10:40:50.870 INFO:tasks.workunit.client.0.smithi060.stdout:7/29: write f1 [723401,119448] 0 2024-09-21T10:40:50.870 INFO:tasks.workunit.client.0.smithi060.stdout:7/30: readlink l2 0 2024-09-21T10:40:50.873 INFO:tasks.workunit.client.0.smithi060.stdout:2/36: mkdir d3/d7 0 2024-09-21T10:40:50.885 INFO:tasks.workunit.client.0.smithi060.stdout:7/31: dread f0 [0,4194304] 0 2024-09-21T10:40:50.892 INFO:tasks.workunit.client.0.smithi060.stdout:2/37: dwrite f2 [0,4194304] 0 2024-09-21T10:40:50.892 INFO:tasks.workunit.client.1.smithi112.stdout:8/658: mkdir d8/d9/dd/dab/dc0 0 2024-09-21T10:40:50.893 INFO:tasks.workunit.client.1.smithi112.stdout:8/659: fdatasync d8/d9/dd/d76/f79 0 2024-09-21T10:40:50.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/703: mknod d3/d4a/d4e/dc2/d10/d8b/cea 0 2024-09-21T10:40:50.893 INFO:tasks.workunit.client.1.smithi112.stdout:0/704: fdatasync d3/d18/f80 0 2024-09-21T10:40:50.895 INFO:tasks.workunit.client.0.smithi060.stdout:7/32: dread f1 [0,4194304] 0 2024-09-21T10:40:50.898 INFO:tasks.workunit.client.1.smithi112.stdout:9/720: mknod d1/d2/d27/d37/d3b/dec/cfa 0 2024-09-21T10:40:50.901 INFO:tasks.workunit.client.1.smithi112.stdout:1/771: unlink d8/d54/d6d/c6f 0 2024-09-21T10:40:50.901 INFO:tasks.workunit.client.1.smithi112.stdout:4/638: truncate de/d33/d2f/d35/d4c/f97 460583 0 2024-09-21T10:40:50.902 INFO:tasks.workunit.client.1.smithi112.stdout:0/705: dread d3/d18/f3b [0,4194304] 0 2024-09-21T10:40:50.902 INFO:tasks.workunit.client.1.smithi112.stdout:0/706: readlink d3/d4a/d4e/dc2/l6 0 2024-09-21T10:40:50.903 INFO:tasks.workunit.client.1.smithi112.stdout:2/569: symlink d0/d12/d8a/d62/d63/lb4 0 2024-09-21T10:40:50.903 INFO:tasks.workunit.client.1.smithi112.stdout:2/570: chown d0/d12/d6c/d7e/d8f/f27 1955391 1 2024-09-21T10:40:50.904 INFO:tasks.workunit.client.1.smithi112.stdout:0/707: dread d3/d23/f29 [0,4194304] 0 2024-09-21T10:40:50.905 INFO:tasks.workunit.client.0.smithi060.stdout:2/38: write f2 [3377592,14962] 0 2024-09-21T10:40:50.907 INFO:tasks.workunit.client.1.smithi112.stdout:3/655: mknod d2/d1f/cde 0 2024-09-21T10:40:50.907 INFO:tasks.workunit.client.1.smithi112.stdout:0/708: dread d3/d4a/d4e/dc2/da8/f91 [0,4194304] 0 2024-09-21T10:40:50.909 INFO:tasks.workunit.client.0.smithi060.stdout:2/39: mknod d3/d7/c8 0 2024-09-21T10:40:50.911 INFO:tasks.workunit.client.1.smithi112.stdout:9/721: mknod d1/d2/d27/d37/d3b/d69/d88/cfb 0 2024-09-21T10:40:50.911 INFO:tasks.workunit.client.0.smithi060.stdout:7/33: dread f0 [0,4194304] 0 2024-09-21T10:40:50.913 INFO:tasks.workunit.client.1.smithi112.stdout:5/693: mknod d9/cd4 0 2024-09-21T10:40:50.918 INFO:tasks.workunit.client.1.smithi112.stdout:2/571: mknod d0/da4/cb5 0 2024-09-21T10:40:50.918 INFO:tasks.workunit.client.1.smithi112.stdout:2/572: write d0/f2a [1000891,41887] 0 2024-09-21T10:40:50.918 INFO:tasks.workunit.client.1.smithi112.stdout:2/573: creat d0/d12/d97/fb6 x:0 0 0 2024-09-21T10:40:50.920 INFO:tasks.workunit.client.1.smithi112.stdout:0/709: mkdir d3/d4a/d4e/dc2/d1a/dba/deb 0 2024-09-21T10:40:50.922 INFO:tasks.workunit.client.1.smithi112.stdout:1/772: dwrite d8/f9a [0,4194304] 0 2024-09-21T10:40:50.923 INFO:tasks.workunit.client.1.smithi112.stdout:9/722: mknod d1/d2/d27/d3a/de3/db5/cfc 0 2024-09-21T10:40:50.923 INFO:tasks.workunit.client.1.smithi112.stdout:9/723: write d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/ff5 [201328,77232] 0 2024-09-21T10:40:50.924 INFO:tasks.workunit.client.0.smithi060.stdout:7/34: dread f0 [0,4194304] 0 2024-09-21T10:40:50.924 INFO:tasks.workunit.client.0.smithi060.stdout:7/35: readlink l4 0 2024-09-21T10:40:50.926 INFO:tasks.workunit.client.1.smithi112.stdout:2/574: symlink d0/d12/d6c/d7e/d8f/d51/lb7 0 2024-09-21T10:40:50.926 INFO:tasks.workunit.client.0.smithi060.stdout:1/30: fsync f5 0 2024-09-21T10:40:50.930 INFO:tasks.workunit.client.1.smithi112.stdout:0/710: mkdir d3/d18/d52/d55/dec 0 2024-09-21T10:40:50.937 INFO:tasks.workunit.client.1.smithi112.stdout:1/773: unlink d8/d54/db0/db1/lc7 0 2024-09-21T10:40:50.938 INFO:tasks.workunit.client.1.smithi112.stdout:5/694: dwrite d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:50.938 INFO:tasks.workunit.client.1.smithi112.stdout:9/724: dread d1/d2/d27/d62/d70/fa6 [0,4194304] 0 2024-09-21T10:40:50.939 INFO:tasks.workunit.client.0.smithi060.stdout:1/31: dread f3 [0,4194304] 0 2024-09-21T10:40:50.939 INFO:tasks.workunit.client.0.smithi060.stdout:1/32: write f5 [1335264,92365] 0 2024-09-21T10:40:50.940 INFO:tasks.workunit.client.0.smithi060.stdout:1/33: symlink d6/l9 0 2024-09-21T10:40:50.940 INFO:tasks.workunit.client.0.smithi060.stdout:1/34: write f5 [2126119,41583] 0 2024-09-21T10:40:50.941 INFO:tasks.workunit.client.1.smithi112.stdout:5/695: read d9/d15/f35 [103171,56657] 0 2024-09-21T10:40:50.941 INFO:tasks.workunit.client.0.smithi060.stdout:9/69: sync 2024-09-21T10:40:50.941 INFO:tasks.workunit.client.0.smithi060.stdout:8/61: sync 2024-09-21T10:40:50.941 INFO:tasks.workunit.client.0.smithi060.stdout:8/62: fsync d2/fe 0 2024-09-21T10:40:50.941 INFO:tasks.workunit.client.0.smithi060.stdout:8/63: write f1 [4749934,37597] 0 2024-09-21T10:40:50.942 INFO:tasks.workunit.client.1.smithi112.stdout:4/639: creat de/d33/d6f/d9c/d3e/fd9 x:0 0 0 2024-09-21T10:40:50.945 INFO:tasks.workunit.client.0.smithi060.stdout:1/35: unlink f3 0 2024-09-21T10:40:50.945 INFO:tasks.workunit.client.0.smithi060.stdout:1/36: stat d6/l9 0 2024-09-21T10:40:50.946 INFO:tasks.workunit.client.0.smithi060.stdout:8/64: dread d2/fe [0,4194304] 0 2024-09-21T10:40:50.946 INFO:tasks.workunit.client.0.smithi060.stdout:8/65: write d2/fc [1069166,67847] 0 2024-09-21T10:40:50.946 INFO:tasks.workunit.client.0.smithi060.stdout:8/66: truncate d2/f8 846715 0 2024-09-21T10:40:50.946 INFO:tasks.workunit.client.1.smithi112.stdout:5/696: truncate d9/d15/f24 7434460 0 2024-09-21T10:40:50.947 INFO:tasks.workunit.client.1.smithi112.stdout:5/697: creat d9/d15/d18/d3a/d4b/d74/d8d/fd5 x:0 0 0 2024-09-21T10:40:50.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:50 smithi060 ceph-mon[28215]: Reconfiguring ceph-exporter.smithi060 (dependencies changed)... 2024-09-21T10:40:50.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:50 smithi060 ceph-mon[28215]: Deploying daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:40:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:50 smithi060 ceph-mon[28215]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:40:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:50 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2901489584' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:40:50.949 INFO:tasks.workunit.client.1.smithi112.stdout:4/640: symlink de/d33/d6f/d9c/dc8/lda 0 2024-09-21T10:40:50.951 INFO:tasks.workunit.client.0.smithi060.stdout:8/67: truncate d2/f3 248125 0 2024-09-21T10:40:50.955 INFO:tasks.workunit.client.1.smithi112.stdout:1/774: read d8/f40 [2405519,54991] 0 2024-09-21T10:40:50.955 INFO:tasks.workunit.client.1.smithi112.stdout:1/775: write d8/d54/d6d/db5/dc2/fda [897434,112814] 0 2024-09-21T10:40:50.955 INFO:tasks.workunit.client.1.smithi112.stdout:1/776: dread d8/d1a/d31/d37/f77 [8388608,4194304] 0 2024-09-21T10:40:50.966 INFO:tasks.workunit.client.1.smithi112.stdout:6/706: rename d4/d4f/faf to d4/dc/d1a/d31/ff9 0 2024-09-21T10:40:50.972 INFO:tasks.workunit.client.1.smithi112.stdout:8/660: creat d8/d9/dd/d2b/fc1 x:0 0 0 2024-09-21T10:40:50.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/40: truncate d3/f5 4591619 0 2024-09-21T10:40:50.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/41: write f2 [3671087,76245] 0 2024-09-21T10:40:50.976 INFO:tasks.workunit.client.1.smithi112.stdout:1/777: dread d8/d1a/fad [0,4194304] 0 2024-09-21T10:40:50.984 INFO:tasks.workunit.client.1.smithi112.stdout:0/711: dwrite d3/d18/f80 [0,4194304] 0 2024-09-21T10:40:50.985 INFO:tasks.workunit.client.0.smithi060.stdout:7/36: dwrite f0 [0,4194304] 0 2024-09-21T10:40:50.985 INFO:tasks.workunit.client.0.smithi060.stdout:8/68: fdatasync d2/fc 0 2024-09-21T10:40:50.988 INFO:tasks.workunit.client.0.smithi060.stdout:7/37: rmdir d5 0 2024-09-21T10:40:50.988 INFO:tasks.workunit.client.0.smithi060.stdout:7/38: chown l2 56278127 1 2024-09-21T10:40:50.988 INFO:tasks.workunit.client.0.smithi060.stdout:7/39: chown l4 210805098 1 2024-09-21T10:40:50.989 INFO:tasks.workunit.client.0.smithi060.stdout:8/69: creat d2/f12 x:0 0 0 2024-09-21T10:40:50.990 INFO:tasks.workunit.client.0.smithi060.stdout:7/40: link f1 f6 0 2024-09-21T10:40:50.991 INFO:tasks.workunit.client.1.smithi112.stdout:2/575: dwrite d0/f1d [0,4194304] 0 2024-09-21T10:40:50.991 INFO:tasks.workunit.client.1.smithi112.stdout:2/576: chown d0/f9 15911 1 2024-09-21T10:40:50.991 INFO:tasks.workunit.client.1.smithi112.stdout:2/577: chown d0/d12/d8a/d62/d63/l31 55962395 1 2024-09-21T10:40:50.991 INFO:tasks.workunit.client.1.smithi112.stdout:2/578: creat d0/d12/d8a/d62/fb8 x:0 0 0 2024-09-21T10:40:50.992 INFO:tasks.workunit.client.0.smithi060.stdout:7/41: link f1 f7 0 2024-09-21T10:40:50.992 INFO:tasks.workunit.client.0.smithi060.stdout:7/42: write f7 [4392224,120388] 0 2024-09-21T10:40:50.993 INFO:tasks.workunit.client.1.smithi112.stdout:9/725: dwrite d1/d2/d27/d3a/d4c/fde [0,4194304] 0 2024-09-21T10:40:50.993 INFO:tasks.workunit.client.1.smithi112.stdout:4/641: dwrite de/d18/f3f [0,4194304] 0 2024-09-21T10:40:50.994 INFO:tasks.workunit.client.0.smithi060.stdout:9/70: dwrite d3/f10 [0,4194304] 0 2024-09-21T10:40:50.994 INFO:tasks.workunit.client.1.smithi112.stdout:5/698: dwrite d9/fa5 [0,4194304] 0 2024-09-21T10:40:50.998 INFO:tasks.workunit.client.1.smithi112.stdout:8/661: dwrite d8/d9/dd/d2b/fc1 [0,4194304] 0 2024-09-21T10:40:51.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/71: mknod d3/d15/c1b 0 2024-09-21T10:40:51.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/72: truncate d3/d15/f17 448340 0 2024-09-21T10:40:51.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/642: write de/d18/f3f [3726540,126222] 0 2024-09-21T10:40:51.010 INFO:tasks.workunit.client.0.smithi060.stdout:1/37: truncate f5 2704699 0 2024-09-21T10:40:51.011 INFO:tasks.workunit.client.0.smithi060.stdout:9/73: dread d3/fe [0,4194304] 0 2024-09-21T10:40:51.015 INFO:tasks.workunit.client.1.smithi112.stdout:5/699: mknod d9/d15/d18/d20/d55/dbb/cd6 0 2024-09-21T10:40:51.017 INFO:tasks.workunit.client.0.smithi060.stdout:1/38: mkdir d6/d8/da 0 2024-09-21T10:40:51.018 INFO:tasks.workunit.client.1.smithi112.stdout:1/778: dwrite d8/fc6 [0,4194304] 0 2024-09-21T10:40:51.018 INFO:tasks.workunit.client.1.smithi112.stdout:1/779: write d8/d54/fa6 [746739,106846] 0 2024-09-21T10:40:51.022 INFO:tasks.workunit.client.1.smithi112.stdout:2/579: dwrite d0/dd/f61 [4194304,4194304] 0 2024-09-21T10:40:51.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/726: dwrite d1/d2/d27/d3a/d6b/d30/d5c/fc2 [0,4194304] 0 2024-09-21T10:40:51.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/727: creat d1/d2/d27/d3a/d6b/d30/d5c/d7c/ffd x:0 0 0 2024-09-21T10:40:51.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/728: write d1/d2/d27/d37/f95 [4241630,54181] 0 2024-09-21T10:40:51.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/729: write d1/f43 [2316455,7041] 0 2024-09-21T10:40:51.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/730: creat d1/d2/d27/d3a/de3/ffe x:0 0 0 2024-09-21T10:40:51.023 INFO:tasks.workunit.client.0.smithi060.stdout:0/43: sync 2024-09-21T10:40:51.023 INFO:tasks.workunit.client.0.smithi060.stdout:6/145: sync 2024-09-21T10:40:51.023 INFO:tasks.workunit.client.0.smithi060.stdout:4/92: sync 2024-09-21T10:40:51.023 INFO:tasks.workunit.client.0.smithi060.stdout:3/58: sync 2024-09-21T10:40:51.023 INFO:tasks.workunit.client.0.smithi060.stdout:0/44: write f2 [8949469,71151] 0 2024-09-21T10:40:51.024 INFO:tasks.workunit.client.1.smithi112.stdout:2/580: dread d0/d12/d8a/d62/d63/f8b [0,4194304] 0 2024-09-21T10:40:51.028 INFO:tasks.workunit.client.1.smithi112.stdout:4/643: unlink de/d33/d2f/d35/f96 0 2024-09-21T10:40:51.030 INFO:tasks.workunit.client.0.smithi060.stdout:6/146: unlink d3/l7 0 2024-09-21T10:40:51.031 INFO:tasks.workunit.client.1.smithi112.stdout:4/644: dread de/d2e/f48 [0,4194304] 0 2024-09-21T10:40:51.031 INFO:tasks.workunit.client.1.smithi112.stdout:4/645: dread - de/d2a/dbf/d82/fa2 zero size 2024-09-21T10:40:51.032 INFO:tasks.workunit.client.0.smithi060.stdout:4/93: mknod d0/df/c1f 0 2024-09-21T10:40:51.032 INFO:tasks.workunit.client.1.smithi112.stdout:5/700: write d9/d15/d18/d20/d47/f49 [2247517,90659] 0 2024-09-21T10:40:51.034 INFO:tasks.workunit.client.0.smithi060.stdout:9/74: dwrite d3/fe [0,4194304] 0 2024-09-21T10:40:51.036 INFO:tasks.workunit.client.0.smithi060.stdout:0/45: rmdir d5 39 2024-09-21T10:40:51.039 INFO:tasks.workunit.client.0.smithi060.stdout:6/147: truncate d3/d12/d16/d25/d27/f29 688079 0 2024-09-21T10:40:51.039 INFO:tasks.workunit.client.0.smithi060.stdout:0/46: dread f0 [0,4194304] 0 2024-09-21T10:40:51.039 INFO:tasks.workunit.client.0.smithi060.stdout:7/43: getdents . 0 2024-09-21T10:40:51.042 INFO:tasks.workunit.client.0.smithi060.stdout:3/59: symlink d0/l13 0 2024-09-21T10:40:51.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/94: write d0/fc [6230014,54958] 0 2024-09-21T10:40:51.043 INFO:tasks.workunit.client.1.smithi112.stdout:5/701: dread d9/ff [0,4194304] 0 2024-09-21T10:40:51.043 INFO:tasks.workunit.client.1.smithi112.stdout:5/702: chown d9 5 1 2024-09-21T10:40:51.044 INFO:tasks.workunit.client.0.smithi060.stdout:0/47: truncate f0 1047152 0 2024-09-21T10:40:51.044 INFO:tasks.workunit.client.0.smithi060.stdout:0/48: stat f0 0 2024-09-21T10:40:51.047 INFO:tasks.workunit.client.1.smithi112.stdout:5/703: dread d9/d15/f35 [0,4194304] 0 2024-09-21T10:40:51.047 INFO:tasks.workunit.client.0.smithi060.stdout:7/44: unlink f7 0 2024-09-21T10:40:51.049 INFO:tasks.workunit.client.1.smithi112.stdout:7/608: rename d7/d22/d47 to d7/d22/d41/d56/d72/dc4 0 2024-09-21T10:40:51.050 INFO:tasks.workunit.client.0.smithi060.stdout:9/75: dwrite d3/f9 [0,4194304] 0 2024-09-21T10:40:51.050 INFO:tasks.workunit.client.1.smithi112.stdout:2/581: rmdir d0/d12/d8a/d62/d63 39 2024-09-21T10:40:51.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/95: mkdir d0/d5/d12/d20 0 2024-09-21T10:40:51.052 INFO:tasks.workunit.client.1.smithi112.stdout:4/646: symlink de/d33/d2f/d35/d4c/d5c/ldb 0 2024-09-21T10:40:51.052 INFO:tasks.workunit.client.1.smithi112.stdout:4/647: readlink de/d33/d2f/d71/l67 0 2024-09-21T10:40:51.053 INFO:tasks.workunit.client.0.smithi060.stdout:7/45: creat f8 x:0 0 0 2024-09-21T10:40:51.059 INFO:tasks.workunit.client.0.smithi060.stdout:9/76: rename d3/fb to d3/d16/f1c 0 2024-09-21T10:40:51.060 INFO:tasks.workunit.client.0.smithi060.stdout:9/77: dread d3/d15/f17 [0,4194304] 0 2024-09-21T10:40:51.060 INFO:tasks.workunit.client.0.smithi060.stdout:9/78: truncate d3/ff 1881392 0 2024-09-21T10:40:51.061 INFO:tasks.workunit.client.0.smithi060.stdout:4/96: symlink d0/d5/l21 0 2024-09-21T10:40:51.061 INFO:tasks.workunit.client.0.smithi060.stdout:4/97: readlink d0/l13 0 2024-09-21T10:40:51.064 INFO:tasks.workunit.client.0.smithi060.stdout:6/148: dwrite d3/f26 [0,4194304] 0 2024-09-21T10:40:51.064 INFO:tasks.workunit.client.1.smithi112.stdout:7/609: dwrite d7/d22/f63 [0,4194304] 0 2024-09-21T10:40:51.064 INFO:tasks.workunit.client.1.smithi112.stdout:7/610: readlink d7/d22/d41/lb8 0 2024-09-21T10:40:51.064 INFO:tasks.workunit.client.1.smithi112.stdout:7/611: dread - d7/d22/d86/fb5 zero size 2024-09-21T10:40:51.064 INFO:tasks.workunit.client.1.smithi112.stdout:7/612: write d7/d22/d41/d56/d72/dc4/f9d [290426,38345] 0 2024-09-21T10:40:51.067 INFO:tasks.workunit.client.0.smithi060.stdout:7/46: creat f9 x:0 0 0 2024-09-21T10:40:51.070 INFO:tasks.workunit.client.0.smithi060.stdout:9/79: creat d3/d16/d1a/f1d x:0 0 0 2024-09-21T10:40:51.070 INFO:tasks.workunit.client.0.smithi060.stdout:9/80: fsync d3/d15/f17 0 2024-09-21T10:40:51.070 INFO:tasks.workunit.client.0.smithi060.stdout:9/81: fdatasync d3/d16/d1a/f1d 0 2024-09-21T10:40:51.072 INFO:tasks.workunit.client.0.smithi060.stdout:4/98: creat d0/d5/d12/d20/f22 x:0 0 0 2024-09-21T10:40:51.072 INFO:tasks.workunit.client.0.smithi060.stdout:4/99: dread - d0/d5/f1a zero size 2024-09-21T10:40:51.076 INFO:tasks.workunit.client.0.smithi060.stdout:6/149: dread d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:40:51.077 INFO:tasks.workunit.client.0.smithi060.stdout:6/150: chown d3/d12/d16 26588 1 2024-09-21T10:40:51.077 INFO:tasks.workunit.client.0.smithi060.stdout:3/60: getdents d0 0 2024-09-21T10:40:51.078 INFO:tasks.workunit.client.0.smithi060.stdout:0/49: write f0 [1318949,123139] 0 2024-09-21T10:40:51.084 INFO:tasks.workunit.client.0.smithi060.stdout:9/82: rename d3/c8 to d3/d16/d1a/c1e 0 2024-09-21T10:40:51.085 INFO:tasks.workunit.client.0.smithi060.stdout:9/83: chown d3/f9 1257265 1 2024-09-21T10:40:51.086 INFO:tasks.workunit.client.0.smithi060.stdout:9/84: write d3/ff [336314,23500] 0 2024-09-21T10:40:51.086 INFO:tasks.workunit.client.1.smithi112.stdout:3/656: rename d2/d22 to d2/d2f/d3f/ddf 0 2024-09-21T10:40:51.088 INFO:tasks.workunit.client.1.smithi112.stdout:2/582: mkdir d0/d12/d46/da0/db9 0 2024-09-21T10:40:51.088 INFO:tasks.workunit.client.1.smithi112.stdout:2/583: truncate d0/d12/d6c/d7e/d8f/d51/d66/fa7 870122 0 2024-09-21T10:40:51.089 INFO:tasks.workunit.client.1.smithi112.stdout:3/657: dread d2/d2f/d3f/ddf/d31/d2a/d39/d60/f6f [0,4194304] 0 2024-09-21T10:40:51.089 INFO:tasks.workunit.client.1.smithi112.stdout:4/648: rmdir de/d33/d6f/d9c/dc8 39 2024-09-21T10:40:51.095 INFO:tasks.workunit.client.1.smithi112.stdout:7/613: symlink d7/d22/d41/d4b/d52/lc5 0 2024-09-21T10:40:51.097 INFO:tasks.workunit.client.0.smithi060.stdout:0/50: dwrite f2 [0,4194304] 0 2024-09-21T10:40:51.097 INFO:tasks.workunit.client.0.smithi060.stdout:0/51: creat d5/d7/f9 x:0 0 0 2024-09-21T10:40:51.097 INFO:tasks.workunit.client.0.smithi060.stdout:6/151: mknod d3/dd/c2b 0 2024-09-21T10:40:51.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/584: write d0/dd/d47/f6b [48989,76982] 0 2024-09-21T10:40:51.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/585: creat d0/d12/d8a/d62/fba x:0 0 0 2024-09-21T10:40:51.098 INFO:tasks.workunit.client.1.smithi112.stdout:6/707: rename d4/dc/d67 to d4/d6/da/d11/d37/d8b/da0/dfa 0 2024-09-21T10:40:51.102 INFO:tasks.workunit.client.0.smithi060.stdout:7/47: mkdir da 0 2024-09-21T10:40:51.103 INFO:tasks.workunit.client.1.smithi112.stdout:4/649: mknod de/d18/cdc 0 2024-09-21T10:40:51.103 INFO:tasks.workunit.client.1.smithi112.stdout:4/650: creat de/d18/d6d/fdd x:0 0 0 2024-09-21T10:40:51.103 INFO:tasks.workunit.client.1.smithi112.stdout:7/614: dread f5 [0,4194304] 0 2024-09-21T10:40:51.104 INFO:tasks.workunit.client.1.smithi112.stdout:7/615: write d7/d22/d78/fa0 [154776,79324] 0 2024-09-21T10:40:51.106 INFO:tasks.workunit.client.0.smithi060.stdout:4/100: rename d0/d5/ca to d0/d5/d12/d20/c23 0 2024-09-21T10:40:51.106 INFO:tasks.workunit.client.0.smithi060.stdout:4/101: write d0/d5/d12/d16/f1d [1337076,45389] 0 2024-09-21T10:40:51.106 INFO:tasks.workunit.client.0.smithi060.stdout:4/102: truncate d0/df/f17 488879 0 2024-09-21T10:40:51.107 INFO:tasks.workunit.client.0.smithi060.stdout:9/85: mkdir d3/d16/d1f 0 2024-09-21T10:40:51.107 INFO:tasks.workunit.client.0.smithi060.stdout:9/86: truncate d3/d16/d1a/f1d 1024312 0 2024-09-21T10:40:51.109 INFO:tasks.workunit.client.1.smithi112.stdout:2/586: mknod d0/d12/d46/da0/db9/cbb 0 2024-09-21T10:40:51.109 INFO:tasks.workunit.client.0.smithi060.stdout:0/52: mkdir d5/d7/da 0 2024-09-21T10:40:51.111 INFO:tasks.workunit.client.1.smithi112.stdout:0/712: rename d3/d4a/d4e/dc2/d10/d8b/c8a to d3/d4a/d4e/dc2/d1a/d21/d46/ced 0 2024-09-21T10:40:51.116 INFO:tasks.workunit.client.1.smithi112.stdout:4/651: creat de/d33/d2f/dcf/fde x:0 0 0 2024-09-21T10:40:51.117 INFO:tasks.workunit.client.0.smithi060.stdout:4/103: symlink d0/d5/d12/d20/l24 0 2024-09-21T10:40:51.118 INFO:tasks.workunit.client.1.smithi112.stdout:7/616: unlink d7/d22/d78/cb0 0 2024-09-21T10:40:51.119 INFO:tasks.workunit.client.0.smithi060.stdout:9/87: mkdir d3/d16/d20 0 2024-09-21T10:40:51.120 INFO:tasks.workunit.client.1.smithi112.stdout:2/587: symlink d0/d12/d76/lbc 0 2024-09-21T10:40:51.120 INFO:tasks.workunit.client.1.smithi112.stdout:2/588: truncate d0/d12/d76/f91 692959 0 2024-09-21T10:40:51.122 INFO:tasks.workunit.client.0.smithi060.stdout:6/152: getdents d3/d12/d16/d1a 0 2024-09-21T10:40:51.122 INFO:tasks.workunit.client.0.smithi060.stdout:6/153: write d3/fb [4080458,89405] 0 2024-09-21T10:40:51.122 INFO:tasks.workunit.client.0.smithi060.stdout:6/154: write d3/d12/d16/d1a/d21/f23 [1724897,5684] 0 2024-09-21T10:40:51.122 INFO:tasks.workunit.client.0.smithi060.stdout:0/53: dwrite d5/d7/f9 [0,4194304] 0 2024-09-21T10:40:51.124 INFO:tasks.workunit.client.0.smithi060.stdout:6/155: read d3/d12/d16/d1a/d21/f23 [168218,23820] 0 2024-09-21T10:40:51.124 INFO:tasks.workunit.client.1.smithi112.stdout:8/662: rename d8/d9/d3c/d90/l98 to d8/d9/dd/d2b/db8/lc2 0 2024-09-21T10:40:51.124 INFO:tasks.workunit.client.1.smithi112.stdout:8/663: truncate d8/d9/dd/dab/f9f 298297 0 2024-09-21T10:40:51.125 INFO:tasks.workunit.client.0.smithi060.stdout:7/48: link l4 da/lb 0 2024-09-21T10:40:51.126 INFO:tasks.workunit.client.1.smithi112.stdout:0/713: symlink d3/d4a/lee 0 2024-09-21T10:40:51.128 INFO:tasks.workunit.client.0.smithi060.stdout:4/104: rename d0/l13 to d0/d5/d12/l25 0 2024-09-21T10:40:51.128 INFO:tasks.workunit.client.1.smithi112.stdout:4/652: rmdir de/d33/d6f/d9c/dc8 39 2024-09-21T10:40:51.130 INFO:tasks.workunit.client.1.smithi112.stdout:2/589: dread d0/d12/d6c/fad [0,4194304] 0 2024-09-21T10:40:51.132 INFO:tasks.workunit.client.0.smithi060.stdout:9/88: unlink d3/c12 0 2024-09-21T10:40:51.132 INFO:tasks.workunit.client.0.smithi060.stdout:9/89: fsync d3/f14 0 2024-09-21T10:40:51.132 INFO:tasks.workunit.client.0.smithi060.stdout:9/90: rename d3/d16/d20 to d3/d16/d20/d21 22 2024-09-21T10:40:51.132 INFO:tasks.workunit.client.0.smithi060.stdout:0/54: dread f0 [0,4194304] 0 2024-09-21T10:40:51.132 INFO:tasks.workunit.client.0.smithi060.stdout:0/55: fdatasync f2 0 2024-09-21T10:40:51.133 INFO:tasks.workunit.client.1.smithi112.stdout:7/617: mknod d7/d22/d41/cc6 0 2024-09-21T10:40:51.136 INFO:tasks.workunit.client.1.smithi112.stdout:1/780: rename d8/d45/fe8 to d8/d54/d6d/db5/dc2/de6/ff0 0 2024-09-21T10:40:51.136 INFO:tasks.workunit.client.1.smithi112.stdout:1/781: dread - d8/d7a/fba zero size 2024-09-21T10:40:51.137 INFO:tasks.workunit.client.0.smithi060.stdout:1/39: write f5 [3555543,75485] 0 2024-09-21T10:40:51.138 INFO:tasks.workunit.client.1.smithi112.stdout:8/664: stat d8/d9/dd/d2b/d31/c6e 0 2024-09-21T10:40:51.139 INFO:tasks.workunit.client.0.smithi060.stdout:6/156: symlink d3/dd/l2c 0 2024-09-21T10:40:51.140 INFO:tasks.workunit.client.0.smithi060.stdout:6/157: rename d3 to d3/d12/d16/d22/d2d 22 2024-09-21T10:40:51.140 INFO:tasks.workunit.client.0.smithi060.stdout:6/158: write d3/fb [1326768,43735] 0 2024-09-21T10:40:51.140 INFO:tasks.workunit.client.0.smithi060.stdout:6/159: readlink d3/l15 0 2024-09-21T10:40:51.141 INFO:tasks.workunit.client.1.smithi112.stdout:0/714: creat d3/d18/dc0/fef x:0 0 0 2024-09-21T10:40:51.143 INFO:tasks.workunit.client.0.smithi060.stdout:7/49: dwrite f9 [0,4194304] 0 2024-09-21T10:40:51.144 INFO:tasks.workunit.client.1.smithi112.stdout:4/653: creat de/d2a/d31/fdf x:0 0 0 2024-09-21T10:40:51.144 INFO:tasks.workunit.client.1.smithi112.stdout:4/654: creat de/d33/d2f/dcf/dcc/fe0 x:0 0 0 2024-09-21T10:40:51.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/105: mkdir d0/d5/d12/d26 0 2024-09-21T10:40:51.147 INFO:tasks.workunit.client.1.smithi112.stdout:8/665: write d8/d9/dd/d2a/f77 [1811390,109497] 0 2024-09-21T10:40:51.147 INFO:tasks.workunit.client.1.smithi112.stdout:8/666: write f3 [2675821,10824] 0 2024-09-21T10:40:51.148 INFO:tasks.workunit.client.0.smithi060.stdout:9/91: creat d3/d15/f22 x:0 0 0 2024-09-21T10:40:51.151 INFO:tasks.workunit.client.0.smithi060.stdout:0/56: creat d5/d7/da/fb x:0 0 0 2024-09-21T10:40:51.151 INFO:tasks.workunit.client.0.smithi060.stdout:0/57: chown f0 133947399 1 2024-09-21T10:40:51.151 INFO:tasks.workunit.client.0.smithi060.stdout:0/58: creat d5/d7/da/fc x:0 0 0 2024-09-21T10:40:51.152 INFO:tasks.workunit.client.1.smithi112.stdout:1/782: mkdir d8/d1a/d31/da1/de7/df1 0 2024-09-21T10:40:51.153 INFO:tasks.workunit.client.1.smithi112.stdout:7/618: dwrite d7/d22/d41/d56/da4/fa6 [0,4194304] 0 2024-09-21T10:40:51.154 INFO:tasks.workunit.client.0.smithi060.stdout:6/160: symlink d3/d12/d16/l2e 0 2024-09-21T10:40:51.156 INFO:tasks.workunit.client.1.smithi112.stdout:0/715: rmdir d3/d4a/d4e/dc2/d10/dd4 0 2024-09-21T10:40:51.158 INFO:tasks.workunit.client.0.smithi060.stdout:1/40: dwrite f5 [0,4194304] 0 2024-09-21T10:40:51.162 INFO:tasks.workunit.client.1.smithi112.stdout:1/783: dread d8/f9a [0,4194304] 0 2024-09-21T10:40:51.162 INFO:tasks.workunit.client.1.smithi112.stdout:1/784: chown d8/d7a/f7e 439284172 1 2024-09-21T10:40:51.162 INFO:tasks.workunit.client.1.smithi112.stdout:1/785: dread - d8/d1a/d53/d57/d83/fa8 zero size 2024-09-21T10:40:51.164 INFO:tasks.workunit.client.1.smithi112.stdout:2/590: rename d0/d12/d8a to d0/d12/d46/da0/db9/dbd 0 2024-09-21T10:40:51.165 INFO:tasks.workunit.client.1.smithi112.stdout:2/591: readlink d0/l56 0 2024-09-21T10:40:51.176 INFO:tasks.workunit.client.1.smithi112.stdout:7/619: truncate d7/d22/d41/d56/d72/dc4/f7e 1591767 0 2024-09-21T10:40:51.176 INFO:tasks.workunit.client.1.smithi112.stdout:7/620: fdatasync d7/d22/d86/dac/d8a/f8d 0 2024-09-21T10:40:51.177 INFO:tasks.workunit.client.0.smithi060.stdout:7/50: creat da/fc x:0 0 0 2024-09-21T10:40:51.178 INFO:tasks.workunit.client.1.smithi112.stdout:0/716: truncate d3/d4a/d4e/dc2/d1a/f65 1992406 0 2024-09-21T10:40:51.179 INFO:tasks.workunit.client.0.smithi060.stdout:9/92: creat d3/d16/d20/f23 x:0 0 0 2024-09-21T10:40:51.183 INFO:tasks.workunit.client.1.smithi112.stdout:4/655: rmdir de/d2a/d31 39 2024-09-21T10:40:51.183 INFO:tasks.workunit.client.1.smithi112.stdout:4/656: chown de/f10 316082606 1 2024-09-21T10:40:51.183 INFO:tasks.workunit.client.1.smithi112.stdout:4/657: read de/d33/d6f/d9c/d3e/f64 [430113,109714] 0 2024-09-21T10:40:51.184 INFO:tasks.workunit.client.0.smithi060.stdout:0/59: symlink d5/d7/ld 0 2024-09-21T10:40:51.186 INFO:tasks.workunit.client.1.smithi112.stdout:1/786: mkdir d8/d1a/d31/da1/de7/df2 0 2024-09-21T10:40:51.188 INFO:tasks.workunit.client.0.smithi060.stdout:6/161: link d3/d12/d16/d1a/f20 d3/d12/d16/d22/f2f 0 2024-09-21T10:40:51.188 INFO:tasks.workunit.client.0.smithi060.stdout:6/162: write d3/d12/d16/d1a/f20 [1846780,35237] 0 2024-09-21T10:40:51.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/667: rename d8/d9/dd/f2f to d8/d9/dd/dab/fc3 0 2024-09-21T10:40:51.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/668: chown d8/d9/d3c/cb0 3201812 1 2024-09-21T10:40:51.189 INFO:tasks.workunit.client.1.smithi112.stdout:8/669: readlink d8/d9/dd/d2b/l3a 0 2024-09-21T10:40:51.190 INFO:tasks.workunit.client.1.smithi112.stdout:8/670: truncate d8/d9/dd/d1a/f72 2046311 0 2024-09-21T10:40:51.190 INFO:tasks.workunit.client.0.smithi060.stdout:6/163: write d3/d12/d16/d1a/f20 [379489,69708] 0 2024-09-21T10:40:51.190 INFO:tasks.workunit.client.0.smithi060.stdout:6/164: write d3/fb [4218094,60511] 0 2024-09-21T10:40:51.191 INFO:tasks.workunit.client.1.smithi112.stdout:0/717: creat d3/d4a/d4e/dc2/da8/ddf/ff0 x:0 0 0 2024-09-21T10:40:51.192 INFO:tasks.workunit.client.0.smithi060.stdout:7/51: read f1 [443859,15318] 0 2024-09-21T10:40:51.192 INFO:tasks.workunit.client.1.smithi112.stdout:7/621: dwrite d7/d22/d41/d4b/da2/fba [0,4194304] 0 2024-09-21T10:40:51.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/658: creat de/d33/d6f/d9c/d3e/dce/fe1 x:0 0 0 2024-09-21T10:40:51.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/659: readlink de/d33/d6f/d9c/d3e/l66 0 2024-09-21T10:40:51.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/660: write de/d18/f26 [9137902,21813] 0 2024-09-21T10:40:51.193 INFO:tasks.workunit.client.1.smithi112.stdout:4/661: chown de/d33/d2f/dcf/fa0 30973 1 2024-09-21T10:40:51.194 INFO:tasks.workunit.client.0.smithi060.stdout:0/60: rmdir d5 39 2024-09-21T10:40:51.194 INFO:tasks.workunit.client.0.smithi060.stdout:0/61: write d5/d7/f8 [197143,40323] 0 2024-09-21T10:40:51.195 INFO:tasks.workunit.client.1.smithi112.stdout:1/787: rmdir d8/d1a/d53 39 2024-09-21T10:40:51.195 INFO:tasks.workunit.client.1.smithi112.stdout:1/788: fdatasync d8/f1f 0 2024-09-21T10:40:51.195 INFO:tasks.workunit.client.1.smithi112.stdout:1/789: readlink d8/d1a/d31/d66/lcd 0 2024-09-21T10:40:51.196 INFO:tasks.workunit.client.1.smithi112.stdout:9/731: sync 2024-09-21T10:40:51.198 INFO:tasks.workunit.client.0.smithi060.stdout:5/38: sync 2024-09-21T10:40:51.199 INFO:tasks.workunit.client.0.smithi060.stdout:6/165: creat d3/f30 x:0 0 0 2024-09-21T10:40:51.199 INFO:tasks.workunit.client.0.smithi060.stdout:6/166: read d3/d12/d16/d22/f2f [1161936,40692] 0 2024-09-21T10:40:51.199 INFO:tasks.workunit.client.0.smithi060.stdout:6/167: stat d3/d12 0 2024-09-21T10:40:51.201 INFO:tasks.workunit.client.1.smithi112.stdout:8/671: link d8/d9/dd/d1a/l3b d8/d9/d3c/d6d/lc4 0 2024-09-21T10:40:51.202 INFO:tasks.workunit.client.0.smithi060.stdout:0/62: link d5/d7/f9 d5/d7/fe 0 2024-09-21T10:40:51.202 INFO:tasks.workunit.client.0.smithi060.stdout:0/63: rename d5/d7 to d5/d7/da/df 22 2024-09-21T10:40:51.206 INFO:tasks.workunit.client.0.smithi060.stdout:7/52: dwrite da/fc [0,4194304] 0 2024-09-21T10:40:51.208 INFO:tasks.workunit.client.1.smithi112.stdout:7/622: creat d7/d3d/fc7 x:0 0 0 2024-09-21T10:40:51.210 INFO:tasks.workunit.client.1.smithi112.stdout:4/662: mknod de/d2e/ce2 0 2024-09-21T10:40:51.211 INFO:tasks.workunit.client.1.smithi112.stdout:7/623: dread d7/d22/d86/dac/f8f [0,4194304] 0 2024-09-21T10:40:51.213 INFO:tasks.workunit.client.1.smithi112.stdout:1/790: creat d8/d1a/d31/da1/de7/ff3 x:0 0 0 2024-09-21T10:40:51.215 INFO:tasks.workunit.client.0.smithi060.stdout:5/39: dwrite d5/f7 [0,4194304] 0 2024-09-21T10:40:51.217 INFO:tasks.workunit.client.1.smithi112.stdout:9/732: unlink d1/d2/d27/d37/le0 0 2024-09-21T10:40:51.218 INFO:tasks.workunit.client.0.smithi060.stdout:7/53: symlink da/ld 0 2024-09-21T10:40:51.222 INFO:tasks.workunit.client.0.smithi060.stdout:5/40: dread d5/f8 [0,4194304] 0 2024-09-21T10:40:51.227 INFO:tasks.workunit.client.1.smithi112.stdout:8/672: creat d8/d9/dd/d2b/db8/fc5 x:0 0 0 2024-09-21T10:40:51.228 INFO:tasks.workunit.client.0.smithi060.stdout:6/168: dwrite d3/d12/d16/d1a/f20 [0,4194304] 0 2024-09-21T10:40:51.228 INFO:tasks.workunit.client.0.smithi060.stdout:0/64: rename d5/d7 to d5/d10 0 2024-09-21T10:40:51.228 INFO:tasks.workunit.client.1.smithi112.stdout:1/791: symlink d8/d20/lf4 0 2024-09-21T10:40:51.231 INFO:tasks.workunit.client.1.smithi112.stdout:1/792: fsync d8/d1a/d31/da1/de7/ff3 0 2024-09-21T10:40:51.232 INFO:tasks.workunit.client.1.smithi112.stdout:2/592: rename d0/d12/d6c/d7e/d8f/d51/d66 to d0/da4/dbe 0 2024-09-21T10:40:51.233 INFO:tasks.workunit.client.1.smithi112.stdout:2/593: write d0/d12/d46/da0/db9/dbd/d62/d89/f92 [142749,45613] 0 2024-09-21T10:40:51.233 INFO:tasks.workunit.client.1.smithi112.stdout:2/594: write d0/d12/d46/da0/db9/dbd/d62/fa8 [621876,34893] 0 2024-09-21T10:40:51.233 INFO:tasks.workunit.client.0.smithi060.stdout:6/169: truncate d3/ff 3537885 0 2024-09-21T10:40:51.233 INFO:tasks.workunit.client.0.smithi060.stdout:6/170: rename d3/d12 to d3/d12/d16/d31 22 2024-09-21T10:40:51.233 INFO:tasks.workunit.client.0.smithi060.stdout:6/171: readlink d3/d12/d16/l17 0 2024-09-21T10:40:51.234 INFO:tasks.workunit.client.1.smithi112.stdout:8/673: creat d8/d9/dd/dab/d8e/fc6 x:0 0 0 2024-09-21T10:40:51.236 INFO:tasks.workunit.client.0.smithi060.stdout:0/65: mkdir d5/d10/d11 0 2024-09-21T10:40:51.236 INFO:tasks.workunit.client.0.smithi060.stdout:0/66: chown d5/d10/da 3304826 1 2024-09-21T10:40:51.236 INFO:tasks.workunit.client.0.smithi060.stdout:0/67: chown d5/d10/ld 0 1 2024-09-21T10:40:51.236 INFO:tasks.workunit.client.0.smithi060.stdout:0/68: write d5/d10/da/fb [936589,19221] 0 2024-09-21T10:40:51.238 INFO:tasks.workunit.client.1.smithi112.stdout:9/733: rmdir d1/d2/d27/d37/d68 39 2024-09-21T10:40:51.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/41: rmdir d5 39 2024-09-21T10:40:51.241 INFO:tasks.workunit.client.0.smithi060.stdout:6/172: creat d3/d12/d16/d1a/f32 x:0 0 0 2024-09-21T10:40:51.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/793: dread d8/d54/db0/fef [0,4194304] 0 2024-09-21T10:40:51.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/794: readlink d8/d1a/l4b 0 2024-09-21T10:40:51.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/795: truncate d8/d1a/d53/d57/fd2 141193 0 2024-09-21T10:40:51.242 INFO:tasks.workunit.client.1.smithi112.stdout:2/595: unlink d0/f2 0 2024-09-21T10:40:51.244 INFO:tasks.workunit.client.1.smithi112.stdout:7/624: rename d7/d22/d41/d56/d5c/c62 to d7/d22/d41/d54/cc8 0 2024-09-21T10:40:51.245 INFO:tasks.workunit.client.1.smithi112.stdout:1/796: mkdir d8/d1a/d31/d66/df5 0 2024-09-21T10:40:51.245 INFO:tasks.workunit.client.1.smithi112.stdout:1/797: truncate d8/d1a/d31/d66/fc1 122585 0 2024-09-21T10:40:51.247 INFO:tasks.workunit.client.1.smithi112.stdout:8/674: rename d8/d9/dd/d1a/f72 to d8/d9/dd/d2b/db8/fc7 0 2024-09-21T10:40:51.248 INFO:tasks.workunit.client.1.smithi112.stdout:1/798: symlink d8/d1a/d31/da1/de7/df1/lf6 0 2024-09-21T10:40:51.249 INFO:tasks.workunit.client.0.smithi060.stdout:7/54: dwrite f6 [4194304,4194304] 0 2024-09-21T10:40:51.249 INFO:tasks.workunit.client.1.smithi112.stdout:1/799: creat d8/d1a/d53/ff7 x:0 0 0 2024-09-21T10:40:51.252 INFO:tasks.workunit.client.0.smithi060.stdout:7/55: mkdir da/de 0 2024-09-21T10:40:51.252 INFO:tasks.workunit.client.1.smithi112.stdout:7/625: dread d7/d22/d86/dac/f98 [0,4194304] 0 2024-09-21T10:40:51.253 INFO:tasks.workunit.client.1.smithi112.stdout:9/734: dread d1/d2/d27/d3a/d4c/fde [0,4194304] 0 2024-09-21T10:40:51.253 INFO:tasks.workunit.client.1.smithi112.stdout:9/735: fsync d1/d2/d27/d3a/de3/db5/fea 0 2024-09-21T10:40:51.254 INFO:tasks.workunit.client.1.smithi112.stdout:1/800: creat d8/d1a/d31/d66/ff8 x:0 0 0 2024-09-21T10:40:51.254 INFO:tasks.workunit.client.0.smithi060.stdout:0/69: read f2 [649212,17641] 0 2024-09-21T10:40:51.254 INFO:tasks.workunit.client.0.smithi060.stdout:0/70: write d5/d10/da/fb [1983894,105208] 0 2024-09-21T10:40:51.254 INFO:tasks.workunit.client.0.smithi060.stdout:7/56: creat da/de/ff x:0 0 0 2024-09-21T10:40:51.255 INFO:tasks.workunit.client.1.smithi112.stdout:4/663: dwrite de/d33/d6f/d9c/d3e/fbd [0,4194304] 0 2024-09-21T10:40:51.255 INFO:tasks.workunit.client.1.smithi112.stdout:8/675: dread d8/d9/dd/f16 [0,4194304] 0 2024-09-21T10:40:51.255 INFO:tasks.workunit.client.1.smithi112.stdout:7/626: mkdir d7/d22/d41/d56/dc9 0 2024-09-21T10:40:51.255 INFO:tasks.workunit.client.1.smithi112.stdout:7/627: dread - d7/d22/d41/d4b/d52/d77/dbd/fc0 zero size 2024-09-21T10:40:51.256 INFO:tasks.workunit.client.1.smithi112.stdout:2/596: dread d0/dd/f61 [4194304,4194304] 0 2024-09-21T10:40:51.256 INFO:tasks.workunit.client.1.smithi112.stdout:2/597: fsync d0/fe 0 2024-09-21T10:40:51.256 INFO:tasks.workunit.client.0.smithi060.stdout:0/71: readlink l3 0 2024-09-21T10:40:51.258 INFO:tasks.workunit.client.0.smithi060.stdout:7/57: mknod da/c10 0 2024-09-21T10:40:51.260 INFO:tasks.workunit.client.0.smithi060.stdout:5/42: dwrite d5/f8 [0,4194304] 0 2024-09-21T10:40:51.260 INFO:tasks.workunit.client.1.smithi112.stdout:6/708: sync 2024-09-21T10:40:51.260 INFO:tasks.workunit.client.1.smithi112.stdout:3/658: sync 2024-09-21T10:40:51.261 INFO:tasks.workunit.client.1.smithi112.stdout:5/704: sync 2024-09-21T10:40:51.261 INFO:tasks.workunit.client.1.smithi112.stdout:3/659: write d2/d2f/daf/dca/fd9 [1007198,102156] 0 2024-09-21T10:40:51.261 INFO:tasks.workunit.client.1.smithi112.stdout:1/801: dread d8/f65 [0,4194304] 0 2024-09-21T10:40:51.264 INFO:tasks.workunit.client.0.smithi060.stdout:0/72: rename d5/d10/fe to d5/d10/da/f12 0 2024-09-21T10:40:51.271 INFO:tasks.workunit.client.1.smithi112.stdout:4/664: dread de/d2a/dbf/f92 [0,4194304] 0 2024-09-21T10:40:51.271 INFO:tasks.workunit.client.1.smithi112.stdout:1/802: dread d8/d1a/d31/d37/f47 [4194304,4194304] 0 2024-09-21T10:40:51.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/173: unlink d3/ff 0 2024-09-21T10:40:51.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/174: chown d3 1 1 2024-09-21T10:40:51.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/175: truncate d3/d12/d16/d22/f2f 4204774 0 2024-09-21T10:40:51.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/176: readlink d3/d12/d16/l2a 0 2024-09-21T10:40:51.274 INFO:tasks.workunit.client.0.smithi060.stdout:6/177: write d3/d12/d16/d25/d27/f29 [1241229,21483] 0 2024-09-21T10:40:51.276 INFO:tasks.workunit.client.1.smithi112.stdout:9/736: dwrite d1/d2/d27/f2f [0,4194304] 0 2024-09-21T10:40:51.276 INFO:tasks.workunit.client.1.smithi112.stdout:8/676: unlink d8/l11 0 2024-09-21T10:40:51.277 INFO:tasks.workunit.client.1.smithi112.stdout:8/677: dread - d8/d9/dd/f9c zero size 2024-09-21T10:40:51.279 INFO:tasks.workunit.client.0.smithi060.stdout:6/178: link d3/dd/l2c d3/d12/d16/d25/d27/l33 0 2024-09-21T10:40:51.280 INFO:tasks.workunit.client.1.smithi112.stdout:7/628: rename d7/d22/d86/f61 to d7/d22/d86/dac/fca 0 2024-09-21T10:40:51.281 INFO:tasks.workunit.client.1.smithi112.stdout:7/629: fsync d7/d22/d41/f7b 0 2024-09-21T10:40:51.282 INFO:tasks.workunit.client.1.smithi112.stdout:2/598: symlink d0/d12/d46/da0/lbf 0 2024-09-21T10:40:51.283 INFO:tasks.workunit.client.1.smithi112.stdout:5/705: creat d9/d15/d18/d3a/d4b/db4/fd7 x:0 0 0 2024-09-21T10:40:51.283 INFO:tasks.workunit.client.1.smithi112.stdout:3/660: rmdir d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76 39 2024-09-21T10:40:51.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/737: symlink d1/d2/d27/d37/d3b/d69/d77/dca/dae/lff 0 2024-09-21T10:40:51.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/738: getdents d1/d2/d27/d62/da1 0 2024-09-21T10:40:51.288 INFO:tasks.workunit.client.1.smithi112.stdout:9/739: write d1/d2/d27/d3a/d6b/fac [5202408,117281] 0 2024-09-21T10:40:51.292 INFO:tasks.workunit.client.1.smithi112.stdout:7/630: creat d7/dbc/fcb x:0 0 0 2024-09-21T10:40:51.293 INFO:tasks.workunit.client.1.smithi112.stdout:5/706: link d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1/ld3 d9/d8a/ld8 0 2024-09-21T10:40:51.293 INFO:tasks.workunit.client.1.smithi112.stdout:5/707: truncate d9/d15/d18/d3a/d4b/db4/fd7 319072 0 2024-09-21T10:40:51.295 INFO:tasks.workunit.client.1.smithi112.stdout:3/661: symlink d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/le0 0 2024-09-21T10:40:51.295 INFO:tasks.workunit.client.1.smithi112.stdout:3/662: truncate d2/fa4 539962 0 2024-09-21T10:40:51.297 INFO:tasks.workunit.client.1.smithi112.stdout:5/708: unlink d9/d57/f9f 0 2024-09-21T10:40:51.298 INFO:tasks.workunit.client.1.smithi112.stdout:2/599: read d0/dd/f29 [3039793,51376] 0 2024-09-21T10:40:51.300 INFO:tasks.workunit.client.1.smithi112.stdout:5/709: link d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd0 d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd9 0 2024-09-21T10:40:51.300 INFO:tasks.workunit.client.1.smithi112.stdout:5/710: stat d9/d15/d18/d3a/d61/d62/d6b 0 2024-09-21T10:40:51.300 INFO:tasks.workunit.client.1.smithi112.stdout:5/711: chown d9/fa5 3754051 1 2024-09-21T10:40:51.301 INFO:tasks.workunit.client.0.smithi060.stdout:7/58: rmdir da 39 2024-09-21T10:40:51.302 INFO:tasks.workunit.client.1.smithi112.stdout:2/600: mkdir d0/d12/d46/d86/dc0 0 2024-09-21T10:40:51.303 INFO:tasks.workunit.client.1.smithi112.stdout:5/712: rmdir d9/d8a 39 2024-09-21T10:40:51.303 INFO:tasks.workunit.client.0.smithi060.stdout:7/59: symlink da/de/l11 0 2024-09-21T10:40:51.306 INFO:tasks.workunit.client.1.smithi112.stdout:5/713: creat d9/d15/d18/d3a/d61/d62/d6b/fda x:0 0 0 2024-09-21T10:40:51.306 INFO:tasks.workunit.client.1.smithi112.stdout:5/714: write d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd9 [558687,116603] 0 2024-09-21T10:40:51.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/718: sync 2024-09-21T10:40:51.311 INFO:tasks.workunit.client.1.smithi112.stdout:5/715: stat d9/d15/d18/d20/d47/l6d 0 2024-09-21T10:40:51.311 INFO:tasks.workunit.client.1.smithi112.stdout:5/716: creat d9/fdb x:0 0 0 2024-09-21T10:40:51.312 INFO:tasks.workunit.client.0.smithi060.stdout:5/43: dwrite d5/d9/fe [0,4194304] 0 2024-09-21T10:40:51.315 INFO:tasks.workunit.client.0.smithi060.stdout:5/44: creat d5/ff x:0 0 0 2024-09-21T10:40:51.316 INFO:tasks.workunit.client.0.smithi060.stdout:5/45: mkdir d5/d9/d10 0 2024-09-21T10:40:51.317 INFO:tasks.workunit.client.0.smithi060.stdout:5/46: mknod d5/d9/c11 0 2024-09-21T10:40:51.320 INFO:tasks.workunit.client.1.smithi112.stdout:3/663: dwrite d2/d2f/d3f/ddf/f5e [4194304,4194304] 0 2024-09-21T10:40:51.321 INFO:tasks.workunit.client.1.smithi112.stdout:3/664: creat d2/db0/ddd/fe1 x:0 0 0 2024-09-21T10:40:51.323 INFO:tasks.workunit.client.1.smithi112.stdout:3/665: creat d2/d2f/d3f/ddf/d31/d2a/d39/fe2 x:0 0 0 2024-09-21T10:40:51.330 INFO:tasks.workunit.client.1.smithi112.stdout:3/666: dread d2/d1f/f2c [0,4194304] 0 2024-09-21T10:40:51.359 INFO:tasks.workunit.client.1.smithi112.stdout:1/803: dwrite d8/d54/d6d/f86 [0,4194304] 0 2024-09-21T10:40:51.360 INFO:tasks.workunit.client.0.smithi060.stdout:5/47: read d5/f8 [3345562,14735] 0 2024-09-21T10:40:51.360 INFO:tasks.workunit.client.1.smithi112.stdout:6/709: dwrite d4/d6/da/d11/d1f/fd9 [0,4194304] 0 2024-09-21T10:40:51.360 INFO:tasks.workunit.client.1.smithi112.stdout:1/804: mknod d8/d20/cf9 0 2024-09-21T10:40:51.362 INFO:tasks.workunit.client.1.smithi112.stdout:8/678: dwrite d8/d18/fb4 [0,4194304] 0 2024-09-21T10:40:51.362 INFO:tasks.workunit.client.1.smithi112.stdout:8/679: write d8/d9/dd/f16 [1503944,92604] 0 2024-09-21T10:40:51.365 INFO:tasks.workunit.client.1.smithi112.stdout:6/710: unlink d4/d6/da/d11/d1f/d22/f33 0 2024-09-21T10:40:51.365 INFO:tasks.workunit.client.1.smithi112.stdout:6/711: write d4/d6/d75/db7/ded/fcd [521256,93724] 0 2024-09-21T10:40:51.367 INFO:tasks.workunit.client.1.smithi112.stdout:1/805: rename d8/f1f to d8/d54/ffa 0 2024-09-21T10:40:51.368 INFO:tasks.workunit.client.1.smithi112.stdout:1/806: dread - d8/d1a/db8/fb9 zero size 2024-09-21T10:40:51.368 INFO:tasks.workunit.client.1.smithi112.stdout:1/807: write d8/d54/d6d/db5/dc2/de6/ff0 [1019768,46479] 0 2024-09-21T10:40:51.368 INFO:tasks.workunit.client.0.smithi060.stdout:7/60: write f1 [6411963,23245] 0 2024-09-21T10:40:51.370 INFO:tasks.workunit.client.1.smithi112.stdout:4/665: dwrite de/d18/d6d/faa [0,4194304] 0 2024-09-21T10:40:51.370 INFO:tasks.workunit.client.1.smithi112.stdout:2/601: dwrite d0/d12/d46/da0/db9/dbd/d62/d63/f35 [0,4194304] 0 2024-09-21T10:40:51.370 INFO:tasks.workunit.client.1.smithi112.stdout:9/740: dwrite d1/d2/d27/d3a/de3/fc8 [0,4194304] 0 2024-09-21T10:40:51.370 INFO:tasks.workunit.client.1.smithi112.stdout:9/741: readlink d1/d2/le1 0 2024-09-21T10:40:51.371 INFO:tasks.workunit.client.1.smithi112.stdout:9/742: write d1/d2/d27/d3a/de3/db5/fea [957156,75761] 0 2024-09-21T10:40:51.371 INFO:tasks.workunit.client.0.smithi060.stdout:0/73: dwrite d5/d10/da/fb [0,4194304] 0 2024-09-21T10:40:51.371 INFO:tasks.workunit.client.0.smithi060.stdout:6/179: dwrite d3/d12/d16/d1a/f20 [0,4194304] 0 2024-09-21T10:40:51.372 INFO:tasks.workunit.client.1.smithi112.stdout:7/631: dwrite d7/d22/d41/d54/d4d/fad [0,4194304] 0 2024-09-21T10:40:51.372 INFO:tasks.workunit.client.1.smithi112.stdout:0/719: dwrite d3/d23/f29 [0,4194304] 0 2024-09-21T10:40:51.372 INFO:tasks.workunit.client.1.smithi112.stdout:8/680: rmdir d8/d9/dd/d2b/d31/dbc 0 2024-09-21T10:40:51.372 INFO:tasks.workunit.client.1.smithi112.stdout:8/681: fsync d8/d9/d3c/d6d/f9d 0 2024-09-21T10:40:51.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/712: mkdir d4/dfb 0 2024-09-21T10:40:51.374 INFO:tasks.workunit.client.1.smithi112.stdout:5/717: dwrite d9/fe [4194304,4194304] 0 2024-09-21T10:40:51.375 INFO:tasks.workunit.client.0.smithi060.stdout:7/61: rename f9 to da/f12 0 2024-09-21T10:40:51.376 INFO:tasks.workunit.client.1.smithi112.stdout:3/667: dwrite d2/d2f/f30 [0,4194304] 0 2024-09-21T10:40:51.377 INFO:tasks.workunit.client.1.smithi112.stdout:1/808: truncate d8/f40 343569 0 2024-09-21T10:40:51.385 INFO:tasks.workunit.client.1.smithi112.stdout:4/666: mknod de/d33/d6f/ce3 0 2024-09-21T10:40:51.386 INFO:tasks.workunit.client.1.smithi112.stdout:6/713: dread d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:51.388 INFO:tasks.workunit.client.1.smithi112.stdout:5/718: write d9/d6e/f91 [5484908,108825] 0 2024-09-21T10:40:51.391 INFO:tasks.workunit.client.1.smithi112.stdout:2/602: creat d0/d12/d46/da0/db9/dbd/d62/d89/fc1 x:0 0 0 2024-09-21T10:40:51.392 INFO:tasks.workunit.client.1.smithi112.stdout:0/720: dread d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/fb7 [0,4194304] 0 2024-09-21T10:40:51.392 INFO:tasks.workunit.client.0.smithi060.stdout:6/180: mknod d3/d12/d16/d1a/c34 0 2024-09-21T10:40:51.396 INFO:tasks.workunit.client.0.smithi060.stdout:7/62: creat da/de/f13 x:0 0 0 2024-09-21T10:40:51.396 INFO:tasks.workunit.client.0.smithi060.stdout:5/48: dwrite d5/ff [0,4194304] 0 2024-09-21T10:40:51.398 INFO:tasks.workunit.client.0.smithi060.stdout:7/63: mkdir da/d14 0 2024-09-21T10:40:51.399 INFO:tasks.workunit.client.0.smithi060.stdout:7/64: write da/de/f13 [458444,98646] 0 2024-09-21T10:40:51.399 INFO:tasks.workunit.client.0.smithi060.stdout:7/65: dread - da/de/ff zero size 2024-09-21T10:40:51.405 INFO:tasks.workunit.client.1.smithi112.stdout:7/632: symlink d7/d22/d41/d56/dc9/lcc 0 2024-09-21T10:40:51.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/49: write d5/d9/fe [1016262,44642] 0 2024-09-21T10:40:51.408 INFO:tasks.workunit.client.0.smithi060.stdout:7/66: write da/f12 [1751134,56365] 0 2024-09-21T10:40:51.412 INFO:tasks.workunit.client.1.smithi112.stdout:3/668: symlink d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/d98/le3 0 2024-09-21T10:40:51.414 INFO:tasks.workunit.client.1.smithi112.stdout:1/809: mkdir d8/d45/dfb 0 2024-09-21T10:40:51.414 INFO:tasks.workunit.client.1.smithi112.stdout:1/810: chown d8/d45/c72 0 1 2024-09-21T10:40:51.415 INFO:tasks.workunit.client.1.smithi112.stdout:4/667: creat de/d2a/dbf/fe4 x:0 0 0 2024-09-21T10:40:51.415 INFO:tasks.workunit.client.1.smithi112.stdout:4/668: chown de/l16 300880 1 2024-09-21T10:40:51.416 INFO:tasks.workunit.client.1.smithi112.stdout:5/719: creat d9/d15/d1d/fdc x:0 0 0 2024-09-21T10:40:51.416 INFO:tasks.workunit.client.1.smithi112.stdout:2/603: rename d0/dd/f42 to d0/dd/fc2 0 2024-09-21T10:40:51.417 INFO:tasks.workunit.client.1.smithi112.stdout:0/721: rmdir d3/d4a/d4e/dc2/d1a/d21/d46 39 2024-09-21T10:40:51.420 INFO:tasks.workunit.client.1.smithi112.stdout:7/633: write d7/d22/f35 [88374,40474] 0 2024-09-21T10:40:51.421 INFO:tasks.workunit.client.0.smithi060.stdout:0/74: dwrite f0 [0,4194304] 0 2024-09-21T10:40:51.421 INFO:tasks.workunit.client.0.smithi060.stdout:0/75: readlink l4 0 2024-09-21T10:40:51.422 INFO:tasks.workunit.client.1.smithi112.stdout:4/669: creat de/d2a/dbf/d82/fe5 x:0 0 0 2024-09-21T10:40:51.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/720: creat d9/d15/d18/d20/d55/dbb/fdd x:0 0 0 2024-09-21T10:40:51.423 INFO:tasks.workunit.client.1.smithi112.stdout:8/682: rmdir d8/d9/dd 39 2024-09-21T10:40:51.426 INFO:tasks.workunit.client.1.smithi112.stdout:2/604: rmdir d0/d12/d46/da0 39 2024-09-21T10:40:51.432 INFO:tasks.workunit.client.1.smithi112.stdout:0/722: creat d3/ff1 x:0 0 0 2024-09-21T10:40:51.435 INFO:tasks.workunit.client.0.smithi060.stdout:7/67: dread f6 [4194304,4194304] 0 2024-09-21T10:40:51.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/721: creat d9/d15/d18/d3a/d4b/fde x:0 0 0 2024-09-21T10:40:51.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/714: dwrite d4/dc/f4b [0,4194304] 0 2024-09-21T10:40:51.440 INFO:tasks.workunit.client.1.smithi112.stdout:6/715: dread - d4/d6/da/d14/d49/fc8 zero size 2024-09-21T10:40:51.440 INFO:tasks.workunit.client.1.smithi112.stdout:4/670: rmdir de/d33/d2f/dcf/dcc 39 2024-09-21T10:40:51.441 INFO:tasks.workunit.client.1.smithi112.stdout:9/743: dwrite d1/d2/d27/d3a/d4c/fbd [0,4194304] 0 2024-09-21T10:40:51.441 INFO:tasks.workunit.client.0.smithi060.stdout:6/181: dwrite d3/f30 [0,4194304] 0 2024-09-21T10:40:51.442 INFO:tasks.workunit.client.1.smithi112.stdout:5/722: mkdir d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf 0 2024-09-21T10:40:51.443 INFO:tasks.workunit.client.1.smithi112.stdout:8/683: dread d8/d9/dd/d2a/f77 [0,4194304] 0 2024-09-21T10:40:51.446 INFO:tasks.workunit.client.1.smithi112.stdout:8/684: dread d8/d9/d3c/f52 [0,4194304] 0 2024-09-21T10:40:51.446 INFO:tasks.workunit.client.1.smithi112.stdout:8/685: write d8/f78 [4637821,121756] 0 2024-09-21T10:40:51.451 INFO:tasks.workunit.client.0.smithi060.stdout:6/182: write d3/d12/d16/f18 [950171,92568] 0 2024-09-21T10:40:51.452 INFO:tasks.workunit.client.1.smithi112.stdout:4/671: dread de/d33/d6f/f7d [0,4194304] 0 2024-09-21T10:40:51.452 INFO:tasks.workunit.client.1.smithi112.stdout:4/672: dread - de/d18/fa8 zero size 2024-09-21T10:40:51.452 INFO:tasks.workunit.client.1.smithi112.stdout:7/634: dwrite d7/d22/d78/f7f [0,4194304] 0 2024-09-21T10:40:51.453 INFO:tasks.workunit.client.1.smithi112.stdout:1/811: dwrite d8/d54/fa6 [0,4194304] 0 2024-09-21T10:40:51.454 INFO:tasks.workunit.client.1.smithi112.stdout:9/744: creat d1/d2/d27/d37/f100 x:0 0 0 2024-09-21T10:40:51.454 INFO:tasks.workunit.client.0.smithi060.stdout:5/50: dwrite d5/ff [0,4194304] 0 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.0.smithi060.stdout:5/51: readlink - no filename 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:4/673: write de/d33/d2f/d35/d4c/f97 [57640,119989] 0 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:4/674: stat de/d33/d6f/f7d 0 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:4/675: dread - de/d33/d2f/dcf/dc2/fc1 zero size 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:5/723: mknod d9/d15/d18/d3a/d4b/ce0 0 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:5/724: fdatasync d9/d15/d1d/f5a 0 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:5/725: write d9/d15/d18/f9e [803918,20512] 0 2024-09-21T10:40:51.455 INFO:tasks.workunit.client.1.smithi112.stdout:5/726: write d9/d15/d18/d3a/d4b/f6f [866901,90050] 0 2024-09-21T10:40:51.456 INFO:tasks.workunit.client.1.smithi112.stdout:0/723: dwrite d3/d4a/d4e/dc2/d10/f24 [0,4194304] 0 2024-09-21T10:40:51.456 INFO:tasks.workunit.client.1.smithi112.stdout:0/724: write d3/d4a/d4e/dc2/d1a/d21/d4f/d83/fb8 [1489515,103607] 0 2024-09-21T10:40:51.458 INFO:tasks.workunit.client.1.smithi112.stdout:1/812: dread d8/d20/f5f [0,4194304] 0 2024-09-21T10:40:51.460 INFO:tasks.workunit.client.0.smithi060.stdout:2/42: sync 2024-09-21T10:40:51.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/183: rename d3/d12/d16/l2a to d3/d12/d16/d22/l35 0 2024-09-21T10:40:51.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/184: write d3/d12/d16/d25/d27/f29 [1942197,104079] 0 2024-09-21T10:40:51.465 INFO:tasks.workunit.client.1.smithi112.stdout:3/669: getdents d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/d98 0 2024-09-21T10:40:51.470 INFO:tasks.workunit.client.1.smithi112.stdout:8/686: mknod d8/d9/dd/d2b/d31/d46/d86/cc8 0 2024-09-21T10:40:51.470 INFO:tasks.workunit.client.1.smithi112.stdout:8/687: chown d8/d9/d3c/d6d/lc4 19986188 1 2024-09-21T10:40:51.471 INFO:tasks.workunit.client.0.smithi060.stdout:2/43: chown d3/c6 270835296 1 2024-09-21T10:40:51.474 INFO:tasks.workunit.client.1.smithi112.stdout:6/716: dwrite d4/d3e/f4c [0,4194304] 0 2024-09-21T10:40:51.475 INFO:tasks.workunit.client.1.smithi112.stdout:7/635: mknod d7/d22/d78/ccd 0 2024-09-21T10:40:51.475 INFO:tasks.workunit.client.1.smithi112.stdout:7/636: write d7/d22/d78/f7f [5644070,78890] 0 2024-09-21T10:40:51.475 INFO:tasks.workunit.client.1.smithi112.stdout:7/637: chown d7/d22/d41/d54 7408233 1 2024-09-21T10:40:51.477 INFO:tasks.workunit.client.1.smithi112.stdout:3/670: write d2/d1f/f6d [654170,97041] 0 2024-09-21T10:40:51.477 INFO:tasks.workunit.client.0.smithi060.stdout:2/44: mknod d3/d7/c9 0 2024-09-21T10:40:51.478 INFO:tasks.workunit.client.0.smithi060.stdout:2/45: readlink - no filename 2024-09-21T10:40:51.482 INFO:tasks.workunit.client.0.smithi060.stdout:2/46: fsync d3/f5 0 2024-09-21T10:40:51.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/76: truncate f0 3449236 0 2024-09-21T10:40:51.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/77: fdatasync d5/d10/da/fb 0 2024-09-21T10:40:51.485 INFO:tasks.workunit.client.1.smithi112.stdout:9/745: mkdir d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101 0 2024-09-21T10:40:51.487 INFO:tasks.workunit.client.0.smithi060.stdout:2/47: rmdir d3/d7 39 2024-09-21T10:40:51.488 INFO:tasks.workunit.client.1.smithi112.stdout:1/813: dwrite d8/d1a/d31/d37/f47 [4194304,4194304] 0 2024-09-21T10:40:51.489 INFO:tasks.workunit.client.1.smithi112.stdout:4/676: dwrite de/d33/d2f/d35/d4c/fcd [0,4194304] 0 2024-09-21T10:40:51.490 INFO:tasks.workunit.client.0.smithi060.stdout:7/68: dwrite da/f12 [0,4194304] 0 2024-09-21T10:40:51.491 INFO:tasks.workunit.client.1.smithi112.stdout:0/725: dwrite d3/d4a/d4e/dc2/da8/d7f/f82 [0,4194304] 0 2024-09-21T10:40:51.491 INFO:tasks.workunit.client.0.smithi060.stdout:0/78: creat d5/d10/da/f13 x:0 0 0 2024-09-21T10:40:51.493 INFO:tasks.workunit.client.0.smithi060.stdout:6/185: dread d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:40:51.493 INFO:tasks.workunit.client.0.smithi060.stdout:2/48: symlink d3/d7/la 0 2024-09-21T10:40:51.493 INFO:tasks.workunit.client.0.smithi060.stdout:2/49: write f2 [188950,10356] 0 2024-09-21T10:40:51.495 INFO:tasks.workunit.client.1.smithi112.stdout:7/638: dwrite d7/d22/d41/d4b/d52/da3/fb9 [0,4194304] 0 2024-09-21T10:40:51.495 INFO:tasks.workunit.client.1.smithi112.stdout:7/639: chown d7/d22/d73/faf 15 1 2024-09-21T10:40:51.499 INFO:tasks.workunit.client.0.smithi060.stdout:0/79: mknod d5/d10/d11/c14 0 2024-09-21T10:40:51.499 INFO:tasks.workunit.client.0.smithi060.stdout:0/80: write d5/d10/f8 [424801,93916] 0 2024-09-21T10:40:51.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/671: dwrite d2/d2f/d3f/fcd [0,4194304] 0 2024-09-21T10:40:51.500 INFO:tasks.workunit.client.0.smithi060.stdout:6/186: creat d3/dd/f36 x:0 0 0 2024-09-21T10:40:51.501 INFO:tasks.workunit.client.0.smithi060.stdout:6/187: fsync d3/f26 0 2024-09-21T10:40:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:6/188: symlink d3/d12/d16/d1a/l37 0 2024-09-21T10:40:51.508 INFO:tasks.workunit.client.0.smithi060.stdout:0/81: write d5/d10/da/fb [332982,8494] 0 2024-09-21T10:40:51.508 INFO:tasks.workunit.client.0.smithi060.stdout:0/82: readlink d5/d10/ld 0 2024-09-21T10:40:51.508 INFO:tasks.workunit.client.0.smithi060.stdout:0/83: fdatasync d5/d10/da/f13 0 2024-09-21T10:40:51.508 INFO:tasks.workunit.client.0.smithi060.stdout:7/69: rename da/de to da/d14/d15 0 2024-09-21T10:40:51.510 INFO:tasks.workunit.client.0.smithi060.stdout:6/189: mkdir d3/d12/d38 0 2024-09-21T10:40:51.513 INFO:tasks.workunit.client.0.smithi060.stdout:7/70: mkdir da/d14/d15/d16 0 2024-09-21T10:40:51.514 INFO:tasks.workunit.client.0.smithi060.stdout:7/71: read - f8 zero size 2024-09-21T10:40:51.514 INFO:tasks.workunit.client.0.smithi060.stdout:2/50: write d3/f5 [4033048,17187] 0 2024-09-21T10:40:51.516 INFO:tasks.workunit.client.1.smithi112.stdout:8/688: creat d8/d9/dd/d2a/d43/d58/fc9 x:0 0 0 2024-09-21T10:40:51.516 INFO:tasks.workunit.client.1.smithi112.stdout:8/689: stat d8/d9/d3c/f5c 0 2024-09-21T10:40:51.516 INFO:tasks.workunit.client.1.smithi112.stdout:8/690: read - d8/d18/fad zero size 2024-09-21T10:40:51.518 INFO:tasks.workunit.client.0.smithi060.stdout:2/51: getdents d3/d7 0 2024-09-21T10:40:51.521 INFO:tasks.workunit.client.1.smithi112.stdout:6/717: creat d4/d6/d9c/ffc x:0 0 0 2024-09-21T10:40:51.522 INFO:tasks.workunit.client.1.smithi112.stdout:6/718: readlink d4/d6/lf 0 2024-09-21T10:40:51.523 INFO:tasks.workunit.client.1.smithi112.stdout:9/746: link d1/d2/d42/cf7 d1/d2/d27/d37/d3b/d69/d88/c102 0 2024-09-21T10:40:51.523 INFO:tasks.workunit.client.1.smithi112.stdout:9/747: readlink d1/d2/laa 0 2024-09-21T10:40:51.523 INFO:tasks.workunit.client.1.smithi112.stdout:9/748: readlink d1/d2/l29 0 2024-09-21T10:40:51.525 INFO:tasks.workunit.client.1.smithi112.stdout:5/727: rename d9/fe to d9/fe1 0 2024-09-21T10:40:51.526 INFO:tasks.workunit.client.0.smithi060.stdout:7/72: dread f1 [0,4194304] 0 2024-09-21T10:40:51.528 INFO:tasks.workunit.client.0.smithi060.stdout:7/73: dread da/d14/d15/f13 [0,4194304] 0 2024-09-21T10:40:51.528 INFO:tasks.workunit.client.0.smithi060.stdout:7/74: write f6 [5662762,5219] 0 2024-09-21T10:40:51.528 INFO:tasks.workunit.client.0.smithi060.stdout:7/75: chown da/d14/d15 3 1 2024-09-21T10:40:51.528 INFO:tasks.workunit.client.1.smithi112.stdout:1/814: creat d8/d45/dfb/ffc x:0 0 0 2024-09-21T10:40:51.529 INFO:tasks.workunit.client.0.smithi060.stdout:7/76: rmdir da/d14 39 2024-09-21T10:40:51.529 INFO:tasks.workunit.client.0.smithi060.stdout:7/77: write f1 [1282633,46611] 0 2024-09-21T10:40:51.531 INFO:tasks.workunit.client.1.smithi112.stdout:4/677: creat de/d33/d2f/d71/fe6 x:0 0 0 2024-09-21T10:40:51.531 INFO:tasks.workunit.client.1.smithi112.stdout:4/678: write de/d33/d6f/d9c/d3e/f64 [1328762,11148] 0 2024-09-21T10:40:51.531 INFO:tasks.workunit.client.1.smithi112.stdout:4/679: dread - de/d2a/dbf/fe4 zero size 2024-09-21T10:40:51.531 INFO:tasks.workunit.client.0.smithi060.stdout:7/78: mknod da/d14/d15/d16/c17 0 2024-09-21T10:40:51.532 INFO:tasks.workunit.client.1.smithi112.stdout:6/719: write d4/d6/da/d14/d49/fad [2501434,36503] 0 2024-09-21T10:40:51.533 INFO:tasks.workunit.client.1.smithi112.stdout:0/726: getdents d3/d4a/d4e/d72 0 2024-09-21T10:40:51.534 INFO:tasks.workunit.client.0.smithi060.stdout:7/79: creat da/d14/d15/f18 x:0 0 0 2024-09-21T10:40:51.534 INFO:tasks.workunit.client.0.smithi060.stdout:7/80: dread - da/d14/d15/ff zero size 2024-09-21T10:40:51.535 INFO:tasks.workunit.client.0.smithi060.stdout:0/84: dwrite f0 [0,4194304] 0 2024-09-21T10:40:51.535 INFO:tasks.workunit.client.0.smithi060.stdout:0/85: readlink d5/d10/ld 0 2024-09-21T10:40:51.535 INFO:tasks.workunit.client.0.smithi060.stdout:0/86: write d5/d10/da/fb [3405099,26113] 0 2024-09-21T10:40:51.535 INFO:tasks.workunit.client.0.smithi060.stdout:0/87: chown d5/d10/d11/c14 14013233 1 2024-09-21T10:40:51.535 INFO:tasks.workunit.client.0.smithi060.stdout:6/190: dwrite d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:51.536 INFO:tasks.workunit.client.1.smithi112.stdout:7/640: rmdir d7/d22/d41/d56/dc9 39 2024-09-21T10:40:51.541 INFO:tasks.workunit.client.1.smithi112.stdout:6/720: dread d4/d6/da/d14/d49/d73/d74/fd4 [0,4194304] 0 2024-09-21T10:40:51.542 INFO:tasks.workunit.client.0.smithi060.stdout:0/88: mkdir d5/d10/da/d15 0 2024-09-21T10:40:51.543 INFO:tasks.workunit.client.0.smithi060.stdout:6/191: symlink d3/dd/l39 0 2024-09-21T10:40:51.544 INFO:tasks.workunit.client.1.smithi112.stdout:0/727: dread d3/d18/f42 [0,4194304] 0 2024-09-21T10:40:51.544 INFO:tasks.workunit.client.1.smithi112.stdout:0/728: chown d3/d18/d45/fbf 104538 1 2024-09-21T10:40:51.544 INFO:tasks.workunit.client.0.smithi060.stdout:0/89: mkdir d5/d10/da/d16 0 2024-09-21T10:40:51.546 INFO:tasks.workunit.client.1.smithi112.stdout:3/672: mknod d2/d2f/d3f/ddf/d31/d2a/ce4 0 2024-09-21T10:40:51.547 INFO:tasks.workunit.client.0.smithi060.stdout:7/81: write f0 [783305,83438] 0 2024-09-21T10:40:51.547 INFO:tasks.workunit.client.0.smithi060.stdout:6/192: unlink d3/d12/d16/d1a/f20 0 2024-09-21T10:40:51.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/691: creat d8/d9/dd/d2b/fca x:0 0 0 2024-09-21T10:40:51.548 INFO:tasks.workunit.client.1.smithi112.stdout:8/692: truncate d8/d9/dd/f5f 8757424 0 2024-09-21T10:40:51.549 INFO:tasks.workunit.client.1.smithi112.stdout:6/721: dread d4/dc/f3f [4194304,4194304] 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/749: symlink d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101/l103 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/750: truncate d1/d2/d27/d37/d3b/fa2 323382 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/751: fsync d1/f36 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/752: write d1/d2/d27/d37/d3b/fad [615718,45128] 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/753: truncate d1/d2/d27/d3a/d6b/f97 66603 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/754: chown d1/f1b 23401745 1 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/755: stat d1/d2/d27/d62/f8f 0 2024-09-21T10:40:51.552 INFO:tasks.workunit.client.1.smithi112.stdout:9/756: write d1/d2/d27/f2f [5146788,30495] 0 2024-09-21T10:40:51.553 INFO:tasks.workunit.client.0.smithi060.stdout:7/82: creat da/d14/f19 x:0 0 0 2024-09-21T10:40:51.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/90: read d5/d10/da/f12 [1932268,106015] 0 2024-09-21T10:40:51.554 INFO:tasks.workunit.client.1.smithi112.stdout:3/673: write d2/d1f/f2c [1214655,95970] 0 2024-09-21T10:40:51.556 INFO:tasks.workunit.client.1.smithi112.stdout:6/722: dread d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:51.556 INFO:tasks.workunit.client.1.smithi112.stdout:1/815: symlink d8/d1a/d53/de2/lfd 0 2024-09-21T10:40:51.558 INFO:tasks.workunit.client.1.smithi112.stdout:4/680: unlink de/d33/d2f/c29 0 2024-09-21T10:40:51.558 INFO:tasks.workunit.client.0.smithi060.stdout:6/193: dread d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:51.561 INFO:tasks.workunit.client.1.smithi112.stdout:7/641: symlink d7/d22/d41/d56/da4/lce 0 2024-09-21T10:40:51.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/83: write da/f12 [2626545,122357] 0 2024-09-21T10:40:51.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/84: fsync f6 0 2024-09-21T10:40:51.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/605: sync 2024-09-21T10:40:51.562 INFO:tasks.workunit.client.1.smithi112.stdout:7/642: write d7/d22/d73/f85 [129503,119403] 0 2024-09-21T10:40:51.562 INFO:tasks.workunit.client.1.smithi112.stdout:7/643: fsync d7/d22/d41/d4b/d5e/f95 0 2024-09-21T10:40:51.562 INFO:tasks.workunit.client.1.smithi112.stdout:0/729: creat d3/d4a/d4e/dc2/d1a/dba/deb/ff2 x:0 0 0 2024-09-21T10:40:51.563 INFO:tasks.workunit.client.1.smithi112.stdout:4/681: write de/d18/d6d/f7e [1682751,35616] 0 2024-09-21T10:40:51.563 INFO:tasks.workunit.client.1.smithi112.stdout:4/682: chown de/d33/d6f/d9c/c7f 0 1 2024-09-21T10:40:51.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/644: dread d7/f26 [0,4194304] 0 2024-09-21T10:40:51.564 INFO:tasks.workunit.client.1.smithi112.stdout:7/645: write d7/d22/d41/d4b/d52/f76 [663166,88769] 0 2024-09-21T10:40:51.566 INFO:tasks.workunit.client.1.smithi112.stdout:9/757: symlink d1/d2/d27/d37/d3b/d69/l104 0 2024-09-21T10:40:51.566 INFO:tasks.workunit.client.1.smithi112.stdout:9/758: dread - d1/d2/d27/d3a/d6b/d30/d5c/d7c/fcb zero size 2024-09-21T10:40:51.567 INFO:tasks.workunit.client.1.smithi112.stdout:9/759: read d1/d2/d27/d3a/d6b/d30/d5c/fd4 [85142,40391] 0 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:1/41: sync 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:8/70: sync 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:3/61: sync 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:4/106: sync 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:8/71: fsync d2/f3 0 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:1/42: truncate f5 4614935 0 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:8/72: dread - d2/f12 zero size 2024-09-21T10:40:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:4/107: write d0/f4 [5444904,3342] 0 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:8/73: chown d2/f8 7906 1 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:9/93: sync 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:9/94: dread - d3/f14 zero size 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:9/95: chown d3/cd 174367 1 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:9/96: chown d3/fe 3148 1 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:9/97: fdatasync d3/d16/f1c 0 2024-09-21T10:40:51.575 INFO:tasks.workunit.client.0.smithi060.stdout:1/43: dread f5 [4194304,4194304] 0 2024-09-21T10:40:51.576 INFO:tasks.workunit.client.0.smithi060.stdout:7/85: link da/fc da/d14/d15/d16/f1a 0 2024-09-21T10:40:51.577 INFO:tasks.workunit.client.1.smithi112.stdout:3/674: symlink d2/le5 0 2024-09-21T10:40:51.579 INFO:tasks.workunit.client.0.smithi060.stdout:6/194: unlink d3/l1c 0 2024-09-21T10:40:51.583 INFO:tasks.workunit.client.0.smithi060.stdout:3/62: write d0/fd [2516754,95480] 0 2024-09-21T10:40:51.583 INFO:tasks.workunit.client.0.smithi060.stdout:3/63: creat d0/d1/f14 x:0 0 0 2024-09-21T10:40:51.586 INFO:tasks.workunit.client.0.smithi060.stdout:8/74: rename d2/l9 to d2/l13 0 2024-09-21T10:40:51.586 INFO:tasks.workunit.client.0.smithi060.stdout:8/75: readlink d2/l6 0 2024-09-21T10:40:51.587 INFO:tasks.workunit.client.0.smithi060.stdout:9/98: mknod d3/c24 0 2024-09-21T10:40:51.591 INFO:tasks.workunit.client.0.smithi060.stdout:6/195: creat d3/d12/d38/f3a x:0 0 0 2024-09-21T10:40:51.592 INFO:tasks.workunit.client.1.smithi112.stdout:5/728: rmdir d9 39 2024-09-21T10:40:51.594 INFO:tasks.workunit.client.1.smithi112.stdout:6/723: unlink d4/dc/d1a/d31/d3c/ff4 0 2024-09-21T10:40:51.594 INFO:tasks.workunit.client.0.smithi060.stdout:4/108: rmdir d0/df 39 2024-09-21T10:40:51.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/816: mkdir d8/d54/d6d/dfe 0 2024-09-21T10:40:51.596 INFO:tasks.workunit.client.1.smithi112.stdout:1/817: dread - d8/d1a/d53/d57/d83/fd1 zero size 2024-09-21T10:40:51.597 INFO:tasks.workunit.client.0.smithi060.stdout:1/44: dwrite f5 [0,4194304] 0 2024-09-21T10:40:51.597 INFO:tasks.workunit.client.0.smithi060.stdout:1/45: chown d6/c7 5001690 1 2024-09-21T10:40:51.598 INFO:tasks.workunit.client.1.smithi112.stdout:2/606: truncate d0/d12/d6c/d7e/d8f/f6f 2002019 0 2024-09-21T10:40:51.601 INFO:tasks.workunit.client.0.smithi060.stdout:4/109: rename d0/d5/d12/f14 to d0/d5/d12/d15/f27 0 2024-09-21T10:40:51.603 INFO:tasks.workunit.client.1.smithi112.stdout:0/730: truncate d3/d4a/f6a 1939430 0 2024-09-21T10:40:51.603 INFO:tasks.workunit.client.1.smithi112.stdout:0/731: chown d3/d18/d45/c9c 0 1 2024-09-21T10:40:51.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/729: read d9/fa5 [102249,122106] 0 2024-09-21T10:40:51.607 INFO:tasks.workunit.client.1.smithi112.stdout:4/683: mknod de/d2a/d31/ce7 0 2024-09-21T10:40:51.607 INFO:tasks.workunit.client.1.smithi112.stdout:4/684: write de/d2a/dbf/d82/f95 [2275270,68617] 0 2024-09-21T10:40:51.608 INFO:tasks.workunit.client.0.smithi060.stdout:1/46: mkdir d6/d8/da/db 0 2024-09-21T10:40:51.609 INFO:tasks.workunit.client.0.smithi060.stdout:4/110: mkdir d0/d5/d12/d16/d28 0 2024-09-21T10:40:51.610 INFO:tasks.workunit.client.1.smithi112.stdout:7/646: write d7/d3d/f67 [8463789,88269] 0 2024-09-21T10:40:51.610 INFO:tasks.workunit.client.1.smithi112.stdout:7/647: chown d7/l32 1151995 1 2024-09-21T10:40:51.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/64: dread d0/fd [0,4194304] 0 2024-09-21T10:40:51.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/65: write d0/d1/f14 [661002,9161] 0 2024-09-21T10:40:51.612 INFO:tasks.workunit.client.0.smithi060.stdout:1/47: creat d6/d8/fc x:0 0 0 2024-09-21T10:40:51.612 INFO:tasks.workunit.client.0.smithi060.stdout:8/76: dwrite d2/ff [0,4194304] 0 2024-09-21T10:40:51.612 INFO:tasks.workunit.client.0.smithi060.stdout:8/77: creat d2/f14 x:0 0 0 2024-09-21T10:40:51.612 INFO:tasks.workunit.client.0.smithi060.stdout:7/86: dwrite da/fc [0,4194304] 0 2024-09-21T10:40:51.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/760: mknod d1/d7f/c105 0 2024-09-21T10:40:51.615 INFO:tasks.workunit.client.0.smithi060.stdout:8/78: dread d2/f8 [0,4194304] 0 2024-09-21T10:40:51.615 INFO:tasks.workunit.client.0.smithi060.stdout:8/79: creat d2/f15 x:0 0 0 2024-09-21T10:40:51.615 INFO:tasks.workunit.client.0.smithi060.stdout:8/80: chown d2/la 6826791 1 2024-09-21T10:40:51.615 INFO:tasks.workunit.client.0.smithi060.stdout:8/81: chown d2/la 0 1 2024-09-21T10:40:51.617 INFO:tasks.workunit.client.0.smithi060.stdout:6/196: dwrite d3/d12/d16/d1a/d21/f23 [0,4194304] 0 2024-09-21T10:40:51.618 INFO:tasks.workunit.client.1.smithi112.stdout:3/675: mknod d2/d2f/d3f/ddf/d31/ce6 0 2024-09-21T10:40:51.620 INFO:tasks.workunit.client.1.smithi112.stdout:1/818: dwrite d8/d54/db0/fee [0,4194304] 0 2024-09-21T10:40:51.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/66: unlink d0/l13 0 2024-09-21T10:40:51.622 INFO:tasks.workunit.client.1.smithi112.stdout:6/724: creat d4/d6/da/d11/ffd x:0 0 0 2024-09-21T10:40:51.622 INFO:tasks.workunit.client.1.smithi112.stdout:6/725: readlink d4/d6/d75/db7/ded/lf5 0 2024-09-21T10:40:51.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/48: mkdir d6/d8/da/db/dd 0 2024-09-21T10:40:51.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/49: stat d6/d8/da/db/dd 0 2024-09-21T10:40:51.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/50: dread - d6/d8/fc zero size 2024-09-21T10:40:51.624 INFO:tasks.workunit.client.1.smithi112.stdout:2/607: rmdir d0/da4 39 2024-09-21T10:40:51.625 INFO:tasks.workunit.client.1.smithi112.stdout:2/608: fdatasync d0/d12/d46/d86/fa6 0 2024-09-21T10:40:51.625 INFO:tasks.workunit.client.0.smithi060.stdout:1/51: dread f5 [4194304,4194304] 0 2024-09-21T10:40:51.626 INFO:tasks.workunit.client.0.smithi060.stdout:6/197: dread d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:51.626 INFO:tasks.workunit.client.0.smithi060.stdout:3/67: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:51.628 INFO:tasks.workunit.client.0.smithi060.stdout:3/68: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:51.628 INFO:tasks.workunit.client.0.smithi060.stdout:3/69: read - d0/d1/f12 zero size 2024-09-21T10:40:51.629 INFO:tasks.workunit.client.1.smithi112.stdout:0/732: unlink d3/d4a/d4e/d72/l81 0 2024-09-21T10:40:51.631 INFO:tasks.workunit.client.1.smithi112.stdout:5/730: rmdir d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf 39 2024-09-21T10:40:51.633 INFO:tasks.workunit.client.1.smithi112.stdout:4/685: mkdir de/d2a/dbf/d82/de8 0 2024-09-21T10:40:51.633 INFO:tasks.workunit.client.1.smithi112.stdout:4/686: fdatasync de/d33/d2f/d71/d40/f5a 0 2024-09-21T10:40:51.633 INFO:tasks.workunit.client.1.smithi112.stdout:4/687: creat de/d33/d2f/d35/d4c/d5c/fe9 x:0 0 0 2024-09-21T10:40:51.634 INFO:tasks.workunit.client.0.smithi060.stdout:7/87: creat da/d14/d15/d16/f1b x:0 0 0 2024-09-21T10:40:51.634 INFO:tasks.workunit.client.0.smithi060.stdout:7/88: read f1 [8201966,69200] 0 2024-09-21T10:40:51.635 INFO:tasks.workunit.client.1.smithi112.stdout:8/693: rename d8/d9/dd/d2a/d43/d58 to d8/d9/dd/dab/d8e/dcb 0 2024-09-21T10:40:51.635 INFO:tasks.workunit.client.1.smithi112.stdout:8/694: readlink d8/l59 0 2024-09-21T10:40:51.637 INFO:tasks.workunit.client.1.smithi112.stdout:0/733: dread d3/d4a/d4e/dc2/d10/f35 [0,4194304] 0 2024-09-21T10:40:51.637 INFO:tasks.workunit.client.1.smithi112.stdout:7/648: creat d7/d22/d86/dac/fcf x:0 0 0 2024-09-21T10:40:51.638 INFO:tasks.workunit.client.0.smithi060.stdout:8/82: mknod d2/c16 0 2024-09-21T10:40:51.638 INFO:tasks.workunit.client.0.smithi060.stdout:8/83: creat d2/f17 x:0 0 0 2024-09-21T10:40:51.639 INFO:tasks.workunit.client.1.smithi112.stdout:3/676: symlink d2/db0/ddd/le7 0 2024-09-21T10:40:51.641 INFO:tasks.workunit.client.1.smithi112.stdout:6/726: dread d4/d4f/f5d [0,4194304] 0 2024-09-21T10:40:51.641 INFO:tasks.workunit.client.1.smithi112.stdout:1/819: mkdir d8/d1a/d31/d66/d87/dff 0 2024-09-21T10:40:51.641 INFO:tasks.workunit.client.1.smithi112.stdout:1/820: truncate d8/d54/fca 466777 0 2024-09-21T10:40:51.641 INFO:tasks.workunit.client.1.smithi112.stdout:1/821: chown d8/d1a/c69 704287054 1 2024-09-21T10:40:51.642 INFO:tasks.workunit.client.0.smithi060.stdout:4/111: dwrite d0/d5/d12/d16/f1d [0,4194304] 0 2024-09-21T10:40:51.645 INFO:tasks.workunit.client.1.smithi112.stdout:2/609: getdents d0/d12/d46/da0 0 2024-09-21T10:40:51.645 INFO:tasks.workunit.client.0.smithi060.stdout:1/52: readlink l4 0 2024-09-21T10:40:51.646 INFO:tasks.workunit.client.0.smithi060.stdout:1/53: chown d6/d8/fc 35695 1 2024-09-21T10:40:51.646 INFO:tasks.workunit.client.0.smithi060.stdout:1/54: fsync f5 0 2024-09-21T10:40:51.646 INFO:tasks.workunit.client.0.smithi060.stdout:1/55: dread - d6/d8/fc zero size 2024-09-21T10:40:51.646 INFO:tasks.workunit.client.1.smithi112.stdout:5/731: creat d9/d15/d1d/fe2 x:0 0 0 2024-09-21T10:40:51.647 INFO:tasks.workunit.client.1.smithi112.stdout:5/732: chown d9/d15/d18/d3a/d4b/d74/d8d/fd5 16968 1 2024-09-21T10:40:51.649 INFO:tasks.workunit.client.0.smithi060.stdout:3/70: creat d0/d1/d11/f15 x:0 0 0 2024-09-21T10:40:51.652 INFO:tasks.workunit.client.1.smithi112.stdout:4/688: unlink de/d33/d6f/d9c/d3e/dce/fe1 0 2024-09-21T10:40:51.652 INFO:tasks.workunit.client.1.smithi112.stdout:4/689: read - de/d33/d2f/dcf/dcc/fd4 zero size 2024-09-21T10:40:51.652 INFO:tasks.workunit.client.0.smithi060.stdout:7/89: symlink da/l1c 0 2024-09-21T10:40:51.653 INFO:tasks.workunit.client.0.smithi060.stdout:7/90: creat da/d14/d15/d16/f1d x:0 0 0 2024-09-21T10:40:51.653 INFO:tasks.workunit.client.0.smithi060.stdout:7/91: read - f8 zero size 2024-09-21T10:40:51.655 INFO:tasks.workunit.client.1.smithi112.stdout:9/761: rename d1/d2/d27/d3a/d6b/f3c to d1/f106 0 2024-09-21T10:40:51.655 INFO:tasks.workunit.client.1.smithi112.stdout:9/762: readlink d1/d2/d27/d37/d3b/l40 0 2024-09-21T10:40:51.659 INFO:tasks.workunit.client.0.smithi060.stdout:8/84: write f1 [2938170,127155] 0 2024-09-21T10:40:51.661 INFO:tasks.workunit.client.0.smithi060.stdout:6/198: write d3/d12/d16/d22/f2f [639681,115141] 0 2024-09-21T10:40:51.664 INFO:tasks.workunit.client.1.smithi112.stdout:8/695: mkdir d8/d9/dd/dab/d8e/dcb/d82/dcc 0 2024-09-21T10:40:51.664 INFO:tasks.workunit.client.1.smithi112.stdout:8/696: creat d8/d9/dd/d2b/fcd x:0 0 0 2024-09-21T10:40:51.668 INFO:tasks.workunit.client.0.smithi060.stdout:7/92: dread da/d14/d15/d16/f1a [0,4194304] 0 2024-09-21T10:40:51.668 INFO:tasks.workunit.client.1.smithi112.stdout:0/734: dwrite d3/d4a/d4e/dc2/d1a/d21/f61 [0,4194304] 0 2024-09-21T10:40:51.668 INFO:tasks.workunit.client.1.smithi112.stdout:7/649: symlink d7/d3d/da7/ld0 0 2024-09-21T10:40:51.673 INFO:tasks.workunit.client.1.smithi112.stdout:3/677: link d2/d2f/d3f/ddf/d31/d2a/d39/d3a/fb6 d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dc3/fe8 0 2024-09-21T10:40:51.673 INFO:tasks.workunit.client.1.smithi112.stdout:3/678: write d2/d1f/f4f [332836,96603] 0 2024-09-21T10:40:51.675 INFO:tasks.workunit.client.1.smithi112.stdout:6/727: mknod d4/d6/d75/db7/cfe 0 2024-09-21T10:40:51.678 INFO:tasks.workunit.client.0.smithi060.stdout:6/199: read d3/f30 [543063,90935] 0 2024-09-21T10:40:51.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/822: mknod d8/d7a/c100 0 2024-09-21T10:40:51.678 INFO:tasks.workunit.client.1.smithi112.stdout:1/823: stat d8/d1a/d31/d66/lcd 0 2024-09-21T10:40:51.681 INFO:tasks.workunit.client.1.smithi112.stdout:2/610: creat d0/dd/d47/fc3 x:0 0 0 2024-09-21T10:40:51.682 INFO:tasks.workunit.client.0.smithi060.stdout:1/56: mkdir d6/d8/da/db/de 0 2024-09-21T10:40:51.687 INFO:tasks.workunit.client.0.smithi060.stdout:7/93: mkdir da/d14/d15/d16/d1e 0 2024-09-21T10:40:51.687 INFO:tasks.workunit.client.0.smithi060.stdout:7/94: write da/f12 [3261060,16024] 0 2024-09-21T10:40:51.690 INFO:tasks.workunit.client.0.smithi060.stdout:6/200: unlink d3/d12/d16/l17 0 2024-09-21T10:40:51.693 INFO:tasks.workunit.client.1.smithi112.stdout:0/735: symlink d3/d4a/d4e/dc2/da8/ddf/lf3 0 2024-09-21T10:40:51.693 INFO:tasks.workunit.client.0.smithi060.stdout:1/57: creat d6/d8/da/db/ff x:0 0 0 2024-09-21T10:40:51.693 INFO:tasks.workunit.client.0.smithi060.stdout:1/58: write d6/d8/da/db/ff [232264,66976] 0 2024-09-21T10:40:51.694 INFO:tasks.workunit.client.0.smithi060.stdout:7/95: mknod da/d14/c1f 0 2024-09-21T10:40:51.695 INFO:tasks.workunit.client.0.smithi060.stdout:7/96: dread - da/d14/d15/d16/f1b zero size 2024-09-21T10:40:51.695 INFO:tasks.workunit.client.0.smithi060.stdout:7/97: write f0 [2145977,92314] 0 2024-09-21T10:40:51.697 INFO:tasks.workunit.client.1.smithi112.stdout:7/650: getdents d7/d22/d86/dac/d8a 0 2024-09-21T10:40:51.699 INFO:tasks.workunit.client.1.smithi112.stdout:2/611: symlink d0/d12/d46/da0/db9/dbd/d62/lc4 0 2024-09-21T10:40:51.700 INFO:tasks.workunit.client.1.smithi112.stdout:2/612: write d0/d12/d6c/d7e/d8f/d51/d57/f67 [4964027,102888] 0 2024-09-21T10:40:51.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/651: link d7/d3d/f40 d7/d22/d41/d56/dc9/fd1 0 2024-09-21T10:40:51.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/652: read - d7/d22/d41/d4b/d5e/fbe zero size 2024-09-21T10:40:51.702 INFO:tasks.workunit.client.1.smithi112.stdout:1/824: dwrite d8/d20/f32 [4194304,4194304] 0 2024-09-21T10:40:51.702 INFO:tasks.workunit.client.1.smithi112.stdout:7/653: chown d7/d22/d41/d80 157822 1 2024-09-21T10:40:51.702 INFO:tasks.workunit.client.1.smithi112.stdout:1/825: fdatasync d8/d20/fa7 0 2024-09-21T10:40:51.704 INFO:tasks.workunit.client.1.smithi112.stdout:1/826: rmdir d8/d1a/d31/da1/de7/df1 39 2024-09-21T10:40:51.704 INFO:tasks.workunit.client.1.smithi112.stdout:1/827: creat d8/d45/dfb/f101 x:0 0 0 2024-09-21T10:40:51.704 INFO:tasks.workunit.client.1.smithi112.stdout:1/828: creat d8/d20/f102 x:0 0 0 2024-09-21T10:40:51.704 INFO:tasks.workunit.client.1.smithi112.stdout:1/829: fdatasync d8/f63 0 2024-09-21T10:40:51.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/830: mknod d8/d54/d6d/db5/c103 0 2024-09-21T10:40:51.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/831: dread d8/d54/d6d/db5/dc2/de6/ff0 [0,4194304] 0 2024-09-21T10:40:51.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/832: chown d8/d45/f9b 943 1 2024-09-21T10:40:51.710 INFO:tasks.workunit.client.1.smithi112.stdout:1/833: creat d8/d1a/d53/f104 x:0 0 0 2024-09-21T10:40:51.711 INFO:tasks.workunit.client.1.smithi112.stdout:1/834: write d8/d1a/d53/f60 [354424,55574] 0 2024-09-21T10:40:51.712 INFO:tasks.workunit.client.1.smithi112.stdout:1/835: mkdir d8/d1a/d53/d57/d105 0 2024-09-21T10:40:51.713 INFO:tasks.workunit.client.1.smithi112.stdout:1/836: dread d8/d45/f9b [0,4194304] 0 2024-09-21T10:40:51.714 INFO:tasks.workunit.client.1.smithi112.stdout:1/837: mkdir d8/d54/d6d/db5/dc2/de6/d106 0 2024-09-21T10:40:51.719 INFO:tasks.workunit.client.0.smithi060.stdout:1/59: dwrite d6/d8/da/db/ff [0,4194304] 0 2024-09-21T10:40:51.719 INFO:tasks.workunit.client.0.smithi060.stdout:1/60: chown l4 7141 1 2024-09-21T10:40:51.719 INFO:tasks.workunit.client.1.smithi112.stdout:8/697: dwrite d8/d18/f1c [0,4194304] 0 2024-09-21T10:40:51.722 INFO:tasks.workunit.client.1.smithi112.stdout:8/698: creat d8/d9/dd/dab/d8e/dcb/d82/dcc/fce x:0 0 0 2024-09-21T10:40:51.722 INFO:tasks.workunit.client.1.smithi112.stdout:8/699: chown d8/d9/d3c/d6d/l8d 33130 1 2024-09-21T10:40:51.722 INFO:tasks.workunit.client.1.smithi112.stdout:8/700: dread - d8/d18/fad zero size 2024-09-21T10:40:51.723 INFO:tasks.workunit.client.1.smithi112.stdout:8/701: mknod d8/d9/dd/dab/ccf 0 2024-09-21T10:40:51.723 INFO:tasks.workunit.client.1.smithi112.stdout:8/702: mkdir d8/d9/d3c/d6d/dd0 0 2024-09-21T10:40:51.724 INFO:tasks.workunit.client.1.smithi112.stdout:8/703: stat d8/d9/dd/d2a/d43/f7c 0 2024-09-21T10:40:51.724 INFO:tasks.workunit.client.1.smithi112.stdout:8/704: chown d8/d18 162683991 1 2024-09-21T10:40:51.726 INFO:tasks.workunit.client.0.smithi060.stdout:1/61: dread f5 [0,4194304] 0 2024-09-21T10:40:51.727 INFO:tasks.workunit.client.1.smithi112.stdout:5/733: dwrite d9/fcc [0,4194304] 0 2024-09-21T10:40:51.730 INFO:tasks.workunit.client.1.smithi112.stdout:5/734: rmdir d9/d15/d18/d20 39 2024-09-21T10:40:51.732 INFO:tasks.workunit.client.1.smithi112.stdout:5/735: write d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd9 [468759,109087] 0 2024-09-21T10:40:51.734 INFO:tasks.workunit.client.0.smithi060.stdout:3/71: dwrite d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:40:51.734 INFO:tasks.workunit.client.0.smithi060.stdout:3/72: dread - d0/d1/f12 zero size 2024-09-21T10:40:51.734 INFO:tasks.workunit.client.0.smithi060.stdout:3/73: chown d0/d1/f14 1785717403 1 2024-09-21T10:40:51.734 INFO:tasks.workunit.client.1.smithi112.stdout:5/736: dread d9/d6e/fd2 [0,4194304] 0 2024-09-21T10:40:51.734 INFO:tasks.workunit.client.1.smithi112.stdout:5/737: readlink d9/d15/d18/d3a/d4b/d74/d8d/lac 0 2024-09-21T10:40:51.734 INFO:tasks.workunit.client.1.smithi112.stdout:0/736: dread d3/d4a/d4e/dc2/d1a/d21/f6d [0,4194304] 0 2024-09-21T10:40:51.735 INFO:tasks.workunit.client.1.smithi112.stdout:5/738: rmdir d9/d15/d18/d3a/d4b/d74/d8d 39 2024-09-21T10:40:51.737 INFO:tasks.workunit.client.1.smithi112.stdout:0/737: rename d3/d18/d52/f6c to d3/d4a/d4e/dc2/d10/d8b/ff4 0 2024-09-21T10:40:51.739 INFO:tasks.workunit.client.0.smithi060.stdout:1/62: dwrite d6/d8/da/db/ff [0,4194304] 0 2024-09-21T10:40:51.743 INFO:tasks.workunit.client.1.smithi112.stdout:4/690: dwrite de/d33/d2f/d71/f9e [0,4194304] 0 2024-09-21T10:40:51.744 INFO:tasks.workunit.client.1.smithi112.stdout:6/728: dwrite d4/d6/da/d14/f8e [0,4194304] 0 2024-09-21T10:40:51.747 INFO:tasks.workunit.client.1.smithi112.stdout:4/691: dread de/d33/d2f/d71/d40/d4f/fd3 [0,4194304] 0 2024-09-21T10:40:51.747 INFO:tasks.workunit.client.1.smithi112.stdout:4/692: readlink de/d18/l23 0 2024-09-21T10:40:51.747 INFO:tasks.workunit.client.1.smithi112.stdout:5/739: dread d9/d15/d18/d3a/d61/d62/d6b/fc0 [0,4194304] 0 2024-09-21T10:40:51.748 INFO:tasks.workunit.client.1.smithi112.stdout:4/693: creat de/d2a/dbf/fea x:0 0 0 2024-09-21T10:40:51.748 INFO:tasks.workunit.client.1.smithi112.stdout:4/694: truncate de/d33/d2f/d71/d40/d4f/fbb 604885 0 2024-09-21T10:40:51.748 INFO:tasks.workunit.client.1.smithi112.stdout:0/738: mkdir d3/d18/d45/df5 0 2024-09-21T10:40:51.748 INFO:tasks.workunit.client.1.smithi112.stdout:5/740: dread d9/d15/d18/fb5 [0,4194304] 0 2024-09-21T10:40:51.748 INFO:tasks.workunit.client.1.smithi112.stdout:5/741: fdatasync d9/d6e/fd2 0 2024-09-21T10:40:51.748 INFO:tasks.workunit.client.1.smithi112.stdout:5/742: chown d9/d15/d18/d20/l25 132349483 1 2024-09-21T10:40:51.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/63: write d6/d8/da/db/ff [2219251,79220] 0 2024-09-21T10:40:51.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/64: chown d6/d8/da/db/de 8028 1 2024-09-21T10:40:51.753 INFO:tasks.workunit.client.0.smithi060.stdout:6/201: dwrite d3/d12/d16/d1a/d21/f23 [0,4194304] 0 2024-09-21T10:40:51.753 INFO:tasks.workunit.client.0.smithi060.stdout:8/85: dwrite f1 [0,4194304] 0 2024-09-21T10:40:51.754 INFO:tasks.workunit.client.0.smithi060.stdout:8/86: chown d2/l6 73571 1 2024-09-21T10:40:51.754 INFO:tasks.workunit.client.0.smithi060.stdout:8/87: dread - d2/f12 zero size 2024-09-21T10:40:51.754 INFO:tasks.workunit.client.1.smithi112.stdout:7/654: dwrite d7/d22/d41/d56/dc9/fd1 [0,4194304] 0 2024-09-21T10:40:51.754 INFO:tasks.workunit.client.1.smithi112.stdout:3/679: dwrite d2/d2f/d3f/ddf/d31/dcf/fc4 [0,4194304] 0 2024-09-21T10:40:51.755 INFO:tasks.workunit.client.1.smithi112.stdout:4/695: dread de/f24 [0,4194304] 0 2024-09-21T10:40:51.755 INFO:tasks.workunit.client.1.smithi112.stdout:4/696: read de/d2e/f32 [112520,61579] 0 2024-09-21T10:40:51.755 INFO:tasks.workunit.client.1.smithi112.stdout:6/729: creat d4/dc/d1a/d31/d56/fff x:0 0 0 2024-09-21T10:40:51.755 INFO:tasks.workunit.client.1.smithi112.stdout:1/838: dwrite d8/d1a/fe3 [0,4194304] 0 2024-09-21T10:40:51.758 INFO:tasks.workunit.client.0.smithi060.stdout:3/74: dwrite d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:51.758 INFO:tasks.workunit.client.0.smithi060.stdout:3/75: read d0/fd [2749565,111652] 0 2024-09-21T10:40:51.758 INFO:tasks.workunit.client.1.smithi112.stdout:0/739: rename d3/f66 to d3/d4a/d4e/dc2/da8/ff6 0 2024-09-21T10:40:51.758 INFO:tasks.workunit.client.1.smithi112.stdout:0/740: readlink d3/d4a/l60 0 2024-09-21T10:40:51.758 INFO:tasks.workunit.client.1.smithi112.stdout:0/741: write d3/d4a/d4e/dc2/fe [3606737,25443] 0 2024-09-21T10:40:51.759 INFO:tasks.workunit.client.1.smithi112.stdout:0/742: chown d3/d4a/d4e 12475726 1 2024-09-21T10:40:51.760 INFO:tasks.workunit.client.1.smithi112.stdout:5/743: symlink d9/d15/d1d/le3 0 2024-09-21T10:40:51.760 INFO:tasks.workunit.client.1.smithi112.stdout:5/744: read - d9/d8a/fb9 zero size 2024-09-21T10:40:51.761 INFO:tasks.workunit.client.0.smithi060.stdout:6/202: creat d3/d12/f3b x:0 0 0 2024-09-21T10:40:51.765 INFO:tasks.workunit.client.0.smithi060.stdout:1/65: dwrite d6/d8/fc [0,4194304] 0 2024-09-21T10:40:51.766 INFO:tasks.workunit.client.1.smithi112.stdout:7/655: dread d7/d22/d41/d4b/da2/fba [0,4194304] 0 2024-09-21T10:40:51.766 INFO:tasks.workunit.client.1.smithi112.stdout:7/656: creat d7/dbc/fd2 x:0 0 0 2024-09-21T10:40:51.766 INFO:tasks.workunit.client.1.smithi112.stdout:7/657: readlink d7/d22/l30 0 2024-09-21T10:40:51.766 INFO:tasks.workunit.client.0.smithi060.stdout:1/66: creat d6/d8/da/db/f10 x:0 0 0 2024-09-21T10:40:51.768 INFO:tasks.workunit.client.0.smithi060.stdout:8/88: mkdir d2/d18 0 2024-09-21T10:40:51.774 INFO:tasks.workunit.client.1.smithi112.stdout:4/697: mknod de/d33/d2f/d35/d4c/d5c/ceb 0 2024-09-21T10:40:51.774 INFO:tasks.workunit.client.0.smithi060.stdout:4/112: dwrite d0/d5/d12/d16/f1d [4194304,4194304] 0 2024-09-21T10:40:51.775 INFO:tasks.workunit.client.1.smithi112.stdout:5/745: dread d9/d15/d18/d3a/f44 [0,4194304] 0 2024-09-21T10:40:51.776 INFO:tasks.workunit.client.1.smithi112.stdout:3/680: dread d2/d1f/f25 [0,4194304] 0 2024-09-21T10:40:51.778 INFO:tasks.workunit.client.0.smithi060.stdout:3/76: creat d0/f16 x:0 0 0 2024-09-21T10:40:51.780 INFO:tasks.workunit.client.1.smithi112.stdout:6/730: rename d4/d3e to d4/d6/da/d11/d1f/d22/d100 0 2024-09-21T10:40:51.781 INFO:tasks.workunit.client.0.smithi060.stdout:6/203: truncate d3/f30 3769628 0 2024-09-21T10:40:51.781 INFO:tasks.workunit.client.0.smithi060.stdout:6/204: fdatasync d3/d12/f3b 0 2024-09-21T10:40:51.783 INFO:tasks.workunit.client.1.smithi112.stdout:0/743: creat d3/d4a/ff7 x:0 0 0 2024-09-21T10:40:51.785 INFO:tasks.workunit.client.1.smithi112.stdout:5/746: dread d9/d15/d1d/f5a [0,4194304] 0 2024-09-21T10:40:51.785 INFO:tasks.workunit.client.1.smithi112.stdout:5/747: read d9/d15/f2a [82890,79331] 0 2024-09-21T10:40:51.787 INFO:tasks.workunit.client.1.smithi112.stdout:7/658: mkdir d7/d22/d41/d56/dc9/dd3 0 2024-09-21T10:40:51.789 INFO:tasks.workunit.client.1.smithi112.stdout:4/698: symlink de/d33/d6f/d9c/lec 0 2024-09-21T10:40:51.789 INFO:tasks.workunit.client.1.smithi112.stdout:4/699: fsync de/d33/d2f/d71/fb1 0 2024-09-21T10:40:51.789 INFO:tasks.workunit.client.1.smithi112.stdout:4/700: stat de/d2a/dbf/fe4 0 2024-09-21T10:40:51.790 INFO:tasks.workunit.client.1.smithi112.stdout:1/839: dwrite d8/d1a/d31/d37/d9e/fcc [0,4194304] 0 2024-09-21T10:40:51.790 INFO:tasks.workunit.client.1.smithi112.stdout:1/840: fsync d8/d1a/db8/dbc/fdf 0 2024-09-21T10:40:51.790 INFO:tasks.workunit.client.0.smithi060.stdout:1/67: mknod d6/d8/c11 0 2024-09-21T10:40:51.791 INFO:tasks.workunit.client.1.smithi112.stdout:4/701: write de/d18/f26 [8983102,8945] 0 2024-09-21T10:40:51.791 INFO:tasks.workunit.client.1.smithi112.stdout:4/702: truncate de/d33/d2f/dcf/dc2/fc1 190728 0 2024-09-21T10:40:51.793 INFO:tasks.workunit.client.1.smithi112.stdout:3/681: rename d2/d1f/f92 to d2/d2f/d3f/ddf/dad/fe9 0 2024-09-21T10:40:51.795 INFO:tasks.workunit.client.0.smithi060.stdout:8/89: rename d2/l13 to d2/l19 0 2024-09-21T10:40:51.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/68: write d6/d8/fc [333002,58400] 0 2024-09-21T10:40:51.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/69: truncate f5 4805140 0 2024-09-21T10:40:51.799 INFO:tasks.workunit.client.0.smithi060.stdout:6/205: dread d3/dd/f14 [0,4194304] 0 2024-09-21T10:40:51.799 INFO:tasks.workunit.client.0.smithi060.stdout:6/206: write d3/d12/d38/f3a [959279,56878] 0 2024-09-21T10:40:51.800 INFO:tasks.workunit.client.1.smithi112.stdout:0/744: unlink d3/d23/f54 0 2024-09-21T10:40:51.800 INFO:tasks.workunit.client.1.smithi112.stdout:0/745: write d3/d4a/fcb [636374,49899] 0 2024-09-21T10:40:51.803 INFO:tasks.workunit.client.0.smithi060.stdout:8/90: dread d2/f3 [0,4194304] 0 2024-09-21T10:40:51.807 INFO:tasks.workunit.client.0.smithi060.stdout:8/91: dread d2/fc [0,4194304] 0 2024-09-21T10:40:51.809 INFO:tasks.workunit.client.1.smithi112.stdout:7/659: mknod d7/d22/d41/d80/cd4 0 2024-09-21T10:40:51.813 INFO:tasks.workunit.client.0.smithi060.stdout:1/70: creat d6/d8/da/f12 x:0 0 0 2024-09-21T10:40:51.815 INFO:tasks.workunit.client.0.smithi060.stdout:8/92: stat d2/l19 0 2024-09-21T10:40:51.816 INFO:tasks.workunit.client.1.smithi112.stdout:4/703: dwrite de/d33/d2f/d71/d40/d4f/fd3 [0,4194304] 0 2024-09-21T10:40:51.816 INFO:tasks.workunit.client.0.smithi060.stdout:1/71: mknod d6/d8/da/c13 0 2024-09-21T10:40:51.819 INFO:tasks.workunit.client.0.smithi060.stdout:8/93: link d2/l10 d2/d18/l1a 0 2024-09-21T10:40:51.819 INFO:tasks.workunit.client.1.smithi112.stdout:3/682: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fd1 [0,4194304] 0 2024-09-21T10:40:51.822 INFO:tasks.workunit.client.1.smithi112.stdout:6/731: mknod d4/dc/d1a/d31/d3c/c101 0 2024-09-21T10:40:51.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/748: mknod d9/d15/d18/d20/d47/ce4 0 2024-09-21T10:40:51.826 INFO:tasks.workunit.client.0.smithi060.stdout:1/72: dread d6/d8/da/db/ff [0,4194304] 0 2024-09-21T10:40:51.826 INFO:tasks.workunit.client.0.smithi060.stdout:1/73: write d6/d8/fc [3830234,27047] 0 2024-09-21T10:40:51.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/74: rename f5 to d6/d8/da/db/dd/f14 0 2024-09-21T10:40:51.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/75: dread - d6/d8/da/db/f10 zero size 2024-09-21T10:40:51.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/76: creat d6/d8/f15 x:0 0 0 2024-09-21T10:40:51.831 INFO:tasks.workunit.client.1.smithi112.stdout:1/841: getdents d8/d45/dae 0 2024-09-21T10:40:51.833 INFO:tasks.workunit.client.1.smithi112.stdout:3/683: dread d2/d2f/d3f/ddf/d31/f36 [0,4194304] 0 2024-09-21T10:40:51.833 INFO:tasks.workunit.client.1.smithi112.stdout:3/684: readlink d2/d2f/d3f/ddf/d31/d2a/d39/d60/l88 0 2024-09-21T10:40:51.836 INFO:tasks.workunit.client.1.smithi112.stdout:5/749: dread d9/d15/d18/d20/d47/f49 [0,4194304] 0 2024-09-21T10:40:51.836 INFO:tasks.workunit.client.1.smithi112.stdout:4/704: dwrite de/d33/d2f/dcf/dc2/fc1 [0,4194304] 0 2024-09-21T10:40:51.837 INFO:tasks.workunit.client.1.smithi112.stdout:6/732: mkdir d4/dc/d1a/d31/d102 0 2024-09-21T10:40:51.837 INFO:tasks.workunit.client.0.smithi060.stdout:5/52: sync 2024-09-21T10:40:51.838 INFO:tasks.workunit.client.0.smithi060.stdout:1/77: write d6/d8/da/db/dd/f14 [101124,113326] 0 2024-09-21T10:40:51.840 INFO:tasks.workunit.client.1.smithi112.stdout:3/685: creat d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fea x:0 0 0 2024-09-21T10:40:51.841 INFO:tasks.workunit.client.0.smithi060.stdout:5/53: symlink d5/da/l12 0 2024-09-21T10:40:51.841 INFO:tasks.workunit.client.0.smithi060.stdout:5/54: write d5/f8 [3532186,67651] 0 2024-09-21T10:40:51.841 INFO:tasks.workunit.client.1.smithi112.stdout:1/842: dread d8/d1a/d31/f3e [0,4194304] 0 2024-09-21T10:40:51.842 INFO:tasks.workunit.client.1.smithi112.stdout:1/843: write d8/d20/f102 [491590,70832] 0 2024-09-21T10:40:51.844 INFO:tasks.workunit.client.0.smithi060.stdout:1/78: mkdir d6/d16 0 2024-09-21T10:40:51.847 INFO:tasks.workunit.client.0.smithi060.stdout:5/55: unlink d5/c6 0 2024-09-21T10:40:51.847 INFO:tasks.workunit.client.1.smithi112.stdout:4/705: read de/d18/f76 [2231797,126610] 0 2024-09-21T10:40:51.848 INFO:tasks.workunit.client.1.smithi112.stdout:5/750: symlink d9/d15/d18/d20/d47/dc6/le5 0 2024-09-21T10:40:51.848 INFO:tasks.workunit.client.1.smithi112.stdout:5/751: write d9/d15/d18/d20/d55/dbb/fdd [386361,60712] 0 2024-09-21T10:40:51.848 INFO:tasks.workunit.client.1.smithi112.stdout:5/752: truncate d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd0 818928 0 2024-09-21T10:40:51.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/79: creat d6/d8/da/db/dd/f17 x:0 0 0 2024-09-21T10:40:51.850 INFO:tasks.workunit.client.1.smithi112.stdout:3/686: creat d2/d8d/feb x:0 0 0 2024-09-21T10:40:51.850 INFO:tasks.workunit.client.1.smithi112.stdout:3/687: write d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fb1 [597759,87085] 0 2024-09-21T10:40:51.853 INFO:tasks.workunit.client.1.smithi112.stdout:1/844: rename d8/fc6 to d8/d54/d6d/db5/dc2/de6/f107 0 2024-09-21T10:40:51.854 INFO:tasks.workunit.client.0.smithi060.stdout:1/80: rmdir d6/d16 0 2024-09-21T10:40:51.855 INFO:tasks.workunit.client.1.smithi112.stdout:4/706: mknod de/d33/d2f/dcf/dc2/dad/ced 0 2024-09-21T10:40:51.856 INFO:tasks.workunit.client.1.smithi112.stdout:6/733: dwrite d4/dc/d1a/d31/f68 [0,4194304] 0 2024-09-21T10:40:51.857 INFO:tasks.workunit.client.1.smithi112.stdout:4/707: write de/d2a/fa6 [32952,66942] 0 2024-09-21T10:40:51.857 INFO:tasks.workunit.client.1.smithi112.stdout:4/708: write de/d33/d2f/f61 [963614,69679] 0 2024-09-21T10:40:51.859 INFO:tasks.workunit.client.1.smithi112.stdout:4/709: dread de/d33/d2f/d35/d4c/f97 [0,4194304] 0 2024-09-21T10:40:51.859 INFO:tasks.workunit.client.1.smithi112.stdout:4/710: write de/d33/f38 [2933516,100322] 0 2024-09-21T10:40:51.860 INFO:tasks.workunit.client.1.smithi112.stdout:5/753: rename d9/d15/d18/d20/d55/dbb/fcf to d9/d15/d18/d3a/d4b/d71/fe6 0 2024-09-21T10:40:51.866 INFO:tasks.workunit.client.1.smithi112.stdout:6/734: symlink d4/d6/da/d11/d1f/d22/l103 0 2024-09-21T10:40:51.867 INFO:tasks.workunit.client.0.smithi060.stdout:4/113: truncate d0/d5/d12/d16/f1d 6454550 0 2024-09-21T10:40:51.868 INFO:tasks.workunit.client.1.smithi112.stdout:3/688: rmdir d2/d2f/dc5/dcc 39 2024-09-21T10:40:51.868 INFO:tasks.workunit.client.1.smithi112.stdout:3/689: creat d2/d2f/d3f/fec x:0 0 0 2024-09-21T10:40:51.868 INFO:tasks.workunit.client.1.smithi112.stdout:3/690: truncate d2/d2f/d3f/ddf/d31/d2a/da1/fbc 894192 0 2024-09-21T10:40:51.868 INFO:tasks.workunit.client.1.smithi112.stdout:3/691: chown d2/d2f/d3f/ddf/d31/d2a/da1 7689 1 2024-09-21T10:40:51.869 INFO:tasks.workunit.client.1.smithi112.stdout:2/613: sync 2024-09-21T10:40:51.869 INFO:tasks.workunit.client.1.smithi112.stdout:9/763: sync 2024-09-21T10:40:51.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/705: sync 2024-09-21T10:40:51.869 INFO:tasks.workunit.client.1.smithi112.stdout:8/706: chown d8/d9/dd/d2b/fc1 69 1 2024-09-21T10:40:51.870 INFO:tasks.workunit.client.1.smithi112.stdout:4/711: mknod de/d2a/dbf/d82/de8/cee 0 2024-09-21T10:40:51.871 INFO:tasks.workunit.client.0.smithi060.stdout:6/207: dwrite d3/f30 [0,4194304] 0 2024-09-21T10:40:51.871 INFO:tasks.workunit.client.0.smithi060.stdout:4/114: symlink d0/d5/d12/d20/l29 0 2024-09-21T10:40:51.874 INFO:tasks.workunit.client.1.smithi112.stdout:6/735: creat d4/d6/da/d11/d1f/d22/f104 x:0 0 0 2024-09-21T10:40:51.874 INFO:tasks.workunit.client.0.smithi060.stdout:6/208: dread d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:40:51.878 INFO:tasks.workunit.client.0.smithi060.stdout:4/115: mknod d0/d5/d12/d15/c2a 0 2024-09-21T10:40:51.878 INFO:tasks.workunit.client.0.smithi060.stdout:4/116: write d0/f6 [1610234,100566] 0 2024-09-21T10:40:51.879 INFO:tasks.workunit.client.1.smithi112.stdout:1/845: dwrite d8/d54/d6d/db5/dc2/de6/f107 [0,4194304] 0 2024-09-21T10:40:51.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/209: link d3/d12/d16/d1a/f1e d3/d12/d16/d1a/f3c 0 2024-09-21T10:40:51.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/210: read d3/fb [3347980,62651] 0 2024-09-21T10:40:51.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/211: chown d3/d12/d16/d22/f2f 112247 1 2024-09-21T10:40:51.882 INFO:tasks.workunit.client.0.smithi060.stdout:6/212: read d3/dd/f14 [4972105,10728] 0 2024-09-21T10:40:51.883 INFO:tasks.workunit.client.0.smithi060.stdout:4/117: unlink d0/d5/d12/d15/f27 0 2024-09-21T10:40:51.890 INFO:tasks.workunit.client.1.smithi112.stdout:3/692: link d2/d1f/c4c d2/d2f/d3f/ced 0 2024-09-21T10:40:51.890 INFO:tasks.workunit.client.1.smithi112.stdout:3/693: fdatasync d2/d1f/f40 0 2024-09-21T10:40:51.893 INFO:tasks.workunit.client.0.smithi060.stdout:6/213: dread d3/d12/d16/d25/f28 [0,4194304] 0 2024-09-21T10:40:51.893 INFO:tasks.workunit.client.1.smithi112.stdout:8/707: rename d8/d9/dd/dab/f9f to d8/d9/dd/fd1 0 2024-09-21T10:40:51.893 INFO:tasks.workunit.client.1.smithi112.stdout:8/708: write d8/d9/dd/f9c [980525,77542] 0 2024-09-21T10:40:51.895 INFO:tasks.workunit.client.0.smithi060.stdout:6/214: symlink d3/d12/d16/d25/l3d 0 2024-09-21T10:40:51.895 INFO:tasks.workunit.client.0.smithi060.stdout:6/215: chown d3/d12/d38 523330227 1 2024-09-21T10:40:51.897 INFO:tasks.workunit.client.1.smithi112.stdout:1/846: link d8/d1a/db8/fc4 d8/d1a/d31/d66/df5/f108 0 2024-09-21T10:40:51.897 INFO:tasks.workunit.client.1.smithi112.stdout:1/847: stat d8/f40 0 2024-09-21T10:40:51.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/712: dwrite de/d33/d2f/dcf/fa0 [0,4194304] 0 2024-09-21T10:40:51.898 INFO:tasks.workunit.client.1.smithi112.stdout:4/713: fdatasync de/d33/d6f/d9c/f49 0 2024-09-21T10:40:51.898 INFO:tasks.workunit.client.1.smithi112.stdout:9/764: dwrite d1/d2/d27/d3a/d6b/d30/fd3 [0,4194304] 0 2024-09-21T10:40:51.899 INFO:tasks.workunit.client.0.smithi060.stdout:5/56: rename d5/da to d5/d9/d13 0 2024-09-21T10:40:51.899 INFO:tasks.workunit.client.0.smithi060.stdout:5/57: readlink d5/d9/d13/l12 0 2024-09-21T10:40:51.901 INFO:tasks.workunit.client.1.smithi112.stdout:3/694: read d2/d2f/d3f/ddf/f5e [1479143,54004] 0 2024-09-21T10:40:51.901 INFO:tasks.workunit.client.1.smithi112.stdout:6/736: dwrite d4/d6/da/d11/d1f/d22/d100/f85 [0,4194304] 0 2024-09-21T10:40:51.902 INFO:tasks.workunit.client.0.smithi060.stdout:6/216: rename d3/dd/f36 to d3/d12/d16/d25/f3e 0 2024-09-21T10:40:51.904 INFO:tasks.workunit.client.1.smithi112.stdout:8/709: creat d8/d9/dd/dab/d8e/fd2 x:0 0 0 2024-09-21T10:40:51.904 INFO:tasks.workunit.client.1.smithi112.stdout:8/710: fsync d8/d9/dd/d1a/f26 0 2024-09-21T10:40:51.907 INFO:tasks.workunit.client.0.smithi060.stdout:5/58: truncate d5/d9/fe 1423807 0 2024-09-21T10:40:51.907 INFO:tasks.workunit.client.0.smithi060.stdout:5/59: write d5/f8 [2227873,53214] 0 2024-09-21T10:40:51.908 INFO:tasks.workunit.client.1.smithi112.stdout:4/714: write de/d33/d2f/d71/d40/f5a [4083169,69887] 0 2024-09-21T10:40:51.909 INFO:tasks.workunit.client.1.smithi112.stdout:4/715: dread - de/d2a/dbf/d82/f87 zero size 2024-09-21T10:40:51.909 INFO:tasks.workunit.client.0.smithi060.stdout:1/81: rmdir d6/d8 39 2024-09-21T10:40:51.909 INFO:tasks.workunit.client.0.smithi060.stdout:1/82: truncate d6/d8/da/db/f10 366510 0 2024-09-21T10:40:51.911 INFO:tasks.workunit.client.1.smithi112.stdout:6/737: dread d4/d6/d75/d7a/fb3 [0,4194304] 0 2024-09-21T10:40:51.912 INFO:tasks.workunit.client.0.smithi060.stdout:5/60: mknod d5/d9/d10/c14 0 2024-09-21T10:40:51.913 INFO:tasks.workunit.client.0.smithi060.stdout:6/217: dread d3/fb [0,4194304] 0 2024-09-21T10:40:51.915 INFO:tasks.workunit.client.0.smithi060.stdout:4/118: dwrite d0/d5/d12/d15/f18 [0,4194304] 0 2024-09-21T10:40:51.916 INFO:tasks.workunit.client.1.smithi112.stdout:1/848: dwrite d8/d1a/fec [0,4194304] 0 2024-09-21T10:40:51.916 INFO:tasks.workunit.client.0.smithi060.stdout:1/83: creat d6/d8/da/db/de/f18 x:0 0 0 2024-09-21T10:40:51.918 INFO:tasks.workunit.client.1.smithi112.stdout:9/765: mkdir d1/d2/d27/d37/d3b/dec/d107 0 2024-09-21T10:40:51.922 INFO:tasks.workunit.client.0.smithi060.stdout:2/52: sync 2024-09-21T10:40:51.922 INFO:tasks.workunit.client.0.smithi060.stdout:4/119: write d0/d5/d12/d16/f1d [6473576,71682] 0 2024-09-21T10:40:51.922 INFO:tasks.workunit.client.0.smithi060.stdout:2/53: chown d3/d7/c9 979 1 2024-09-21T10:40:51.927 INFO:tasks.workunit.client.1.smithi112.stdout:4/716: rename de/d33/d6f/d9c/d3e/l41 to de/d33/d2f/d71/d40/d4f/lef 0 2024-09-21T10:40:51.930 INFO:tasks.workunit.client.1.smithi112.stdout:8/711: dwrite d8/d9/f25 [4194304,4194304] 0 2024-09-21T10:40:51.931 INFO:tasks.workunit.client.0.smithi060.stdout:6/218: dread d3/f26 [0,4194304] 0 2024-09-21T10:40:51.931 INFO:tasks.workunit.client.0.smithi060.stdout:4/120: link d0/d5/d12/d16/f1d d0/d5/d12/d26/f2b 0 2024-09-21T10:40:51.934 INFO:tasks.workunit.client.1.smithi112.stdout:9/766: mknod d1/d2/d42/c108 0 2024-09-21T10:40:51.936 INFO:tasks.workunit.client.0.smithi060.stdout:6/219: link d3/d12/d16/d1a/c1f d3/d12/d16/d1a/d21/c3f 0 2024-09-21T10:40:51.936 INFO:tasks.workunit.client.0.smithi060.stdout:6/220: creat d3/d12/d16/f40 x:0 0 0 2024-09-21T10:40:51.938 INFO:tasks.workunit.client.0.smithi060.stdout:4/121: write d0/d5/f10 [815471,122765] 0 2024-09-21T10:40:51.938 INFO:tasks.workunit.client.0.smithi060.stdout:4/122: readlink d0/d5/d12/l25 0 2024-09-21T10:40:51.938 INFO:tasks.workunit.client.0.smithi060.stdout:1/84: dwrite d6/d8/da/db/dd/f14 [0,4194304] 0 2024-09-21T10:40:51.939 INFO:tasks.workunit.client.0.smithi060.stdout:2/54: mkdir d3/db 0 2024-09-21T10:40:51.939 INFO:tasks.workunit.client.0.smithi060.stdout:2/55: fsync d3/f5 0 2024-09-21T10:40:51.942 INFO:tasks.workunit.client.1.smithi112.stdout:4/717: rename f5 to de/d18/d6d/ff0 0 2024-09-21T10:40:51.942 INFO:tasks.workunit.client.1.smithi112.stdout:4/718: chown de/d33/d2f/d71 405511 1 2024-09-21T10:40:51.943 INFO:tasks.workunit.client.0.smithi060.stdout:6/221: dread d3/d12/d16/d25/f28 [0,4194304] 0 2024-09-21T10:40:51.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/85: mknod d6/d8/da/db/c19 0 2024-09-21T10:40:51.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/86: creat d6/d8/da/db/de/f1a x:0 0 0 2024-09-21T10:40:51.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/87: write d6/d8/da/db/de/f18 [369516,79152] 0 2024-09-21T10:40:51.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/88: write d6/d8/fc [3235538,46917] 0 2024-09-21T10:40:51.945 INFO:tasks.workunit.client.0.smithi060.stdout:1/89: stat d6/d8/da/db/dd 0 2024-09-21T10:40:51.946 INFO:tasks.workunit.client.1.smithi112.stdout:3/695: getdents d2/d2f/d3f 0 2024-09-21T10:40:51.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:51 smithi060 ceph-mon[28215]: pgmap v12: 65 pgs: 65 active+clean; 1.4 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 154 MiB/s rd, 195 MiB/s wr, 823 op/s 2024-09-21T10:40:51.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:51 smithi112 ceph-mon[35117]: pgmap v12: 65 pgs: 65 active+clean; 1.4 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 154 MiB/s rd, 195 MiB/s wr, 823 op/s 2024-09-21T10:40:51.950 INFO:tasks.workunit.client.1.smithi112.stdout:6/738: rename d4/d6/da/f47 to d4/d6/da/f105 0 2024-09-21T10:40:51.950 INFO:tasks.workunit.client.1.smithi112.stdout:6/739: fdatasync d4/d6/da/d14/d49/fad 0 2024-09-21T10:40:51.952 INFO:tasks.workunit.client.0.smithi060.stdout:6/222: dread d3/fb [0,4194304] 0 2024-09-21T10:40:51.953 INFO:tasks.workunit.client.0.smithi060.stdout:2/56: rename d3/db to d3/d7/dc 0 2024-09-21T10:40:51.954 INFO:tasks.workunit.client.0.smithi060.stdout:2/57: write d3/f5 [656496,36368] 0 2024-09-21T10:40:51.956 INFO:tasks.workunit.client.1.smithi112.stdout:9/767: creat d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101/f109 x:0 0 0 2024-09-21T10:40:51.956 INFO:tasks.workunit.client.1.smithi112.stdout:9/768: chown d1/d2/d27/d3a/l2b 215333589 1 2024-09-21T10:40:51.957 INFO:tasks.workunit.client.0.smithi060.stdout:4/123: dwrite d0/d5/fe [0,4194304] 0 2024-09-21T10:40:51.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/712: rename d8/d9/d3c/d6d/lb3 to d8/d9/dd/dab/d8e/dcb/d82/dcc/ld3 0 2024-09-21T10:40:51.960 INFO:tasks.workunit.client.1.smithi112.stdout:8/713: chown d8/d18/fb4 17 1 2024-09-21T10:40:51.963 INFO:tasks.workunit.client.1.smithi112.stdout:6/740: creat d4/d6/da/d11/d1f/d22/d100/f106 x:0 0 0 2024-09-21T10:40:51.965 INFO:tasks.workunit.client.1.smithi112.stdout:9/769: truncate d1/d2/d27/d3a/d6b/f1f 1011756 0 2024-09-21T10:40:51.965 INFO:tasks.workunit.client.1.smithi112.stdout:4/719: dwrite de/d18/d6d/fdd [0,4194304] 0 2024-09-21T10:40:51.966 INFO:tasks.workunit.client.1.smithi112.stdout:3/696: dwrite d2/d2f/d3f/f89 [0,4194304] 0 2024-09-21T10:40:51.967 INFO:tasks.workunit.client.1.smithi112.stdout:8/714: mkdir d8/d9/dd/d1a/dd4 0 2024-09-21T10:40:51.967 INFO:tasks.workunit.client.1.smithi112.stdout:8/715: dread - d8/d9/dd/dab/d8e/dcb/fc9 zero size 2024-09-21T10:40:51.969 INFO:tasks.workunit.client.0.smithi060.stdout:6/223: mkdir d3/d12/d38/d41 0 2024-09-21T10:40:51.970 INFO:tasks.workunit.client.1.smithi112.stdout:4/720: dread de/d33/d2f/dcf/dc2/fa7 [0,4194304] 0 2024-09-21T10:40:51.970 INFO:tasks.workunit.client.1.smithi112.stdout:4/721: chown de/l16 1714006 1 2024-09-21T10:40:51.970 INFO:tasks.workunit.client.1.smithi112.stdout:4/722: chown de/d18/f26 7 1 2024-09-21T10:40:51.971 INFO:tasks.workunit.client.1.smithi112.stdout:9/770: truncate d1/d2/d27/d3a/d6b/d30/f54 2813236 0 2024-09-21T10:40:51.974 INFO:tasks.workunit.client.1.smithi112.stdout:6/741: dread d4/dc/d1a/d31/d56/f72 [0,4194304] 0 2024-09-21T10:40:51.975 INFO:tasks.workunit.client.0.smithi060.stdout:6/224: dread d3/d12/d16/d25/f28 [0,4194304] 0 2024-09-21T10:40:51.975 INFO:tasks.workunit.client.0.smithi060.stdout:2/58: creat d3/d7/fd x:0 0 0 2024-09-21T10:40:51.977 INFO:tasks.workunit.client.0.smithi060.stdout:6/225: dread d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:40:51.977 INFO:tasks.workunit.client.0.smithi060.stdout:6/226: fsync d3/d12/d38/f3a 0 2024-09-21T10:40:51.978 INFO:tasks.workunit.client.1.smithi112.stdout:0/746: sync 2024-09-21T10:40:51.979 INFO:tasks.workunit.client.0.smithi060.stdout:2/59: rename d3/d7/c9 to d3/d7/dc/ce 0 2024-09-21T10:40:51.981 INFO:tasks.workunit.client.0.smithi060.stdout:4/124: dwrite d0/d5/d12/f19 [0,4194304] 0 2024-09-21T10:40:51.987 INFO:tasks.workunit.client.0.smithi060.stdout:4/125: dread d0/d5/d12/d15/f18 [0,4194304] 0 2024-09-21T10:40:51.987 INFO:tasks.workunit.client.0.smithi060.stdout:4/126: write d0/d5/f1a [815679,53860] 0 2024-09-21T10:40:51.987 INFO:tasks.workunit.client.0.smithi060.stdout:4/127: truncate d0/d5/d12/d20/f22 988675 0 2024-09-21T10:40:51.987 INFO:tasks.workunit.client.0.smithi060.stdout:4/128: write d0/f6 [78183,11117] 0 2024-09-21T10:40:51.991 INFO:tasks.workunit.client.0.smithi060.stdout:6/227: link d3/d12/d16/d22/l35 d3/d12/d38/d41/l42 0 2024-09-21T10:40:51.992 INFO:tasks.workunit.client.1.smithi112.stdout:4/723: dwrite de/d2a/dbf/d82/fe5 [0,4194304] 0 2024-09-21T10:40:51.992 INFO:tasks.workunit.client.1.smithi112.stdout:4/724: chown de/d2a/dbf/fe4 678625635 1 2024-09-21T10:40:51.993 INFO:tasks.workunit.client.0.smithi060.stdout:2/60: symlink d3/lf 0 2024-09-21T10:40:51.993 INFO:tasks.workunit.client.0.smithi060.stdout:2/61: dread - d3/d7/fd zero size 2024-09-21T10:40:51.994 INFO:tasks.workunit.client.1.smithi112.stdout:9/771: dwrite d1/f36 [0,4194304] 0 2024-09-21T10:40:51.994 INFO:tasks.workunit.client.1.smithi112.stdout:3/697: link d2/d2f/lbb d2/d2f/dc5/dcc/lee 0 2024-09-21T10:40:51.996 INFO:tasks.workunit.client.1.smithi112.stdout:8/716: mkdir d8/dd5 0 2024-09-21T10:40:51.997 INFO:tasks.workunit.client.0.smithi060.stdout:6/228: mknod d3/dd/c43 0 2024-09-21T10:40:51.998 INFO:tasks.workunit.client.0.smithi060.stdout:4/129: dread d0/d5/fe [0,4194304] 0 2024-09-21T10:40:51.999 INFO:tasks.workunit.client.1.smithi112.stdout:8/717: dread d8/d9/dd/d1a/f67 [0,4194304] 0 2024-09-21T10:40:51.999 INFO:tasks.workunit.client.1.smithi112.stdout:6/742: rmdir d4/d6/da/d14/d49/d62/dcf 39 2024-09-21T10:40:51.999 INFO:tasks.workunit.client.1.smithi112.stdout:6/743: readlink d4/d6/da/l2b 0 2024-09-21T10:40:52.001 INFO:tasks.workunit.client.1.smithi112.stdout:0/747: creat d3/d4a/d4e/d72/ff8 x:0 0 0 2024-09-21T10:40:52.002 INFO:tasks.workunit.client.0.smithi060.stdout:2/62: mknod d3/c10 0 2024-09-21T10:40:52.003 INFO:tasks.workunit.client.0.smithi060.stdout:2/63: write d3/d7/fd [702469,40921] 0 2024-09-21T10:40:52.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/725: creat de/d33/d2f/d35/ff1 x:0 0 0 2024-09-21T10:40:52.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/726: fdatasync de/f15 0 2024-09-21T10:40:52.006 INFO:tasks.workunit.client.0.smithi060.stdout:4/130: dread d0/d5/f1a [0,4194304] 0 2024-09-21T10:40:52.007 INFO:tasks.workunit.client.0.smithi060.stdout:2/64: creat d3/d7/dc/f11 x:0 0 0 2024-09-21T10:40:52.007 INFO:tasks.workunit.client.0.smithi060.stdout:2/65: chown f2 71839741 1 2024-09-21T10:40:52.010 INFO:tasks.workunit.client.0.smithi060.stdout:6/229: write d3/f30 [1095335,128391] 0 2024-09-21T10:40:52.010 INFO:tasks.workunit.client.1.smithi112.stdout:9/772: mknod d1/d2/d27/d3a/d6b/c10a 0 2024-09-21T10:40:52.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/660: sync 2024-09-21T10:40:52.011 INFO:tasks.workunit.client.1.smithi112.stdout:5/754: sync 2024-09-21T10:40:52.011 INFO:tasks.workunit.client.1.smithi112.stdout:7/661: fsync d7/d22/d41/f84 0 2024-09-21T10:40:52.012 INFO:tasks.workunit.client.1.smithi112.stdout:8/718: mkdir d8/d9/dd/d2b/d31/d46/dd6 0 2024-09-21T10:40:52.014 INFO:tasks.workunit.client.1.smithi112.stdout:3/698: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/f80 [0,4194304] 0 2024-09-21T10:40:52.014 INFO:tasks.workunit.client.1.smithi112.stdout:6/744: creat d4/dc/d1a/f107 x:0 0 0 2024-09-21T10:40:52.016 INFO:tasks.workunit.client.1.smithi112.stdout:0/748: mkdir d3/d18/d52/df9 0 2024-09-21T10:40:52.018 INFO:tasks.workunit.client.0.smithi060.stdout:4/131: dread d0/fc [4194304,4194304] 0 2024-09-21T10:40:52.018 INFO:tasks.workunit.client.1.smithi112.stdout:9/773: truncate d1/d2/d27/d3a/d6b/d30/fce 143772 0 2024-09-21T10:40:52.021 INFO:tasks.workunit.client.1.smithi112.stdout:5/755: creat d9/d15/d18/d3a/fe7 x:0 0 0 2024-09-21T10:40:52.021 INFO:tasks.workunit.client.1.smithi112.stdout:5/756: stat d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1/fae 0 2024-09-21T10:40:52.023 INFO:tasks.workunit.client.1.smithi112.stdout:7/662: mknod d7/d22/d73/cd5 0 2024-09-21T10:40:52.024 INFO:tasks.workunit.client.1.smithi112.stdout:2/614: sync 2024-09-21T10:40:52.024 INFO:tasks.workunit.client.1.smithi112.stdout:2/615: write d0/d12/d46/da0/db9/dbd/d62/d63/f22 [4585186,108876] 0 2024-09-21T10:40:52.024 INFO:tasks.workunit.client.1.smithi112.stdout:2/616: chown d0/dd/d47/fc3 6 1 2024-09-21T10:40:52.025 INFO:tasks.workunit.client.1.smithi112.stdout:1/849: sync 2024-09-21T10:40:52.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/719: getdents d8/d9/dd 0 2024-09-21T10:40:52.026 INFO:tasks.workunit.client.1.smithi112.stdout:8/720: fsync d8/d9/dd/d2a/d43/f66 0 2024-09-21T10:40:52.031 INFO:tasks.workunit.client.1.smithi112.stdout:6/745: mknod d4/dc/d1a/d31/d56/d64/c108 0 2024-09-21T10:40:52.032 INFO:tasks.workunit.client.0.smithi060.stdout:2/66: creat d3/f12 x:0 0 0 2024-09-21T10:40:52.033 INFO:tasks.workunit.client.1.smithi112.stdout:5/757: dread d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:52.033 INFO:tasks.workunit.client.1.smithi112.stdout:0/749: rmdir d3/d18/d52/d55 39 2024-09-21T10:40:52.033 INFO:tasks.workunit.client.1.smithi112.stdout:0/750: creat d3/ffa x:0 0 0 2024-09-21T10:40:52.034 INFO:tasks.workunit.client.1.smithi112.stdout:2/617: dread d0/f2d [0,4194304] 0 2024-09-21T10:40:52.036 INFO:tasks.workunit.client.1.smithi112.stdout:1/850: dread d8/f24 [0,4194304] 0 2024-09-21T10:40:52.036 INFO:tasks.workunit.client.1.smithi112.stdout:1/851: stat d8 0 2024-09-21T10:40:52.036 INFO:tasks.workunit.client.1.smithi112.stdout:1/852: fsync d8/d1a/f9f 0 2024-09-21T10:40:52.037 INFO:tasks.workunit.client.1.smithi112.stdout:1/853: truncate d8/d1a/d53/fc9 67812 0 2024-09-21T10:40:52.037 INFO:tasks.workunit.client.1.smithi112.stdout:1/854: chown d8/d1a/c95 70 1 2024-09-21T10:40:52.037 INFO:tasks.workunit.client.1.smithi112.stdout:7/663: creat d7/d22/d41/d56/fd6 x:0 0 0 2024-09-21T10:40:52.037 INFO:tasks.workunit.client.1.smithi112.stdout:7/664: truncate d7/dbc/fcb 239614 0 2024-09-21T10:40:52.037 INFO:tasks.workunit.client.0.smithi060.stdout:6/230: creat d3/d12/d38/d41/f44 x:0 0 0 2024-09-21T10:40:52.037 INFO:tasks.workunit.client.0.smithi060.stdout:6/231: fsync d3/d12/d16/d25/f3e 0 2024-09-21T10:40:52.038 INFO:tasks.workunit.client.1.smithi112.stdout:4/727: dwrite de/d33/f38 [0,4194304] 0 2024-09-21T10:40:52.038 INFO:tasks.workunit.client.1.smithi112.stdout:4/728: write de/d33/d2f/d71/fa1 [571414,106328] 0 2024-09-21T10:40:52.038 INFO:tasks.workunit.client.1.smithi112.stdout:4/729: chown de/d33/d2f/d71/d40/f72 52414126 1 2024-09-21T10:40:52.039 INFO:tasks.workunit.client.0.smithi060.stdout:4/132: unlink d0/d5/d12/d15/f18 0 2024-09-21T10:40:52.040 INFO:tasks.workunit.client.1.smithi112.stdout:8/721: rmdir d8/d9/dd/d2b/d31/d46/dd6 0 2024-09-21T10:40:52.040 INFO:tasks.workunit.client.1.smithi112.stdout:8/722: chown d8/d9/dd/d2b/d31/fa7 81 1 2024-09-21T10:40:52.040 INFO:tasks.workunit.client.1.smithi112.stdout:9/774: dwrite d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101/f109 [0,4194304] 0 2024-09-21T10:40:52.041 INFO:tasks.workunit.client.0.smithi060.stdout:6/232: creat d3/d12/d16/d25/f45 x:0 0 0 2024-09-21T10:40:52.044 INFO:tasks.workunit.client.1.smithi112.stdout:6/746: unlink d4/d6/da/d14/d49/d73/d74/fd4 0 2024-09-21T10:40:52.045 INFO:tasks.workunit.client.0.smithi060.stdout:4/133: creat d0/d5/d12/d15/f2c x:0 0 0 2024-09-21T10:40:52.045 INFO:tasks.workunit.client.0.smithi060.stdout:4/134: fdatasync d0/d5/d12/d20/f22 0 2024-09-21T10:40:52.047 INFO:tasks.workunit.client.1.smithi112.stdout:5/758: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/le8 0 2024-09-21T10:40:52.052 INFO:tasks.workunit.client.0.smithi060.stdout:6/233: getdents d3/d12 0 2024-09-21T10:40:52.052 INFO:tasks.workunit.client.0.smithi060.stdout:6/234: creat d3/d12/d38/d41/f46 x:0 0 0 2024-09-21T10:40:52.055 INFO:tasks.workunit.client.1.smithi112.stdout:2/618: mkdir d0/da4/dc5 0 2024-09-21T10:40:52.057 INFO:tasks.workunit.client.0.smithi060.stdout:4/135: dread d0/d5/d12/f19 [0,4194304] 0 2024-09-21T10:40:52.058 INFO:tasks.workunit.client.1.smithi112.stdout:1/855: getdents d8/d54/d6d/db5/dc2/de6 0 2024-09-21T10:40:52.058 INFO:tasks.workunit.client.1.smithi112.stdout:1/856: chown d8/d1a/d31/d37/f5e 2001260 1 2024-09-21T10:40:52.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/723: dwrite d8/d9/dd/d76/d97/fa8 [0,4194304] 0 2024-09-21T10:40:52.058 INFO:tasks.workunit.client.1.smithi112.stdout:8/724: stat d8/d9/dd/d2b/d31/d46/d86 0 2024-09-21T10:40:52.058 INFO:tasks.workunit.client.0.smithi060.stdout:6/235: mknod d3/d12/d38/c47 0 2024-09-21T10:40:52.059 INFO:tasks.workunit.client.1.smithi112.stdout:7/665: truncate d7/f14 7432526 0 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:0/91: sync 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:7/98: sync 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:9/99: sync 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:0/92: chown d5/d10/ld 234225 1 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:0/93: stat d5/d10/d11 0 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:0/94: read d5/d10/da/fb [1468002,41559] 0 2024-09-21T10:40:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:0/95: write d5/d10/da/f12 [1363266,89951] 0 2024-09-21T10:40:52.062 INFO:tasks.workunit.client.1.smithi112.stdout:4/730: unlink de/d33/c59 0 2024-09-21T10:40:52.062 INFO:tasks.workunit.client.1.smithi112.stdout:8/725: dread d8/d9/dd/dab/d8e/dcb/d82/f87 [0,4194304] 0 2024-09-21T10:40:52.063 INFO:tasks.workunit.client.1.smithi112.stdout:5/759: dwrite d9/f1b [0,4194304] 0 2024-09-21T10:40:52.064 INFO:tasks.workunit.client.0.smithi060.stdout:7/99: symlink da/d14/l20 0 2024-09-21T10:40:52.067 INFO:tasks.workunit.client.0.smithi060.stdout:4/136: dread d0/f4 [4194304,4194304] 0 2024-09-21T10:40:52.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/619: write d0/d12/d46/da0/db9/dbd/d62/d63/f35 [4003900,102472] 0 2024-09-21T10:40:52.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/620: chown d0/dd/c32 23632 1 2024-09-21T10:40:52.069 INFO:tasks.workunit.client.1.smithi112.stdout:2/621: creat d0/d12/d46/da0/db9/dbd/d62/d89/fc6 x:0 0 0 2024-09-21T10:40:52.071 INFO:tasks.workunit.client.0.smithi060.stdout:0/96: mkdir d5/d10/da/d15/d17 0 2024-09-21T10:40:52.074 INFO:tasks.workunit.client.1.smithi112.stdout:9/775: creat d1/d2/d27/d37/d3b/dec/f10b x:0 0 0 2024-09-21T10:40:52.074 INFO:tasks.workunit.client.0.smithi060.stdout:4/137: link d0/f4 d0/d5/d12/d16/d28/f2d 0 2024-09-21T10:40:52.074 INFO:tasks.workunit.client.1.smithi112.stdout:5/760: write d9/d15/d18/d3a/f5b [3309309,76724] 0 2024-09-21T10:40:52.076 INFO:tasks.workunit.client.1.smithi112.stdout:6/747: getdents d4/dc/d1a/d31/d56/d64/d9b/de2 0 2024-09-21T10:40:52.078 INFO:tasks.workunit.client.0.smithi060.stdout:7/100: dread f6 [0,4194304] 0 2024-09-21T10:40:52.079 INFO:tasks.workunit.client.0.smithi060.stdout:0/97: unlink l4 0 2024-09-21T10:40:52.081 INFO:tasks.workunit.client.1.smithi112.stdout:1/857: mkdir d8/d1a/d53/d57/d83/d109 0 2024-09-21T10:40:52.084 INFO:tasks.workunit.client.1.smithi112.stdout:7/666: unlink d7/d22/d41/d80/c8c 0 2024-09-21T10:40:52.086 INFO:tasks.workunit.client.0.smithi060.stdout:7/101: dread da/fc [0,4194304] 0 2024-09-21T10:40:52.086 INFO:tasks.workunit.client.0.smithi060.stdout:7/102: truncate da/d14/d15/ff 915457 0 2024-09-21T10:40:52.087 INFO:tasks.workunit.client.0.smithi060.stdout:0/98: mknod d5/d10/d11/c18 0 2024-09-21T10:40:52.087 INFO:tasks.workunit.client.0.smithi060.stdout:0/99: chown f0 6775433 1 2024-09-21T10:40:52.087 INFO:tasks.workunit.client.0.smithi060.stdout:0/100: write d5/d10/da/fc [520217,31632] 0 2024-09-21T10:40:52.088 INFO:tasks.workunit.client.1.smithi112.stdout:6/748: dread d4/dc/d1a/d31/f71 [0,4194304] 0 2024-09-21T10:40:52.088 INFO:tasks.workunit.client.1.smithi112.stdout:4/731: mknod de/d33/d2f/dcf/cf2 0 2024-09-21T10:40:52.088 INFO:tasks.workunit.client.1.smithi112.stdout:4/732: truncate de/d33/d2f/d35/d4c/d5c/fe9 364693 0 2024-09-21T10:40:52.090 INFO:tasks.workunit.client.1.smithi112.stdout:8/726: unlink d8/d9/dd/d2b/l3a 0 2024-09-21T10:40:52.091 INFO:tasks.workunit.client.0.smithi060.stdout:9/100: dwrite d3/d16/f1c [0,4194304] 0 2024-09-21T10:40:52.091 INFO:tasks.workunit.client.0.smithi060.stdout:6/236: dwrite d3/d12/d38/d41/f46 [0,4194304] 0 2024-09-21T10:40:52.095 INFO:tasks.workunit.client.1.smithi112.stdout:7/667: read d7/d22/f28 [654702,77495] 0 2024-09-21T10:40:52.099 INFO:tasks.workunit.client.0.smithi060.stdout:0/101: write f0 [1585764,80962] 0 2024-09-21T10:40:52.107 INFO:tasks.workunit.client.1.smithi112.stdout:9/776: dwrite d1/d2/d27/d3a/d6b/d30/d5c/d7c/ffd [0,4194304] 0 2024-09-21T10:40:52.108 INFO:tasks.workunit.client.0.smithi060.stdout:0/102: creat d5/d10/da/d16/f19 x:0 0 0 2024-09-21T10:40:52.110 INFO:tasks.workunit.client.0.smithi060.stdout:9/101: getdents d3/d16/d20 0 2024-09-21T10:40:52.111 INFO:tasks.workunit.client.0.smithi060.stdout:4/138: dwrite d0/d5/f1a [0,4194304] 0 2024-09-21T10:40:52.111 INFO:tasks.workunit.client.0.smithi060.stdout:4/139: stat d0/d5/d12/d15/f2c 0 2024-09-21T10:40:52.113 INFO:tasks.workunit.client.1.smithi112.stdout:7/668: dwrite d7/d3d/f67 [4194304,4194304] 0 2024-09-21T10:40:52.115 INFO:tasks.workunit.client.0.smithi060.stdout:7/103: dwrite da/d14/d15/f18 [0,4194304] 0 2024-09-21T10:40:52.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/237: dwrite d3/d12/d16/f40 [0,4194304] 0 2024-09-21T10:40:52.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/238: chown d3/d12/d16/d1a/d21 6776959 1 2024-09-21T10:40:52.117 INFO:tasks.workunit.client.1.smithi112.stdout:1/858: unlink d8/d45/la0 0 2024-09-21T10:40:52.117 INFO:tasks.workunit.client.1.smithi112.stdout:1/859: stat d8/d45/c6a 0 2024-09-21T10:40:52.122 INFO:tasks.workunit.client.0.smithi060.stdout:4/140: rmdir d0/d1c 0 2024-09-21T10:40:52.125 INFO:tasks.workunit.client.0.smithi060.stdout:9/102: dwrite d3/fe [0,4194304] 0 2024-09-21T10:40:52.125 INFO:tasks.workunit.client.0.smithi060.stdout:9/103: chown d3/d15/f22 470009 1 2024-09-21T10:40:52.127 INFO:tasks.workunit.client.0.smithi060.stdout:9/104: dread d3/ff [0,4194304] 0 2024-09-21T10:40:52.127 INFO:tasks.workunit.client.0.smithi060.stdout:9/105: chown d3/c24 18 1 2024-09-21T10:40:52.131 INFO:tasks.workunit.client.0.smithi060.stdout:7/104: symlink da/d14/d15/d16/d1e/l21 0 2024-09-21T10:40:52.131 INFO:tasks.workunit.client.0.smithi060.stdout:7/105: creat da/d14/d15/d16/f22 x:0 0 0 2024-09-21T10:40:52.133 INFO:tasks.workunit.client.1.smithi112.stdout:9/777: unlink d1/d2/d27/d3a/fe6 0 2024-09-21T10:40:52.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/778: chown d1/d2/d27/d3a/d6b/d30/d5e/l96 2467674 1 2024-09-21T10:40:52.134 INFO:tasks.workunit.client.1.smithi112.stdout:9/779: readlink d1/d2/d27/d3a/l31 0 2024-09-21T10:40:52.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/622: getdents d0/d12/d46/d86 0 2024-09-21T10:40:52.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/623: chown d0/d12/d46/da0/db9/dbd/d62/d63/lb4 3612 1 2024-09-21T10:40:52.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/624: chown d0/d12/d6c 323607 1 2024-09-21T10:40:52.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/625: write d0/d12/f39 [1321979,34846] 0 2024-09-21T10:40:52.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/626: dread - d0/d12/d6c/d7e/d8f/d51/d57/fb2 zero size 2024-09-21T10:40:52.137 INFO:tasks.workunit.client.1.smithi112.stdout:2/627: fdatasync d0/dd/f61 0 2024-09-21T10:40:52.138 INFO:tasks.workunit.client.1.smithi112.stdout:2/628: read d0/f90 [183547,32050] 0 2024-09-21T10:40:52.138 INFO:tasks.workunit.client.0.smithi060.stdout:4/141: rename d0/df/c1f to d0/d5/d12/c2e 0 2024-09-21T10:40:52.138 INFO:tasks.workunit.client.1.smithi112.stdout:7/669: stat d7/d22/d41/d54/cc8 0 2024-09-21T10:40:52.138 INFO:tasks.workunit.client.1.smithi112.stdout:1/860: symlink d8/d1a/d31/da1/dc3/l10a 0 2024-09-21T10:40:52.140 INFO:tasks.workunit.client.1.smithi112.stdout:6/749: rmdir d4/d6/d9c/dce 39 2024-09-21T10:40:52.141 INFO:tasks.workunit.client.0.smithi060.stdout:7/106: rename f1 to da/d14/d15/d16/d1e/f23 0 2024-09-21T10:40:52.144 INFO:tasks.workunit.client.1.smithi112.stdout:9/780: mkdir d1/d2/d27/d37/d3b/dec/d107/d10c 0 2024-09-21T10:40:52.147 INFO:tasks.workunit.client.0.smithi060.stdout:7/107: rename da/d14/d15/d16/f22 to da/f24 0 2024-09-21T10:40:52.147 INFO:tasks.workunit.client.1.smithi112.stdout:7/670: dread d7/f71 [0,4194304] 0 2024-09-21T10:40:52.147 INFO:tasks.workunit.client.1.smithi112.stdout:2/629: symlink d0/d12/lc7 0 2024-09-21T10:40:52.148 INFO:tasks.workunit.client.0.smithi060.stdout:0/103: truncate d5/d10/da/fc 254472 0 2024-09-21T10:40:52.148 INFO:tasks.workunit.client.0.smithi060.stdout:0/104: chown d5/d10/f8 15 1 2024-09-21T10:40:52.151 INFO:tasks.workunit.client.1.smithi112.stdout:1/861: mkdir d8/d54/db0/d10b 0 2024-09-21T10:40:52.151 INFO:tasks.workunit.client.1.smithi112.stdout:1/862: stat d8/d1a/d53/d57/fdc 0 2024-09-21T10:40:52.152 INFO:tasks.workunit.client.1.smithi112.stdout:1/863: readlink d8/d1a/l84 0 2024-09-21T10:40:52.152 INFO:tasks.workunit.client.1.smithi112.stdout:1/864: write d8/d54/db0/db1/fd4 [968388,32254] 0 2024-09-21T10:40:52.152 INFO:tasks.workunit.client.1.smithi112.stdout:1/865: write d8/d1a/d53/d57/fcb [1016347,45130] 0 2024-09-21T10:40:52.153 INFO:tasks.workunit.client.0.smithi060.stdout:7/108: mkdir da/d14/d25 0 2024-09-21T10:40:52.153 INFO:tasks.workunit.client.0.smithi060.stdout:6/239: dwrite d3/d12/d38/d41/f46 [0,4194304] 0 2024-09-21T10:40:52.153 INFO:tasks.workunit.client.1.smithi112.stdout:3/699: sync 2024-09-21T10:40:52.153 INFO:tasks.workunit.client.1.smithi112.stdout:6/750: creat d4/d6/f109 x:0 0 0 2024-09-21T10:40:52.153 INFO:tasks.workunit.client.1.smithi112.stdout:7/671: getdents d7/d22/d41/d4b/da2 0 2024-09-21T10:40:52.154 INFO:tasks.workunit.client.1.smithi112.stdout:9/781: write d1/d2/f7b [1130209,66336] 0 2024-09-21T10:40:52.154 INFO:tasks.workunit.client.1.smithi112.stdout:9/782: creat d1/d2/d27/d3a/de3/db5/f10d x:0 0 0 2024-09-21T10:40:52.155 INFO:tasks.workunit.client.0.smithi060.stdout:7/109: rename da/lb to da/d14/d25/l26 0 2024-09-21T10:40:52.156 INFO:tasks.workunit.client.0.smithi060.stdout:7/110: dread da/d14/d15/ff [0,4194304] 0 2024-09-21T10:40:52.156 INFO:tasks.workunit.client.1.smithi112.stdout:1/866: truncate d8/fe 1047871 0 2024-09-21T10:40:52.158 INFO:tasks.workunit.client.1.smithi112.stdout:6/751: symlink d4/d6/d75/db7/ded/l10a 0 2024-09-21T10:40:52.158 INFO:tasks.workunit.client.1.smithi112.stdout:6/752: readlink d4/dc/d1a/l81 0 2024-09-21T10:40:52.158 INFO:tasks.workunit.client.1.smithi112.stdout:6/753: write d4/d6/da/f105 [418385,94498] 0 2024-09-21T10:40:52.158 INFO:tasks.workunit.client.1.smithi112.stdout:6/754: truncate d4/dc/d1a/d31/d56/fc5 974823 0 2024-09-21T10:40:52.158 INFO:tasks.workunit.client.1.smithi112.stdout:6/755: dread - d4/d6/d9c/dce/fdf zero size 2024-09-21T10:40:52.160 INFO:tasks.workunit.client.1.smithi112.stdout:1/867: dread d8/d1a/d31/d37/f5e [0,4194304] 0 2024-09-21T10:40:52.160 INFO:tasks.workunit.client.1.smithi112.stdout:1/868: dread - d8/d1a/f9f zero size 2024-09-21T10:40:52.160 INFO:tasks.workunit.client.1.smithi112.stdout:7/672: mknod d7/d22/d41/d56/db7/cd7 0 2024-09-21T10:40:52.163 INFO:tasks.workunit.client.0.smithi060.stdout:6/240: write d3/d12/d16/f40 [439413,9269] 0 2024-09-21T10:40:52.163 INFO:tasks.workunit.client.0.smithi060.stdout:9/106: dwrite d3/fa [0,4194304] 0 2024-09-21T10:40:52.163 INFO:tasks.workunit.client.0.smithi060.stdout:9/107: getdents d3/d16/d1f 0 2024-09-21T10:40:52.166 INFO:tasks.workunit.client.0.smithi060.stdout:4/142: dread d0/d5/d12/f19 [0,4194304] 0 2024-09-21T10:40:52.166 INFO:tasks.workunit.client.0.smithi060.stdout:4/143: chown d0/d5/d12/c2e 7832537 1 2024-09-21T10:40:52.166 INFO:tasks.workunit.client.1.smithi112.stdout:6/756: readlink d4/d6/da/l3d 0 2024-09-21T10:40:52.168 INFO:tasks.workunit.client.0.smithi060.stdout:6/241: creat d3/d12/d16/d22/f48 x:0 0 0 2024-09-21T10:40:52.171 INFO:tasks.workunit.client.1.smithi112.stdout:2/630: dwrite d0/d12/d6c/d7e/d8f/d51/d57/f84 [0,4194304] 0 2024-09-21T10:40:52.172 INFO:tasks.workunit.client.1.smithi112.stdout:7/673: mkdir d7/d22/d41/d56/dc9/dd3/dd8 0 2024-09-21T10:40:52.174 INFO:tasks.workunit.client.0.smithi060.stdout:4/144: rename d0/d5/fe to d0/d5/d12/d20/f2f 0 2024-09-21T10:40:52.177 INFO:tasks.workunit.client.0.smithi060.stdout:6/242: mknod d3/d12/d16/d25/c49 0 2024-09-21T10:40:52.177 INFO:tasks.workunit.client.0.smithi060.stdout:6/243: chown d3/fb 603126725 1 2024-09-21T10:40:52.177 INFO:tasks.workunit.client.0.smithi060.stdout:6/244: readlink d3/d12/d16/d25/l3d 0 2024-09-21T10:40:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:6/245: creat d3/d12/d16/d22/f4a x:0 0 0 2024-09-21T10:40:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:6/246: chown d3/c5 1601053 1 2024-09-21T10:40:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:6/247: stat d3/d12/d16/d1a/d21/f23 0 2024-09-21T10:40:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:6/248: chown d3/dd/le 982120913 1 2024-09-21T10:40:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:6/249: chown d3/d12 233 1 2024-09-21T10:40:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:6/250: read d3/f30 [1675374,120475] 0 2024-09-21T10:40:52.183 INFO:tasks.workunit.client.1.smithi112.stdout:9/783: dwrite d1/f43 [0,4194304] 0 2024-09-21T10:40:52.183 INFO:tasks.workunit.client.1.smithi112.stdout:9/784: fdatasync d1/d2/d27/d37/d3b/d69/d77/dca/dae/fb2 0 2024-09-21T10:40:52.183 INFO:tasks.workunit.client.1.smithi112.stdout:2/631: mkdir d0/d12/d46/d86/dc0/dc8 0 2024-09-21T10:40:52.184 INFO:tasks.workunit.client.0.smithi060.stdout:6/251: creat d3/f4b x:0 0 0 2024-09-21T10:40:52.186 INFO:tasks.workunit.client.1.smithi112.stdout:7/674: write d7/d22/d41/d54/f4e [1276466,31721] 0 2024-09-21T10:40:52.187 INFO:tasks.workunit.client.0.smithi060.stdout:6/252: dread d3/d12/d16/d1a/f1e [0,4194304] 0 2024-09-21T10:40:52.187 INFO:tasks.workunit.client.0.smithi060.stdout:4/145: dread d0/d5/d12/d26/f2b [4194304,4194304] 0 2024-09-21T10:40:52.187 INFO:tasks.workunit.client.0.smithi060.stdout:7/111: dwrite da/f24 [0,4194304] 0 2024-09-21T10:40:52.188 INFO:tasks.workunit.client.1.smithi112.stdout:9/785: rmdir d1/d2/d27/d37/d3b/dec 39 2024-09-21T10:40:52.188 INFO:tasks.workunit.client.1.smithi112.stdout:1/869: dwrite d8/d1a/d53/f104 [0,4194304] 0 2024-09-21T10:40:52.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/253: rename d3/d12/d16/d1a/f32 to d3/d12/d16/d1a/f4c 0 2024-09-21T10:40:52.192 INFO:tasks.workunit.client.1.smithi112.stdout:9/786: creat d1/d2/d27/d37/d3b/d69/d88/f10e x:0 0 0 2024-09-21T10:40:52.199 INFO:tasks.workunit.client.0.smithi060.stdout:7/112: mkdir da/d14/d15/d16/d1e/d27 0 2024-09-21T10:40:52.200 INFO:tasks.workunit.client.0.smithi060.stdout:9/108: truncate d3/fa 3695627 0 2024-09-21T10:40:52.200 INFO:tasks.workunit.client.0.smithi060.stdout:9/109: dread - d3/d15/f22 zero size 2024-09-21T10:40:52.202 INFO:tasks.workunit.client.1.smithi112.stdout:9/787: dread d1/d2/d27/d3a/d6b/fb9 [0,4194304] 0 2024-09-21T10:40:52.206 INFO:tasks.workunit.client.0.smithi060.stdout:7/113: mknod da/c28 0 2024-09-21T10:40:52.208 INFO:tasks.workunit.client.1.smithi112.stdout:1/870: truncate d8/d20/f4a 2190884 0 2024-09-21T10:40:52.208 INFO:tasks.workunit.client.1.smithi112.stdout:6/757: dwrite d4/d6/da/d11/d37/f70 [0,4194304] 0 2024-09-21T10:40:52.209 INFO:tasks.workunit.client.0.smithi060.stdout:7/114: truncate da/d14/d15/d16/f1a 2558209 0 2024-09-21T10:40:52.212 INFO:tasks.workunit.client.1.smithi112.stdout:1/871: creat d8/d1a/d31/d37/f10c x:0 0 0 2024-09-21T10:40:52.212 INFO:tasks.workunit.client.1.smithi112.stdout:1/872: write d8/d1a/d53/d57/f6e [639210,55760] 0 2024-09-21T10:40:52.214 INFO:tasks.workunit.client.1.smithi112.stdout:6/758: symlink d4/d6/da/d11/d37/d8b/da0/l10b 0 2024-09-21T10:40:52.214 INFO:tasks.workunit.client.0.smithi060.stdout:4/146: dwrite d0/d5/d12/d20/f22 [0,4194304] 0 2024-09-21T10:40:52.215 INFO:tasks.workunit.client.1.smithi112.stdout:2/632: dwrite d0/d12/d46/da0/fab [0,4194304] 0 2024-09-21T10:40:52.215 INFO:tasks.workunit.client.1.smithi112.stdout:9/788: dread d1/d7f/f9b [0,4194304] 0 2024-09-21T10:40:52.216 INFO:tasks.workunit.client.1.smithi112.stdout:7/675: rmdir d7/d22/d41/d56/d97 0 2024-09-21T10:40:52.216 INFO:tasks.workunit.client.1.smithi112.stdout:7/676: creat d7/d22/d41/d54/d4d/fd9 x:0 0 0 2024-09-21T10:40:52.228 INFO:tasks.workunit.client.1.smithi112.stdout:6/759: dread d4/dc/d7e/f88 [0,4194304] 0 2024-09-21T10:40:52.228 INFO:tasks.workunit.client.1.smithi112.stdout:6/760: creat d4/d6/f10c x:0 0 0 2024-09-21T10:40:52.228 INFO:tasks.workunit.client.1.smithi112.stdout:6/761: chown d4/d6/da/d14/d49/d62/d96 383418 1 2024-09-21T10:40:52.228 INFO:tasks.workunit.client.0.smithi060.stdout:4/147: dwrite d0/d5/d12/d16/d28/f2d [4194304,4194304] 0 2024-09-21T10:40:52.229 INFO:tasks.workunit.client.0.smithi060.stdout:4/148: chown d0/d5/d12/d15/c1b 27 1 2024-09-21T10:40:52.229 INFO:tasks.workunit.client.0.smithi060.stdout:4/149: stat d0/fc 0 2024-09-21T10:40:52.229 INFO:tasks.workunit.client.1.smithi112.stdout:7/677: rename d7/d22/d78/f7f to d7/d22/d41/d56/d72/dc4/fda 0 2024-09-21T10:40:52.229 INFO:tasks.workunit.client.1.smithi112.stdout:7/678: chown d7/d3d/da7 29905 1 2024-09-21T10:40:52.229 INFO:tasks.workunit.client.1.smithi112.stdout:7/679: write d7/f26 [1639326,128993] 0 2024-09-21T10:40:52.230 INFO:tasks.workunit.client.1.smithi112.stdout:1/873: rmdir d8/d1a/d31/da1/de7 39 2024-09-21T10:40:52.232 INFO:tasks.workunit.client.0.smithi060.stdout:4/150: mkdir d0/d5/d12/d16/d30 0 2024-09-21T10:40:52.232 INFO:tasks.workunit.client.0.smithi060.stdout:9/110: dread d3/fa [0,4194304] 0 2024-09-21T10:40:52.235 INFO:tasks.workunit.client.0.smithi060.stdout:4/151: symlink d0/d5/d12/d16/d28/l31 0 2024-09-21T10:40:52.237 INFO:tasks.workunit.client.1.smithi112.stdout:6/762: write d4/d6/da/fa7 [6436237,113304] 0 2024-09-21T10:40:52.237 INFO:tasks.workunit.client.1.smithi112.stdout:6/763: chown d4/dc/d1a/d31/d3c 13408894 1 2024-09-21T10:40:52.238 INFO:tasks.workunit.client.0.smithi060.stdout:7/115: dread da/d14/d15/d16/f1a [0,4194304] 0 2024-09-21T10:40:52.238 INFO:tasks.workunit.client.0.smithi060.stdout:7/116: stat da/d14/l20 0 2024-09-21T10:40:52.239 INFO:tasks.workunit.client.1.smithi112.stdout:0/751: sync 2024-09-21T10:40:52.239 INFO:tasks.workunit.client.0.smithi060.stdout:4/152: rename d0/d5/d12/d16/d30 to d0/d5/d12/d20/d32 0 2024-09-21T10:40:52.239 INFO:tasks.workunit.client.1.smithi112.stdout:6/764: dread d4/d6/da/d11/d1f/d22/fc4 [4194304,4194304] 0 2024-09-21T10:40:52.240 INFO:tasks.workunit.client.1.smithi112.stdout:2/633: rmdir d0/d12/d46 39 2024-09-21T10:40:52.241 INFO:tasks.workunit.client.1.smithi112.stdout:5/761: sync 2024-09-21T10:40:52.242 INFO:tasks.workunit.client.1.smithi112.stdout:9/789: getdents d1/d7f 0 2024-09-21T10:40:52.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/874: dread d8/d45/f94 [0,4194304] 0 2024-09-21T10:40:52.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/875: write d8/d20/f4a [1710021,109622] 0 2024-09-21T10:40:52.242 INFO:tasks.workunit.client.1.smithi112.stdout:1/876: readlink d8/d1a/d53/l8f 0 2024-09-21T10:40:52.243 INFO:tasks.workunit.client.1.smithi112.stdout:1/877: stat d8/d45/f94 0 2024-09-21T10:40:52.243 INFO:tasks.workunit.client.0.smithi060.stdout:9/111: dread d3/fe [0,4194304] 0 2024-09-21T10:40:52.246 INFO:tasks.workunit.client.1.smithi112.stdout:7/680: link d7/d22/d86/dac/d8a/f8d d7/d22/d41/d56/dc9/fdb 0 2024-09-21T10:40:52.247 INFO:tasks.workunit.client.0.smithi060.stdout:7/117: dread f6 [0,4194304] 0 2024-09-21T10:40:52.247 INFO:tasks.workunit.client.0.smithi060.stdout:7/118: fdatasync da/d14/d15/f18 0 2024-09-21T10:40:52.247 INFO:tasks.workunit.client.0.smithi060.stdout:7/119: chown l4 0 1 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.1.smithi112.stdout:8/727: sync 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.1.smithi112.stdout:4/733: sync 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.1.smithi112.stdout:3/700: sync 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.1.smithi112.stdout:3/701: read - d2/d2f/d3f/ddf/d31/d2a/f85 zero size 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.1.smithi112.stdout:3/702: truncate d2/d1f/fc8 8417 0 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.0.smithi060.stdout:4/153: dread d0/d5/f1a [0,4194304] 0 2024-09-21T10:40:52.248 INFO:tasks.workunit.client.0.smithi060.stdout:4/154: fsync d0/d5/d12/d20/f22 0 2024-09-21T10:40:52.253 INFO:tasks.workunit.client.1.smithi112.stdout:0/752: truncate d3/d4a/d4e/dc2/d43/fb1 740961 0 2024-09-21T10:40:52.253 INFO:tasks.workunit.client.1.smithi112.stdout:0/753: read - d3/d18/d45/fe2 zero size 2024-09-21T10:40:52.255 INFO:tasks.workunit.client.1.smithi112.stdout:2/634: dwrite d0/d12/d46/da0/db9/dbd/d62/d63/f69 [0,4194304] 0 2024-09-21T10:40:52.256 INFO:tasks.workunit.client.1.smithi112.stdout:1/878: write d8/d1a/d53/f104 [2957835,2966] 0 2024-09-21T10:40:52.256 INFO:tasks.workunit.client.1.smithi112.stdout:6/765: link d4/dc/d1a/d31/d3c/f7c d4/d6/d9c/f10d 0 2024-09-21T10:40:52.256 INFO:tasks.workunit.client.1.smithi112.stdout:6/766: write d4/d6/da/d11/d37/d8b/fbf [5207324,29704] 0 2024-09-21T10:40:52.257 INFO:tasks.workunit.client.1.smithi112.stdout:5/762: rmdir d9/d6e 39 2024-09-21T10:40:52.260 INFO:tasks.workunit.client.1.smithi112.stdout:9/790: link d1/d2/f60 d1/d2/d27/d37/d68/f10f 0 2024-09-21T10:40:52.261 INFO:tasks.workunit.client.0.smithi060.stdout:9/112: rmdir d3 39 2024-09-21T10:40:52.261 INFO:tasks.workunit.client.0.smithi060.stdout:9/113: fdatasync d3/d16/d1a/f1d 0 2024-09-21T10:40:52.264 INFO:tasks.workunit.client.0.smithi060.stdout:4/155: getdents d0/d5 0 2024-09-21T10:40:52.266 INFO:tasks.workunit.client.1.smithi112.stdout:1/879: dread d8/d1a/d31/d37/f8a [0,4194304] 0 2024-09-21T10:40:52.267 INFO:tasks.workunit.client.1.smithi112.stdout:7/681: creat d7/d22/fdc x:0 0 0 2024-09-21T10:40:52.271 INFO:tasks.workunit.client.1.smithi112.stdout:0/754: link d3/d4a/d4e/dc2/da8/ddf/ff0 d3/d23/ffb 0 2024-09-21T10:40:52.273 INFO:tasks.workunit.client.1.smithi112.stdout:6/767: write d4/d6/da/d11/d37/d8b/fbf [2716138,113391] 0 2024-09-21T10:40:52.273 INFO:tasks.workunit.client.1.smithi112.stdout:6/768: readlink d4/d6/da/de1/le8 0 2024-09-21T10:40:52.273 INFO:tasks.workunit.client.1.smithi112.stdout:2/635: mknod d0/da4/cc9 0 2024-09-21T10:40:52.275 INFO:tasks.workunit.client.1.smithi112.stdout:9/791: symlink d1/d2/d27/d37/d3b/l110 0 2024-09-21T10:40:52.275 INFO:tasks.workunit.client.1.smithi112.stdout:9/792: write d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/ff5 [436277,129464] 0 2024-09-21T10:40:52.276 INFO:tasks.workunit.client.0.smithi060.stdout:9/114: write d3/d16/f1c [4052422,45257] 0 2024-09-21T10:40:52.276 INFO:tasks.workunit.client.0.smithi060.stdout:7/120: dwrite da/f24 [4194304,4194304] 0 2024-09-21T10:40:52.276 INFO:tasks.workunit.client.1.smithi112.stdout:1/880: symlink d8/d54/d6d/db5/l10d 0 2024-09-21T10:40:52.276 INFO:tasks.workunit.client.0.smithi060.stdout:4/156: dread d0/d5/d12/d16/d28/f2d [4194304,4194304] 0 2024-09-21T10:40:52.277 INFO:tasks.workunit.client.1.smithi112.stdout:7/682: creat d7/d22/d41/d4b/da2/fdd x:0 0 0 2024-09-21T10:40:52.279 INFO:tasks.workunit.client.1.smithi112.stdout:5/763: dwrite d9/d15/d18/d20/faf [0,4194304] 0 2024-09-21T10:40:52.279 INFO:tasks.workunit.client.0.smithi060.stdout:9/115: link d3/f9 d3/d16/d20/f25 0 2024-09-21T10:40:52.279 INFO:tasks.workunit.client.0.smithi060.stdout:9/116: fdatasync d3/fc 0 2024-09-21T10:40:52.281 INFO:tasks.workunit.client.0.smithi060.stdout:4/157: dread d0/d5/d12/d16/d28/f2d [4194304,4194304] 0 2024-09-21T10:40:52.281 INFO:tasks.workunit.client.0.smithi060.stdout:4/158: getdents d0/d5/d12/d20/d32 0 2024-09-21T10:40:52.283 INFO:tasks.workunit.client.1.smithi112.stdout:0/755: mknod d3/d4a/d4e/d72/da0/cfc 0 2024-09-21T10:40:52.284 INFO:tasks.workunit.client.1.smithi112.stdout:8/728: dread d8/f69 [0,4194304] 0 2024-09-21T10:40:52.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/121: symlink da/d14/l29 0 2024-09-21T10:40:52.285 INFO:tasks.workunit.client.1.smithi112.stdout:2/636: creat d0/d12/d46/da0/db9/fca x:0 0 0 2024-09-21T10:40:52.285 INFO:tasks.workunit.client.1.smithi112.stdout:8/729: dread d8/d9/dd/d2a/d43/f9e [0,4194304] 0 2024-09-21T10:40:52.289 INFO:tasks.workunit.client.0.smithi060.stdout:9/117: creat d3/d16/d1a/f26 x:0 0 0 2024-09-21T10:40:52.290 INFO:tasks.workunit.client.1.smithi112.stdout:1/881: rmdir d8/d1a/d31/da1/de7/df2 0 2024-09-21T10:40:52.290 INFO:tasks.workunit.client.1.smithi112.stdout:1/882: stat d8/d1a/f3b 0 2024-09-21T10:40:52.290 INFO:tasks.workunit.client.1.smithi112.stdout:1/883: chown d8/d54/db0/fee 112465 1 2024-09-21T10:40:52.291 INFO:tasks.workunit.client.0.smithi060.stdout:4/159: mknod d0/c33 0 2024-09-21T10:40:52.294 INFO:tasks.workunit.client.0.smithi060.stdout:7/122: read da/f24 [2506456,9595] 0 2024-09-21T10:40:52.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/683: symlink d7/d22/d41/d56/d72/lde 0 2024-09-21T10:40:52.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/684: stat d7/d22/d41/d56/d5c/f96 0 2024-09-21T10:40:52.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/685: creat d7/d22/d41/d4b/d5e/fdf x:0 0 0 2024-09-21T10:40:52.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/686: getdents d7/d22/d73/da1 0 2024-09-21T10:40:52.297 INFO:tasks.workunit.client.0.smithi060.stdout:4/160: creat d0/d5/f34 x:0 0 0 2024-09-21T10:40:52.297 INFO:tasks.workunit.client.0.smithi060.stdout:4/161: fsync d0/f6 0 2024-09-21T10:40:52.297 INFO:tasks.workunit.client.0.smithi060.stdout:4/162: chown d0/d5 26042 1 2024-09-21T10:40:52.297 INFO:tasks.workunit.client.0.smithi060.stdout:4/163: chown d0/d5/f34 0 1 2024-09-21T10:40:52.299 INFO:tasks.workunit.client.0.smithi060.stdout:7/123: mkdir da/d14/d2a 0 2024-09-21T10:40:52.300 INFO:tasks.workunit.client.0.smithi060.stdout:9/118: dwrite d3/d15/f22 [0,4194304] 0 2024-09-21T10:40:52.301 INFO:tasks.workunit.client.1.smithi112.stdout:5/764: mkdir d9/d15/d18/d3a/d61/d93/de9 0 2024-09-21T10:40:52.301 INFO:tasks.workunit.client.0.smithi060.stdout:4/164: symlink d0/l35 0 2024-09-21T10:40:52.302 INFO:tasks.workunit.client.0.smithi060.stdout:4/165: dread - d0/d5/f34 zero size 2024-09-21T10:40:52.304 INFO:tasks.workunit.client.1.smithi112.stdout:4/734: rename de/d33/d2f/dcf to de/d33/d2f/d35/df3 0 2024-09-21T10:40:52.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/756: symlink d3/d4a/d4e/dc2/da8/ddf/de5/lfd 0 2024-09-21T10:40:52.307 INFO:tasks.workunit.client.1.smithi112.stdout:0/757: getdents d3/d18/d52/df9 0 2024-09-21T10:40:52.312 INFO:tasks.workunit.client.0.smithi060.stdout:9/119: symlink d3/l27 0 2024-09-21T10:40:52.313 INFO:tasks.workunit.client.0.smithi060.stdout:4/166: write d0/d5/d12/d16/f1d [3647417,92710] 0 2024-09-21T10:40:52.313 INFO:tasks.workunit.client.0.smithi060.stdout:4/167: chown d0/df/c1e 426244380 1 2024-09-21T10:40:52.313 INFO:tasks.workunit.client.0.smithi060.stdout:4/168: creat d0/d5/f36 x:0 0 0 2024-09-21T10:40:52.313 INFO:tasks.workunit.client.0.smithi060.stdout:4/169: stat d0/d5/d12/d20/l24 0 2024-09-21T10:40:52.314 INFO:tasks.workunit.client.1.smithi112.stdout:1/884: mknod d8/d1a/d31/d66/d87/c10e 0 2024-09-21T10:40:52.314 INFO:tasks.workunit.client.1.smithi112.stdout:1/885: write d8/d1a/db8/fb9 [832577,57263] 0 2024-09-21T10:40:52.314 INFO:tasks.workunit.client.1.smithi112.stdout:1/886: read - d8/d20/fc5 zero size 2024-09-21T10:40:52.318 INFO:tasks.workunit.client.0.smithi060.stdout:7/124: dwrite da/d14/d15/d16/f1d [0,4194304] 0 2024-09-21T10:40:52.320 INFO:tasks.workunit.client.0.smithi060.stdout:4/170: rename d0/d5/f34 to d0/d5/d12/d20/d32/f37 0 2024-09-21T10:40:52.320 INFO:tasks.workunit.client.1.smithi112.stdout:7/687: mkdir d7/d22/d41/d56/d72/de0 0 2024-09-21T10:40:52.322 INFO:tasks.workunit.client.1.smithi112.stdout:1/887: read d8/f24 [1679143,127480] 0 2024-09-21T10:40:52.325 INFO:tasks.workunit.client.1.smithi112.stdout:3/703: rename d2/d2f/d3f/ddf/d31/d2a/l6e to d2/d2f/d3f/lef 0 2024-09-21T10:40:52.325 INFO:tasks.workunit.client.1.smithi112.stdout:6/769: rename d4/d6/d9c/dce to d4/d6/d9c/dce/d10e 22 2024-09-21T10:40:52.325 INFO:tasks.workunit.client.1.smithi112.stdout:6/770: fdatasync d4/d6/da/d11/d1f/d22/f26 0 2024-09-21T10:40:52.325 INFO:tasks.workunit.client.1.smithi112.stdout:6/771: write d4/d6/da/d11/d1f/d22/f26 [5179659,70273] 0 2024-09-21T10:40:52.325 INFO:tasks.workunit.client.1.smithi112.stdout:5/765: dwrite d9/d15/d18/d20/d47/fa8 [4194304,4194304] 0 2024-09-21T10:40:52.326 INFO:tasks.workunit.client.1.smithi112.stdout:0/758: dwrite d3/d4a/d4e/d72/fa9 [0,4194304] 0 2024-09-21T10:40:52.326 INFO:tasks.workunit.client.0.smithi060.stdout:9/120: write d3/f9 [1422115,89711] 0 2024-09-21T10:40:52.326 INFO:tasks.workunit.client.0.smithi060.stdout:9/121: chown d3/f9 7970 1 2024-09-21T10:40:52.328 INFO:tasks.workunit.client.1.smithi112.stdout:4/735: mkdir de/d2e/df4 0 2024-09-21T10:40:52.328 INFO:tasks.workunit.client.1.smithi112.stdout:4/736: fsync de/d33/d2f/f52 0 2024-09-21T10:40:52.330 INFO:tasks.workunit.client.0.smithi060.stdout:4/171: symlink d0/d5/d12/d16/d28/l38 0 2024-09-21T10:40:52.332 INFO:tasks.workunit.client.1.smithi112.stdout:2/637: getdents d0/d12/d46/da0/db9 0 2024-09-21T10:40:52.333 INFO:tasks.workunit.client.1.smithi112.stdout:3/704: write d2/f18 [1695082,55898] 0 2024-09-21T10:40:52.334 INFO:tasks.workunit.client.1.smithi112.stdout:7/688: truncate d7/d22/f48 606423 0 2024-09-21T10:40:52.334 INFO:tasks.workunit.client.1.smithi112.stdout:7/689: write d7/d22/d41/d4b/f64 [2488685,44304] 0 2024-09-21T10:40:52.335 INFO:tasks.workunit.client.0.smithi060.stdout:9/122: read d3/fe [1624288,74219] 0 2024-09-21T10:40:52.335 INFO:tasks.workunit.client.0.smithi060.stdout:9/123: chown d3/l7 76848 1 2024-09-21T10:40:52.337 INFO:tasks.workunit.client.0.smithi060.stdout:4/172: truncate d0/d5/d12/d20/f2f 3918963 0 2024-09-21T10:40:52.337 INFO:tasks.workunit.client.0.smithi060.stdout:4/173: fsync d0/df/f17 0 2024-09-21T10:40:52.338 INFO:tasks.workunit.client.0.smithi060.stdout:4/174: fsync d0/d5/d12/f19 0 2024-09-21T10:40:52.339 INFO:tasks.workunit.client.1.smithi112.stdout:1/888: mkdir d8/d54/d6d/db5/dc2/de6/d10f 0 2024-09-21T10:40:52.339 INFO:tasks.workunit.client.1.smithi112.stdout:0/759: dread d3/d4a/d4e/dc2/f1d [0,4194304] 0 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/124: truncate d3/ff 1007343 0 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/125: chown d3/d16/d1a/f1d 909 1 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/126: creat d3/d16/d1a/f28 x:0 0 0 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/127: chown d3/f10 157 1 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/128: stat d3/d16/d1a/f1d 0 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/129: chown d3/fa 802 1 2024-09-21T10:40:52.340 INFO:tasks.workunit.client.1.smithi112.stdout:1/889: dread d8/d45/f9b [0,4194304] 0 2024-09-21T10:40:52.341 INFO:tasks.workunit.client.1.smithi112.stdout:9/793: rename d1/d2/d27/d3a/d6b/d30/lcc to d1/d2/d27/d3a/d6b/l111 0 2024-09-21T10:40:52.343 INFO:tasks.workunit.client.1.smithi112.stdout:6/772: rmdir d4/dc/d1a/d31/d56/d64/d9b/de2/dec 0 2024-09-21T10:40:52.345 INFO:tasks.workunit.client.0.smithi060.stdout:9/130: rename d3/d16/f1c to d3/d16/d1f/f29 0 2024-09-21T10:40:52.350 INFO:tasks.workunit.client.0.smithi060.stdout:9/131: creat d3/d16/d1f/f2a x:0 0 0 2024-09-21T10:40:52.351 INFO:tasks.workunit.client.1.smithi112.stdout:4/737: mknod de/d33/d2f/d35/df3/dc2/dad/cf5 0 2024-09-21T10:40:52.352 INFO:tasks.workunit.client.1.smithi112.stdout:2/638: symlink d0/dd/lcb 0 2024-09-21T10:40:52.354 INFO:tasks.workunit.client.1.smithi112.stdout:1/890: dread d8/d1a/f62 [0,4194304] 0 2024-09-21T10:40:52.355 INFO:tasks.workunit.client.0.smithi060.stdout:9/132: creat d3/d15/f2b x:0 0 0 2024-09-21T10:40:52.356 INFO:tasks.workunit.client.0.smithi060.stdout:4/175: read d0/d5/d12/f19 [2415485,99173] 0 2024-09-21T10:40:52.360 INFO:tasks.workunit.client.0.smithi060.stdout:4/176: link d0/d5/d12/c2e d0/d5/d12/d20/d32/c39 0 2024-09-21T10:40:52.362 INFO:tasks.workunit.client.1.smithi112.stdout:7/690: creat d7/d3d/da7/fe1 x:0 0 0 2024-09-21T10:40:52.364 INFO:tasks.workunit.client.0.smithi060.stdout:7/125: dwrite da/f12 [0,4194304] 0 2024-09-21T10:40:52.364 INFO:tasks.workunit.client.1.smithi112.stdout:9/794: mknod d1/d2/d27/d37/d3b/dec/d107/c112 0 2024-09-21T10:40:52.364 INFO:tasks.workunit.client.1.smithi112.stdout:9/795: write d1/d2/d27/d3a/de3/f99 [80192,77492] 0 2024-09-21T10:40:52.365 INFO:tasks.workunit.client.0.smithi060.stdout:4/177: mkdir d0/d5/d3a 0 2024-09-21T10:40:52.365 INFO:tasks.workunit.client.0.smithi060.stdout:4/178: write d0/d5/d12/d20/d32/f37 [508555,40684] 0 2024-09-21T10:40:52.368 INFO:tasks.workunit.client.1.smithi112.stdout:2/639: mknod d0/d12/d46/d86/dc0/dc8/ccc 0 2024-09-21T10:40:52.368 INFO:tasks.workunit.client.1.smithi112.stdout:7/691: dread d7/d22/d86/f7d [0,4194304] 0 2024-09-21T10:40:52.368 INFO:tasks.workunit.client.0.smithi060.stdout:7/126: creat da/d14/d2a/f2b x:0 0 0 2024-09-21T10:40:52.368 INFO:tasks.workunit.client.0.smithi060.stdout:7/127: write da/d14/d15/f13 [982775,66900] 0 2024-09-21T10:40:52.369 INFO:tasks.workunit.client.0.smithi060.stdout:9/133: write f2 [3937736,93992] 0 2024-09-21T10:40:52.370 INFO:tasks.workunit.client.1.smithi112.stdout:1/891: truncate d8/d1a/d31/d66/df5/f108 123594 0 2024-09-21T10:40:52.370 INFO:tasks.workunit.client.1.smithi112.stdout:1/892: creat d8/d1a/d31/d37/f110 x:0 0 0 2024-09-21T10:40:52.371 INFO:tasks.workunit.client.1.smithi112.stdout:0/760: dwrite d3/d18/d52/fe8 [0,4194304] 0 2024-09-21T10:40:52.371 INFO:tasks.workunit.client.0.smithi060.stdout:4/179: truncate d0/d5/f10 5839629 0 2024-09-21T10:40:52.371 INFO:tasks.workunit.client.0.smithi060.stdout:4/180: chown d0/d5/d12/d20/l29 705 1 2024-09-21T10:40:52.372 INFO:tasks.workunit.client.1.smithi112.stdout:5/766: dwrite d9/d15/d18/f77 [0,4194304] 0 2024-09-21T10:40:52.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/705: dwrite d2/d1f/f4f [0,4194304] 0 2024-09-21T10:40:52.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/706: write d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fea [203496,44801] 0 2024-09-21T10:40:52.372 INFO:tasks.workunit.client.1.smithi112.stdout:6/773: dwrite d4/dc/d1a/d31/d56/fff [0,4194304] 0 2024-09-21T10:40:52.373 INFO:tasks.workunit.client.1.smithi112.stdout:9/796: rename d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/ceb to d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/c113 0 2024-09-21T10:40:52.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/774: dread d4/dc/d7e/f88 [0,4194304] 0 2024-09-21T10:40:52.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/775: truncate d4/dc/d1a/d31/d3c/fef 662765 0 2024-09-21T10:40:52.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/776: chown d4/d4f/f66 743823323 1 2024-09-21T10:40:52.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/777: write d4/d6/f10c [616681,10736] 0 2024-09-21T10:40:52.376 INFO:tasks.workunit.client.1.smithi112.stdout:6/778: fsync f1 0 2024-09-21T10:40:52.376 INFO:tasks.workunit.client.1.smithi112.stdout:2/640: creat d0/d12/d46/da0/db9/dbd/d62/d63/fcd x:0 0 0 2024-09-21T10:40:52.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/128: write da/d14/d15/d16/f1d [2169861,87328] 0 2024-09-21T10:40:52.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/129: read f0 [3810487,37084] 0 2024-09-21T10:40:52.378 INFO:tasks.workunit.client.0.smithi060.stdout:4/181: creat d0/d5/d12/d16/d28/f3b x:0 0 0 2024-09-21T10:40:52.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/692: mknod d7/d22/d41/d4b/d52/ce2 0 2024-09-21T10:40:52.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/693: readlink d7/d22/l25 0 2024-09-21T10:40:52.380 INFO:tasks.workunit.client.1.smithi112.stdout:4/738: dwrite de/d33/d2f/d71/f9e [0,4194304] 0 2024-09-21T10:40:52.381 INFO:tasks.workunit.client.0.smithi060.stdout:9/134: fsync d3/f9 0 2024-09-21T10:40:52.381 INFO:tasks.workunit.client.0.smithi060.stdout:9/135: write d3/d16/d1a/f28 [769060,90664] 0 2024-09-21T10:40:52.386 INFO:tasks.workunit.client.1.smithi112.stdout:3/707: dread d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:52.387 INFO:tasks.workunit.client.1.smithi112.stdout:1/893: dread d8/d1a/db8/fb9 [0,4194304] 0 2024-09-21T10:40:52.387 INFO:tasks.workunit.client.1.smithi112.stdout:1/894: creat d8/d7a/f111 x:0 0 0 2024-09-21T10:40:52.387 INFO:tasks.workunit.client.1.smithi112.stdout:1/895: write d8/d7a/f7e [224888,20017] 0 2024-09-21T10:40:52.387 INFO:tasks.workunit.client.1.smithi112.stdout:0/761: fdatasync d3/d4a/d4e/dc2/d1a/dba/deb/ff2 0 2024-09-21T10:40:52.387 INFO:tasks.workunit.client.1.smithi112.stdout:0/762: dread - d3/d4a/fbd zero size 2024-09-21T10:40:52.390 INFO:tasks.workunit.client.0.smithi060.stdout:9/136: rmdir d3/d16/d20 39 2024-09-21T10:40:52.390 INFO:tasks.workunit.client.0.smithi060.stdout:7/130: rmdir da/d14 39 2024-09-21T10:40:52.392 INFO:tasks.workunit.client.1.smithi112.stdout:6/779: dwrite d4/d6/da/d11/d37/d8b/da0/dfa/fd6 [0,4194304] 0 2024-09-21T10:40:52.393 INFO:tasks.workunit.client.0.smithi060.stdout:9/137: link f2 d3/d16/d1f/f2c 0 2024-09-21T10:40:52.395 INFO:tasks.workunit.client.1.smithi112.stdout:5/767: creat d9/d15/d18/d3a/d61/d62/fea x:0 0 0 2024-09-21T10:40:52.396 INFO:tasks.workunit.client.0.smithi060.stdout:4/182: dread d0/fc [0,4194304] 0 2024-09-21T10:40:52.396 INFO:tasks.workunit.client.0.smithi060.stdout:4/183: write d0/df/f17 [1047498,68995] 0 2024-09-21T10:40:52.396 INFO:tasks.workunit.client.0.smithi060.stdout:7/131: creat da/d14/d25/f2c x:0 0 0 2024-09-21T10:40:52.398 INFO:tasks.workunit.client.0.smithi060.stdout:9/138: link d3/c13 d3/d16/d1a/c2d 0 2024-09-21T10:40:52.399 INFO:tasks.workunit.client.0.smithi060.stdout:9/139: dread - d3/d16/d1a/f26 zero size 2024-09-21T10:40:52.399 INFO:tasks.workunit.client.0.smithi060.stdout:9/140: stat d3/f9 0 2024-09-21T10:40:52.399 INFO:tasks.workunit.client.1.smithi112.stdout:0/763: write d3/d4a/d4e/dc2/d1a/d21/d46/f58 [361795,70605] 0 2024-09-21T10:40:52.402 INFO:tasks.workunit.client.0.smithi060.stdout:4/184: mkdir d0/d3c 0 2024-09-21T10:40:52.408 INFO:tasks.workunit.client.0.smithi060.stdout:9/141: dread d3/d16/d20/f25 [0,4194304] 0 2024-09-21T10:40:52.408 INFO:tasks.workunit.client.1.smithi112.stdout:6/780: dwrite d4/d6/f109 [0,4194304] 0 2024-09-21T10:40:52.408 INFO:tasks.workunit.client.1.smithi112.stdout:6/781: getdents d4/d4f/de7 0 2024-09-21T10:40:52.409 INFO:tasks.workunit.client.0.smithi060.stdout:4/185: getdents d0/d5/d12/d16 0 2024-09-21T10:40:52.411 INFO:tasks.workunit.client.0.smithi060.stdout:9/142: rename d3/d16/d1a/c2d to d3/d16/d1a/c2e 0 2024-09-21T10:40:52.412 INFO:tasks.workunit.client.0.smithi060.stdout:7/132: dwrite da/d14/d15/f13 [0,4194304] 0 2024-09-21T10:40:52.414 INFO:tasks.workunit.client.0.smithi060.stdout:4/186: mkdir d0/d5/d12/d3d 0 2024-09-21T10:40:52.414 INFO:tasks.workunit.client.0.smithi060.stdout:4/187: write d0/d5/f36 [78306,4473] 0 2024-09-21T10:40:52.420 INFO:tasks.workunit.client.0.smithi060.stdout:7/133: link da/f24 da/d14/d2a/f2d 0 2024-09-21T10:40:52.420 INFO:tasks.workunit.client.0.smithi060.stdout:7/134: fdatasync da/d14/f19 0 2024-09-21T10:40:52.422 INFO:tasks.workunit.client.1.smithi112.stdout:9/797: mknod d1/d2/d27/d3a/d6b/d30/d5c/d7c/c114 0 2024-09-21T10:40:52.424 INFO:tasks.workunit.client.0.smithi060.stdout:4/188: link d0/d5/d12/d20/d32/c39 d0/c3e 0 2024-09-21T10:40:52.424 INFO:tasks.workunit.client.0.smithi060.stdout:4/189: readlink d0/d5/d12/d20/l24 0 2024-09-21T10:40:52.424 INFO:tasks.workunit.client.0.smithi060.stdout:4/190: write d0/f6 [658985,36480] 0 2024-09-21T10:40:52.427 INFO:tasks.workunit.client.1.smithi112.stdout:2/641: rename d0/d12/d6c/d7e/d8f/f1e to d0/da4/dbe/fce 0 2024-09-21T10:40:52.427 INFO:tasks.workunit.client.1.smithi112.stdout:2/642: dread - d0/d12/d76/f82 zero size 2024-09-21T10:40:52.428 INFO:tasks.workunit.client.1.smithi112.stdout:7/694: symlink d7/d22/d86/dac/le3 0 2024-09-21T10:40:52.431 INFO:tasks.workunit.client.1.smithi112.stdout:4/739: symlink de/d33/d6f/d9c/d3e/lf6 0 2024-09-21T10:40:52.432 INFO:tasks.workunit.client.1.smithi112.stdout:3/708: truncate d2/d2f/d3f/ddf/d31/d37/f52 412928 0 2024-09-21T10:40:52.434 INFO:tasks.workunit.client.1.smithi112.stdout:1/896: mknod d8/d1a/d53/d57/d83/d109/c112 0 2024-09-21T10:40:52.435 INFO:tasks.workunit.client.1.smithi112.stdout:8/730: sync 2024-09-21T10:40:52.435 INFO:tasks.workunit.client.1.smithi112.stdout:5/768: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf/leb 0 2024-09-21T10:40:52.436 INFO:tasks.workunit.client.1.smithi112.stdout:0/764: mknod d3/d4a/d4e/dc2/da8/ddf/de5/cfe 0 2024-09-21T10:40:52.436 INFO:tasks.workunit.client.1.smithi112.stdout:0/765: stat d3/d4a/d4e/dc2/d1a/d21/d4f/dc3 0 2024-09-21T10:40:52.438 INFO:tasks.workunit.client.1.smithi112.stdout:6/782: symlink d4/d6/da/d11/d1f/d22/l10f 0 2024-09-21T10:40:52.438 INFO:tasks.workunit.client.1.smithi112.stdout:7/695: dread d7/d3d/f67 [0,4194304] 0 2024-09-21T10:40:52.439 INFO:tasks.workunit.client.1.smithi112.stdout:9/798: rmdir d1/d2/d27/d37/d3b/d69/d77/da0 39 2024-09-21T10:40:52.439 INFO:tasks.workunit.client.1.smithi112.stdout:9/799: write d1/d2/fc4 [868800,84407] 0 2024-09-21T10:40:52.442 INFO:tasks.workunit.client.0.smithi060.stdout:4/191: read d0/d5/d12/d20/f2f [2575644,59316] 0 2024-09-21T10:40:52.443 INFO:tasks.workunit.client.0.smithi060.stdout:9/143: dwrite d3/d16/d1f/f2c [0,4194304] 0 2024-09-21T10:40:52.443 INFO:tasks.workunit.client.1.smithi112.stdout:2/643: symlink d0/d12/d76/lcf 0 2024-09-21T10:40:52.443 INFO:tasks.workunit.client.1.smithi112.stdout:8/731: write d8/d9/d3c/d6d/f74 [2247760,45145] 0 2024-09-21T10:40:52.443 INFO:tasks.workunit.client.1.smithi112.stdout:8/732: chown d8/d9/dd/d2b/d31/d46/d86/cc8 0 1 2024-09-21T10:40:52.443 INFO:tasks.workunit.client.1.smithi112.stdout:4/740: truncate de/d18/d6d/ff0 1346884 0 2024-09-21T10:40:52.443 INFO:tasks.workunit.client.1.smithi112.stdout:1/897: rmdir d8/d1a/d53/d57 39 2024-09-21T10:40:52.444 INFO:tasks.workunit.client.1.smithi112.stdout:1/898: chown d8/d20/caf 0 1 2024-09-21T10:40:52.444 INFO:tasks.workunit.client.1.smithi112.stdout:1/899: creat d8/f113 x:0 0 0 2024-09-21T10:40:52.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/135: dwrite f6 [8388608,4194304] 0 2024-09-21T10:40:52.445 INFO:tasks.workunit.client.1.smithi112.stdout:0/766: creat d3/d4a/d4e/dc2/d10/dc6/fff x:0 0 0 2024-09-21T10:40:52.445 INFO:tasks.workunit.client.1.smithi112.stdout:0/767: chown d3/d23/ffb 29202911 1 2024-09-21T10:40:52.445 INFO:tasks.workunit.client.1.smithi112.stdout:0/768: readlink d3/d4a/lb9 0 2024-09-21T10:40:52.446 INFO:tasks.workunit.client.0.smithi060.stdout:4/192: rename d0/d5/d12/d20/l29 to d0/d5/d12/d20/d32/l3f 0 2024-09-21T10:40:52.446 INFO:tasks.workunit.client.1.smithi112.stdout:3/709: dread d2/f78 [0,4194304] 0 2024-09-21T10:40:52.447 INFO:tasks.workunit.client.1.smithi112.stdout:6/783: creat d4/d6/da/d11/d1f/d22/d100/f110 x:0 0 0 2024-09-21T10:40:52.448 INFO:tasks.workunit.client.0.smithi060.stdout:9/144: getdents d3 0 2024-09-21T10:40:52.450 INFO:tasks.workunit.client.0.smithi060.stdout:4/193: dread d0/fc [0,4194304] 0 2024-09-21T10:40:52.450 INFO:tasks.workunit.client.0.smithi060.stdout:4/194: stat d0 0 2024-09-21T10:40:52.451 INFO:tasks.workunit.client.1.smithi112.stdout:2/644: mkdir d0/dd/d47/dd0 0 2024-09-21T10:40:52.455 INFO:tasks.workunit.client.1.smithi112.stdout:8/733: write d8/fc [1580338,61716] 0 2024-09-21T10:40:52.456 INFO:tasks.workunit.client.1.smithi112.stdout:3/710: dread d2/f51 [0,4194304] 0 2024-09-21T10:40:52.457 INFO:tasks.workunit.client.1.smithi112.stdout:3/711: fdatasync d2/f17 0 2024-09-21T10:40:52.457 INFO:tasks.workunit.client.1.smithi112.stdout:3/712: chown d2/d2f/d3f/ddf/d31/d2a/d39/d3a/cda 86940 1 2024-09-21T10:40:52.457 INFO:tasks.workunit.client.0.smithi060.stdout:4/195: link d0/d5/d12/d16/d28/l31 d0/d5/d12/d15/l40 0 2024-09-21T10:40:52.459 INFO:tasks.workunit.client.1.smithi112.stdout:4/741: rename de/l16 to de/d33/d2f/d35/d4c/lf7 0 2024-09-21T10:40:52.459 INFO:tasks.workunit.client.1.smithi112.stdout:4/742: write de/d2a/dbf/fea [985049,59104] 0 2024-09-21T10:40:52.459 INFO:tasks.workunit.client.1.smithi112.stdout:4/743: chown de/d2a/dbf/d82/fe5 907 1 2024-09-21T10:40:52.459 INFO:tasks.workunit.client.1.smithi112.stdout:9/800: write d1/d2/d27/d3a/f33 [610406,26255] 0 2024-09-21T10:40:52.460 INFO:tasks.workunit.client.0.smithi060.stdout:7/136: rmdir da/d14/d25 39 2024-09-21T10:40:52.460 INFO:tasks.workunit.client.0.smithi060.stdout:7/137: truncate da/d14/f19 256338 0 2024-09-21T10:40:52.462 INFO:tasks.workunit.client.1.smithi112.stdout:0/769: creat d3/d4a/d4e/dc2/d10/f100 x:0 0 0 2024-09-21T10:40:52.464 INFO:tasks.workunit.client.0.smithi060.stdout:4/196: creat d0/f41 x:0 0 0 2024-09-21T10:40:52.466 INFO:tasks.workunit.client.0.smithi060.stdout:7/138: mkdir da/d14/d15/d16/d1e/d2e 0 2024-09-21T10:40:52.467 INFO:tasks.workunit.client.0.smithi060.stdout:7/139: truncate da/d14/d15/f18 3589667 0 2024-09-21T10:40:52.468 INFO:tasks.workunit.client.1.smithi112.stdout:3/713: read d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/f80 [2110459,77692] 0 2024-09-21T10:40:52.468 INFO:tasks.workunit.client.1.smithi112.stdout:2/645: symlink d0/d12/d46/da0/db9/dbd/d62/d63/ld1 0 2024-09-21T10:40:52.471 INFO:tasks.workunit.client.1.smithi112.stdout:8/734: creat d8/fd7 x:0 0 0 2024-09-21T10:40:52.472 INFO:tasks.workunit.client.1.smithi112.stdout:4/744: mkdir de/df8 0 2024-09-21T10:40:52.474 INFO:tasks.workunit.client.1.smithi112.stdout:9/801: symlink d1/d2/d27/d62/l115 0 2024-09-21T10:40:52.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/770: creat d3/d18/d52/d55/f101 x:0 0 0 2024-09-21T10:40:52.477 INFO:tasks.workunit.client.1.smithi112.stdout:0/771: write d3/d18/d52/d55/fd1 [340416,110168] 0 2024-09-21T10:40:52.478 INFO:tasks.workunit.client.1.smithi112.stdout:6/784: unlink d4/dc/d7e/fd2 0 2024-09-21T10:40:52.480 INFO:tasks.workunit.client.1.smithi112.stdout:8/735: rename d8/d9/d3c/d57/l70 to d8/d9/dd/dab/d8e/dcb/d82/ld8 0 2024-09-21T10:40:52.483 INFO:tasks.workunit.client.1.smithi112.stdout:4/745: link de/d33/d6f/d9c/c56 de/d33/d6f/d9c/dc8/cf9 0 2024-09-21T10:40:52.483 INFO:tasks.workunit.client.1.smithi112.stdout:5/769: dwrite d9/d15/d18/d20/d55/dbb/fdd [0,4194304] 0 2024-09-21T10:40:52.483 INFO:tasks.workunit.client.1.smithi112.stdout:4/746: chown de/d2a/dbf/f92 0 1 2024-09-21T10:40:52.486 INFO:tasks.workunit.client.1.smithi112.stdout:9/802: link d1/d2/d27/d37/d3b/l110 d1/d81/l116 0 2024-09-21T10:40:52.486 INFO:tasks.workunit.client.1.smithi112.stdout:1/900: dwrite d8/d1a/d53/fd5 [0,4194304] 0 2024-09-21T10:40:52.488 INFO:tasks.workunit.client.1.smithi112.stdout:6/785: unlink d4/d6/d9c/f10d 0 2024-09-21T10:40:52.488 INFO:tasks.workunit.client.1.smithi112.stdout:6/786: write d4/dc/d1a/d31/d3c/f53 [831315,90878] 0 2024-09-21T10:40:52.489 INFO:tasks.workunit.client.0.smithi060.stdout:4/197: dread d0/d5/d12/f19 [0,4194304] 0 2024-09-21T10:40:52.490 INFO:tasks.workunit.client.1.smithi112.stdout:8/736: write d8/f14 [4364134,91700] 0 2024-09-21T10:40:52.496 INFO:tasks.workunit.client.1.smithi112.stdout:5/770: mknod d9/d15/d18/d3a/d4b/d74/d8d/d9a/cec 0 2024-09-21T10:40:52.498 INFO:tasks.workunit.client.1.smithi112.stdout:9/803: mknod d1/d2/d27/d3a/d6b/d30/d5c/c117 0 2024-09-21T10:40:52.498 INFO:tasks.workunit.client.0.smithi060.stdout:9/145: dwrite d3/d15/f22 [4194304,4194304] 0 2024-09-21T10:40:52.499 INFO:tasks.workunit.client.0.smithi060.stdout:7/140: dwrite da/f24 [0,4194304] 0 2024-09-21T10:40:52.499 INFO:tasks.workunit.client.0.smithi060.stdout:7/141: stat f8 0 2024-09-21T10:40:52.499 INFO:tasks.workunit.client.0.smithi060.stdout:7/142: rename da/d14/d2a to da/d14/d2a/d2f 22 2024-09-21T10:40:52.500 INFO:tasks.workunit.client.1.smithi112.stdout:0/772: dwrite d3/d4a/d4e/dc2/d10/d8b/f9a [4194304,4194304] 0 2024-09-21T10:40:52.500 INFO:tasks.workunit.client.1.smithi112.stdout:3/714: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dc3/fe8 [0,4194304] 0 2024-09-21T10:40:52.500 INFO:tasks.workunit.client.1.smithi112.stdout:0/773: dread - d3/d4a/ff7 zero size 2024-09-21T10:40:52.500 INFO:tasks.workunit.client.1.smithi112.stdout:4/747: write de/d2a/dbf/fea [9822,123786] 0 2024-09-21T10:40:52.502 INFO:tasks.workunit.client.0.smithi060.stdout:4/198: symlink d0/d3c/l42 0 2024-09-21T10:40:52.502 INFO:tasks.workunit.client.0.smithi060.stdout:4/199: creat d0/d5/d12/d20/f43 x:0 0 0 2024-09-21T10:40:52.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/146: mkdir d3/d16/d20/d2f 0 2024-09-21T10:40:52.506 INFO:tasks.workunit.client.1.smithi112.stdout:6/787: mknod d4/d6/da/d11/d37/d19/df3/c111 0 2024-09-21T10:40:52.508 INFO:tasks.workunit.client.0.smithi060.stdout:7/143: creat da/d14/d15/d16/f30 x:0 0 0 2024-09-21T10:40:52.509 INFO:tasks.workunit.client.1.smithi112.stdout:8/737: mknod d8/d9/d3c/d57/cd9 0 2024-09-21T10:40:52.511 INFO:tasks.workunit.client.1.smithi112.stdout:5/771: creat d9/d15/d18/d20/d47/fed x:0 0 0 2024-09-21T10:40:52.514 INFO:tasks.workunit.client.1.smithi112.stdout:9/804: link d1/d2/d27/d3a/d6b/d30/f8b d1/f118 0 2024-09-21T10:40:52.516 INFO:tasks.workunit.client.0.smithi060.stdout:9/147: symlink d3/d16/d20/l30 0 2024-09-21T10:40:52.519 INFO:tasks.workunit.client.0.smithi060.stdout:7/144: write da/f24 [1678060,97635] 0 2024-09-21T10:40:52.519 INFO:tasks.workunit.client.0.smithi060.stdout:7/145: readlink da/d14/d15/l11 0 2024-09-21T10:40:52.520 INFO:tasks.workunit.client.0.smithi060.stdout:7/146: truncate da/d14/d15/d16/f1b 823324 0 2024-09-21T10:40:52.520 INFO:tasks.workunit.client.0.smithi060.stdout:7/147: fsync da/fc 0 2024-09-21T10:40:52.530 INFO:tasks.workunit.client.1.smithi112.stdout:5/772: dwrite d9/d15/d18/d20/d47/fed [0,4194304] 0 2024-09-21T10:40:52.531 INFO:tasks.workunit.client.1.smithi112.stdout:3/715: mkdir d2/d2f/daf/dca/df0 0 2024-09-21T10:40:52.534 INFO:tasks.workunit.client.1.smithi112.stdout:3/716: dread d2/db0/fc9 [0,4194304] 0 2024-09-21T10:40:52.534 INFO:tasks.workunit.client.1.smithi112.stdout:3/717: write d2/d2f/d3f/ddf/d31/f97 [728686,101587] 0 2024-09-21T10:40:52.534 INFO:tasks.workunit.client.0.smithi060.stdout:7/148: symlink da/d14/d15/l31 0 2024-09-21T10:40:52.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/748: truncate de/d33/d2f/d35/df3/dc2/fc1 1381079 0 2024-09-21T10:40:52.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/749: read de/f10 [7470364,92048] 0 2024-09-21T10:40:52.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/750: write de/d33/d2f/d71/d40/f5a [119161,6689] 0 2024-09-21T10:40:52.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/751: write de/d18/fa8 [298927,65928] 0 2024-09-21T10:40:52.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/752: fdatasync de/d2a/dbf/d82/f87 0 2024-09-21T10:40:52.537 INFO:tasks.workunit.client.1.smithi112.stdout:4/753: chown de/d18/fa8 18385 1 2024-09-21T10:40:52.538 INFO:tasks.workunit.client.1.smithi112.stdout:4/754: write de/d33/d2f/d35/f3b [706905,46662] 0 2024-09-21T10:40:52.538 INFO:tasks.workunit.client.0.smithi060.stdout:4/200: rmdir d0/d5/d12 39 2024-09-21T10:40:52.539 INFO:tasks.workunit.client.1.smithi112.stdout:5/773: dread d9/d15/d18/d20/d47/f49 [0,4194304] 0 2024-09-21T10:40:52.541 INFO:tasks.workunit.client.1.smithi112.stdout:8/738: mknod d8/d9/dd/d2b/d31/d46/d86/cda 0 2024-09-21T10:40:52.545 INFO:tasks.workunit.client.0.smithi060.stdout:4/201: dread d0/d5/d12/d20/f2f [0,4194304] 0 2024-09-21T10:40:52.546 INFO:tasks.workunit.client.0.smithi060.stdout:8/94: sync 2024-09-21T10:40:52.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/77: sync 2024-09-21T10:40:52.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/78: write d0/f16 [275656,28280] 0 2024-09-21T10:40:52.547 INFO:tasks.workunit.client.0.smithi060.stdout:4/202: mkdir d0/d44 0 2024-09-21T10:40:52.547 INFO:tasks.workunit.client.0.smithi060.stdout:4/203: chown d0/c3e 2 1 2024-09-21T10:40:52.549 INFO:tasks.workunit.client.0.smithi060.stdout:8/95: mknod d2/c1b 0 2024-09-21T10:40:52.549 INFO:tasks.workunit.client.0.smithi060.stdout:8/96: creat d2/f1c x:0 0 0 2024-09-21T10:40:52.551 INFO:tasks.workunit.client.1.smithi112.stdout:0/774: mkdir d3/d4a/d4e/dc2/d1a/dba/d102 0 2024-09-21T10:40:52.551 INFO:tasks.workunit.client.0.smithi060.stdout:3/79: symlink d0/d1/l17 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/80: stat d0/d1/f14 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/81: write d0/fd [1601329,24957] 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/82: stat d0/d1/l17 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/83: write d0/fd [4125752,35473] 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/84: stat d0/d1/l3 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.0.smithi060.stdout:3/85: fsync d0/d1/f12 0 2024-09-21T10:40:52.552 INFO:tasks.workunit.client.1.smithi112.stdout:3/718: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dc3/fe8 [0,4194304] 0 2024-09-21T10:40:52.553 INFO:tasks.workunit.client.1.smithi112.stdout:1/901: rename d8/d1a/db8/dbc to d8/d45/dae/d114 0 2024-09-21T10:40:52.553 INFO:tasks.workunit.client.0.smithi060.stdout:4/204: getdents d0/df 0 2024-09-21T10:40:52.555 INFO:tasks.workunit.client.1.smithi112.stdout:6/788: getdents d4/dc/d1a/d31/d56/d64/d84 0 2024-09-21T10:40:52.557 INFO:tasks.workunit.client.1.smithi112.stdout:5/774: chown d9/d15/l17 747772819 1 2024-09-21T10:40:52.558 INFO:tasks.workunit.client.0.smithi060.stdout:8/97: mknod d2/c1d 0 2024-09-21T10:40:52.558 INFO:tasks.workunit.client.0.smithi060.stdout:8/98: write d2/f15 [716708,79829] 0 2024-09-21T10:40:52.558 INFO:tasks.workunit.client.0.smithi060.stdout:8/99: chown d2/f8 122755274 1 2024-09-21T10:40:52.559 INFO:tasks.workunit.client.1.smithi112.stdout:8/739: mknod d8/d9/dd/d76/d97/cdb 0 2024-09-21T10:40:52.560 INFO:tasks.workunit.client.0.smithi060.stdout:4/205: creat d0/d5/d12/d20/f45 x:0 0 0 2024-09-21T10:40:52.562 INFO:tasks.workunit.client.0.smithi060.stdout:7/149: dwrite f6 [4194304,4194304] 0 2024-09-21T10:40:52.563 INFO:tasks.workunit.client.0.smithi060.stdout:3/86: dread d0/f16 [0,4194304] 0 2024-09-21T10:40:52.563 INFO:tasks.workunit.client.0.smithi060.stdout:3/87: write d0/d1/f12 [770337,73422] 0 2024-09-21T10:40:52.564 INFO:tasks.workunit.client.0.smithi060.stdout:4/206: mkdir d0/df/d46 0 2024-09-21T10:40:52.564 INFO:tasks.workunit.client.0.smithi060.stdout:4/207: stat d0/d5/d12/d20/d32/f37 0 2024-09-21T10:40:52.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/775: dread d3/d18/f80 [0,4194304] 0 2024-09-21T10:40:52.564 INFO:tasks.workunit.client.1.smithi112.stdout:0/776: write d3/d4a/fbd [871857,58918] 0 2024-09-21T10:40:52.566 INFO:tasks.workunit.client.1.smithi112.stdout:3/719: dread d2/f18 [0,4194304] 0 2024-09-21T10:40:52.566 INFO:tasks.workunit.client.0.smithi060.stdout:7/150: mkdir da/d14/d15/d16/d32 0 2024-09-21T10:40:52.568 INFO:tasks.workunit.client.0.smithi060.stdout:4/208: getdents d0/d3c 0 2024-09-21T10:40:52.568 INFO:tasks.workunit.client.0.smithi060.stdout:4/209: chown d0/c33 127 1 2024-09-21T10:40:52.570 INFO:tasks.workunit.client.1.smithi112.stdout:9/805: rename d1/d2/d27/d3a/d4c/fde to d1/d2/d27/d37/d3b/dec/d107/d10c/f119 0 2024-09-21T10:40:52.570 INFO:tasks.workunit.client.1.smithi112.stdout:9/806: creat d1/d2/d27/d37/f11a x:0 0 0 2024-09-21T10:40:52.571 INFO:tasks.workunit.client.0.smithi060.stdout:7/151: mkdir da/d14/d33 0 2024-09-21T10:40:52.572 INFO:tasks.workunit.client.1.smithi112.stdout:2/646: sync 2024-09-21T10:40:52.572 INFO:tasks.workunit.client.1.smithi112.stdout:7/696: sync 2024-09-21T10:40:52.572 INFO:tasks.workunit.client.1.smithi112.stdout:5/775: write d9/d15/d18/d3a/d61/d93/f98 [2948185,55395] 0 2024-09-21T10:40:52.573 INFO:tasks.workunit.client.1.smithi112.stdout:1/902: unlink d8/d20/f102 0 2024-09-21T10:40:52.577 INFO:tasks.workunit.client.0.smithi060.stdout:4/210: rmdir d0/d5/d12/d16/d28 39 2024-09-21T10:40:52.577 INFO:tasks.workunit.client.0.smithi060.stdout:8/100: rmdir d2 39 2024-09-21T10:40:52.578 INFO:tasks.workunit.client.1.smithi112.stdout:8/740: mknod d8/d9/dd/d76/cdc 0 2024-09-21T10:40:52.583 INFO:tasks.workunit.client.1.smithi112.stdout:9/807: read d1/d2/d27/d3a/d4c/fbd [1385355,33965] 0 2024-09-21T10:40:52.583 INFO:tasks.workunit.client.1.smithi112.stdout:3/720: unlink d2/c1e 0 2024-09-21T10:40:52.586 INFO:tasks.workunit.client.1.smithi112.stdout:6/789: rename d4/d6/d75/ca9 to d4/c112 0 2024-09-21T10:40:52.586 INFO:tasks.workunit.client.1.smithi112.stdout:6/790: fsync d4/d6/da/d11/d1f/d22/f26 0 2024-09-21T10:40:52.586 INFO:tasks.workunit.client.1.smithi112.stdout:6/791: write d4/d6/d9c/dce/fdf [790642,62633] 0 2024-09-21T10:40:52.589 INFO:tasks.workunit.client.1.smithi112.stdout:2/647: symlink d0/d12/d46/da0/ld2 0 2024-09-21T10:40:52.589 INFO:tasks.workunit.client.1.smithi112.stdout:2/648: chown d0/d12/d46/da0/db9/dbd/f52 794 1 2024-09-21T10:40:52.590 INFO:tasks.workunit.client.1.smithi112.stdout:3/721: dread f1 [0,4194304] 0 2024-09-21T10:40:52.590 INFO:tasks.workunit.client.1.smithi112.stdout:6/792: write d4/dc/d7e/f88 [4100946,40880] 0 2024-09-21T10:40:52.590 INFO:tasks.workunit.client.1.smithi112.stdout:7/697: mkdir d7/d22/d41/d4b/d52/d77/dbd/de4 0 2024-09-21T10:40:52.591 INFO:tasks.workunit.client.1.smithi112.stdout:7/698: write d7/d22/d41/d56/d72/dc4/fda [4678779,48965] 0 2024-09-21T10:40:52.593 INFO:tasks.workunit.client.0.smithi060.stdout:7/152: dwrite da/d14/d15/ff [0,4194304] 0 2024-09-21T10:40:52.594 INFO:tasks.workunit.client.1.smithi112.stdout:5/776: link d9/d15/d1d/c48 d9/d15/d18/d20/cee 0 2024-09-21T10:40:52.594 INFO:tasks.workunit.client.0.smithi060.stdout:7/153: dread da/d14/f19 [0,4194304] 0 2024-09-21T10:40:52.594 INFO:tasks.workunit.client.0.smithi060.stdout:7/154: write da/d14/d25/f2c [303788,55018] 0 2024-09-21T10:40:52.596 INFO:tasks.workunit.client.1.smithi112.stdout:8/741: mknod d8/d9/dd/d76/d97/cdd 0 2024-09-21T10:40:52.596 INFO:tasks.workunit.client.0.smithi060.stdout:3/88: dwrite d0/d1/f12 [0,4194304] 0 2024-09-21T10:40:52.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/808: dread d1/d2/d27/d3a/fb6 [0,4194304] 0 2024-09-21T10:40:52.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/809: creat d1/d2/d27/d3a/d6b/d30/d5c/f11b x:0 0 0 2024-09-21T10:40:52.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/810: write d1/d2/d27/d37/d3b/d69/d77/dca/dae/fb2 [996872,110070] 0 2024-09-21T10:40:52.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/811: fdatasync d1/d2/d27/d3a/f56 0 2024-09-21T10:40:52.599 INFO:tasks.workunit.client.1.smithi112.stdout:1/903: dwrite d8/d20/fc5 [0,4194304] 0 2024-09-21T10:40:52.600 INFO:tasks.workunit.client.0.smithi060.stdout:4/211: dwrite d0/d5/d12/d20/f2f [0,4194304] 0 2024-09-21T10:40:52.600 INFO:tasks.workunit.client.1.smithi112.stdout:0/777: rmdir d3/d18/d52/d55 39 2024-09-21T10:40:52.600 INFO:tasks.workunit.client.1.smithi112.stdout:2/649: mkdir d0/da2/dd3 0 2024-09-21T10:40:52.601 INFO:tasks.workunit.client.1.smithi112.stdout:3/722: getdents d2/d1f 0 2024-09-21T10:40:52.601 INFO:tasks.workunit.client.1.smithi112.stdout:3/723: dread - d2/d2f/d3f/ddf/d31/d2a/f85 zero size 2024-09-21T10:40:52.604 INFO:tasks.workunit.client.1.smithi112.stdout:7/699: symlink d7/d22/d41/d56/db7/le5 0 2024-09-21T10:40:52.604 INFO:tasks.workunit.client.1.smithi112.stdout:7/700: truncate d7/d22/d73/fa8 6268 0 2024-09-21T10:40:52.605 INFO:tasks.workunit.client.1.smithi112.stdout:5/777: mknod d9/d15/d18/cef 0 2024-09-21T10:40:52.607 INFO:tasks.workunit.client.1.smithi112.stdout:5/778: dread d9/d6e/fd2 [0,4194304] 0 2024-09-21T10:40:52.608 INFO:tasks.workunit.client.0.smithi060.stdout:7/155: symlink da/d14/l34 0 2024-09-21T10:40:52.609 INFO:tasks.workunit.client.1.smithi112.stdout:8/742: mknod d8/d9/dd/dab/cde 0 2024-09-21T10:40:52.609 INFO:tasks.workunit.client.1.smithi112.stdout:8/743: stat d8/d9/d3c/d90 0 2024-09-21T10:40:52.610 INFO:tasks.workunit.client.1.smithi112.stdout:3/724: read d2/d1f/f35 [562927,24289] 0 2024-09-21T10:40:52.612 INFO:tasks.workunit.client.1.smithi112.stdout:6/793: dread d4/d6/da/f2c [0,4194304] 0 2024-09-21T10:40:52.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/812: mkdir d1/d7f/df0/d11c 0 2024-09-21T10:40:52.615 INFO:tasks.workunit.client.0.smithi060.stdout:4/212: truncate d0/df/f17 897938 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:8/744: dread d8/d9/dd/d76/d97/fa8 [0,4194304] 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:8/745: truncate d8/d9/dd/d2a/d43/f47 4742974 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:0/778: dwrite d3/d4a/d4e/dc2/da8/f91 [0,4194304] 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:0/779: fsync d3/d18/d52/d55/fdc 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:2/650: mknod d0/d12/d77/cd4 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:2/651: write d0/fe [2721437,121058] 0 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:2/652: chown d0/dd/d47/fc3 8839136 1 2024-09-21T10:40:52.621 INFO:tasks.workunit.client.1.smithi112.stdout:2/653: chown d0/d12/f41 471738311 1 2024-09-21T10:40:52.622 INFO:tasks.workunit.client.0.smithi060.stdout:3/89: rmdir d0/d1 39 2024-09-21T10:40:52.623 INFO:tasks.workunit.client.1.smithi112.stdout:7/701: unlink d7/d22/d41/d56/d72/dc4/d4a/l69 0 2024-09-21T10:40:52.625 INFO:tasks.workunit.client.0.smithi060.stdout:4/213: creat d0/d5/d12/d16/f47 x:0 0 0 2024-09-21T10:40:52.626 INFO:tasks.workunit.client.1.smithi112.stdout:6/794: truncate d4/dc/d1a/d31/d56/fff 2274933 0 2024-09-21T10:40:52.626 INFO:tasks.workunit.client.1.smithi112.stdout:6/795: truncate d4/d6/da/d11/d37/d19/fb0 24086 0 2024-09-21T10:40:52.626 INFO:tasks.workunit.client.1.smithi112.stdout:5/779: write d9/d15/d18/d20/d47/fed [3109576,18494] 0 2024-09-21T10:40:52.628 INFO:tasks.workunit.client.1.smithi112.stdout:1/904: dwrite d8/f9a [0,4194304] 0 2024-09-21T10:40:52.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/725: write d2/f1b [1472095,112936] 0 2024-09-21T10:40:52.630 INFO:tasks.workunit.client.1.smithi112.stdout:9/813: link d1/d2/d27/d37/d3b/f78 d1/d2/d27/dc5/f11d 0 2024-09-21T10:40:52.630 INFO:tasks.workunit.client.1.smithi112.stdout:9/814: fdatasync d1/d2/d27/d3a/d6b/d30/fda 0 2024-09-21T10:40:52.634 INFO:tasks.workunit.client.0.smithi060.stdout:3/90: creat d0/d1/f18 x:0 0 0 2024-09-21T10:40:52.637 INFO:tasks.workunit.client.0.smithi060.stdout:7/156: rename da/d14/d15/d16 to da/d14/d35 0 2024-09-21T10:40:52.640 INFO:tasks.workunit.client.0.smithi060.stdout:3/91: mknod d0/d1/c19 0 2024-09-21T10:40:52.641 INFO:tasks.workunit.client.1.smithi112.stdout:8/746: mknod d8/d9/dd/d76/d97/cdf 0 2024-09-21T10:40:52.643 INFO:tasks.workunit.client.0.smithi060.stdout:7/157: creat da/d14/d35/f36 x:0 0 0 2024-09-21T10:40:52.643 INFO:tasks.workunit.client.0.smithi060.stdout:7/158: fsync da/f24 0 2024-09-21T10:40:52.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/780: symlink d3/d4a/d4e/dc2/d43/l103 0 2024-09-21T10:40:52.645 INFO:tasks.workunit.client.0.smithi060.stdout:3/92: link d0/d1/d11/f15 d0/d1/f1a 0 2024-09-21T10:40:52.645 INFO:tasks.workunit.client.0.smithi060.stdout:3/93: read - d0/d1/f18 zero size 2024-09-21T10:40:52.645 INFO:tasks.workunit.client.0.smithi060.stdout:3/94: chown d0/d1/l17 25 1 2024-09-21T10:40:52.646 INFO:tasks.workunit.client.1.smithi112.stdout:2/654: link d0/d12/d46/da0/db9/dbd/d62/d63/f4f d0/d12/d77/fd5 0 2024-09-21T10:40:52.656 INFO:tasks.workunit.client.0.smithi060.stdout:4/214: dwrite d0/f41 [0,4194304] 0 2024-09-21T10:40:52.656 INFO:tasks.workunit.client.0.smithi060.stdout:4/215: write d0/fc [5988650,20862] 0 2024-09-21T10:40:52.658 INFO:tasks.workunit.client.0.smithi060.stdout:7/159: symlink da/d14/d35/l37 0 2024-09-21T10:40:52.658 INFO:tasks.workunit.client.0.smithi060.stdout:7/160: chown da/fc 61439919 1 2024-09-21T10:40:52.658 INFO:tasks.workunit.client.0.smithi060.stdout:7/161: write da/d14/d35/f1d [2885317,62638] 0 2024-09-21T10:40:52.660 INFO:tasks.workunit.client.1.smithi112.stdout:7/702: dwrite d7/d22/d41/d56/d72/dc4/f9d [0,4194304] 0 2024-09-21T10:40:52.660 INFO:tasks.workunit.client.1.smithi112.stdout:7/703: stat d7/d3d/fc7 0 2024-09-21T10:40:52.660 INFO:tasks.workunit.client.1.smithi112.stdout:7/704: write d7/d22/d86/dac/fcf [964250,19230] 0 2024-09-21T10:40:52.661 INFO:tasks.workunit.client.0.smithi060.stdout:3/95: symlink d0/d1/d11/l1b 0 2024-09-21T10:40:52.663 INFO:tasks.workunit.client.1.smithi112.stdout:3/726: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/d98/fa5 [0,4194304] 0 2024-09-21T10:40:52.663 INFO:tasks.workunit.client.1.smithi112.stdout:3/727: readlink d2/d2f/d3f/l7b 0 2024-09-21T10:40:52.663 INFO:tasks.workunit.client.1.smithi112.stdout:3/728: dread - d2/d2f/d3f/fec zero size 2024-09-21T10:40:52.663 INFO:tasks.workunit.client.1.smithi112.stdout:3/729: truncate d2/d2f/d3f/ddf/d31/dcf/fc4 5101544 0 2024-09-21T10:40:52.663 INFO:tasks.workunit.client.1.smithi112.stdout:6/796: dwrite d4/d6/da/d11/ffd [0,4194304] 0 2024-09-21T10:40:52.663 INFO:tasks.workunit.client.1.smithi112.stdout:5/780: symlink d9/d15/d18/d3a/d61/d93/lf0 0 2024-09-21T10:40:52.670 INFO:tasks.workunit.client.1.smithi112.stdout:3/730: dread d2/d1f/f40 [0,4194304] 0 2024-09-21T10:40:52.673 INFO:tasks.workunit.client.0.smithi060.stdout:4/216: creat d0/d3c/f48 x:0 0 0 2024-09-21T10:40:52.675 INFO:tasks.workunit.client.0.smithi060.stdout:7/162: getdents da/d14 0 2024-09-21T10:40:52.676 INFO:tasks.workunit.client.0.smithi060.stdout:7/163: fsync da/d14/d15/ff 0 2024-09-21T10:40:52.677 INFO:tasks.workunit.client.1.smithi112.stdout:5/781: dwrite d9/d15/d18/d3a/d61/d62/d6b/fc0 [0,4194304] 0 2024-09-21T10:40:52.677 INFO:tasks.workunit.client.1.smithi112.stdout:5/782: fsync d9/d15/d1d/f1f 0 2024-09-21T10:40:52.678 INFO:tasks.workunit.client.1.smithi112.stdout:5/783: dread d9/d6e/fd2 [0,4194304] 0 2024-09-21T10:40:52.678 INFO:tasks.workunit.client.1.smithi112.stdout:5/784: truncate d9/d15/d18/f82 1653253 0 2024-09-21T10:40:52.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/217: symlink d0/d5/d12/d15/l49 0 2024-09-21T10:40:52.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/218: truncate d0/d5/f36 1093820 0 2024-09-21T10:40:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/164: creat da/d14/d33/f38 x:0 0 0 2024-09-21T10:40:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/165: fsync f8 0 2024-09-21T10:40:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/166: read da/d14/d35/d1e/f23 [2556398,129287] 0 2024-09-21T10:40:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/167: stat da/c28 0 2024-09-21T10:40:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/168: fsync da/f12 0 2024-09-21T10:40:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/169: dread - da/d14/d35/f30 zero size 2024-09-21T10:40:52.686 INFO:tasks.workunit.client.0.smithi060.stdout:4/219: creat d0/d44/f4a x:0 0 0 2024-09-21T10:40:52.688 INFO:tasks.workunit.client.1.smithi112.stdout:9/815: link d1/d2/d27/d62/d70/f21 d1/d2/d27/d3a/f11e 0 2024-09-21T10:40:52.688 INFO:tasks.workunit.client.0.smithi060.stdout:7/170: truncate da/d14/d15/ff 2615652 0 2024-09-21T10:40:52.690 INFO:tasks.workunit.client.0.smithi060.stdout:4/220: truncate d0/df/f17 54197 0 2024-09-21T10:40:52.692 INFO:tasks.workunit.client.1.smithi112.stdout:0/781: creat d3/d18/d52/f104 x:0 0 0 2024-09-21T10:40:52.693 INFO:tasks.workunit.client.0.smithi060.stdout:7/171: creat da/d14/d35/d1e/d27/f39 x:0 0 0 2024-09-21T10:40:52.696 INFO:tasks.workunit.client.1.smithi112.stdout:2/655: rename d0/l2b to d0/da2/ld6 0 2024-09-21T10:40:52.696 INFO:tasks.workunit.client.1.smithi112.stdout:2/656: truncate d0/f10 5196963 0 2024-09-21T10:40:52.696 INFO:tasks.workunit.client.1.smithi112.stdout:8/747: write d8/d18/fb4 [4193419,88183] 0 2024-09-21T10:40:52.698 INFO:tasks.workunit.client.0.smithi060.stdout:7/172: symlink da/d14/d35/d1e/l3a 0 2024-09-21T10:40:52.700 INFO:tasks.workunit.client.1.smithi112.stdout:7/705: truncate d7/d22/f31 6718558 0 2024-09-21T10:40:52.701 INFO:tasks.workunit.client.0.smithi060.stdout:7/173: link da/c10 da/d14/d35/c3b 0 2024-09-21T10:40:52.702 INFO:tasks.workunit.client.0.smithi060.stdout:7/174: readlink da/d14/d15/l11 0 2024-09-21T10:40:52.702 INFO:tasks.workunit.client.0.smithi060.stdout:7/175: chown da/d14/d35/f1a 37 1 2024-09-21T10:40:52.705 INFO:tasks.workunit.client.1.smithi112.stdout:6/797: creat d4/d6/da/d14/d49/d73/d74/db5/f113 x:0 0 0 2024-09-21T10:40:52.706 INFO:tasks.workunit.client.1.smithi112.stdout:3/731: creat d2/d2f/daf/ff1 x:0 0 0 2024-09-21T10:40:52.707 INFO:tasks.workunit.client.1.smithi112.stdout:3/732: readlink d2/d2f/d3f/ddf/lc6 0 2024-09-21T10:40:52.707 INFO:tasks.workunit.client.1.smithi112.stdout:3/733: write d2/f93 [982240,87684] 0 2024-09-21T10:40:52.707 INFO:tasks.workunit.client.1.smithi112.stdout:3/734: readlink d2/le5 0 2024-09-21T10:40:52.707 INFO:tasks.workunit.client.1.smithi112.stdout:5/785: rmdir d9/d15/d18/d3a/d61/d62/d6b 39 2024-09-21T10:40:52.707 INFO:tasks.workunit.client.1.smithi112.stdout:1/905: getdents d8/d54/db0 0 2024-09-21T10:40:52.708 INFO:tasks.workunit.client.1.smithi112.stdout:4/755: sync 2024-09-21T10:40:52.709 INFO:tasks.workunit.client.1.smithi112.stdout:9/816: mknod d1/d2/d27/d62/da1/c11f 0 2024-09-21T10:40:52.709 INFO:tasks.workunit.client.1.smithi112.stdout:1/906: dread d8/d1a/d31/d66/df5/f108 [0,4194304] 0 2024-09-21T10:40:52.709 INFO:tasks.workunit.client.1.smithi112.stdout:1/907: fdatasync d8/d1a/d53/d57/fe9 0 2024-09-21T10:40:52.710 INFO:tasks.workunit.client.1.smithi112.stdout:0/782: mknod d3/d4a/d4e/dc2/d1a/c105 0 2024-09-21T10:40:52.711 INFO:tasks.workunit.client.1.smithi112.stdout:2/657: creat d0/da4/dc5/fd7 x:0 0 0 2024-09-21T10:40:52.712 INFO:tasks.workunit.client.0.smithi060.stdout:5/61: sync 2024-09-21T10:40:52.713 INFO:tasks.workunit.client.1.smithi112.stdout:8/748: mknod d8/d9/dd/dab/d8e/dcb/ce0 0 2024-09-21T10:40:52.713 INFO:tasks.workunit.client.0.smithi060.stdout:4/221: dwrite d0/fc [0,4194304] 0 2024-09-21T10:40:52.714 INFO:tasks.workunit.client.1.smithi112.stdout:7/706: symlink d7/d22/d73/da1/le6 0 2024-09-21T10:40:52.715 INFO:tasks.workunit.client.1.smithi112.stdout:6/798: creat d4/d6/da/d11/d37/d19/df3/f114 x:0 0 0 2024-09-21T10:40:52.716 INFO:tasks.workunit.client.1.smithi112.stdout:6/799: dread - d4/d6/da/d14/d49/d73/d74/db5/f113 zero size 2024-09-21T10:40:52.716 INFO:tasks.workunit.client.1.smithi112.stdout:6/800: creat d4/d6/da/d11/d37/d19/df3/f115 x:0 0 0 2024-09-21T10:40:52.716 INFO:tasks.workunit.client.1.smithi112.stdout:6/801: creat d4/d6/da/d14/d49/d73/d74/f116 x:0 0 0 2024-09-21T10:40:52.717 INFO:tasks.workunit.client.0.smithi060.stdout:5/62: link d5/f8 d5/d9/f15 0 2024-09-21T10:40:52.717 INFO:tasks.workunit.client.0.smithi060.stdout:5/63: write d5/d9/f15 [2563063,68445] 0 2024-09-21T10:40:52.720 INFO:tasks.workunit.client.1.smithi112.stdout:5/786: rename d9/d15/d1d/c50 to d9/d8a/cf1 0 2024-09-21T10:40:52.720 INFO:tasks.workunit.client.1.smithi112.stdout:2/658: dread d0/dd/f29 [0,4194304] 0 2024-09-21T10:40:52.721 INFO:tasks.workunit.client.0.smithi060.stdout:4/222: unlink d0/d5/d12/d16/cd 0 2024-09-21T10:40:52.722 INFO:tasks.workunit.client.1.smithi112.stdout:1/908: write d8/d54/fa6 [2338604,23193] 0 2024-09-21T10:40:52.722 INFO:tasks.workunit.client.1.smithi112.stdout:4/756: mkdir de/d33/d2f/d35/d4c/d5c/dfa 0 2024-09-21T10:40:52.722 INFO:tasks.workunit.client.1.smithi112.stdout:4/757: write de/d33/db5/fb6 [1114786,106031] 0 2024-09-21T10:40:52.723 INFO:tasks.workunit.client.1.smithi112.stdout:9/817: symlink d1/d2/d27/d37/d3b/d69/d77/l120 0 2024-09-21T10:40:52.727 INFO:tasks.workunit.client.1.smithi112.stdout:0/783: mknod d3/d4a/d4e/dc2/d1a/d21/d46/c106 0 2024-09-21T10:40:52.728 INFO:tasks.workunit.client.1.smithi112.stdout:8/749: mkdir d8/d9/d3c/d90/de1 0 2024-09-21T10:40:52.728 INFO:tasks.workunit.client.1.smithi112.stdout:8/750: write d8/d9/d3c/f5c [4876075,57680] 0 2024-09-21T10:40:52.730 INFO:tasks.workunit.client.1.smithi112.stdout:7/707: creat d7/d22/d41/d54/fe7 x:0 0 0 2024-09-21T10:40:52.731 INFO:tasks.workunit.client.1.smithi112.stdout:7/708: write d7/d22/d86/f7d [363363,36870] 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.0.smithi060.stdout:5/64: dread d5/ff [0,4194304] 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.1.smithi112.stdout:1/909: write d8/d20/fc5 [2903205,114517] 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.1.smithi112.stdout:1/910: write d8/d45/dae/d114/fcf [784214,89960] 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.1.smithi112.stdout:1/911: fdatasync d8/d45/dfb/ffc 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.1.smithi112.stdout:3/735: dwrite d2/fa [0,4194304] 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.0.smithi060.stdout:7/176: dwrite da/d14/d35/f1a [0,4194304] 0 2024-09-21T10:40:52.734 INFO:tasks.workunit.client.0.smithi060.stdout:7/177: write da/d14/f19 [876375,4482] 0 2024-09-21T10:40:52.736 INFO:tasks.workunit.client.1.smithi112.stdout:5/787: creat d9/d15/ff2 x:0 0 0 2024-09-21T10:40:52.737 INFO:tasks.workunit.client.1.smithi112.stdout:2/659: mkdir d0/d12/d46/dd8 0 2024-09-21T10:40:52.737 INFO:tasks.workunit.client.1.smithi112.stdout:2/660: write d0/dd/f29 [5037849,91491] 0 2024-09-21T10:40:52.739 INFO:tasks.workunit.client.1.smithi112.stdout:6/802: dread d4/d6/d9c/dce/fdf [0,4194304] 0 2024-09-21T10:40:52.740 INFO:tasks.workunit.client.1.smithi112.stdout:4/758: mknod de/d33/d2f/d35/df3/dc2/dad/cfb 0 2024-09-21T10:40:52.741 INFO:tasks.workunit.client.1.smithi112.stdout:8/751: link d8/d9/dd/d2b/d31/lbb d8/d9/dd/d1a/dd4/le2 0 2024-09-21T10:40:52.741 INFO:tasks.workunit.client.1.smithi112.stdout:8/752: write d8/d9/dd/d2b/fca [914921,69369] 0 2024-09-21T10:40:52.741 INFO:tasks.workunit.client.1.smithi112.stdout:8/753: read d8/d9/dd/d2b/d31/d46/fa4 [3042806,83586] 0 2024-09-21T10:40:52.744 INFO:tasks.workunit.client.1.smithi112.stdout:1/912: creat d8/d1a/d31/da1/f115 x:0 0 0 2024-09-21T10:40:52.745 INFO:tasks.workunit.client.1.smithi112.stdout:3/736: mkdir d2/d2f/d3f/ddf/dad/df2 0 2024-09-21T10:40:52.745 INFO:tasks.workunit.client.1.smithi112.stdout:7/709: dread d7/ff [4194304,4194304] 0 2024-09-21T10:40:52.745 INFO:tasks.workunit.client.0.smithi060.stdout:7/178: dread da/d14/f19 [0,4194304] 0 2024-09-21T10:40:52.746 INFO:tasks.workunit.client.1.smithi112.stdout:0/784: dwrite d3/d4a/d4e/dc2/da8/ddf/ff0 [0,4194304] 0 2024-09-21T10:40:52.752 INFO:tasks.workunit.client.1.smithi112.stdout:2/661: dread d0/d12/d6c/d7e/d8f/f3c [0,4194304] 0 2024-09-21T10:40:52.752 INFO:tasks.workunit.client.1.smithi112.stdout:6/803: mknod d4/d6/d75/db7/c117 0 2024-09-21T10:40:52.753 INFO:tasks.workunit.client.1.smithi112.stdout:6/804: chown d4/d6/d9c 5612 1 2024-09-21T10:40:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:5/65: dread d5/d9/f15 [0,4194304] 0 2024-09-21T10:40:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:5/66: fdatasync d5/ff 0 2024-09-21T10:40:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:5/67: creat d5/f16 x:0 0 0 2024-09-21T10:40:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:5/68: stat c3 0 2024-09-21T10:40:52.756 INFO:tasks.workunit.client.1.smithi112.stdout:4/759: dread de/d33/d2f/d71/d40/d4f/f6b [4194304,4194304] 0 2024-09-21T10:40:52.759 INFO:tasks.workunit.client.1.smithi112.stdout:5/788: dwrite d9/ff [0,4194304] 0 2024-09-21T10:40:52.759 INFO:tasks.workunit.client.0.smithi060.stdout:4/223: dwrite d0/d5/d12/d20/d32/f37 [0,4194304] 0 2024-09-21T10:40:52.760 INFO:tasks.workunit.client.0.smithi060.stdout:5/69: creat d5/d9/d13/f17 x:0 0 0 2024-09-21T10:40:52.760 INFO:tasks.workunit.client.0.smithi060.stdout:5/70: fdatasync d5/f8 0 2024-09-21T10:40:52.760 INFO:tasks.workunit.client.0.smithi060.stdout:5/71: write d5/d9/f15 [4325523,49365] 0 2024-09-21T10:40:52.763 INFO:tasks.workunit.client.0.smithi060.stdout:7/179: dread da/f24 [4194304,4194304] 0 2024-09-21T10:40:52.763 INFO:tasks.workunit.client.0.smithi060.stdout:5/72: dread d5/d9/fe [0,4194304] 0 2024-09-21T10:40:52.763 INFO:tasks.workunit.client.0.smithi060.stdout:5/73: chown d5/d9/cd 23801 1 2024-09-21T10:40:52.767 INFO:tasks.workunit.client.0.smithi060.stdout:4/224: link d0/d5/d12/d20/f2f d0/d5/f4b 0 2024-09-21T10:40:52.768 INFO:tasks.workunit.client.0.smithi060.stdout:7/180: mknod da/d14/d2a/c3c 0 2024-09-21T10:40:52.768 INFO:tasks.workunit.client.1.smithi112.stdout:2/662: dwrite d0/d12/d6c/d7e/d8f/d51/d57/fb2 [0,4194304] 0 2024-09-21T10:40:52.769 INFO:tasks.workunit.client.0.smithi060.stdout:5/74: symlink d5/l18 0 2024-09-21T10:40:52.772 INFO:tasks.workunit.client.0.smithi060.stdout:4/225: symlink d0/d5/d12/d26/l4c 0 2024-09-21T10:40:52.774 INFO:tasks.workunit.client.0.smithi060.stdout:7/181: creat da/d14/d35/d1e/d2e/f3d x:0 0 0 2024-09-21T10:40:52.775 INFO:tasks.workunit.client.0.smithi060.stdout:4/226: mkdir d0/d5/d12/d15/d4d 0 2024-09-21T10:40:52.777 INFO:tasks.workunit.client.0.smithi060.stdout:7/182: symlink da/d14/d25/l3e 0 2024-09-21T10:40:52.778 INFO:tasks.workunit.client.1.smithi112.stdout:8/754: creat d8/fe3 x:0 0 0 2024-09-21T10:40:52.779 INFO:tasks.workunit.client.0.smithi060.stdout:4/227: truncate d0/d5/d12/d16/f1d 5514458 0 2024-09-21T10:40:52.781 INFO:tasks.workunit.client.1.smithi112.stdout:1/913: mknod d8/d1a/d31/da1/de7/df1/c116 0 2024-09-21T10:40:52.782 INFO:tasks.workunit.client.0.smithi060.stdout:7/183: mknod da/d14/d25/c3f 0 2024-09-21T10:40:52.782 INFO:tasks.workunit.client.0.smithi060.stdout:7/184: chown da/d14/d35 932467 1 2024-09-21T10:40:52.784 INFO:tasks.workunit.client.1.smithi112.stdout:7/710: mknod d7/ce8 0 2024-09-21T10:40:52.789 INFO:tasks.workunit.client.1.smithi112.stdout:6/805: dread d4/dc/d7e/f83 [0,4194304] 0 2024-09-21T10:40:52.789 INFO:tasks.workunit.client.1.smithi112.stdout:4/760: creat de/d33/d2f/ffc x:0 0 0 2024-09-21T10:40:52.789 INFO:tasks.workunit.client.0.smithi060.stdout:5/75: dwrite d5/f7 [0,4194304] 0 2024-09-21T10:40:52.789 INFO:tasks.workunit.client.0.smithi060.stdout:5/76: dread - d5/d9/d13/f17 zero size 2024-09-21T10:40:52.791 INFO:tasks.workunit.client.1.smithi112.stdout:5/789: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/lf3 0 2024-09-21T10:40:52.795 INFO:tasks.workunit.client.0.smithi060.stdout:7/185: read da/d14/d35/d1e/f23 [4915299,113670] 0 2024-09-21T10:40:52.798 INFO:tasks.workunit.client.1.smithi112.stdout:2/663: creat d0/d12/d6c/fd9 x:0 0 0 2024-09-21T10:40:52.799 INFO:tasks.workunit.client.1.smithi112.stdout:4/761: dread de/d18/f21 [0,4194304] 0 2024-09-21T10:40:52.800 INFO:tasks.workunit.client.1.smithi112.stdout:4/762: write de/d2a/fa6 [999630,51567] 0 2024-09-21T10:40:52.800 INFO:tasks.workunit.client.1.smithi112.stdout:4/763: write de/d2a/dbf/d82/f95 [3262984,73467] 0 2024-09-21T10:40:52.800 INFO:tasks.workunit.client.0.smithi060.stdout:4/228: dwrite d0/d44/f4a [0,4194304] 0 2024-09-21T10:40:52.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/755: mknod d8/d9/dd/d2a/d43/ce4 0 2024-09-21T10:40:52.802 INFO:tasks.workunit.client.1.smithi112.stdout:1/914: dwrite d8/d1a/d53/ff7 [0,4194304] 0 2024-09-21T10:40:52.802 INFO:tasks.workunit.client.1.smithi112.stdout:1/915: write d8/d20/f5b [270707,17454] 0 2024-09-21T10:40:52.802 INFO:tasks.workunit.client.1.smithi112.stdout:3/737: rename d2/d2f/d3f/ddf/d31/d2a/ce4 to d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/cf3 0 2024-09-21T10:40:52.803 INFO:tasks.workunit.client.0.smithi060.stdout:5/77: mkdir d5/d9/d10/d19 0 2024-09-21T10:40:52.803 INFO:tasks.workunit.client.0.smithi060.stdout:5/78: truncate d5/ff 4772351 0 2024-09-21T10:40:52.804 INFO:tasks.workunit.client.1.smithi112.stdout:7/711: link d7/d22/f46 d7/d22/d41/d56/d72/dc4/fe9 0 2024-09-21T10:40:52.805 INFO:tasks.workunit.client.0.smithi060.stdout:7/186: unlink da/d14/d35/d1e/l3a 0 2024-09-21T10:40:52.805 INFO:tasks.workunit.client.0.smithi060.stdout:7/187: dread - da/d14/d35/f30 zero size 2024-09-21T10:40:52.806 INFO:tasks.workunit.client.1.smithi112.stdout:5/790: symlink d9/d15/d18/lf4 0 2024-09-21T10:40:52.807 INFO:tasks.workunit.client.1.smithi112.stdout:4/764: symlink de/d33/d6f/d9c/lfd 0 2024-09-21T10:40:52.809 INFO:tasks.workunit.client.1.smithi112.stdout:8/756: mknod d8/d9/dd/d2b/d31/ce5 0 2024-09-21T10:40:52.810 INFO:tasks.workunit.client.0.smithi060.stdout:4/229: symlink d0/d5/d12/d16/d28/l4e 0 2024-09-21T10:40:52.813 INFO:tasks.workunit.client.1.smithi112.stdout:7/712: dread d7/d22/f31 [0,4194304] 0 2024-09-21T10:40:52.817 INFO:tasks.workunit.client.1.smithi112.stdout:1/916: unlink d8/d1a/d31/d66/lcd 0 2024-09-21T10:40:52.822 INFO:tasks.workunit.client.0.smithi060.stdout:7/188: creat da/d14/d35/f40 x:0 0 0 2024-09-21T10:40:52.823 INFO:tasks.workunit.client.1.smithi112.stdout:5/791: mkdir d9/d15/d18/d20/d47/dc6/df5 0 2024-09-21T10:40:52.824 INFO:tasks.workunit.client.0.smithi060.stdout:4/230: mknod d0/d5/d12/c4f 0 2024-09-21T10:40:52.824 INFO:tasks.workunit.client.1.smithi112.stdout:8/757: dread d8/d9/dd/d2a/f77 [0,4194304] 0 2024-09-21T10:40:52.825 INFO:tasks.workunit.client.1.smithi112.stdout:4/765: dwrite de/d33/d2f/d35/ff1 [0,4194304] 0 2024-09-21T10:40:52.825 INFO:tasks.workunit.client.1.smithi112.stdout:4/766: dread - de/d2a/dbf/fe4 zero size 2024-09-21T10:40:52.826 INFO:tasks.workunit.client.1.smithi112.stdout:1/917: symlink d8/d1a/l117 0 2024-09-21T10:40:52.826 INFO:tasks.workunit.client.1.smithi112.stdout:1/918: fsync d8/d1a/d31/da1/de7/ff3 0 2024-09-21T10:40:52.826 INFO:tasks.workunit.client.1.smithi112.stdout:1/919: creat d8/d45/f118 x:0 0 0 2024-09-21T10:40:52.826 INFO:tasks.workunit.client.1.smithi112.stdout:1/920: read - d8/f113 zero size 2024-09-21T10:40:52.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/79: getdents d5 0 2024-09-21T10:40:52.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/80: truncate d5/d9/fe 2043768 0 2024-09-21T10:40:52.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/81: stat d5/d9/d13 0 2024-09-21T10:40:52.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/82: chown d5/d9/cc 7 1 2024-09-21T10:40:52.829 INFO:tasks.workunit.client.0.smithi060.stdout:7/189: rmdir da/d14 39 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:9/148: sync 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:2/67: sync 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:0/105: sync 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/90: sync 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:2/68: write d3/f5 [2226334,113252] 0 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:2/69: stat d3/d7/dc/f11 0 2024-09-21T10:40:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:6/254: sync 2024-09-21T10:40:52.834 INFO:tasks.workunit.client.0.smithi060.stdout:4/231: link d0/d5/d12/c2e d0/d5/d12/c50 0 2024-09-21T10:40:52.836 INFO:tasks.workunit.client.1.smithi112.stdout:5/792: truncate d9/d15/d18/f31 3347094 0 2024-09-21T10:40:52.838 INFO:tasks.workunit.client.0.smithi060.stdout:7/190: mknod da/d14/d15/c41 0 2024-09-21T10:40:52.841 INFO:tasks.workunit.client.1.smithi112.stdout:8/758: creat d8/d9/dd/d1a/fe6 x:0 0 0 2024-09-21T10:40:52.842 INFO:tasks.workunit.client.0.smithi060.stdout:9/149: creat d3/d16/d20/d2f/f31 x:0 0 0 2024-09-21T10:40:52.843 INFO:tasks.workunit.client.1.smithi112.stdout:4/767: dwrite de/d2e/f32 [0,4194304] 0 2024-09-21T10:40:52.844 INFO:tasks.workunit.client.0.smithi060.stdout:1/91: mknod d6/d8/da/db/de/c1b 0 2024-09-21T10:40:52.850 INFO:tasks.workunit.client.0.smithi060.stdout:2/70: rename d3/d7/dc to d3/d7/d13 0 2024-09-21T10:40:52.850 INFO:tasks.workunit.client.0.smithi060.stdout:8/101: sync 2024-09-21T10:40:52.850 INFO:tasks.workunit.client.0.smithi060.stdout:3/96: sync 2024-09-21T10:40:52.850 INFO:tasks.workunit.client.0.smithi060.stdout:3/97: chown d0/d1/f1a 8122969 1 2024-09-21T10:40:52.851 INFO:tasks.workunit.client.1.smithi112.stdout:1/921: mkdir d8/d54/d6d/db5/dc2/d119 0 2024-09-21T10:40:52.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/232: mkdir d0/d44/d51 0 2024-09-21T10:40:52.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/233: chown d0/df/f17 2 1 2024-09-21T10:40:52.852 INFO:tasks.workunit.client.0.smithi060.stdout:4/234: chown d0/d5/d12/d16/d28/l4e 14 1 2024-09-21T10:40:52.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/806: rename d4/d6/da/d11/d37/d8b/da0/da5 to d4/d6/da/d11/d37/d19/df3/d118 0 2024-09-21T10:40:52.856 INFO:tasks.workunit.client.0.smithi060.stdout:6/255: dwrite d3/d12/d16/d22/f4a [0,4194304] 0 2024-09-21T10:40:52.857 INFO:tasks.workunit.client.0.smithi060.stdout:6/256: creat d3/d12/d38/d41/f4d x:0 0 0 2024-09-21T10:40:52.857 INFO:tasks.workunit.client.0.smithi060.stdout:0/106: dwrite f0 [4194304,4194304] 0 2024-09-21T10:40:52.859 INFO:tasks.workunit.client.0.smithi060.stdout:9/150: symlink d3/d16/l32 0 2024-09-21T10:40:52.859 INFO:tasks.workunit.client.0.smithi060.stdout:9/151: fsync d3/fc 0 2024-09-21T10:40:52.862 INFO:tasks.workunit.client.0.smithi060.stdout:1/92: mkdir d6/d8/da/db/d1c 0 2024-09-21T10:40:52.864 INFO:tasks.workunit.client.0.smithi060.stdout:2/71: getdents d3/d7/d13 0 2024-09-21T10:40:52.864 INFO:tasks.workunit.client.1.smithi112.stdout:1/922: dread d8/d1a/d53/ff7 [0,4194304] 0 2024-09-21T10:40:52.866 INFO:tasks.workunit.client.1.smithi112.stdout:8/759: unlink d8/d9/d3c/d6d/f93 0 2024-09-21T10:40:52.869 INFO:tasks.workunit.client.0.smithi060.stdout:8/102: rename f1 to d2/f1e 0 2024-09-21T10:40:52.875 INFO:tasks.workunit.client.0.smithi060.stdout:7/191: dwrite da/d14/d35/d1e/f23 [4194304,4194304] 0 2024-09-21T10:40:52.877 INFO:tasks.workunit.client.1.smithi112.stdout:4/768: dwrite de/d33/d6f/d9c/d3e/f64 [0,4194304] 0 2024-09-21T10:40:52.877 INFO:tasks.workunit.client.1.smithi112.stdout:4/769: write de/d33/d2f/d71/d40/f88 [529464,80890] 0 2024-09-21T10:40:52.877 INFO:tasks.workunit.client.1.smithi112.stdout:4/770: fdatasync de/d33/d6f/d9c/d3e/fbd 0 2024-09-21T10:40:52.877 INFO:tasks.workunit.client.1.smithi112.stdout:8/760: truncate d8/d9/d3c/f52 2921014 0 2024-09-21T10:40:52.878 INFO:tasks.workunit.client.1.smithi112.stdout:6/807: dwrite d4/d6/f109 [0,4194304] 0 2024-09-21T10:40:52.878 INFO:tasks.workunit.client.1.smithi112.stdout:6/808: write d4/d6/d75/d7a/fb3 [4712814,107810] 0 2024-09-21T10:40:52.879 INFO:tasks.workunit.client.0.smithi060.stdout:6/257: dwrite d3/d12/d16/f40 [4194304,4194304] 0 2024-09-21T10:40:52.880 INFO:tasks.workunit.client.0.smithi060.stdout:0/107: link d5/d10/d11/c18 d5/d10/da/c1a 0 2024-09-21T10:40:52.880 INFO:tasks.workunit.client.0.smithi060.stdout:0/108: read d5/d10/da/f12 [1751265,8338] 0 2024-09-21T10:40:52.882 INFO:tasks.workunit.client.0.smithi060.stdout:8/103: write d2/ff [448329,109893] 0 2024-09-21T10:40:52.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/152: mknod d3/d16/d20/c33 0 2024-09-21T10:40:52.886 INFO:tasks.workunit.client.0.smithi060.stdout:9/153: dread d3/d15/f17 [0,4194304] 0 2024-09-21T10:40:52.886 INFO:tasks.workunit.client.0.smithi060.stdout:9/154: truncate d3/d15/f2b 502670 0 2024-09-21T10:40:52.886 INFO:tasks.workunit.client.0.smithi060.stdout:9/155: readlink l1 0 2024-09-21T10:40:52.889 INFO:tasks.workunit.client.0.smithi060.stdout:4/235: rename d0/d5/d12/d16/d28/l4e to d0/d5/d12/d3d/l52 0 2024-09-21T10:40:52.889 INFO:tasks.workunit.client.0.smithi060.stdout:4/236: fsync d0/d5/f1a 0 2024-09-21T10:40:52.891 INFO:tasks.workunit.client.1.smithi112.stdout:8/761: dread d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:52.891 INFO:tasks.workunit.client.1.smithi112.stdout:8/762: dread - d8/d9/dd/dab/d8e/dcb/d82/dcc/fce zero size 2024-09-21T10:40:52.891 INFO:tasks.workunit.client.1.smithi112.stdout:8/763: chown d8/d9/dd/d2b/db8/db9 2464585 1 2024-09-21T10:40:52.895 INFO:tasks.workunit.client.1.smithi112.stdout:4/771: mknod de/d2e/df4/cfe 0 2024-09-21T10:40:52.896 INFO:tasks.workunit.client.0.smithi060.stdout:3/98: rmdir d0 39 2024-09-21T10:40:52.896 INFO:tasks.workunit.client.0.smithi060.stdout:3/99: write d0/fd [2417112,107400] 0 2024-09-21T10:40:52.897 INFO:tasks.workunit.client.1.smithi112.stdout:8/764: dread d8/d9/d3c/f50 [0,4194304] 0 2024-09-21T10:40:52.897 INFO:tasks.workunit.client.1.smithi112.stdout:8/765: creat d8/d9/dd/d1a/fe7 x:0 0 0 2024-09-21T10:40:52.897 INFO:tasks.workunit.client.1.smithi112.stdout:8/766: read d8/d9/dd/d1a/f26 [145502,19879] 0 2024-09-21T10:40:52.898 INFO:tasks.workunit.client.0.smithi060.stdout:7/192: rmdir da/d14 39 2024-09-21T10:40:52.899 INFO:tasks.workunit.client.0.smithi060.stdout:2/72: dwrite d3/f5 [0,4194304] 0 2024-09-21T10:40:52.899 INFO:tasks.workunit.client.0.smithi060.stdout:2/73: chown d3/f12 219324655 1 2024-09-21T10:40:52.899 INFO:tasks.workunit.client.0.smithi060.stdout:2/74: write d3/f12 [366480,87196] 0 2024-09-21T10:40:52.904 INFO:tasks.workunit.client.0.smithi060.stdout:6/258: mkdir d3/d12/d4e 0 2024-09-21T10:40:52.907 INFO:tasks.workunit.client.0.smithi060.stdout:3/100: write d0/d1/d11/f15 [3798173,114727] 0 2024-09-21T10:40:52.908 INFO:tasks.workunit.client.0.smithi060.stdout:6/259: dread d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:40:52.908 INFO:tasks.workunit.client.0.smithi060.stdout:6/260: creat d3/d12/d16/d1a/f4f x:0 0 0 2024-09-21T10:40:52.908 INFO:tasks.workunit.client.0.smithi060.stdout:6/261: dread - d3/d12/d16/d1a/f4c zero size 2024-09-21T10:40:52.909 INFO:tasks.workunit.client.1.smithi112.stdout:6/809: symlink d4/d6/da/d11/d37/d19/df3/d118/l119 0 2024-09-21T10:40:52.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/156: symlink d3/d16/l34 0 2024-09-21T10:40:52.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/157: write d3/d16/d20/d2f/f31 [622936,57480] 0 2024-09-21T10:40:52.911 INFO:tasks.workunit.client.0.smithi060.stdout:6/262: write d3/d12/d16/d1a/f3c [788269,12603] 0 2024-09-21T10:40:52.912 INFO:tasks.workunit.client.0.smithi060.stdout:6/263: stat d3/d12/d16/d22/f2f 0 2024-09-21T10:40:52.914 INFO:tasks.workunit.client.1.smithi112.stdout:3/738: rename d2/db0 to d2/d2f/daf/df4 0 2024-09-21T10:40:52.918 INFO:tasks.workunit.client.0.smithi060.stdout:4/237: getdents d0/d5/d12/d20/d32 0 2024-09-21T10:40:52.918 INFO:tasks.workunit.client.0.smithi060.stdout:4/238: readlink d0/d5/d12/d16/d28/l31 0 2024-09-21T10:40:52.920 INFO:tasks.workunit.client.1.smithi112.stdout:8/767: truncate d8/d9/dd/f16 5588713 0 2024-09-21T10:40:52.920 INFO:tasks.workunit.client.0.smithi060.stdout:7/193: read f6 [5703162,87227] 0 2024-09-21T10:40:52.920 INFO:tasks.workunit.client.0.smithi060.stdout:7/194: chown f0 3885 1 2024-09-21T10:40:52.921 INFO:tasks.workunit.client.0.smithi060.stdout:0/109: dwrite f2 [0,4194304] 0 2024-09-21T10:40:52.922 INFO:tasks.workunit.client.0.smithi060.stdout:8/104: dwrite d2/fe [0,4194304] 0 2024-09-21T10:40:52.925 INFO:tasks.workunit.client.1.smithi112.stdout:4/772: dwrite de/d33/d2f/f61 [0,4194304] 0 2024-09-21T10:40:52.925 INFO:tasks.workunit.client.1.smithi112.stdout:4/773: fsync de/d2a/dbf/d82/fb3 0 2024-09-21T10:40:52.926 INFO:tasks.workunit.client.1.smithi112.stdout:3/739: rmdir d2/d2f/d3f/ddf/dad/df2 0 2024-09-21T10:40:52.928 INFO:tasks.workunit.client.1.smithi112.stdout:7/713: rename d7/d22/d41/d56/da4 to d7/d22/d41/d4b/da2/dea 0 2024-09-21T10:40:52.928 INFO:tasks.workunit.client.1.smithi112.stdout:7/714: chown d7/d22/d41/d4b/d52/ce2 0 1 2024-09-21T10:40:52.931 INFO:tasks.workunit.client.0.smithi060.stdout:4/239: getdents d0/d5/d12 0 2024-09-21T10:40:52.934 INFO:tasks.workunit.client.1.smithi112.stdout:7/715: symlink d7/d22/d86/dac/leb 0 2024-09-21T10:40:52.936 INFO:tasks.workunit.client.0.smithi060.stdout:7/195: unlink da/d14/c1f 0 2024-09-21T10:40:52.937 INFO:tasks.workunit.client.0.smithi060.stdout:9/158: dwrite d3/d16/d1f/f2a [0,4194304] 0 2024-09-21T10:40:52.941 INFO:tasks.workunit.client.1.smithi112.stdout:7/716: mknod d7/d3d/da7/cec 0 2024-09-21T10:40:52.941 INFO:tasks.workunit.client.0.smithi060.stdout:0/110: link d5/d10/f8 d5/d10/da/d15/f1b 0 2024-09-21T10:40:52.941 INFO:tasks.workunit.client.0.smithi060.stdout:0/111: chown d5 500854 1 2024-09-21T10:40:52.943 INFO:tasks.workunit.client.0.smithi060.stdout:8/105: creat d2/f1f x:0 0 0 2024-09-21T10:40:52.943 INFO:tasks.workunit.client.1.smithi112.stdout:7/717: mknod d7/d22/d41/d4b/d52/ced 0 2024-09-21T10:40:52.946 INFO:tasks.workunit.client.1.smithi112.stdout:7/718: mkdir d7/d22/d73/dee 0 2024-09-21T10:40:52.948 INFO:tasks.workunit.client.0.smithi060.stdout:8/106: symlink d2/l20 0 2024-09-21T10:40:52.948 INFO:tasks.workunit.client.0.smithi060.stdout:2/75: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:52.948 INFO:tasks.workunit.client.0.smithi060.stdout:2/76: readlink d3/d7/la 0 2024-09-21T10:40:52.949 INFO:tasks.workunit.client.1.smithi112.stdout:7/719: symlink d7/d22/d41/d56/d5c/d9b/lef 0 2024-09-21T10:40:52.951 INFO:tasks.workunit.client.0.smithi060.stdout:8/107: getdents d2/d18 0 2024-09-21T10:40:52.951 INFO:tasks.workunit.client.0.smithi060.stdout:8/108: chown d2/c7 113 1 2024-09-21T10:40:52.955 INFO:tasks.workunit.client.1.smithi112.stdout:6/810: dwrite d4/d6/da/d11/d1f/d22/d86/ff2 [0,4194304] 0 2024-09-21T10:40:52.955 INFO:tasks.workunit.client.1.smithi112.stdout:6/811: write d4/d6/da/d14/d49/d73/fa4 [582084,48820] 0 2024-09-21T10:40:52.955 INFO:tasks.workunit.client.0.smithi060.stdout:0/112: dread d5/d10/da/f12 [0,4194304] 0 2024-09-21T10:40:52.958 INFO:tasks.workunit.client.1.smithi112.stdout:9/818: sync 2024-09-21T10:40:52.958 INFO:tasks.workunit.client.1.smithi112.stdout:8/768: dwrite d8/d9/dd/d2b/fc1 [0,4194304] 0 2024-09-21T10:40:52.961 INFO:tasks.workunit.client.1.smithi112.stdout:6/812: mknod d4/d6/da/d11/d1f/d22/d86/c11a 0 2024-09-21T10:40:52.961 INFO:tasks.workunit.client.1.smithi112.stdout:3/740: dwrite d2/d8d/feb [0,4194304] 0 2024-09-21T10:40:52.961 INFO:tasks.workunit.client.1.smithi112.stdout:4/774: dwrite de/d18/fc6 [0,4194304] 0 2024-09-21T10:40:52.962 INFO:tasks.workunit.client.1.smithi112.stdout:4/775: read de/fac [294988,4899] 0 2024-09-21T10:40:52.962 INFO:tasks.workunit.client.1.smithi112.stdout:4/776: creat de/d33/d2f/fff x:0 0 0 2024-09-21T10:40:52.963 INFO:tasks.workunit.client.1.smithi112.stdout:9/819: mkdir d1/d2/d27/d3a/d6b/d30/d121 0 2024-09-21T10:40:52.963 INFO:tasks.workunit.client.0.smithi060.stdout:4/240: dwrite d0/d3c/f48 [0,4194304] 0 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/264: getdents d3/d12/d16/d1a 0 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/265: write d3/d12/d16/d25/f3e [590165,85241] 0 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/266: chown d3/dd/f14 99 1 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/267: fsync d3/d12/d16/d1a/d21/f23 0 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/268: stat d3/f26 0 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.1.smithi112.stdout:4/777: dread de/d33/d2f/d71/d40/f88 [0,4194304] 0 2024-09-21T10:40:52.967 INFO:tasks.workunit.client.1.smithi112.stdout:4/778: creat de/d33/d2f/d35/f100 x:0 0 0 2024-09-21T10:40:52.968 INFO:tasks.workunit.client.1.smithi112.stdout:4/779: write de/d33/d2f/d71/fb1 [1044222,110325] 0 2024-09-21T10:40:52.968 INFO:tasks.workunit.client.0.smithi060.stdout:9/159: dwrite d3/fe [0,4194304] 0 2024-09-21T10:40:52.971 INFO:tasks.workunit.client.1.smithi112.stdout:7/720: dwrite d7/d22/d73/faf [0,4194304] 0 2024-09-21T10:40:52.971 INFO:tasks.workunit.client.1.smithi112.stdout:7/721: dread - d7/d22/d41/d4b/da2/dea/fae zero size 2024-09-21T10:40:52.988 INFO:tasks.workunit.client.1.smithi112.stdout:3/741: mkdir d2/d2f/d3f/ddf/d31/df5 0 2024-09-21T10:40:52.988 INFO:tasks.workunit.client.0.smithi060.stdout:2/77: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:40:52.990 INFO:tasks.workunit.client.0.smithi060.stdout:6/269: mknod d3/dd/c50 0 2024-09-21T10:40:52.993 INFO:tasks.workunit.client.0.smithi060.stdout:9/160: creat d3/f35 x:0 0 0 2024-09-21T10:40:52.994 INFO:tasks.workunit.client.1.smithi112.stdout:6/813: dread d4/d4f/f66 [4194304,4194304] 0 2024-09-21T10:40:52.994 INFO:tasks.workunit.client.1.smithi112.stdout:6/814: readlink d4/d6/da/d11/d1f/l6a 0 2024-09-21T10:40:52.995 INFO:tasks.workunit.client.1.smithi112.stdout:8/769: dwrite d8/d9/dd/fd1 [0,4194304] 0 2024-09-21T10:40:52.996 INFO:tasks.workunit.client.1.smithi112.stdout:8/770: write d8/d9/dd/dab/f65 [729453,31186] 0 2024-09-21T10:40:52.997 INFO:tasks.workunit.client.0.smithi060.stdout:8/109: truncate d2/fe 997883 0 2024-09-21T10:40:52.997 INFO:tasks.workunit.client.0.smithi060.stdout:8/110: fsync d2/f1f 0 2024-09-21T10:40:52.999 INFO:tasks.workunit.client.0.smithi060.stdout:4/241: dwrite d0/d5/d12/f19 [0,4194304] 0 2024-09-21T10:40:53.002 INFO:tasks.workunit.client.1.smithi112.stdout:9/820: mkdir d1/d2/d27/d62/da1/d122 0 2024-09-21T10:40:53.004 INFO:tasks.workunit.client.0.smithi060.stdout:6/270: dwrite d3/d12/d16/d1a/f3c [0,4194304] 0 2024-09-21T10:40:53.004 INFO:tasks.workunit.client.0.smithi060.stdout:6/271: write d3/d12/d16/d25/f45 [184376,90831] 0 2024-09-21T10:40:53.004 INFO:tasks.workunit.client.0.smithi060.stdout:6/272: chown d3/d12/d16/d25/d27/l33 44 1 2024-09-21T10:40:53.004 INFO:tasks.workunit.client.0.smithi060.stdout:6/273: chown d3/d12/d38/d41 5255 1 2024-09-21T10:40:53.005 INFO:tasks.workunit.client.0.smithi060.stdout:6/274: write d3/d12/d38/f3a [328731,91604] 0 2024-09-21T10:40:53.005 INFO:tasks.workunit.client.1.smithi112.stdout:4/780: getdents de/d33/d6f/d9c/d3e/d75 0 2024-09-21T10:40:53.007 INFO:tasks.workunit.client.1.smithi112.stdout:7/722: rmdir d7/d22/d41/d4b/d52 39 2024-09-21T10:40:53.011 INFO:tasks.workunit.client.1.smithi112.stdout:3/742: rename d2/f17 to d2/d2f/d3f/ddf/d31/d2a/d39/d3a/ff6 0 2024-09-21T10:40:53.013 INFO:tasks.workunit.client.1.smithi112.stdout:6/815: mkdir d4/dc/d1a/d31/d56/d11b 0 2024-09-21T10:40:53.013 INFO:tasks.workunit.client.1.smithi112.stdout:3/743: dread d2/d1f/f40 [0,4194304] 0 2024-09-21T10:40:53.014 INFO:tasks.workunit.client.1.smithi112.stdout:3/744: dread d2/d2f/d3f/ddf/d31/d2a/da1/fbc [0,4194304] 0 2024-09-21T10:40:53.015 INFO:tasks.workunit.client.0.smithi060.stdout:9/161: rename d3/c13 to d3/c36 0 2024-09-21T10:40:53.017 INFO:tasks.workunit.client.0.smithi060.stdout:8/111: symlink d2/d18/l21 0 2024-09-21T10:40:53.019 INFO:tasks.workunit.client.0.smithi060.stdout:4/242: symlink d0/d5/d12/d15/d4d/l53 0 2024-09-21T10:40:53.019 INFO:tasks.workunit.client.1.smithi112.stdout:0/785: sync 2024-09-21T10:40:53.019 INFO:tasks.workunit.client.1.smithi112.stdout:0/786: chown d3/d18/d52/d55/f93 276710419 1 2024-09-21T10:40:53.026 INFO:tasks.workunit.client.0.smithi060.stdout:2/78: mknod d3/c14 0 2024-09-21T10:40:53.027 INFO:tasks.workunit.client.1.smithi112.stdout:8/771: mkdir d8/d9/dd/dab/d8e/dcb/d82/dcc/de8 0 2024-09-21T10:40:53.029 INFO:tasks.workunit.client.0.smithi060.stdout:9/162: unlink d3/d16/d1f/f29 0 2024-09-21T10:40:53.030 INFO:tasks.workunit.client.1.smithi112.stdout:9/821: symlink d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/l123 0 2024-09-21T10:40:53.031 INFO:tasks.workunit.client.1.smithi112.stdout:4/781: link de/f12 de/d33/d2f/d71/f101 0 2024-09-21T10:40:53.032 INFO:tasks.workunit.client.1.smithi112.stdout:7/723: truncate d7/f10 455111 0 2024-09-21T10:40:53.032 INFO:tasks.workunit.client.1.smithi112.stdout:7/724: write d7/dbc/fcb [1029410,26827] 0 2024-09-21T10:40:53.033 INFO:tasks.workunit.client.0.smithi060.stdout:8/112: dwrite d2/f17 [0,4194304] 0 2024-09-21T10:40:53.033 INFO:tasks.workunit.client.0.smithi060.stdout:8/113: write d2/f1c [122257,57782] 0 2024-09-21T10:40:53.033 INFO:tasks.workunit.client.0.smithi060.stdout:9/163: dread d3/d16/d1a/f28 [0,4194304] 0 2024-09-21T10:40:53.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/745: rmdir d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dc3 39 2024-09-21T10:40:53.037 INFO:tasks.workunit.client.0.smithi060.stdout:2/79: dread d3/f12 [0,4194304] 0 2024-09-21T10:40:53.038 INFO:tasks.workunit.client.1.smithi112.stdout:0/787: unlink d3/d18/dc0/ccf 0 2024-09-21T10:40:53.042 INFO:tasks.workunit.client.1.smithi112.stdout:8/772: unlink d8/d18/fb4 0 2024-09-21T10:40:53.042 INFO:tasks.workunit.client.0.smithi060.stdout:9/164: dread d3/d16/d1f/f2c [0,4194304] 0 2024-09-21T10:40:53.043 INFO:tasks.workunit.client.1.smithi112.stdout:9/822: link d1/d2/d27/l6a d1/d2/d27/d37/d68/l124 0 2024-09-21T10:40:53.044 INFO:tasks.workunit.client.1.smithi112.stdout:4/782: unlink de/d33/d2f/d35/d4c/d5c/la4 0 2024-09-21T10:40:53.045 INFO:tasks.workunit.client.1.smithi112.stdout:7/725: mkdir d7/d22/d41/d56/d72/df0 0 2024-09-21T10:40:53.047 INFO:tasks.workunit.client.1.smithi112.stdout:6/816: link d4/d6/da/d14/d49/d73/d74/c9f d4/dc/d1a/d31/d3c/c11c 0 2024-09-21T10:40:53.048 INFO:tasks.workunit.client.0.smithi060.stdout:2/80: write d3/f5 [2009949,60777] 0 2024-09-21T10:40:53.048 INFO:tasks.workunit.client.0.smithi060.stdout:2/81: getdents d3/d7/d13 0 2024-09-21T10:40:53.050 INFO:tasks.workunit.client.1.smithi112.stdout:4/783: link de/d18/d6d/f70 de/d33/d2f/d35/df3/f102 0 2024-09-21T10:40:53.050 INFO:tasks.workunit.client.1.smithi112.stdout:4/784: stat de/d33/d6f/d9c/dc8 0 2024-09-21T10:40:53.050 INFO:tasks.workunit.client.1.smithi112.stdout:4/785: write de/d18/f76 [2672852,108156] 0 2024-09-21T10:40:53.050 INFO:tasks.workunit.client.1.smithi112.stdout:4/786: truncate de/d33/d2f/d71/d40/f72 2312107 0 2024-09-21T10:40:53.051 INFO:tasks.workunit.client.0.smithi060.stdout:2/82: mkdir d3/d7/d13/d15 0 2024-09-21T10:40:53.052 INFO:tasks.workunit.client.1.smithi112.stdout:0/788: rmdir d3/d4a/d4e/dc2/d43 39 2024-09-21T10:40:53.053 INFO:tasks.workunit.client.1.smithi112.stdout:4/787: symlink de/d33/d6f/d9c/l103 0 2024-09-21T10:40:53.054 INFO:tasks.workunit.client.1.smithi112.stdout:0/789: creat d3/d4a/d4e/d72/da0/f107 x:0 0 0 2024-09-21T10:40:53.054 INFO:tasks.workunit.client.1.smithi112.stdout:0/790: fdatasync d3/ffa 0 2024-09-21T10:40:53.055 INFO:tasks.workunit.client.1.smithi112.stdout:0/791: read d3/d4a/f64 [264456,96035] 0 2024-09-21T10:40:53.056 INFO:tasks.workunit.client.1.smithi112.stdout:9/823: dread d1/d2/f7b [0,4194304] 0 2024-09-21T10:40:53.057 INFO:tasks.workunit.client.1.smithi112.stdout:4/788: rename de/d33/d2f/cd1 to de/d33/d2f/d35/df3/dcc/c104 0 2024-09-21T10:40:53.057 INFO:tasks.workunit.client.1.smithi112.stdout:4/789: write de/d2a/dbf/d82/fb3 [248820,80206] 0 2024-09-21T10:40:53.057 INFO:tasks.workunit.client.1.smithi112.stdout:4/790: readlink de/d33/d6f/d9c/la9 0 2024-09-21T10:40:53.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/83: dread d3/d7/fd [0,4194304] 0 2024-09-21T10:40:53.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/84: truncate d3/f5 5277097 0 2024-09-21T10:40:53.058 INFO:tasks.workunit.client.1.smithi112.stdout:4/791: creat de/d2e/df4/f105 x:0 0 0 2024-09-21T10:40:53.059 INFO:tasks.workunit.client.1.smithi112.stdout:9/824: symlink d1/d2/d27/d37/d3b/d69/l125 0 2024-09-21T10:40:53.060 INFO:tasks.workunit.client.1.smithi112.stdout:0/792: mknod d3/d4a/d4e/dc2/d1a/dba/c108 0 2024-09-21T10:40:53.062 INFO:tasks.workunit.client.1.smithi112.stdout:7/726: write d7/f26 [3500301,117888] 0 2024-09-21T10:40:53.062 INFO:tasks.workunit.client.1.smithi112.stdout:4/792: rename de/d2e/df4/cfe to de/d33/db5/c106 0 2024-09-21T10:40:53.063 INFO:tasks.workunit.client.1.smithi112.stdout:9/825: truncate d1/d2/f1e 1951343 0 2024-09-21T10:40:53.063 INFO:tasks.workunit.client.1.smithi112.stdout:9/826: read d1/d2/f75 [795131,102922] 0 2024-09-21T10:40:53.064 INFO:tasks.workunit.client.1.smithi112.stdout:0/793: mknod d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/dde/c109 0 2024-09-21T10:40:53.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/85: dread d3/f12 [0,4194304] 0 2024-09-21T10:40:53.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/86: readlink d3/d7/la 0 2024-09-21T10:40:53.066 INFO:tasks.workunit.client.1.smithi112.stdout:4/793: link de/d33/d6f/d9c/cd7 de/d2a/dbf/d82/de8/c107 0 2024-09-21T10:40:53.067 INFO:tasks.workunit.client.1.smithi112.stdout:4/794: symlink de/d33/d6f/d9c/d3e/l108 0 2024-09-21T10:40:53.068 INFO:tasks.workunit.client.1.smithi112.stdout:4/795: mkdir de/d109 0 2024-09-21T10:40:53.069 INFO:tasks.workunit.client.1.smithi112.stdout:4/796: mknod de/d33/d2f/d71/d40/c10a 0 2024-09-21T10:40:53.070 INFO:tasks.workunit.client.0.smithi060.stdout:2/87: dread d3/f12 [0,4194304] 0 2024-09-21T10:40:53.071 INFO:tasks.workunit.client.0.smithi060.stdout:9/165: dwrite d3/fa [4194304,4194304] 0 2024-09-21T10:40:53.072 INFO:tasks.workunit.client.0.smithi060.stdout:9/166: write d3/d16/d20/f25 [5080259,84113] 0 2024-09-21T10:40:53.074 INFO:tasks.workunit.client.1.smithi112.stdout:0/794: write d3/d18/d52/d55/dcc/fab [4749826,70718] 0 2024-09-21T10:40:53.074 INFO:tasks.workunit.client.1.smithi112.stdout:3/746: dwrite d2/d2f/d3f/ddf/d31/d37/f68 [0,4194304] 0 2024-09-21T10:40:53.074 INFO:tasks.workunit.client.1.smithi112.stdout:0/795: write d3/d18/d45/fbf [1020507,118355] 0 2024-09-21T10:40:53.074 INFO:tasks.workunit.client.1.smithi112.stdout:0/796: truncate d3/d18/dc0/fef 970902 0 2024-09-21T10:40:53.078 INFO:tasks.workunit.client.1.smithi112.stdout:3/747: unlink d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fd1 0 2024-09-21T10:40:53.080 INFO:tasks.workunit.client.1.smithi112.stdout:9/827: dread d1/d2/f75 [0,4194304] 0 2024-09-21T10:40:53.080 INFO:tasks.workunit.client.1.smithi112.stdout:3/748: link d2/d2f/d3f/ddf/d31/d2a/d39/d60/f6f d2/d2f/daf/dca/ff7 0 2024-09-21T10:40:53.083 INFO:tasks.workunit.client.0.smithi060.stdout:8/114: write d2/fe [977827,78591] 0 2024-09-21T10:40:53.083 INFO:tasks.workunit.client.0.smithi060.stdout:8/115: write d2/fc [1407529,89606] 0 2024-09-21T10:40:53.083 INFO:tasks.workunit.client.1.smithi112.stdout:3/749: dread d2/d1f/fc8 [0,4194304] 0 2024-09-21T10:40:53.084 INFO:tasks.workunit.client.1.smithi112.stdout:9/828: creat d1/d2/d27/d37/d3b/dec/f126 x:0 0 0 2024-09-21T10:40:53.086 INFO:tasks.workunit.client.0.smithi060.stdout:2/88: truncate d3/f12 1877954 0 2024-09-21T10:40:53.088 INFO:tasks.workunit.client.0.smithi060.stdout:2/89: dread d3/d7/fd [0,4194304] 0 2024-09-21T10:40:53.088 INFO:tasks.workunit.client.0.smithi060.stdout:2/90: rename d3/d7/d13 to d3/d7/d13/d16 22 2024-09-21T10:40:53.089 INFO:tasks.workunit.client.0.smithi060.stdout:8/116: link d2/fe d2/d18/f22 0 2024-09-21T10:40:53.089 INFO:tasks.workunit.client.0.smithi060.stdout:8/117: fsync d2/f17 0 2024-09-21T10:40:53.089 INFO:tasks.workunit.client.0.smithi060.stdout:4/243: dwrite d0/d5/d12/d16/d28/f3b [0,4194304] 0 2024-09-21T10:40:53.090 INFO:tasks.workunit.client.0.smithi060.stdout:4/244: dread - d0/d5/d12/d20/f45 zero size 2024-09-21T10:40:53.092 INFO:tasks.workunit.client.1.smithi112.stdout:3/750: unlink d2/d2f/d3f/ddf/d31/d2a/f85 0 2024-09-21T10:40:53.092 INFO:tasks.workunit.client.1.smithi112.stdout:3/751: truncate d2/f51 2140819 0 2024-09-21T10:40:53.092 INFO:tasks.workunit.client.1.smithi112.stdout:6/817: dwrite d4/d6/da/f12 [0,4194304] 0 2024-09-21T10:40:53.094 INFO:tasks.workunit.client.0.smithi060.stdout:2/91: dread d3/f5 [0,4194304] 0 2024-09-21T10:40:53.094 INFO:tasks.workunit.client.1.smithi112.stdout:5/793: sync 2024-09-21T10:40:53.094 INFO:tasks.workunit.client.1.smithi112.stdout:1/923: sync 2024-09-21T10:40:53.094 INFO:tasks.workunit.client.1.smithi112.stdout:2/664: sync 2024-09-21T10:40:53.094 INFO:tasks.workunit.client.1.smithi112.stdout:5/794: write d9/d15/d18/d3a/d4b/fab [717589,71203] 0 2024-09-21T10:40:53.098 INFO:tasks.workunit.client.1.smithi112.stdout:3/752: dread d2/f18 [0,4194304] 0 2024-09-21T10:40:53.100 INFO:tasks.workunit.client.1.smithi112.stdout:6/818: link d4/dc/d1a/d31/d56/f9a d4/d6/da/d14/d49/d73/f11d 0 2024-09-21T10:40:53.103 INFO:tasks.workunit.client.1.smithi112.stdout:1/924: write d8/d54/d6d/f70 [158017,59825] 0 2024-09-21T10:40:53.103 INFO:tasks.workunit.client.1.smithi112.stdout:2/665: mknod d0/d12/d46/d86/cda 0 2024-09-21T10:40:53.105 INFO:tasks.workunit.client.0.smithi060.stdout:8/118: rename d2/fc to d2/f23 0 2024-09-21T10:40:53.107 INFO:tasks.workunit.client.1.smithi112.stdout:5/795: creat d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf/ff6 x:0 0 0 2024-09-21T10:40:53.113 INFO:tasks.workunit.client.0.smithi060.stdout:4/245: creat d0/d5/d12/d15/d4d/f54 x:0 0 0 2024-09-21T10:40:53.113 INFO:tasks.workunit.client.0.smithi060.stdout:4/246: chown d0/df/c1e 435 1 2024-09-21T10:40:53.114 INFO:tasks.workunit.client.1.smithi112.stdout:2/666: creat d0/da4/dbe/fdb x:0 0 0 2024-09-21T10:40:53.114 INFO:tasks.workunit.client.1.smithi112.stdout:2/667: read - d0/d12/d46/da0/db9/dbd/d62/fb8 zero size 2024-09-21T10:40:53.115 INFO:tasks.workunit.client.0.smithi060.stdout:2/92: mkdir d3/d7/d13/d17 0 2024-09-21T10:40:53.116 INFO:tasks.workunit.client.1.smithi112.stdout:5/796: rmdir d9/d15/d18/d3a/d61/d62/d6b 39 2024-09-21T10:40:53.116 INFO:tasks.workunit.client.1.smithi112.stdout:5/797: dread - d9/d15/d18/d3a/d4b/d74/d8d/fd5 zero size 2024-09-21T10:40:53.117 INFO:tasks.workunit.client.1.smithi112.stdout:1/925: dwrite d8/d20/f4a [0,4194304] 0 2024-09-21T10:40:53.117 INFO:tasks.workunit.client.1.smithi112.stdout:1/926: write d8/d1a/db8/fc4 [346676,128352] 0 2024-09-21T10:40:53.118 INFO:tasks.workunit.client.0.smithi060.stdout:8/119: link d2/f12 d2/f24 0 2024-09-21T10:40:53.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/819: getdents d4/d6/da/d14/d49/d73/d74/db5 0 2024-09-21T10:40:53.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/820: chown d4/dc/d1a/d31/d3c/c11c 6517 1 2024-09-21T10:40:53.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/821: chown d4/dc/d1a/cb2 172469474 1 2024-09-21T10:40:53.122 INFO:tasks.workunit.client.1.smithi112.stdout:5/798: creat d9/d15/d18/d3a/d4b/ff7 x:0 0 0 2024-09-21T10:40:53.123 INFO:tasks.workunit.client.0.smithi060.stdout:4/247: stat d0/d5/d12/c2e 0 2024-09-21T10:40:53.123 INFO:tasks.workunit.client.1.smithi112.stdout:2/668: dread d0/d12/d6c/d7e/d8f/d51/f70 [0,4194304] 0 2024-09-21T10:40:53.124 INFO:tasks.workunit.client.1.smithi112.stdout:1/927: link d8/d20/l4c d8/d54/d6d/db5/dc2/de6/d10f/l11a 0 2024-09-21T10:40:53.124 INFO:tasks.workunit.client.1.smithi112.stdout:1/928: read d8/d54/db0/fef [3211485,124759] 0 2024-09-21T10:40:53.125 INFO:tasks.workunit.client.0.smithi060.stdout:2/93: mkdir d3/d7/d18 0 2024-09-21T10:40:53.125 INFO:tasks.workunit.client.0.smithi060.stdout:2/94: stat d3/d7/d13/d15 0 2024-09-21T10:40:53.125 INFO:tasks.workunit.client.1.smithi112.stdout:6/822: truncate d4/d6/f10c 53309 0 2024-09-21T10:40:53.127 INFO:tasks.workunit.client.0.smithi060.stdout:8/120: mknod d2/c25 0 2024-09-21T10:40:53.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/248: rename d0/d5/d12/c2e to d0/d5/d12/d3d/c55 0 2024-09-21T10:40:53.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/249: chown d0/d5/d12/d20/c23 995 1 2024-09-21T10:40:53.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/250: dread - d0/d5/d12/d15/f2c zero size 2024-09-21T10:40:53.130 INFO:tasks.workunit.client.0.smithi060.stdout:4/251: write d0/d5/d12/d16/f1d [1703366,68109] 0 2024-09-21T10:40:53.131 INFO:tasks.workunit.client.0.smithi060.stdout:8/121: mkdir d2/d26 0 2024-09-21T10:40:53.138 INFO:tasks.workunit.client.0.smithi060.stdout:4/252: dread d0/d5/d12/d20/f2f [0,4194304] 0 2024-09-21T10:40:53.138 INFO:tasks.workunit.client.1.smithi112.stdout:5/799: mkdir d9/d15/d18/d3a/d4b/d74/d8d/d9a/df8 0 2024-09-21T10:40:53.139 INFO:tasks.workunit.client.1.smithi112.stdout:5/800: fdatasync d9/d15/d18/d3a/d4b/ff7 0 2024-09-21T10:40:53.139 INFO:tasks.workunit.client.1.smithi112.stdout:4/797: getdents de/d33/d6f/d9c/d3e 0 2024-09-21T10:40:53.141 INFO:tasks.workunit.client.1.smithi112.stdout:2/669: creat d0/d12/d46/d86/dc0/dc8/fdc x:0 0 0 2024-09-21T10:40:53.142 INFO:tasks.workunit.client.0.smithi060.stdout:4/253: getdents d0/d5/d12/d26 0 2024-09-21T10:40:53.142 INFO:tasks.workunit.client.0.smithi060.stdout:4/254: truncate d0/d5/d12/d16/f47 818206 0 2024-09-21T10:40:53.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/255: link d0/d5/d12/f19 d0/d3c/f56 0 2024-09-21T10:40:53.146 INFO:tasks.workunit.client.1.smithi112.stdout:6/823: creat d4/d6/da/d11/d37/db8/f11e x:0 0 0 2024-09-21T10:40:53.146 INFO:tasks.workunit.client.1.smithi112.stdout:6/824: truncate d4/dc/d1a/f107 798896 0 2024-09-21T10:40:53.146 INFO:tasks.workunit.client.0.smithi060.stdout:8/122: dwrite d2/ff [0,4194304] 0 2024-09-21T10:40:53.147 INFO:tasks.workunit.client.0.smithi060.stdout:8/123: write d2/f1f [728965,20295] 0 2024-09-21T10:40:53.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/801: mknod d9/d15/d18/d3a/cf9 0 2024-09-21T10:40:53.151 INFO:tasks.workunit.client.1.smithi112.stdout:5/802: chown d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1 46506 1 2024-09-21T10:40:53.152 INFO:tasks.workunit.client.0.smithi060.stdout:8/124: mknod d2/d18/c27 0 2024-09-21T10:40:53.152 INFO:tasks.workunit.client.0.smithi060.stdout:8/125: chown d2/d18 1 1 2024-09-21T10:40:53.152 INFO:tasks.workunit.client.1.smithi112.stdout:4/798: mknod de/d33/d2f/d35/df3/dc2/dad/c10b 0 2024-09-21T10:40:53.153 INFO:tasks.workunit.client.0.smithi060.stdout:4/256: rmdir d0/d44 39 2024-09-21T10:40:53.154 INFO:tasks.workunit.client.1.smithi112.stdout:9/829: getdents d1/d2/d27/d37/d3b/dec 0 2024-09-21T10:40:53.155 INFO:tasks.workunit.client.1.smithi112.stdout:2/670: creat d0/da2/fdd x:0 0 0 2024-09-21T10:40:53.155 INFO:tasks.workunit.client.1.smithi112.stdout:2/671: fdatasync d0/d12/d6c/f9a 0 2024-09-21T10:40:53.155 INFO:tasks.workunit.client.1.smithi112.stdout:2/672: chown d0/d12/d76/lcf 79 1 2024-09-21T10:40:53.155 INFO:tasks.workunit.client.1.smithi112.stdout:6/825: dread d4/d6/da/d11/d1f/d22/d100/f85 [0,4194304] 0 2024-09-21T10:40:53.161 INFO:tasks.workunit.client.1.smithi112.stdout:9/830: creat d1/d7f/f127 x:0 0 0 2024-09-21T10:40:53.161 INFO:tasks.workunit.client.1.smithi112.stdout:9/831: fsync d1/d2/f5 0 2024-09-21T10:40:53.162 INFO:tasks.workunit.client.0.smithi060.stdout:8/126: symlink d2/d26/l28 0 2024-09-21T10:40:53.163 INFO:tasks.workunit.client.1.smithi112.stdout:2/673: unlink d0/d12/d46/da0/db9/dbd/d62/fba 0 2024-09-21T10:40:53.165 INFO:tasks.workunit.client.0.smithi060.stdout:4/257: rename d0/d5/d12/d26 to d0/d5/d12/d20/d32/d57 0 2024-09-21T10:40:53.166 INFO:tasks.workunit.client.1.smithi112.stdout:4/799: dwrite de/d33/d2f/d71/d40/d4f/fd3 [4194304,4194304] 0 2024-09-21T10:40:53.166 INFO:tasks.workunit.client.1.smithi112.stdout:4/800: truncate de/d33/d2f/d35/d4c/f97 492775 0 2024-09-21T10:40:53.166 INFO:tasks.workunit.client.1.smithi112.stdout:4/801: chown de/d33/d6f/c89 4 1 2024-09-21T10:40:53.166 INFO:tasks.workunit.client.1.smithi112.stdout:6/826: creat d4/dfb/f11f x:0 0 0 2024-09-21T10:40:53.167 INFO:tasks.workunit.client.0.smithi060.stdout:8/127: unlink d2/f24 0 2024-09-21T10:40:53.168 INFO:tasks.workunit.client.1.smithi112.stdout:5/803: mknod d9/d15/d18/d20/d47/cfa 0 2024-09-21T10:40:53.170 INFO:tasks.workunit.client.0.smithi060.stdout:4/258: link d0/d5/d12/d16/d28/l38 d0/d5/d12/d16/l58 0 2024-09-21T10:40:53.170 INFO:tasks.workunit.client.0.smithi060.stdout:4/259: stat d0/df/c1e 0 2024-09-21T10:40:53.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/674: mknod d0/d12/d46/dd8/cde 0 2024-09-21T10:40:53.174 INFO:tasks.workunit.client.0.smithi060.stdout:8/128: creat d2/d26/f29 x:0 0 0 2024-09-21T10:40:53.174 INFO:tasks.workunit.client.0.smithi060.stdout:8/129: readlink d2/l6 0 2024-09-21T10:40:53.175 INFO:tasks.workunit.client.1.smithi112.stdout:4/802: read de/d18/d6d/faa [1000562,33518] 0 2024-09-21T10:40:53.178 INFO:tasks.workunit.client.0.smithi060.stdout:8/130: symlink d2/l2a 0 2024-09-21T10:40:53.180 INFO:tasks.workunit.client.0.smithi060.stdout:8/131: truncate d2/f8 11399 0 2024-09-21T10:40:53.182 INFO:tasks.workunit.client.1.smithi112.stdout:6/827: creat d4/f120 x:0 0 0 2024-09-21T10:40:53.183 INFO:tasks.workunit.client.1.smithi112.stdout:6/828: read - d4/d6/da/d11/d1f/d22/d100/f110 zero size 2024-09-21T10:40:53.184 INFO:tasks.workunit.client.1.smithi112.stdout:5/804: dwrite d9/d15/d18/d3a/d4b/f6f [0,4194304] 0 2024-09-21T10:40:53.187 INFO:tasks.workunit.client.1.smithi112.stdout:2/675: mknod d0/da2/cdf 0 2024-09-21T10:40:53.188 INFO:tasks.workunit.client.1.smithi112.stdout:4/803: mkdir de/d33/d2f/d71/d40/d4f/d10c 0 2024-09-21T10:40:53.192 INFO:tasks.workunit.client.1.smithi112.stdout:5/805: mkdir d9/d6e/dfb 0 2024-09-21T10:40:53.192 INFO:tasks.workunit.client.1.smithi112.stdout:1/929: truncate d8/d54/d6d/f70 6257680 0 2024-09-21T10:40:53.196 INFO:tasks.workunit.client.1.smithi112.stdout:5/806: getdents d9/d15/d18/d3a/d61/d62 0 2024-09-21T10:40:53.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/807: link d9/d15/d18/d3a/d4b/ff7 d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/ffc 0 2024-09-21T10:40:53.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/808: chown d9/d15/d18/d3a/f2d 21 1 2024-09-21T10:40:53.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/809: dread - d9/d15/d18/d3a/d61/d62/fea zero size 2024-09-21T10:40:53.198 INFO:tasks.workunit.client.1.smithi112.stdout:5/810: dread - d9/d8a/fb9 zero size 2024-09-21T10:40:53.200 INFO:tasks.workunit.client.1.smithi112.stdout:4/804: dread de/d33/d2f/f61 [0,4194304] 0 2024-09-21T10:40:53.202 INFO:tasks.workunit.client.1.smithi112.stdout:4/805: symlink de/d33/d2f/d71/d40/l10d 0 2024-09-21T10:40:53.202 INFO:tasks.workunit.client.1.smithi112.stdout:2/676: dwrite d0/d12/d97/faa [4194304,4194304] 0 2024-09-21T10:40:53.203 INFO:tasks.workunit.client.1.smithi112.stdout:4/806: rename de/d33/d6f/d9c/f7a to de/d2a/dbf/f10e 0 2024-09-21T10:40:53.203 INFO:tasks.workunit.client.1.smithi112.stdout:4/807: stat de/d18/f21 0 2024-09-21T10:40:53.205 INFO:tasks.workunit.client.1.smithi112.stdout:2/677: creat d0/d12/d6c/d7e/d8f/fe0 x:0 0 0 2024-09-21T10:40:53.205 INFO:tasks.workunit.client.0.smithi060.stdout:8/132: getdents d2/d18 0 2024-09-21T10:40:53.207 INFO:tasks.workunit.client.1.smithi112.stdout:2/678: mkdir d0/d12/d46/da0/db9/dbd/de1 0 2024-09-21T10:40:53.207 INFO:tasks.workunit.client.1.smithi112.stdout:2/679: dread - d0/d12/d46/da0/db9/dbd/d62/d89/fc6 zero size 2024-09-21T10:40:53.215 INFO:tasks.workunit.client.0.smithi060.stdout:5/83: sync 2024-09-21T10:40:53.215 INFO:tasks.workunit.client.0.smithi060.stdout:5/84: fdatasync d5/d9/fe 0 2024-09-21T10:40:53.215 INFO:tasks.workunit.client.0.smithi060.stdout:5/85: write d5/d9/fe [2187952,82397] 0 2024-09-21T10:40:53.215 INFO:tasks.workunit.client.0.smithi060.stdout:5/86: chown d5/d9/cc 0 1 2024-09-21T10:40:53.215 INFO:tasks.workunit.client.0.smithi060.stdout:5/87: stat d5/d9/d13/f17 0 2024-09-21T10:40:53.216 INFO:tasks.workunit.client.0.smithi060.stdout:5/88: fdatasync d5/d9/f15 0 2024-09-21T10:40:53.218 INFO:tasks.workunit.client.1.smithi112.stdout:2/680: dread d0/f2d [0,4194304] 0 2024-09-21T10:40:53.218 INFO:tasks.workunit.client.1.smithi112.stdout:1/930: write d8/d54/d6d/f70 [307423,120084] 0 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:8/773: sync 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:7/727: sync 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:0/797: sync 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:0/798: truncate d3/d4a/d4e/dc2/d10/dc6/fff 266089 0 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:8/774: creat d8/d9/dd/d1a/fe9 x:0 0 0 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:8/775: dread - d8/d9/dd/dab/d8e/fc6 zero size 2024-09-21T10:40:53.219 INFO:tasks.workunit.client.1.smithi112.stdout:8/776: dread - d8/d9/fba zero size 2024-09-21T10:40:53.220 INFO:tasks.workunit.client.1.smithi112.stdout:2/681: mknod d0/dd/d47/ce2 0 2024-09-21T10:40:53.220 INFO:tasks.workunit.client.1.smithi112.stdout:2/682: creat d0/da2/fe3 x:0 0 0 2024-09-21T10:40:53.222 INFO:tasks.workunit.client.1.smithi112.stdout:7/728: link d7/d22/d41/d4b/da2/dea/fae d7/d22/d41/d4b/da2/ff1 0 2024-09-21T10:40:53.222 INFO:tasks.workunit.client.1.smithi112.stdout:7/729: stat d7/d22/d41/d56/dc9 0 2024-09-21T10:40:53.223 INFO:tasks.workunit.client.1.smithi112.stdout:4/808: dwrite de/d33/d6f/d9c/d3e/d57/f8e [0,4194304] 0 2024-09-21T10:40:53.224 INFO:tasks.workunit.client.1.smithi112.stdout:8/777: symlink d8/d9/dd/d2b/db8/db9/lea 0 2024-09-21T10:40:53.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/778: dread - d8/d9/dd/d2b/db8/fc5 zero size 2024-09-21T10:40:53.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/779: write d8/d9/dd/d2a/f5a [1201348,94549] 0 2024-09-21T10:40:53.225 INFO:tasks.workunit.client.1.smithi112.stdout:8/780: creat d8/d18/feb x:0 0 0 2024-09-21T10:40:53.228 INFO:tasks.workunit.client.0.smithi060.stdout:8/133: dwrite d2/f12 [0,4194304] 0 2024-09-21T10:40:53.229 INFO:tasks.workunit.client.1.smithi112.stdout:2/683: dread d0/d12/d6c/d7e/d8f/d51/d57/f84 [0,4194304] 0 2024-09-21T10:40:53.229 INFO:tasks.workunit.client.1.smithi112.stdout:2/684: write d0/d12/d46/da0/db9/dbd/d62/d89/fae [5011438,86431] 0 2024-09-21T10:40:53.229 INFO:tasks.workunit.client.1.smithi112.stdout:2/685: truncate d0/d12/d6c/d7e/d8f/d51/f54 871785 0 2024-09-21T10:40:53.230 INFO:tasks.workunit.client.1.smithi112.stdout:2/686: read d0/dd/f6a [484059,37987] 0 2024-09-21T10:40:53.230 INFO:tasks.workunit.client.1.smithi112.stdout:2/687: write d0/d12/d6c/d7e/d8f/d51/d57/f67 [493570,60687] 0 2024-09-21T10:40:53.236 INFO:tasks.workunit.client.0.smithi060.stdout:8/134: mknod d2/d26/c2b 0 2024-09-21T10:40:53.237 INFO:tasks.workunit.client.1.smithi112.stdout:2/688: rename d0/d12/d46/da0/db9/dbd/d62/d89/fc6 to d0/dd/d47/dd0/fe4 0 2024-09-21T10:40:53.238 INFO:tasks.workunit.client.1.smithi112.stdout:2/689: write d0/d12/f41 [3914868,74573] 0 2024-09-21T10:40:53.238 INFO:tasks.workunit.client.1.smithi112.stdout:8/781: dread d8/f78 [4194304,4194304] 0 2024-09-21T10:40:53.239 INFO:tasks.workunit.client.1.smithi112.stdout:2/690: link d0/d12/d46/da0/db9/dbd/d62/d63/f8b d0/d12/d46/da0/db9/dbd/de1/fe5 0 2024-09-21T10:40:53.241 INFO:tasks.workunit.client.1.smithi112.stdout:8/782: unlink d8/d9/dd/dab/d8e/dcb/ce0 0 2024-09-21T10:40:53.242 INFO:tasks.workunit.client.1.smithi112.stdout:8/783: truncate d8/d9/dd/d2b/d31/f7d 517270 0 2024-09-21T10:40:53.244 INFO:tasks.workunit.client.1.smithi112.stdout:2/691: symlink d0/d12/d6c/d7e/d8f/d51/d57/le6 0 2024-09-21T10:40:53.245 INFO:tasks.workunit.client.1.smithi112.stdout:7/730: write d7/d3d/f3e [4365604,115412] 0 2024-09-21T10:40:53.245 INFO:tasks.workunit.client.1.smithi112.stdout:2/692: read d0/da4/dbe/fa7 [381621,79347] 0 2024-09-21T10:40:53.245 INFO:tasks.workunit.client.1.smithi112.stdout:2/693: creat d0/da4/dbe/fe7 x:0 0 0 2024-09-21T10:40:53.245 INFO:tasks.workunit.client.1.smithi112.stdout:0/799: dwrite d3/d18/d52/d55/f93 [0,4194304] 0 2024-09-21T10:40:53.246 INFO:tasks.workunit.client.0.smithi060.stdout:5/89: dwrite d5/d9/fe [0,4194304] 0 2024-09-21T10:40:53.246 INFO:tasks.workunit.client.0.smithi060.stdout:5/90: write d5/f16 [839306,66123] 0 2024-09-21T10:40:53.247 INFO:tasks.workunit.client.0.smithi060.stdout:5/91: rename d5 to d5/d9/d10/d1a 22 2024-09-21T10:40:53.247 INFO:tasks.workunit.client.1.smithi112.stdout:8/784: creat d8/d9/d3c/d90/de1/fec x:0 0 0 2024-09-21T10:40:53.249 INFO:tasks.workunit.client.1.smithi112.stdout:5/811: dwrite d9/d15/d18/f82 [0,4194304] 0 2024-09-21T10:40:53.249 INFO:tasks.workunit.client.1.smithi112.stdout:4/809: dread de/d18/f3f [0,4194304] 0 2024-09-21T10:40:53.249 INFO:tasks.workunit.client.1.smithi112.stdout:4/810: fsync de/d33/d2f/d35/d4c/d5c/fd6 0 2024-09-21T10:40:53.249 INFO:tasks.workunit.client.1.smithi112.stdout:4/811: write de/d33/d2f/d71/d40/d4f/f6b [1402593,69973] 0 2024-09-21T10:40:53.250 INFO:tasks.workunit.client.0.smithi060.stdout:5/92: creat d5/d9/d10/f1b x:0 0 0 2024-09-21T10:40:53.253 INFO:tasks.workunit.client.1.smithi112.stdout:8/785: dread d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:53.253 INFO:tasks.workunit.client.1.smithi112.stdout:8/786: stat d8/d9/dd/d2b/d31/f39 0 2024-09-21T10:40:53.257 INFO:tasks.workunit.client.0.smithi060.stdout:5/93: link d5/ff d5/d9/d10/f1c 0 2024-09-21T10:40:53.258 INFO:tasks.workunit.client.1.smithi112.stdout:7/731: getdents d7/dbc 0 2024-09-21T10:40:53.258 INFO:tasks.workunit.client.1.smithi112.stdout:7/732: truncate d7/d22/d41/f7b 925669 0 2024-09-21T10:40:53.261 INFO:tasks.workunit.client.0.smithi060.stdout:5/94: creat d5/d9/f1d x:0 0 0 2024-09-21T10:40:53.261 INFO:tasks.workunit.client.1.smithi112.stdout:3/753: sync 2024-09-21T10:40:53.261 INFO:tasks.workunit.client.1.smithi112.stdout:3/754: fsync d2/f1b 0 2024-09-21T10:40:53.261 INFO:tasks.workunit.client.1.smithi112.stdout:3/755: fdatasync d2/d2f/d3f/ddf/d31/d2a/d39/fce 0 2024-09-21T10:40:53.263 INFO:tasks.workunit.client.1.smithi112.stdout:8/787: rename d8/d9/dd/d2b/db8/db9 to d8/d9/ded 0 2024-09-21T10:40:53.263 INFO:tasks.workunit.client.1.smithi112.stdout:8/788: fsync d8/d9/dd/fd1 0 2024-09-21T10:40:53.267 INFO:tasks.workunit.client.1.smithi112.stdout:2/694: dwrite d0/d12/d46/da0/fab [0,4194304] 0 2024-09-21T10:40:53.268 INFO:tasks.workunit.client.1.smithi112.stdout:0/800: mkdir d3/d4a/d4e/dc2/d1a/dba/d10a 0 2024-09-21T10:40:53.269 INFO:tasks.workunit.client.1.smithi112.stdout:7/733: mkdir d7/d22/d41/d56/db7/df2 0 2024-09-21T10:40:53.272 INFO:tasks.workunit.client.1.smithi112.stdout:7/734: mknod d7/d22/d41/d56/d72/dc4/cf3 0 2024-09-21T10:40:53.273 INFO:tasks.workunit.client.1.smithi112.stdout:2/695: getdents d0/dd/d47 0 2024-09-21T10:40:53.273 INFO:tasks.workunit.client.1.smithi112.stdout:2/696: chown d0/d12/d46/d86/dc0/dc8 2 1 2024-09-21T10:40:53.274 INFO:tasks.workunit.client.0.smithi060.stdout:5/95: dwrite d5/d9/d13/f17 [0,4194304] 0 2024-09-21T10:40:53.287 INFO:tasks.workunit.client.1.smithi112.stdout:0/801: rename d3/d4a/d4e/dc2/da8 to d3/d18/d52/d55/dcc/d10b 0 2024-09-21T10:40:53.289 INFO:tasks.workunit.client.1.smithi112.stdout:7/735: mknod d7/d22/d41/d56/db7/cf4 0 2024-09-21T10:40:53.289 INFO:tasks.workunit.client.1.smithi112.stdout:7/736: write d7/d22/d41/d54/f87 [1410459,64264] 0 2024-09-21T10:40:53.291 INFO:tasks.workunit.client.1.smithi112.stdout:3/756: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/f80 [0,4194304] 0 2024-09-21T10:40:53.291 INFO:tasks.workunit.client.1.smithi112.stdout:3/757: creat d2/d8d/ff8 x:0 0 0 2024-09-21T10:40:53.291 INFO:tasks.workunit.client.1.smithi112.stdout:0/802: mknod d3/d4a/d4e/dc2/d1a/dba/deb/c10c 0 2024-09-21T10:40:53.294 INFO:tasks.workunit.client.0.smithi060.stdout:5/96: truncate d5/d9/d10/f1c 2698622 0 2024-09-21T10:40:53.294 INFO:tasks.workunit.client.0.smithi060.stdout:5/97: chown d5/d9/d10/c14 2030774 1 2024-09-21T10:40:53.294 INFO:tasks.workunit.client.0.smithi060.stdout:5/98: write d5/d9/f1d [790706,25447] 0 2024-09-21T10:40:53.299 INFO:tasks.workunit.client.1.smithi112.stdout:3/758: mkdir d2/d2f/d3f/ddf/d31/d2a/d39/d60/df9 0 2024-09-21T10:40:53.302 INFO:tasks.workunit.client.1.smithi112.stdout:0/803: creat d3/d18/d52/d55/dcc/f10d x:0 0 0 2024-09-21T10:40:53.302 INFO:tasks.workunit.client.1.smithi112.stdout:0/804: chown d3/d4a/d4e/d72/da0/cfc 13 1 2024-09-21T10:40:53.303 INFO:tasks.workunit.client.1.smithi112.stdout:7/737: symlink d7/d22/d41/d56/d5c/lf5 0 2024-09-21T10:40:53.303 INFO:tasks.workunit.client.1.smithi112.stdout:7/738: chown d7/d22/l25 54287726 1 2024-09-21T10:40:53.303 INFO:tasks.workunit.client.1.smithi112.stdout:7/739: dread - d7/d22/d41/d54/fe7 zero size 2024-09-21T10:40:53.303 INFO:tasks.workunit.client.1.smithi112.stdout:7/740: readlink d7/d3d/da7/ld0 0 2024-09-21T10:40:53.306 INFO:tasks.workunit.client.1.smithi112.stdout:0/805: mkdir d3/d4a/d4e/dc2/d1a/d21/d10e 0 2024-09-21T10:40:53.307 INFO:tasks.workunit.client.1.smithi112.stdout:7/741: rename d7/d22/d41/d56/d72/dc4/d4a/c6e to d7/d22/d41/d80/cf6 0 2024-09-21T10:40:53.308 INFO:tasks.workunit.client.1.smithi112.stdout:0/806: mknod d3/d18/d52/d55/dcc/d10b/ddf/de5/c10f 0 2024-09-21T10:40:53.311 INFO:tasks.workunit.client.0.smithi060.stdout:8/135: dwrite d2/f1e [4194304,4194304] 0 2024-09-21T10:40:53.311 INFO:tasks.workunit.client.1.smithi112.stdout:7/742: creat d7/d22/d41/d56/d72/dc4/d4a/ff7 x:0 0 0 2024-09-21T10:40:53.311 INFO:tasks.workunit.client.1.smithi112.stdout:0/807: mknod d3/d18/c110 0 2024-09-21T10:40:53.311 INFO:tasks.workunit.client.1.smithi112.stdout:0/808: write d3/d18/d52/d55/f101 [797195,115348] 0 2024-09-21T10:40:53.314 INFO:tasks.workunit.client.1.smithi112.stdout:7/743: creat d7/d22/d41/d56/d72/de0/ff8 x:0 0 0 2024-09-21T10:40:53.314 INFO:tasks.workunit.client.1.smithi112.stdout:7/744: write d7/d22/d41/d4b/f64 [791732,48308] 0 2024-09-21T10:40:53.314 INFO:tasks.workunit.client.1.smithi112.stdout:7/745: creat d7/d22/d41/d54/ff9 x:0 0 0 2024-09-21T10:40:53.314 INFO:tasks.workunit.client.1.smithi112.stdout:7/746: truncate d7/f49 419909 0 2024-09-21T10:40:53.314 INFO:tasks.workunit.client.1.smithi112.stdout:7/747: write d7/d22/d41/d56/f75 [1693577,89479] 0 2024-09-21T10:40:53.316 INFO:tasks.workunit.client.1.smithi112.stdout:5/812: dwrite d9/d15/d18/d3a/f5b [4194304,4194304] 0 2024-09-21T10:40:53.316 INFO:tasks.workunit.client.1.smithi112.stdout:8/789: dwrite d8/d9/d3c/d90/de1/fec [0,4194304] 0 2024-09-21T10:40:53.317 INFO:tasks.workunit.client.1.smithi112.stdout:2/697: dwrite d0/d12/d46/da0/db9/dbd/d62/d63/fcd [0,4194304] 0 2024-09-21T10:40:53.317 INFO:tasks.workunit.client.1.smithi112.stdout:2/698: write d0/d12/d76/f82 [483944,85874] 0 2024-09-21T10:40:53.317 INFO:tasks.workunit.client.1.smithi112.stdout:2/699: dread - d0/d12/d97/fb6 zero size 2024-09-21T10:40:53.317 INFO:tasks.workunit.client.1.smithi112.stdout:2/700: fdatasync d0/d12/f4d 0 2024-09-21T10:40:53.317 INFO:tasks.workunit.client.1.smithi112.stdout:2/701: chown d0/d12/d46/d86/cda 1 1 2024-09-21T10:40:53.318 INFO:tasks.workunit.client.1.smithi112.stdout:2/702: chown d0/f19 7 1 2024-09-21T10:40:53.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/748: mknod d7/d22/d41/d56/d72/df0/cfa 0 2024-09-21T10:40:53.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/749: dread - d7/d22/d41/d56/fd6 zero size 2024-09-21T10:40:53.320 INFO:tasks.workunit.client.0.smithi060.stdout:5/99: unlink d5/d9/d10/f1c 0 2024-09-21T10:40:53.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/100: unlink d5/d9/d13/l12 0 2024-09-21T10:40:53.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/101: write d5/d9/d10/f1b [738976,79566] 0 2024-09-21T10:40:53.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/102: write d5/d9/d10/f1b [330716,25010] 0 2024-09-21T10:40:53.324 INFO:tasks.workunit.client.0.smithi060.stdout:5/103: creat d5/d9/d10/f1e x:0 0 0 2024-09-21T10:40:53.329 INFO:tasks.workunit.client.0.smithi060.stdout:5/104: symlink d5/d9/d10/l1f 0 2024-09-21T10:40:53.329 INFO:tasks.workunit.client.0.smithi060.stdout:5/105: fsync d5/f8 0 2024-09-21T10:40:53.329 INFO:tasks.workunit.client.0.smithi060.stdout:5/106: creat d5/d9/d13/f20 x:0 0 0 2024-09-21T10:40:53.329 INFO:tasks.workunit.client.0.smithi060.stdout:5/107: fdatasync d5/d9/f15 0 2024-09-21T10:40:53.330 INFO:tasks.workunit.client.0.smithi060.stdout:8/136: dwrite d2/f8 [0,4194304] 0 2024-09-21T10:40:53.330 INFO:tasks.workunit.client.1.smithi112.stdout:0/809: dwrite d3/d4a/d4e/dc2/d1a/d21/d4f/f7e [0,4194304] 0 2024-09-21T10:40:53.330 INFO:tasks.workunit.client.1.smithi112.stdout:0/810: truncate d3/d18/dc0/fda 721915 0 2024-09-21T10:40:53.334 INFO:tasks.workunit.client.0.smithi060.stdout:5/108: mkdir d5/d9/d10/d19/d21 0 2024-09-21T10:40:53.334 INFO:tasks.workunit.client.0.smithi060.stdout:5/109: dread - d5/d9/d10/f1e zero size 2024-09-21T10:40:53.334 INFO:tasks.workunit.client.0.smithi060.stdout:5/110: write d5/d9/d10/f1b [850537,76773] 0 2024-09-21T10:40:53.334 INFO:tasks.workunit.client.1.smithi112.stdout:5/813: mknod d9/d15/d18/d3a/d61/d93/cfd 0 2024-09-21T10:40:53.335 INFO:tasks.workunit.client.1.smithi112.stdout:5/814: creat d9/d15/d1d/ffe x:0 0 0 2024-09-21T10:40:53.335 INFO:tasks.workunit.client.0.smithi060.stdout:8/137: creat d2/d18/f2c x:0 0 0 2024-09-21T10:40:53.337 INFO:tasks.workunit.client.1.smithi112.stdout:8/790: rename d8/d9/dd/dab/d8e/dcb/fc9 to d8/d18/fee 0 2024-09-21T10:40:53.337 INFO:tasks.workunit.client.1.smithi112.stdout:8/791: write d8/d9/f13 [1550045,15301] 0 2024-09-21T10:40:53.337 INFO:tasks.workunit.client.1.smithi112.stdout:8/792: creat d8/d18/fef x:0 0 0 2024-09-21T10:40:53.338 INFO:tasks.workunit.client.0.smithi060.stdout:5/111: unlink c3 0 2024-09-21T10:40:53.338 INFO:tasks.workunit.client.0.smithi060.stdout:5/112: rename d5/d9/d10 to d5/d9/d10/d22 22 2024-09-21T10:40:53.338 INFO:tasks.workunit.client.0.smithi060.stdout:5/113: readlink d5/l18 0 2024-09-21T10:40:53.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/703: creat d0/d12/d46/dd8/fe8 x:0 0 0 2024-09-21T10:40:53.345 INFO:tasks.workunit.client.1.smithi112.stdout:2/704: readlink d0/da4/dbe/l7c 0 2024-09-21T10:40:53.348 INFO:tasks.workunit.client.0.smithi060.stdout:8/138: dwrite d2/ff [4194304,4194304] 0 2024-09-21T10:40:53.348 INFO:tasks.workunit.client.0.smithi060.stdout:8/139: creat d2/f2d x:0 0 0 2024-09-21T10:40:53.348 INFO:tasks.workunit.client.1.smithi112.stdout:0/811: creat d3/d4a/d4e/dc2/d1a/d21/f111 x:0 0 0 2024-09-21T10:40:53.350 INFO:tasks.workunit.client.1.smithi112.stdout:7/750: rename d7/d22/d86/fab to d7/d22/d41/d56/ffb 0 2024-09-21T10:40:53.351 INFO:tasks.workunit.client.0.smithi060.stdout:5/114: rmdir d5/d9/d13 39 2024-09-21T10:40:53.357 INFO:tasks.workunit.client.1.smithi112.stdout:8/793: write d8/f8c [870720,61489] 0 2024-09-21T10:40:53.357 INFO:tasks.workunit.client.1.smithi112.stdout:8/794: chown d8/d9/dd/d76/d97/cdb 3 1 2024-09-21T10:40:53.361 INFO:tasks.workunit.client.1.smithi112.stdout:6/829: sync 2024-09-21T10:40:53.361 INFO:tasks.workunit.client.1.smithi112.stdout:9/832: sync 2024-09-21T10:40:53.361 INFO:tasks.workunit.client.1.smithi112.stdout:6/830: stat d4/dc/d1a/f107 0 2024-09-21T10:40:53.362 INFO:tasks.workunit.client.1.smithi112.stdout:2/705: mknod d0/da4/dc5/ce9 0 2024-09-21T10:40:53.362 INFO:tasks.workunit.client.1.smithi112.stdout:2/706: fdatasync d0/da4/dbe/f6d 0 2024-09-21T10:40:53.363 INFO:tasks.workunit.client.1.smithi112.stdout:0/812: rmdir d3/d18/d52/d55/dcc/d10b/ddf 39 2024-09-21T10:40:53.363 INFO:tasks.workunit.client.1.smithi112.stdout:0/813: creat d3/d4a/d4e/d72/da0/f112 x:0 0 0 2024-09-21T10:40:53.363 INFO:tasks.workunit.client.1.smithi112.stdout:0/814: truncate d3/d4a/d4e/dc2/d10/f100 202876 0 2024-09-21T10:40:53.366 INFO:tasks.workunit.client.1.smithi112.stdout:5/815: rename d9/d8a/fb9 to d9/d15/d18/d20/d55/fff 0 2024-09-21T10:40:53.368 INFO:tasks.workunit.client.1.smithi112.stdout:8/795: mkdir d8/d9/dd/d2a/db6/df0 0 2024-09-21T10:40:53.368 INFO:tasks.workunit.client.0.smithi060.stdout:1/93: sync 2024-09-21T10:40:53.368 INFO:tasks.workunit.client.0.smithi060.stdout:1/94: fdatasync d6/d8/da/db/de/f1a 0 2024-09-21T10:40:53.370 INFO:tasks.workunit.client.1.smithi112.stdout:9/833: creat d1/f128 x:0 0 0 2024-09-21T10:40:53.374 INFO:tasks.workunit.client.1.smithi112.stdout:6/831: rename d4/d6/da/d11/d1f/l7d to d4/dc/d1a/d31/d56/d64/d9b/de2/l121 0 2024-09-21T10:40:53.374 INFO:tasks.workunit.client.1.smithi112.stdout:6/832: write d4/d6/da/d11/d1f/d22/f89 [39382,69728] 0 2024-09-21T10:40:53.375 INFO:tasks.workunit.client.1.smithi112.stdout:7/751: getdents d7/d22/d41/d4b/da2 0 2024-09-21T10:40:53.375 INFO:tasks.workunit.client.1.smithi112.stdout:6/833: dread f1 [0,4194304] 0 2024-09-21T10:40:53.375 INFO:tasks.workunit.client.1.smithi112.stdout:6/834: truncate d4/d6/da/d11/d37/d19/df3/f114 500663 0 2024-09-21T10:40:53.375 INFO:tasks.workunit.client.1.smithi112.stdout:6/835: chown d4 7095218 1 2024-09-21T10:40:53.376 INFO:tasks.workunit.client.0.smithi060.stdout:1/95: dread d6/d8/da/db/ff [0,4194304] 0 2024-09-21T10:40:53.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/834: mkdir d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101/d129 0 2024-09-21T10:40:53.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/835: fdatasync d1/d2/d27/d3a/d6b/d30/da5/fe5 0 2024-09-21T10:40:53.377 INFO:tasks.workunit.client.1.smithi112.stdout:0/815: getdents d3/d4a/d4e/d72 0 2024-09-21T10:40:53.378 INFO:tasks.workunit.client.0.smithi060.stdout:8/140: dwrite d2/f12 [0,4194304] 0 2024-09-21T10:40:53.378 INFO:tasks.workunit.client.0.smithi060.stdout:8/141: truncate d2/d26/f29 776638 0 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.1.smithi112.stdout:1/931: sync 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.1.smithi112.stdout:3/759: sync 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.1.smithi112.stdout:4/812: sync 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.1.smithi112.stdout:3/760: write d2/f18 [984347,55346] 0 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.1.smithi112.stdout:5/816: read d9/d15/f2e [1890856,10016] 0 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.0.smithi060.stdout:1/96: creat d6/d8/da/db/dd/f1d x:0 0 0 2024-09-21T10:40:53.379 INFO:tasks.workunit.client.0.smithi060.stdout:5/115: dwrite d5/d9/f15 [0,4194304] 0 2024-09-21T10:40:53.380 INFO:tasks.workunit.client.1.smithi112.stdout:7/752: rename d7/d22/d41/f51 to d7/d22/d86/dac/d8a/ffc 0 2024-09-21T10:40:53.381 INFO:tasks.workunit.client.1.smithi112.stdout:8/796: read d8/d9/dd/d2b/db8/fc7 [433302,124871] 0 2024-09-21T10:40:53.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/797: write d8/d9/d3c/f50 [1357749,89671] 0 2024-09-21T10:40:53.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/798: dread - d8/d9/d3c/d57/fb2 zero size 2024-09-21T10:40:53.382 INFO:tasks.workunit.client.0.smithi060.stdout:8/142: rename d2/ld to d2/d26/l2e 0 2024-09-21T10:40:53.382 INFO:tasks.workunit.client.1.smithi112.stdout:6/836: mknod d4/d6/c122 0 2024-09-21T10:40:53.383 INFO:tasks.workunit.client.1.smithi112.stdout:6/837: fdatasync d4/dfb/f11f 0 2024-09-21T10:40:53.384 INFO:tasks.workunit.client.1.smithi112.stdout:9/836: creat d1/d2/d27/d37/d3b/dec/f12a x:0 0 0 2024-09-21T10:40:53.385 INFO:tasks.workunit.client.0.smithi060.stdout:5/116: symlink d5/d9/d13/l23 0 2024-09-21T10:40:53.385 INFO:tasks.workunit.client.1.smithi112.stdout:1/932: mkdir d8/d54/d6d/db5/d11b 0 2024-09-21T10:40:53.387 INFO:tasks.workunit.client.0.smithi060.stdout:8/143: rename d2/d18/l21 to d2/d26/l2f 0 2024-09-21T10:40:53.389 INFO:tasks.workunit.client.1.smithi112.stdout:3/761: unlink d2/d2f/f30 0 2024-09-21T10:40:53.390 INFO:tasks.workunit.client.0.smithi060.stdout:1/97: rmdir d6/d8/da/db/de 39 2024-09-21T10:40:53.392 INFO:tasks.workunit.client.1.smithi112.stdout:5/817: mkdir d9/d6e/dfb/d100 0 2024-09-21T10:40:53.392 INFO:tasks.workunit.client.1.smithi112.stdout:5/818: fsync d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd0 0 2024-09-21T10:40:53.395 INFO:tasks.workunit.client.0.smithi060.stdout:5/117: rename d5/d9/d10/f1e to d5/f24 0 2024-09-21T10:40:53.395 INFO:tasks.workunit.client.0.smithi060.stdout:5/118: chown d5/l18 23159 1 2024-09-21T10:40:53.396 INFO:tasks.workunit.client.1.smithi112.stdout:4/813: dread de/d33/f38 [0,4194304] 0 2024-09-21T10:40:53.397 INFO:tasks.workunit.client.0.smithi060.stdout:8/144: dread d2/f17 [0,4194304] 0 2024-09-21T10:40:53.397 INFO:tasks.workunit.client.0.smithi060.stdout:8/145: creat d2/d18/f30 x:0 0 0 2024-09-21T10:40:53.397 INFO:tasks.workunit.client.1.smithi112.stdout:7/753: unlink d7/d22/d41/d56/d72/lde 0 2024-09-21T10:40:53.398 INFO:tasks.workunit.client.0.smithi060.stdout:5/119: truncate d5/ff 3123070 0 2024-09-21T10:40:53.400 INFO:tasks.workunit.client.1.smithi112.stdout:7/754: dread d7/d22/d41/d4b/d52/f76 [0,4194304] 0 2024-09-21T10:40:53.401 INFO:tasks.workunit.client.0.smithi060.stdout:1/98: dread d6/d8/da/db/ff [0,4194304] 0 2024-09-21T10:40:53.403 INFO:tasks.workunit.client.0.smithi060.stdout:8/146: rename d2/d26/l28 to d2/d18/l31 0 2024-09-21T10:40:53.403 INFO:tasks.workunit.client.0.smithi060.stdout:8/147: creat d2/d26/f32 x:0 0 0 2024-09-21T10:40:53.403 INFO:tasks.workunit.client.1.smithi112.stdout:6/838: write d4/dc/d7e/f92 [390860,5166] 0 2024-09-21T10:40:53.403 INFO:tasks.workunit.client.1.smithi112.stdout:6/839: creat d4/d6/da/d11/d37/d19/df3/f123 x:0 0 0 2024-09-21T10:40:53.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/120: symlink d5/d9/l25 0 2024-09-21T10:40:53.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/121: readlink d5/d9/d13/l23 0 2024-09-21T10:40:53.409 INFO:tasks.workunit.client.0.smithi060.stdout:5/122: rename d5/d9/c11 to d5/c26 0 2024-09-21T10:40:53.409 INFO:tasks.workunit.client.0.smithi060.stdout:5/123: dread - d5/d9/d13/f20 zero size 2024-09-21T10:40:53.409 INFO:tasks.workunit.client.0.smithi060.stdout:5/124: stat d5/d9/cc 0 2024-09-21T10:40:53.411 INFO:tasks.workunit.client.0.smithi060.stdout:8/148: dread d2/f17 [0,4194304] 0 2024-09-21T10:40:53.412 INFO:tasks.workunit.client.1.smithi112.stdout:3/762: truncate d2/d2f/d3f/ddf/d31/dcf/fc4 2281091 0 2024-09-21T10:40:53.412 INFO:tasks.workunit.client.1.smithi112.stdout:3/763: write d2/f78 [3309516,103065] 0 2024-09-21T10:40:53.412 INFO:tasks.workunit.client.1.smithi112.stdout:0/816: dwrite d3/d4a/fb4 [0,4194304] 0 2024-09-21T10:40:53.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/837: dwrite d1/d2/d27/d3a/f71 [4194304,4194304] 0 2024-09-21T10:40:53.412 INFO:tasks.workunit.client.1.smithi112.stdout:5/819: mkdir d9/d8a/d101 0 2024-09-21T10:40:53.412 INFO:tasks.workunit.client.1.smithi112.stdout:4/814: stat de/l60 0 2024-09-21T10:40:53.414 INFO:tasks.workunit.client.1.smithi112.stdout:1/933: dwrite d8/d54/d6d/f70 [4194304,4194304] 0 2024-09-21T10:40:53.417 INFO:tasks.workunit.client.0.smithi060.stdout:1/99: dwrite d6/d8/da/db/f10 [0,4194304] 0 2024-09-21T10:40:53.417 INFO:tasks.workunit.client.0.smithi060.stdout:1/100: write d6/d8/fc [2834588,90852] 0 2024-09-21T10:40:53.417 INFO:tasks.workunit.client.0.smithi060.stdout:5/125: dread d5/ff [0,4194304] 0 2024-09-21T10:40:53.418 INFO:tasks.workunit.client.1.smithi112.stdout:1/934: dread d8/d1a/db8/fc4 [0,4194304] 0 2024-09-21T10:40:53.419 INFO:tasks.workunit.client.1.smithi112.stdout:8/799: rmdir d8/d9/dd/dab/d8e 39 2024-09-21T10:40:53.427 INFO:tasks.workunit.client.1.smithi112.stdout:6/840: truncate d4/dc/f4b 2602052 0 2024-09-21T10:40:53.427 INFO:tasks.workunit.client.1.smithi112.stdout:6/841: readlink d4/d6/da/d11/d37/d19/df3/d118/le5 0 2024-09-21T10:40:53.429 INFO:tasks.workunit.client.1.smithi112.stdout:3/764: symlink d2/d2f/daf/lfa 0 2024-09-21T10:40:53.429 INFO:tasks.workunit.client.1.smithi112.stdout:3/765: dread - d2/d2f/fd4 zero size 2024-09-21T10:40:53.435 INFO:tasks.workunit.client.1.smithi112.stdout:0/817: dwrite d3/d18/d52/d55/f5e [0,4194304] 0 2024-09-21T10:40:53.435 INFO:tasks.workunit.client.0.smithi060.stdout:8/149: dwrite d2/f8 [4194304,4194304] 0 2024-09-21T10:40:53.436 INFO:tasks.workunit.client.1.smithi112.stdout:9/838: symlink d1/d2/d27/d37/d3b/d69/d77/dca/l12b 0 2024-09-21T10:40:53.437 INFO:tasks.workunit.client.0.smithi060.stdout:1/101: unlink d6/d8/da/db/dd/f17 0 2024-09-21T10:40:53.437 INFO:tasks.workunit.client.0.smithi060.stdout:1/102: write d6/d8/da/db/ff [725001,129704] 0 2024-09-21T10:40:53.438 INFO:tasks.workunit.client.0.smithi060.stdout:1/103: stat d6/d8/da/db/de/f1a 0 2024-09-21T10:40:53.438 INFO:tasks.workunit.client.0.smithi060.stdout:1/104: read - d6/d8/da/f12 zero size 2024-09-21T10:40:53.438 INFO:tasks.workunit.client.0.smithi060.stdout:1/105: write d6/d8/da/db/de/f1a [925781,129405] 0 2024-09-21T10:40:53.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/820: mknod d9/d15/d1d/c102 0 2024-09-21T10:40:53.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/821: write d9/d15/d18/d3a/d4b/f9d [634307,4887] 0 2024-09-21T10:40:53.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/822: write d9/d15/d18/d20/d47/fed [497469,126894] 0 2024-09-21T10:40:53.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/823: write d9/d15/f6a [1250858,48129] 0 2024-09-21T10:40:53.439 INFO:tasks.workunit.client.1.smithi112.stdout:5/824: write d9/d15/d18/d3a/d4b/d74/d8d/fd5 [129706,69140] 0 2024-09-21T10:40:53.439 INFO:tasks.workunit.client.0.smithi060.stdout:5/126: mknod d5/d9/d10/c27 0 2024-09-21T10:40:53.441 INFO:tasks.workunit.client.1.smithi112.stdout:4/815: creat de/d33/d6f/d9c/d3e/d75/f10f x:0 0 0 2024-09-21T10:40:53.443 INFO:tasks.workunit.client.1.smithi112.stdout:4/816: dread de/d33/d2f/d71/fa1 [0,4194304] 0 2024-09-21T10:40:53.445 INFO:tasks.workunit.client.1.smithi112.stdout:9/839: write d1/d2/d27/d37/f95 [2784208,124878] 0 2024-09-21T10:40:53.447 INFO:tasks.workunit.client.1.smithi112.stdout:7/755: rmdir d7/d22/d41/d56/d72 39 2024-09-21T10:40:53.448 INFO:tasks.workunit.client.1.smithi112.stdout:7/756: readlink d7/d22/d41/d56/d72/lbb 0 2024-09-21T10:40:53.449 INFO:tasks.workunit.client.0.smithi060.stdout:1/106: symlink d6/d8/da/db/de/l1e 0 2024-09-21T10:40:53.449 INFO:tasks.workunit.client.0.smithi060.stdout:1/107: fdatasync d6/d8/da/db/de/f18 0 2024-09-21T10:40:53.450 INFO:tasks.workunit.client.1.smithi112.stdout:1/935: creat d8/d1a/d31/da1/de7/df1/f11c x:0 0 0 2024-09-21T10:40:53.451 INFO:tasks.workunit.client.0.smithi060.stdout:5/127: truncate d5/d9/d13/f17 1803141 0 2024-09-21T10:40:53.453 INFO:tasks.workunit.client.1.smithi112.stdout:8/800: truncate d8/d9/dd/d2b/d31/f7d 39406 0 2024-09-21T10:40:53.456 INFO:tasks.workunit.client.0.smithi060.stdout:1/108: rename d6/d8/f15 to d6/d8/da/f1f 0 2024-09-21T10:40:53.458 INFO:tasks.workunit.client.1.smithi112.stdout:6/842: symlink d4/dc/d1a/d31/d56/d64/d9b/l124 0 2024-09-21T10:40:53.458 INFO:tasks.workunit.client.1.smithi112.stdout:6/843: creat d4/d6/da/d11/d1f/d22/f125 x:0 0 0 2024-09-21T10:40:53.458 INFO:tasks.workunit.client.1.smithi112.stdout:6/844: truncate d4/d6/da/d14/d49/d73/d74/f116 89850 0 2024-09-21T10:40:53.458 INFO:tasks.workunit.client.1.smithi112.stdout:6/845: stat d4/d6/da/l3d 0 2024-09-21T10:40:53.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/128: write d5/ff [1094357,66055] 0 2024-09-21T10:40:53.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/109: creat d6/f20 x:0 0 0 2024-09-21T10:40:53.461 INFO:tasks.workunit.client.1.smithi112.stdout:3/766: mkdir d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dfb 0 2024-09-21T10:40:53.463 INFO:tasks.workunit.client.1.smithi112.stdout:1/936: write d8/d1a/d31/f3e [2575819,104060] 0 2024-09-21T10:40:53.464 INFO:tasks.workunit.client.1.smithi112.stdout:0/818: creat d3/d4a/d4e/dc2/d1a/dba/d10a/f113 x:0 0 0 2024-09-21T10:40:53.465 INFO:tasks.workunit.client.0.smithi060.stdout:5/129: symlink d5/d9/l28 0 2024-09-21T10:40:53.465 INFO:tasks.workunit.client.1.smithi112.stdout:1/937: dread d8/d20/fa7 [0,4194304] 0 2024-09-21T10:40:53.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/817: dwrite de/d18/f3f [4194304,4194304] 0 2024-09-21T10:40:53.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/818: readlink de/d33/d2f/d71/d40/d4f/lef 0 2024-09-21T10:40:53.466 INFO:tasks.workunit.client.1.smithi112.stdout:4/819: creat de/d2a/dbf/d82/f110 x:0 0 0 2024-09-21T10:40:53.466 INFO:tasks.workunit.client.1.smithi112.stdout:5/825: dwrite d9/d15/f63 [0,4194304] 0 2024-09-21T10:40:53.467 INFO:tasks.workunit.client.0.smithi060.stdout:1/110: rename d6/d8/da/db/ff to d6/d8/da/db/de/f21 0 2024-09-21T10:40:53.468 INFO:tasks.workunit.client.1.smithi112.stdout:9/840: rmdir d1/d2/d27/d37/d3b/dec/d107 39 2024-09-21T10:40:53.469 INFO:tasks.workunit.client.0.smithi060.stdout:5/130: mkdir d5/d9/d10/d29 0 2024-09-21T10:40:53.471 INFO:tasks.workunit.client.1.smithi112.stdout:7/757: mkdir d7/d22/d41/d4b/d52/dfd 0 2024-09-21T10:40:53.471 INFO:tasks.workunit.client.1.smithi112.stdout:8/801: getdents d8/d9/dd/d2a/db6 0 2024-09-21T10:40:53.474 INFO:tasks.workunit.client.0.smithi060.stdout:5/131: rmdir d5/d9/d10/d29 0 2024-09-21T10:40:53.474 INFO:tasks.workunit.client.0.smithi060.stdout:1/111: write d6/d8/da/db/dd/f14 [612865,72540] 0 2024-09-21T10:40:53.474 INFO:tasks.workunit.client.0.smithi060.stdout:1/112: read - d6/f20 zero size 2024-09-21T10:40:53.478 INFO:tasks.workunit.client.0.smithi060.stdout:5/132: mknod d5/d9/d10/d19/c2a 0 2024-09-21T10:40:53.479 INFO:tasks.workunit.client.1.smithi112.stdout:0/819: rmdir d3/d4a/d4e/dc2/d1a/d21/d4f/dc3 39 2024-09-21T10:40:53.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/113: mknod d6/d8/da/db/de/c22 0 2024-09-21T10:40:53.483 INFO:tasks.workunit.client.1.smithi112.stdout:1/938: rename d8/f24 to d8/d54/d6d/db5/dc2/de6/f11d 0 2024-09-21T10:40:53.484 INFO:tasks.workunit.client.1.smithi112.stdout:1/939: truncate d8/d45/dae/d114/fdf 839511 0 2024-09-21T10:40:53.484 INFO:tasks.workunit.client.1.smithi112.stdout:1/940: write d8/d20/fed [487817,117514] 0 2024-09-21T10:40:53.484 INFO:tasks.workunit.client.1.smithi112.stdout:1/941: dread - d8/d45/dfb/ffc zero size 2024-09-21T10:40:53.484 INFO:tasks.workunit.client.1.smithi112.stdout:1/942: fdatasync d8/d1a/d31/d37/f110 0 2024-09-21T10:40:53.487 INFO:tasks.workunit.client.0.smithi060.stdout:1/114: creat d6/d8/da/f23 x:0 0 0 2024-09-21T10:40:53.487 INFO:tasks.workunit.client.0.smithi060.stdout:1/115: dread - d6/d8/da/f12 zero size 2024-09-21T10:40:53.488 INFO:tasks.workunit.client.0.smithi060.stdout:5/133: getdents d5/d9 0 2024-09-21T10:40:53.490 INFO:tasks.workunit.client.1.smithi112.stdout:8/802: dwrite d8/d9/fba [0,4194304] 0 2024-09-21T10:40:53.490 INFO:tasks.workunit.client.0.smithi060.stdout:5/134: read d5/f16 [509839,72830] 0 2024-09-21T10:40:53.490 INFO:tasks.workunit.client.1.smithi112.stdout:7/758: dwrite d7/d3d/f3e [0,4194304] 0 2024-09-21T10:40:53.491 INFO:tasks.workunit.client.1.smithi112.stdout:7/759: write d7/d22/d41/d56/d72/de0/ff8 [549701,25863] 0 2024-09-21T10:40:53.491 INFO:tasks.workunit.client.1.smithi112.stdout:7/760: read d7/f10 [235370,122992] 0 2024-09-21T10:40:53.491 INFO:tasks.workunit.client.0.smithi060.stdout:5/135: write d5/d9/f1d [735290,23475] 0 2024-09-21T10:40:53.492 INFO:tasks.workunit.client.0.smithi060.stdout:5/136: read d5/d9/f1d [583354,87339] 0 2024-09-21T10:40:53.492 INFO:tasks.workunit.client.0.smithi060.stdout:5/137: write d5/d9/d13/f20 [743649,70939] 0 2024-09-21T10:40:53.492 INFO:tasks.workunit.client.0.smithi060.stdout:5/138: fdatasync d5/f8 0 2024-09-21T10:40:53.492 INFO:tasks.workunit.client.1.smithi112.stdout:7/761: dread d7/d22/d41/d56/d72/f8b [0,4194304] 0 2024-09-21T10:40:53.493 INFO:tasks.workunit.client.1.smithi112.stdout:4/820: mkdir de/d33/d2f/d35/d111 0 2024-09-21T10:40:53.495 INFO:tasks.workunit.client.1.smithi112.stdout:7/762: dread d7/d22/d41/d56/d5c/f96 [0,4194304] 0 2024-09-21T10:40:53.499 INFO:tasks.workunit.client.0.smithi060.stdout:5/139: creat d5/d9/f2b x:0 0 0 2024-09-21T10:40:53.502 INFO:tasks.workunit.client.0.smithi060.stdout:5/140: symlink d5/d9/l2c 0 2024-09-21T10:40:53.503 INFO:tasks.workunit.client.0.smithi060.stdout:1/116: rename d6/d8 to d6/d24 0 2024-09-21T10:40:53.506 INFO:tasks.workunit.client.0.smithi060.stdout:1/117: symlink d6/d24/da/db/dd/l25 0 2024-09-21T10:40:53.507 INFO:tasks.workunit.client.0.smithi060.stdout:1/118: write d6/f20 [807099,18143] 0 2024-09-21T10:40:53.511 INFO:tasks.workunit.client.0.smithi060.stdout:1/119: unlink l4 0 2024-09-21T10:40:53.512 INFO:tasks.workunit.client.1.smithi112.stdout:7/763: dwrite d7/d22/d86/dac/d8a/ffc [0,4194304] 0 2024-09-21T10:40:53.512 INFO:tasks.workunit.client.1.smithi112.stdout:7/764: readlink d7/d22/d86/dac/leb 0 2024-09-21T10:40:53.513 INFO:tasks.workunit.client.1.smithi112.stdout:5/826: rmdir d9/d15/d18/d3a/d4b/d74/d8d/d9a 39 2024-09-21T10:40:53.514 INFO:tasks.workunit.client.1.smithi112.stdout:6/846: mknod d4/dc/d1a/d31/d3c/c126 0 2024-09-21T10:40:53.516 INFO:tasks.workunit.client.0.smithi060.stdout:5/141: dwrite d5/f16 [0,4194304] 0 2024-09-21T10:40:53.516 INFO:tasks.workunit.client.1.smithi112.stdout:1/943: link d8/d1a/d31/d66/df5/f108 d8/d1a/d31/d66/d87/f11e 0 2024-09-21T10:40:53.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/120: dread d6/d24/da/db/dd/f14 [4194304,4194304] 0 2024-09-21T10:40:53.519 INFO:tasks.workunit.client.0.smithi060.stdout:3/101: sync 2024-09-21T10:40:53.522 INFO:tasks.workunit.client.1.smithi112.stdout:8/803: creat d8/d9/dd/d2b/db8/ff1 x:0 0 0 2024-09-21T10:40:53.522 INFO:tasks.workunit.client.1.smithi112.stdout:8/804: write d8/d18/fa2 [904374,113782] 0 2024-09-21T10:40:53.524 INFO:tasks.workunit.client.1.smithi112.stdout:7/765: write d7/d22/d41/d4b/da2/dea/fa6 [3015313,41046] 0 2024-09-21T10:40:53.524 INFO:tasks.workunit.client.0.smithi060.stdout:5/142: creat d5/d9/d10/d19/d21/f2d x:0 0 0 2024-09-21T10:40:53.526 INFO:tasks.workunit.client.1.smithi112.stdout:4/821: link de/d33/d6f/ca5 de/d18/c112 0 2024-09-21T10:40:53.527 INFO:tasks.workunit.client.0.smithi060.stdout:1/121: creat d6/d24/da/db/d1c/f26 x:0 0 0 2024-09-21T10:40:53.532 INFO:tasks.workunit.client.0.smithi060.stdout:3/102: creat d0/f1c x:0 0 0 2024-09-21T10:40:53.533 INFO:tasks.workunit.client.1.smithi112.stdout:2/707: sync 2024-09-21T10:40:53.535 INFO:tasks.workunit.client.1.smithi112.stdout:7/766: write d7/d22/d41/d56/d72/dc4/f9d [3595353,74482] 0 2024-09-21T10:40:53.535 INFO:tasks.workunit.client.0.smithi060.stdout:5/143: symlink d5/d9/d13/l2e 0 2024-09-21T10:40:53.537 INFO:tasks.workunit.client.1.smithi112.stdout:6/847: dwrite d4/d6/da/d11/d37/d8b/fbf [0,4194304] 0 2024-09-21T10:40:53.537 INFO:tasks.workunit.client.1.smithi112.stdout:7/767: write d7/f1e [753737,120345] 0 2024-09-21T10:40:53.538 INFO:tasks.workunit.client.1.smithi112.stdout:5/827: creat d9/d6e/dfb/f103 x:0 0 0 2024-09-21T10:40:53.538 INFO:tasks.workunit.client.1.smithi112.stdout:5/828: getdents d9/d15/d18/d3a/d4b/d74/d8d/d9a/df8 0 2024-09-21T10:40:53.538 INFO:tasks.workunit.client.1.smithi112.stdout:5/829: chown d9/d15/d18/d20/d55/c99 4989118 1 2024-09-21T10:40:53.541 INFO:tasks.workunit.client.1.smithi112.stdout:1/944: rename d8/cc to d8/d54/d6d/db5/c11f 0 2024-09-21T10:40:53.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/144: mknod d5/c2f 0 2024-09-21T10:40:53.543 INFO:tasks.workunit.client.1.smithi112.stdout:8/805: symlink d8/d9/dd/d2a/db6/lf2 0 2024-09-21T10:40:53.543 INFO:tasks.workunit.client.1.smithi112.stdout:8/806: chown d8/d9/dd/d76 119 1 2024-09-21T10:40:53.545 INFO:tasks.workunit.client.0.smithi060.stdout:1/122: dwrite d6/d24/fc [0,4194304] 0 2024-09-21T10:40:53.547 INFO:tasks.workunit.client.1.smithi112.stdout:4/822: creat de/d33/d6f/d9c/d3e/f113 x:0 0 0 2024-09-21T10:40:53.547 INFO:tasks.workunit.client.1.smithi112.stdout:4/823: chown de/d33/d2f/d71/d40/d4f/f6b 6005784 1 2024-09-21T10:40:53.548 INFO:tasks.workunit.client.1.smithi112.stdout:5/830: dread d9/d15/f63 [0,4194304] 0 2024-09-21T10:40:53.552 INFO:tasks.workunit.client.1.smithi112.stdout:2/708: getdents d0/d12/d6c/d7e/d8f/d51 0 2024-09-21T10:40:53.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/709: chown d0/dd/d47/c4b 115 1 2024-09-21T10:40:53.553 INFO:tasks.workunit.client.1.smithi112.stdout:2/710: chown d0/d12/lc7 2040 1 2024-09-21T10:40:53.553 INFO:tasks.workunit.client.1.smithi112.stdout:6/848: symlink d4/d6/da/d11/d1f/l127 0 2024-09-21T10:40:53.557 INFO:tasks.workunit.client.1.smithi112.stdout:1/945: creat d8/d1a/d53/d57/d105/f120 x:0 0 0 2024-09-21T10:40:53.557 INFO:tasks.workunit.client.1.smithi112.stdout:1/946: chown d8/d1a/fad 0 1 2024-09-21T10:40:53.557 INFO:tasks.workunit.client.1.smithi112.stdout:1/947: fsync d8/d1a/db8/fc4 0 2024-09-21T10:40:53.557 INFO:tasks.workunit.client.1.smithi112.stdout:4/824: rmdir de/d33/d2f/d35/df3/dc2 39 2024-09-21T10:40:53.558 INFO:tasks.workunit.client.1.smithi112.stdout:5/831: mknod d9/d15/d18/d20/d47/dc6/c104 0 2024-09-21T10:40:53.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/711: link d0/d12/d77/fd5 d0/d12/d46/da0/db9/fea 0 2024-09-21T10:40:53.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/712: dread - d0/d12/d6c/d7e/f96 zero size 2024-09-21T10:40:53.562 INFO:tasks.workunit.client.1.smithi112.stdout:6/849: write d4/dc/d1a/d31/d3c/f7c [883517,13847] 0 2024-09-21T10:40:53.562 INFO:tasks.workunit.client.1.smithi112.stdout:1/948: rename d8/d7a/c100 to d8/d54/d6d/db5/d11b/c121 0 2024-09-21T10:40:53.562 INFO:tasks.workunit.client.1.smithi112.stdout:4/825: rename de/f24 to de/d18/d6d/f114 0 2024-09-21T10:40:53.563 INFO:tasks.workunit.client.1.smithi112.stdout:1/949: mknod d8/d1a/d31/da1/c122 0 2024-09-21T10:40:53.564 INFO:tasks.workunit.client.1.smithi112.stdout:5/832: rename d9/d15/d1d/ffe to d9/d15/d18/d3a/d61/d62/d6b/f105 0 2024-09-21T10:40:53.566 INFO:tasks.workunit.client.1.smithi112.stdout:1/950: creat d8/d54/d6d/db5/dc2/de6/d106/f123 x:0 0 0 2024-09-21T10:40:53.568 INFO:tasks.workunit.client.1.smithi112.stdout:6/850: rename d4/dc/d1a/d31/d56/f72 to d4/d6/d75/f128 0 2024-09-21T10:40:53.572 INFO:tasks.workunit.client.1.smithi112.stdout:8/807: dwrite d8/d9/dd/dab/d8e/dcb/f5e [0,4194304] 0 2024-09-21T10:40:53.572 INFO:tasks.workunit.client.1.smithi112.stdout:8/808: write d8/d9/dd/d2b/fca [1695675,101620] 0 2024-09-21T10:40:53.572 INFO:tasks.workunit.client.1.smithi112.stdout:1/951: dread d8/d54/db0/db1/fd4 [0,4194304] 0 2024-09-21T10:40:53.572 INFO:tasks.workunit.client.1.smithi112.stdout:1/952: getdents d8/d54/db0/d10b 0 2024-09-21T10:40:53.572 INFO:tasks.workunit.client.0.smithi060.stdout:5/145: dwrite d5/f7 [0,4194304] 0 2024-09-21T10:40:53.573 INFO:tasks.workunit.client.0.smithi060.stdout:1/123: dwrite d6/d24/da/db/f10 [0,4194304] 0 2024-09-21T10:40:53.576 INFO:tasks.workunit.client.1.smithi112.stdout:4/826: dread de/d2e/f32 [0,4194304] 0 2024-09-21T10:40:53.579 INFO:tasks.workunit.client.0.smithi060.stdout:1/124: mknod d6/d24/da/db/dd/c27 0 2024-09-21T10:40:53.581 INFO:tasks.workunit.client.1.smithi112.stdout:4/827: truncate de/d33/d6f/d9c/d3e/fb0 1045653 0 2024-09-21T10:40:53.583 INFO:tasks.workunit.client.0.smithi060.stdout:1/125: mknod d6/d24/da/db/c28 0 2024-09-21T10:40:53.586 INFO:tasks.workunit.client.1.smithi112.stdout:4/828: creat de/d33/d6f/d9c/f115 x:0 0 0 2024-09-21T10:40:53.586 INFO:tasks.workunit.client.1.smithi112.stdout:4/829: write de/d18/f26 [4886604,20627] 0 2024-09-21T10:40:53.586 INFO:tasks.workunit.client.1.smithi112.stdout:4/830: fsync de/d33/d2f/d35/d4c/d5c/fe9 0 2024-09-21T10:40:53.587 INFO:tasks.workunit.client.0.smithi060.stdout:1/126: creat d6/d24/da/db/f29 x:0 0 0 2024-09-21T10:40:53.588 INFO:tasks.workunit.client.1.smithi112.stdout:5/833: dwrite d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd0 [0,4194304] 0 2024-09-21T10:40:53.588 INFO:tasks.workunit.client.1.smithi112.stdout:5/834: truncate d9/d15/d18/d3a/d4b/db4/fd7 403883 0 2024-09-21T10:40:53.589 INFO:tasks.workunit.client.1.smithi112.stdout:1/953: dread d8/d54/db0/fef [0,4194304] 0 2024-09-21T10:40:53.590 INFO:tasks.workunit.client.1.smithi112.stdout:4/831: rename de/d18/l23 to de/d18/d6d/l116 0 2024-09-21T10:40:53.591 INFO:tasks.workunit.client.0.smithi060.stdout:1/127: mknod d6/d24/da/db/c2a 0 2024-09-21T10:40:53.591 INFO:tasks.workunit.client.0.smithi060.stdout:1/128: readlink d6/l9 0 2024-09-21T10:40:53.595 INFO:tasks.workunit.client.1.smithi112.stdout:1/954: symlink d8/d1a/d53/d57/d83/d109/l124 0 2024-09-21T10:40:53.596 INFO:tasks.workunit.client.1.smithi112.stdout:1/955: write d8/d1a/d53/fc9 [25134,80659] 0 2024-09-21T10:40:53.596 INFO:tasks.workunit.client.1.smithi112.stdout:1/956: dread - d8/d1a/d53/d57/d105/f120 zero size 2024-09-21T10:40:53.597 INFO:tasks.workunit.client.1.smithi112.stdout:5/835: rename d9/f1c to d9/d15/d18/d3a/d4b/d74/f106 0 2024-09-21T10:40:53.599 INFO:tasks.workunit.client.1.smithi112.stdout:4/832: creat de/f117 x:0 0 0 2024-09-21T10:40:53.599 INFO:tasks.workunit.client.0.smithi060.stdout:1/129: dread d6/d24/fc [0,4194304] 0 2024-09-21T10:40:53.601 INFO:tasks.workunit.client.1.smithi112.stdout:1/957: mkdir d8/d7a/d125 0 2024-09-21T10:40:53.601 INFO:tasks.workunit.client.1.smithi112.stdout:3/767: sync 2024-09-21T10:40:53.603 INFO:tasks.workunit.client.1.smithi112.stdout:6/851: dwrite d4/d6/da/d11/d37/d19/f2e [0,4194304] 0 2024-09-21T10:40:53.603 INFO:tasks.workunit.client.1.smithi112.stdout:4/833: symlink de/d33/d2f/d71/d40/l118 0 2024-09-21T10:40:53.604 INFO:tasks.workunit.client.1.smithi112.stdout:8/809: dwrite d8/d9/dd/d76/d97/fa3 [0,4194304] 0 2024-09-21T10:40:53.604 INFO:tasks.workunit.client.1.smithi112.stdout:8/810: truncate d8/d18/fef 140299 0 2024-09-21T10:40:53.604 INFO:tasks.workunit.client.1.smithi112.stdout:8/811: chown d8/d9/dd/dab/d8e/dcb/d82/dcc 467 1 2024-09-21T10:40:53.605 INFO:tasks.workunit.client.0.smithi060.stdout:1/130: symlink d6/d24/da/db/d1c/l2b 0 2024-09-21T10:40:53.605 INFO:tasks.workunit.client.0.smithi060.stdout:1/131: write d6/d24/da/f1f [191029,87743] 0 2024-09-21T10:40:53.605 INFO:tasks.workunit.client.0.smithi060.stdout:1/132: creat d6/f2c x:0 0 0 2024-09-21T10:40:53.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/768: mknod d2/d2f/d3f/ddf/d31/cfc 0 2024-09-21T10:40:53.607 INFO:tasks.workunit.client.1.smithi112.stdout:4/834: link de/d2e/ce2 de/d33/d2f/d71/c119 0 2024-09-21T10:40:53.614 INFO:tasks.workunit.client.1.smithi112.stdout:6/852: dread d4/d6/da/d11/d1f/d22/fd5 [0,4194304] 0 2024-09-21T10:40:53.614 INFO:tasks.workunit.client.1.smithi112.stdout:3/769: dread d2/d1f/fbd [0,4194304] 0 2024-09-21T10:40:53.616 INFO:tasks.workunit.client.1.smithi112.stdout:5/836: dwrite d9/d15/f2a [0,4194304] 0 2024-09-21T10:40:53.622 INFO:tasks.workunit.client.1.smithi112.stdout:4/835: rename de/d33/d2f/d35/df3/dc2/dad/ced to de/d33/d2f/d71/d40/d4f/c11a 0 2024-09-21T10:40:53.622 INFO:tasks.workunit.client.1.smithi112.stdout:8/812: dwrite d8/d9/d3c/d57/fb2 [0,4194304] 0 2024-09-21T10:40:53.624 INFO:tasks.workunit.client.1.smithi112.stdout:6/853: creat d4/dc/d7e/f129 x:0 0 0 2024-09-21T10:40:53.624 INFO:tasks.workunit.client.1.smithi112.stdout:6/854: chown d4/d6/d75/f128 87727279 1 2024-09-21T10:40:53.627 INFO:tasks.workunit.client.1.smithi112.stdout:5/837: unlink d9/d15/d18/d3a/d4b/cb0 0 2024-09-21T10:40:53.628 INFO:tasks.workunit.client.0.smithi060.stdout:1/133: rmdir d6 39 2024-09-21T10:40:53.629 INFO:tasks.workunit.client.1.smithi112.stdout:3/770: rename d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/f80 to d2/d8d/ffd 0 2024-09-21T10:40:53.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/134: truncate d6/d24/da/f12 107658 0 2024-09-21T10:40:53.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/135: readlink d6/l9 0 2024-09-21T10:40:53.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/136: write d6/f2c [645787,59963] 0 2024-09-21T10:40:53.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/137: chown d6/f2c 10239 1 2024-09-21T10:40:53.631 INFO:tasks.workunit.client.1.smithi112.stdout:4/836: symlink de/d33/d6f/d9c/l11b 0 2024-09-21T10:40:53.631 INFO:tasks.workunit.client.1.smithi112.stdout:4/837: chown de/d33/d2f/d71/d40 1677559 1 2024-09-21T10:40:53.633 INFO:tasks.workunit.client.0.smithi060.stdout:1/138: dread d6/f20 [0,4194304] 0 2024-09-21T10:40:53.634 INFO:tasks.workunit.client.1.smithi112.stdout:8/813: dread - d8/faa zero size 2024-09-21T10:40:53.635 INFO:tasks.workunit.client.1.smithi112.stdout:6/855: rmdir d4/d6/da/d11/d37/d19 39 2024-09-21T10:40:53.635 INFO:tasks.workunit.client.1.smithi112.stdout:6/856: fsync d4/d6/da/d14/d49/d73/fa4 0 2024-09-21T10:40:53.636 INFO:tasks.workunit.client.0.smithi060.stdout:1/139: rmdir d6/d24 39 2024-09-21T10:40:53.636 INFO:tasks.workunit.client.0.smithi060.stdout:0/113: sync 2024-09-21T10:40:53.636 INFO:tasks.workunit.client.0.smithi060.stdout:7/196: sync 2024-09-21T10:40:53.637 INFO:tasks.workunit.client.1.smithi112.stdout:3/771: rename d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dc3 to d2/d2f/d3f/ddf/d31/d2a/dfe 0 2024-09-21T10:40:53.642 INFO:tasks.workunit.client.0.smithi060.stdout:1/140: mknod d6/d24/da/db/de/c2d 0 2024-09-21T10:40:53.644 INFO:tasks.workunit.client.1.smithi112.stdout:8/814: unlink d8/d9/l8f 0 2024-09-21T10:40:53.644 INFO:tasks.workunit.client.1.smithi112.stdout:8/815: creat d8/d9/d3c/d57/ff3 x:0 0 0 2024-09-21T10:40:53.645 INFO:tasks.workunit.client.0.smithi060.stdout:7/197: mknod da/d14/d25/c42 0 2024-09-21T10:40:53.645 INFO:tasks.workunit.client.0.smithi060.stdout:7/198: dread - da/d14/d2a/f2b zero size 2024-09-21T10:40:53.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/841: sync 2024-09-21T10:40:53.647 INFO:tasks.workunit.client.1.smithi112.stdout:9/842: truncate d1/d2/fc4 1681967 0 2024-09-21T10:40:53.647 INFO:tasks.workunit.client.1.smithi112.stdout:6/857: read d4/dc/d1a/f61 [548324,59116] 0 2024-09-21T10:40:53.647 INFO:tasks.workunit.client.1.smithi112.stdout:6/858: fsync d4/d6/da/d14/d49/fad 0 2024-09-21T10:40:53.647 INFO:tasks.workunit.client.0.smithi060.stdout:0/114: symlink d5/d10/da/d16/l1c 0 2024-09-21T10:40:53.648 INFO:tasks.workunit.client.1.smithi112.stdout:6/859: write d4/dc/d1a/d31/d56/fc5 [59630,79392] 0 2024-09-21T10:40:53.649 INFO:tasks.workunit.client.1.smithi112.stdout:3/772: mkdir d2/d2f/d3f/ddf/d31/d2a/dff 0 2024-09-21T10:40:53.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/141: creat d6/d24/da/db/de/f2e x:0 0 0 2024-09-21T10:40:53.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/142: write d6/f2c [925365,123109] 0 2024-09-21T10:40:53.651 INFO:tasks.workunit.client.0.smithi060.stdout:7/199: mknod da/d14/d35/d32/c43 0 2024-09-21T10:40:53.651 INFO:tasks.workunit.client.0.smithi060.stdout:7/200: creat da/d14/d35/d1e/d27/f44 x:0 0 0 2024-09-21T10:40:53.652 INFO:tasks.workunit.client.1.smithi112.stdout:8/816: getdents d8/d9/d3c/d90 0 2024-09-21T10:40:53.652 INFO:tasks.workunit.client.1.smithi112.stdout:8/817: chown d8/d9/dd/d2a/fb1 38 1 2024-09-21T10:40:53.652 INFO:tasks.workunit.client.1.smithi112.stdout:5/838: dwrite d9/d15/d18/d3a/d4b/f52 [0,4194304] 0 2024-09-21T10:40:53.652 INFO:tasks.workunit.client.1.smithi112.stdout:5/839: chown d9/ca 26423 1 2024-09-21T10:40:53.653 INFO:tasks.workunit.client.1.smithi112.stdout:4/838: dwrite de/d18/f21 [4194304,4194304] 0 2024-09-21T10:40:53.655 INFO:tasks.workunit.client.1.smithi112.stdout:3/773: mkdir d2/d1f/d100 0 2024-09-21T10:40:53.658 INFO:tasks.workunit.client.1.smithi112.stdout:8/818: rename d8/d9/dd/d76/cdc to d8/d9/ded/cf4 0 2024-09-21T10:40:53.658 INFO:tasks.workunit.client.1.smithi112.stdout:5/840: symlink d9/d15/d18/d20/l107 0 2024-09-21T10:40:53.661 INFO:tasks.workunit.client.0.smithi060.stdout:7/201: write da/d14/d35/f1a [203737,14539] 0 2024-09-21T10:40:53.662 INFO:tasks.workunit.client.0.smithi060.stdout:0/115: dread d5/d10/da/fb [0,4194304] 0 2024-09-21T10:40:53.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/819: symlink d8/d9/dd/dab/d8e/dcb/d82/dcc/de8/lf5 0 2024-09-21T10:40:53.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/820: readlink l4 0 2024-09-21T10:40:53.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/821: truncate d8/d9/dd/dab/d8e/dcb/d82/f87 1119564 0 2024-09-21T10:40:53.663 INFO:tasks.workunit.client.1.smithi112.stdout:5/841: creat d9/d15/d18/d20/f108 x:0 0 0 2024-09-21T10:40:53.663 INFO:tasks.workunit.client.1.smithi112.stdout:5/842: readlink d9/d15/d18/d20/l25 0 2024-09-21T10:40:53.664 INFO:tasks.workunit.client.0.smithi060.stdout:0/116: symlink d5/l1d 0 2024-09-21T10:40:53.665 INFO:tasks.workunit.client.1.smithi112.stdout:8/822: mkdir d8/d9/dd/d2b/d31/d46/df6 0 2024-09-21T10:40:53.665 INFO:tasks.workunit.client.1.smithi112.stdout:8/823: write d8/d9/dd/d2b/d31/d46/fa4 [6218133,120065] 0 2024-09-21T10:40:53.666 INFO:tasks.workunit.client.1.smithi112.stdout:5/843: symlink d9/d15/d18/d20/d47/dc6/df5/l109 0 2024-09-21T10:40:53.667 INFO:tasks.workunit.client.1.smithi112.stdout:3/774: dread d2/fa [0,4194304] 0 2024-09-21T10:40:53.667 INFO:tasks.workunit.client.1.smithi112.stdout:3/775: write f0 [20756,43071] 0 2024-09-21T10:40:53.667 INFO:tasks.workunit.client.0.smithi060.stdout:0/117: symlink d5/d10/d11/l1e 0 2024-09-21T10:40:53.668 INFO:tasks.workunit.client.1.smithi112.stdout:8/824: mknod d8/d9/dd/d2b/cf7 0 2024-09-21T10:40:53.669 INFO:tasks.workunit.client.1.smithi112.stdout:5/844: link d9/d15/d18/d20/faf d9/d15/d18/d20/d47/dc6/df5/f10a 0 2024-09-21T10:40:53.671 INFO:tasks.workunit.client.1.smithi112.stdout:5/845: mkdir d9/d15/d18/d3a/d61/d62/d10b 0 2024-09-21T10:40:53.671 INFO:tasks.workunit.client.1.smithi112.stdout:5/846: write d9/d15/d18/d3a/d4b/ff7 [43117,86847] 0 2024-09-21T10:40:53.671 INFO:tasks.workunit.client.1.smithi112.stdout:5/847: creat d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf/f10c x:0 0 0 2024-09-21T10:40:53.675 INFO:tasks.workunit.client.1.smithi112.stdout:5/848: unlink d9/d15/c67 0 2024-09-21T10:40:53.675 INFO:tasks.workunit.client.1.smithi112.stdout:5/849: chown d9/d15/d18/fcb 629009 1 2024-09-21T10:40:53.675 INFO:tasks.workunit.client.1.smithi112.stdout:5/850: truncate d9/d15/d18/d3a/d4b/fde 1027018 0 2024-09-21T10:40:53.676 INFO:tasks.workunit.client.1.smithi112.stdout:6/860: dwrite d4/d6/da/d11/d37/db8/f11e [0,4194304] 0 2024-09-21T10:40:53.676 INFO:tasks.workunit.client.1.smithi112.stdout:6/861: chown d4/d6/d75 3289279 1 2024-09-21T10:40:53.677 INFO:tasks.workunit.client.1.smithi112.stdout:5/851: unlink d9/d15/d18/d3a/d4b/db4/fd7 0 2024-09-21T10:40:53.679 INFO:tasks.workunit.client.1.smithi112.stdout:4/839: dwrite de/f117 [0,4194304] 0 2024-09-21T10:40:53.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/840: write de/d18/d6d/f114 [3939744,124148] 0 2024-09-21T10:40:53.681 INFO:tasks.workunit.client.1.smithi112.stdout:3/776: write d2/d2f/f53 [4135599,27170] 0 2024-09-21T10:40:53.681 INFO:tasks.workunit.client.1.smithi112.stdout:3/777: creat d2/d8d/f101 x:0 0 0 2024-09-21T10:40:53.681 INFO:tasks.workunit.client.1.smithi112.stdout:3/778: write d2/d2f/d3f/ddf/f29 [3432942,17302] 0 2024-09-21T10:40:53.681 INFO:tasks.workunit.client.1.smithi112.stdout:5/852: symlink d9/d6e/dfb/d100/l10d 0 2024-09-21T10:40:53.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/202: fsync da/d14/d35/f1a 0 2024-09-21T10:40:53.684 INFO:tasks.workunit.client.0.smithi060.stdout:7/203: truncate da/d14/d35/f40 872274 0 2024-09-21T10:40:53.689 INFO:tasks.workunit.client.1.smithi112.stdout:3/779: mknod d2/d1f/d100/c102 0 2024-09-21T10:40:53.693 INFO:tasks.workunit.client.0.smithi060.stdout:7/204: mknod da/d14/d33/c45 0 2024-09-21T10:40:53.694 INFO:tasks.workunit.client.1.smithi112.stdout:3/780: symlink d2/d2f/daf/dca/df0/l103 0 2024-09-21T10:40:53.696 INFO:tasks.workunit.client.1.smithi112.stdout:5/853: write d9/d15/d18/d20/d47/fa8 [7589269,117929] 0 2024-09-21T10:40:53.696 INFO:tasks.workunit.client.1.smithi112.stdout:5/854: write d9/d15/d18/d3a/d4b/d74/d8d/f90 [1195528,59211] 0 2024-09-21T10:40:53.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:53 smithi060 ceph-mon[28215]: pgmap v13: 65 pgs: 65 active+clean; 1.4 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 152 MiB/s rd, 188 MiB/s wr, 377 op/s 2024-09-21T10:40:53.699 INFO:tasks.workunit.client.1.smithi112.stdout:5/855: rename d9/d15/d18/d20/cee to d9/d15/d18/d3a/d4b/d74/d8d/d9a/df8/c10e 0 2024-09-21T10:40:53.699 INFO:tasks.workunit.client.1.smithi112.stdout:3/781: dread d2/d2f/d3f/ddf/d31/d2a/f3b [0,4194304] 0 2024-09-21T10:40:53.700 INFO:tasks.workunit.client.1.smithi112.stdout:5/856: link d9/l65 d9/d15/d18/d3a/d4b/d74/d8d/d9a/df8/l10f 0 2024-09-21T10:40:53.700 INFO:tasks.workunit.client.1.smithi112.stdout:5/857: chown d9/d15/d18/d3a/d4b/d74/d8d/fd5 68095965 1 2024-09-21T10:40:53.701 INFO:tasks.workunit.client.1.smithi112.stdout:3/782: creat d2/d2f/d3f/ddf/d31/d2a/dfe/f104 x:0 0 0 2024-09-21T10:40:53.702 INFO:tasks.workunit.client.1.smithi112.stdout:8/825: dwrite d8/d9/dd/d2a/d43/f7c [0,4194304] 0 2024-09-21T10:40:53.702 INFO:tasks.workunit.client.1.smithi112.stdout:5/858: symlink d9/d15/d18/d3a/d4b/l110 0 2024-09-21T10:40:53.704 INFO:tasks.workunit.client.1.smithi112.stdout:3/783: symlink d2/d2f/d3f/ddf/d31/d2a/dfe/l105 0 2024-09-21T10:40:53.706 INFO:tasks.workunit.client.0.smithi060.stdout:0/118: dwrite d5/d10/da/f13 [0,4194304] 0 2024-09-21T10:40:53.707 INFO:tasks.workunit.client.1.smithi112.stdout:8/826: truncate d8/d9/dd/d2a/d43/f9e 392094 0 2024-09-21T10:40:53.708 INFO:tasks.workunit.client.1.smithi112.stdout:5/859: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/da1/l111 0 2024-09-21T10:40:53.708 INFO:tasks.workunit.client.1.smithi112.stdout:5/860: readlink d9/d15/d18/d20/d55/lcd 0 2024-09-21T10:40:53.708 INFO:tasks.workunit.client.0.smithi060.stdout:1/143: dwrite d6/f2c [0,4194304] 0 2024-09-21T10:40:53.709 INFO:tasks.workunit.client.1.smithi112.stdout:3/784: write d2/d2f/daf/df4/fa7 [228536,122878] 0 2024-09-21T10:40:53.709 INFO:tasks.workunit.client.1.smithi112.stdout:3/785: truncate d2/d2f/d3f/f99 5130542 0 2024-09-21T10:40:53.710 INFO:tasks.workunit.client.1.smithi112.stdout:8/827: rename d8/d9/dd/dab/d8e/fd2 to d8/d9/ff8 0 2024-09-21T10:40:53.712 INFO:tasks.workunit.client.1.smithi112.stdout:5/861: symlink d9/d15/d18/d20/d47/dc6/l112 0 2024-09-21T10:40:53.712 INFO:tasks.workunit.client.1.smithi112.stdout:5/862: fsync d9/d15/d18/d3a/d61/d62/d6b/faa 0 2024-09-21T10:40:53.713 INFO:tasks.workunit.client.0.smithi060.stdout:0/119: creat d5/d10/d11/f1f x:0 0 0 2024-09-21T10:40:53.714 INFO:tasks.workunit.client.1.smithi112.stdout:3/786: write d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/fba [170667,20092] 0 2024-09-21T10:40:53.717 INFO:tasks.workunit.client.1.smithi112.stdout:8/828: rename d8/d9/dd/dab/fc3 to d8/d9/dd/d2a/db6/df0/ff9 0 2024-09-21T10:40:53.718 INFO:tasks.workunit.client.0.smithi060.stdout:1/144: mknod d6/c2f 0 2024-09-21T10:40:53.718 INFO:tasks.workunit.client.0.smithi060.stdout:1/145: fdatasync d6/f20 0 2024-09-21T10:40:53.721 INFO:tasks.workunit.client.1.smithi112.stdout:3/787: creat d2/dd5/f106 x:0 0 0 2024-09-21T10:40:53.721 INFO:tasks.workunit.client.1.smithi112.stdout:3/788: truncate d2/d1f/fbd 1099586 0 2024-09-21T10:40:53.723 INFO:tasks.workunit.client.1.smithi112.stdout:8/829: mkdir d8/d9/dd/d76/d97/dfa 0 2024-09-21T10:40:53.724 INFO:tasks.workunit.client.1.smithi112.stdout:8/830: write d8/d9/dd/f16 [5797040,118294] 0 2024-09-21T10:40:53.727 INFO:tasks.workunit.client.1.smithi112.stdout:4/841: dwrite de/d33/d2f/d71/d40/f88 [0,4194304] 0 2024-09-21T10:40:53.727 INFO:tasks.workunit.client.1.smithi112.stdout:4/842: truncate de/d33/d2f/d71/d40/fc4 380230 0 2024-09-21T10:40:53.727 INFO:tasks.workunit.client.1.smithi112.stdout:4/843: write de/d33/d2f/d35/d4c/f97 [1385172,58523] 0 2024-09-21T10:40:53.729 INFO:tasks.workunit.client.1.smithi112.stdout:6/862: dwrite d4/dc/d1a/d31/f71 [0,4194304] 0 2024-09-21T10:40:53.729 INFO:tasks.workunit.client.1.smithi112.stdout:4/844: dread de/d33/d2f/d71/fa1 [0,4194304] 0 2024-09-21T10:40:53.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/843: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:53.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/844: fsync d1/d2/d42/fdc 0 2024-09-21T10:40:53.732 INFO:tasks.workunit.client.0.smithi060.stdout:0/120: read f2 [2510002,31453] 0 2024-09-21T10:40:53.732 INFO:tasks.workunit.client.0.smithi060.stdout:7/205: dwrite da/d14/d25/f2c [0,4194304] 0 2024-09-21T10:40:53.732 INFO:tasks.workunit.client.0.smithi060.stdout:0/121: write f0 [566359,119244] 0 2024-09-21T10:40:53.734 INFO:tasks.workunit.client.1.smithi112.stdout:4/845: link de/d18/f3f de/d33/d6f/d9c/dc8/f11c 0 2024-09-21T10:40:53.738 INFO:tasks.workunit.client.0.smithi060.stdout:7/206: creat da/d14/d15/f46 x:0 0 0 2024-09-21T10:40:53.738 INFO:tasks.workunit.client.1.smithi112.stdout:5/863: dwrite d9/d15/f63 [0,4194304] 0 2024-09-21T10:40:53.742 INFO:tasks.workunit.client.1.smithi112.stdout:8/831: write d8/d9/dd/f20 [1001821,16929] 0 2024-09-21T10:40:53.742 INFO:tasks.workunit.client.0.smithi060.stdout:7/207: creat da/d14/d35/d1e/f47 x:0 0 0 2024-09-21T10:40:53.742 INFO:tasks.workunit.client.0.smithi060.stdout:7/208: chown f0 111 1 2024-09-21T10:40:53.742 INFO:tasks.workunit.client.0.smithi060.stdout:7/209: truncate da/d14/d35/d1e/d27/f39 337680 0 2024-09-21T10:40:53.744 INFO:tasks.workunit.client.0.smithi060.stdout:7/210: creat da/d14/f48 x:0 0 0 2024-09-21T10:40:53.745 INFO:tasks.workunit.client.0.smithi060.stdout:1/146: dwrite d6/d24/da/db/de/f2e [0,4194304] 0 2024-09-21T10:40:53.745 INFO:tasks.workunit.client.0.smithi060.stdout:1/147: chown d6/d24/da 17 1 2024-09-21T10:40:53.746 INFO:tasks.workunit.client.1.smithi112.stdout:3/789: dwrite d2/d2f/d3f/ddf/f5e [0,4194304] 0 2024-09-21T10:40:53.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/148: symlink d6/d24/l30 0 2024-09-21T10:40:53.752 INFO:tasks.workunit.client.0.smithi060.stdout:0/122: dwrite d5/d10/da/f12 [0,4194304] 0 2024-09-21T10:40:53.760 INFO:tasks.workunit.client.0.smithi060.stdout:0/123: dread d5/d10/da/f12 [0,4194304] 0 2024-09-21T10:40:53.760 INFO:tasks.workunit.client.0.smithi060.stdout:0/124: chown d5/d10/da/d16 26570728 1 2024-09-21T10:40:53.762 INFO:tasks.workunit.client.0.smithi060.stdout:0/125: mkdir d5/d10/da/d20 0 2024-09-21T10:40:53.765 INFO:tasks.workunit.client.0.smithi060.stdout:0/126: creat d5/f21 x:0 0 0 2024-09-21T10:40:53.765 INFO:tasks.workunit.client.0.smithi060.stdout:0/127: chown d5/d10/ld 8590 1 2024-09-21T10:40:53.766 INFO:tasks.workunit.client.0.smithi060.stdout:0/128: dread - d5/d10/da/d16/f19 zero size 2024-09-21T10:40:53.766 INFO:tasks.workunit.client.0.smithi060.stdout:0/129: write d5/d10/d11/f1f [409383,45177] 0 2024-09-21T10:40:53.768 INFO:tasks.workunit.client.1.smithi112.stdout:6/863: mkdir d4/d6/da/d12a 0 2024-09-21T10:40:53.768 INFO:tasks.workunit.client.1.smithi112.stdout:6/864: stat d4/d6/da/de1 0 2024-09-21T10:40:53.771 INFO:tasks.workunit.client.0.smithi060.stdout:7/211: dwrite f0 [0,4194304] 0 2024-09-21T10:40:53.771 INFO:tasks.workunit.client.0.smithi060.stdout:0/130: dread d5/d10/f9 [0,4194304] 0 2024-09-21T10:40:53.771 INFO:tasks.workunit.client.0.smithi060.stdout:1/149: dwrite d6/f20 [0,4194304] 0 2024-09-21T10:40:53.771 INFO:tasks.workunit.client.1.smithi112.stdout:5/864: mkdir d9/d15/d18/d3a/d4b/d71/d113 0 2024-09-21T10:40:53.771 INFO:tasks.workunit.client.1.smithi112.stdout:5/865: write d9/d15/d1d/fdc [934539,76011] 0 2024-09-21T10:40:53.772 INFO:tasks.workunit.client.1.smithi112.stdout:8/832: mkdir d8/d9/d3c/d90/dfb 0 2024-09-21T10:40:53.776 INFO:tasks.workunit.client.1.smithi112.stdout:3/790: unlink d2/c4 0 2024-09-21T10:40:53.776 INFO:tasks.workunit.client.1.smithi112.stdout:3/791: chown d2/d1f/f7d 0 1 2024-09-21T10:40:53.779 INFO:tasks.workunit.client.0.smithi060.stdout:0/131: symlink d5/l22 0 2024-09-21T10:40:53.787 INFO:tasks.workunit.client.1.smithi112.stdout:9/845: rmdir d1/d2/d27/d37 39 2024-09-21T10:40:53.787 INFO:tasks.workunit.client.1.smithi112.stdout:9/846: read - d1/d2/d27/d37/d3b/dec/f12a zero size 2024-09-21T10:40:53.787 INFO:tasks.workunit.client.1.smithi112.stdout:9/847: chown d1/d2/d42/ca9 955836171 1 2024-09-21T10:40:53.791 INFO:tasks.workunit.client.0.smithi060.stdout:7/212: rename da/d14/d35/d1e to da/d14/d2a/d49 0 2024-09-21T10:40:53.792 INFO:tasks.workunit.client.1.smithi112.stdout:4/846: getdents de/d33/d2f/d71 0 2024-09-21T10:40:53.796 INFO:tasks.workunit.client.1.smithi112.stdout:5/866: rename d9/d15/d18/d3a/d61/d93/cfd to d9/d15/d18/d3a/d4b/d74/d8d/c114 0 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:1/958: sync 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:7/768: sync 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:0/820: sync 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:2/713: sync 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:2/714: write d0/da4/dbe/fa7 [1356456,127743] 0 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:2/715: fdatasync d0/d12/f7b 0 2024-09-21T10:40:53.798 INFO:tasks.workunit.client.1.smithi112.stdout:2/716: stat d0/d12/d77 0 2024-09-21T10:40:53.799 INFO:tasks.workunit.client.1.smithi112.stdout:3/792: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d3a/f59 [0,4194304] 0 2024-09-21T10:40:53.799 INFO:tasks.workunit.client.1.smithi112.stdout:3/793: readlink d2/d2f/d3f/l57 0 2024-09-21T10:40:53.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/150: dwrite d6/d24/fc [4194304,4194304] 0 2024-09-21T10:40:53.799 INFO:tasks.workunit.client.0.smithi060.stdout:0/132: rename d5/c6 to d5/d10/da/d20/c23 0 2024-09-21T10:40:53.799 INFO:tasks.workunit.client.0.smithi060.stdout:0/133: write d5/f21 [892844,57769] 0 2024-09-21T10:40:53.805 INFO:tasks.workunit.client.1.smithi112.stdout:6/865: mkdir d4/dc/d1a/d31/d3c/d12b 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/847: getdents de/d2e 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/848: creat de/d33/d2f/d71/d40/d4f/f11d x:0 0 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/849: read de/d33/d2f/d35/f36 [1976609,47736] 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/850: fdatasync de/d2e/f48 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/851: fsync de/d18/fa8 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/852: creat de/d33/d2f/d71/d40/d4f/f11e x:0 0 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/853: fsync de/d33/d2f/d35/d4c/d5c/fd6 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:4/854: fsync de/d33/d2f/f52 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:5/867: creat d9/d15/d18/d3a/d4b/d74/d8d/d9a/df8/f115 x:0 0 0 2024-09-21T10:40:53.808 INFO:tasks.workunit.client.1.smithi112.stdout:5/868: write d9/d15/d18/d3a/d61/d62/d6b/f105 [663467,52491] 0 2024-09-21T10:40:53.810 INFO:tasks.workunit.client.0.smithi060.stdout:0/134: mkdir d5/d10/da/d16/d24 0 2024-09-21T10:40:53.811 INFO:tasks.workunit.client.1.smithi112.stdout:1/959: link d8/d1a/d31/c74 d8/d54/d6d/c126 0 2024-09-21T10:40:53.811 INFO:tasks.workunit.client.1.smithi112.stdout:1/960: readlink d8/d7a/ld9 0 2024-09-21T10:40:53.812 INFO:tasks.workunit.client.0.smithi060.stdout:1/151: dread d6/d24/fc [0,4194304] 0 2024-09-21T10:40:53.813 INFO:tasks.workunit.client.1.smithi112.stdout:1/961: dread d8/d54/db0/db1/fd4 [0,4194304] 0 2024-09-21T10:40:53.813 INFO:tasks.workunit.client.1.smithi112.stdout:2/717: rename d0/da4/dbe/fe7 to d0/d12/d77/feb 0 2024-09-21T10:40:53.815 INFO:tasks.workunit.client.1.smithi112.stdout:3/794: mkdir d2/dd5/d107 0 2024-09-21T10:40:53.820 INFO:tasks.workunit.client.1.smithi112.stdout:4/855: mkdir de/d11f 0 2024-09-21T10:40:53.821 INFO:tasks.workunit.client.1.smithi112.stdout:4/856: chown de/d33/d2f/d35/df3/dcc/c104 20 1 2024-09-21T10:40:53.822 INFO:tasks.workunit.client.1.smithi112.stdout:5/869: creat d9/d15/d18/d3a/d4b/d71/d113/f116 x:0 0 0 2024-09-21T10:40:53.822 INFO:tasks.workunit.client.1.smithi112.stdout:5/870: write d9/f11 [2548706,63518] 0 2024-09-21T10:40:53.822 INFO:tasks.workunit.client.1.smithi112.stdout:0/821: getdents d3/d4a/d4e/dc2/d10 0 2024-09-21T10:40:53.822 INFO:tasks.workunit.client.1.smithi112.stdout:0/822: write d3/d4a/d4e/dc2/d1a/f65 [2164084,77459] 0 2024-09-21T10:40:53.824 INFO:tasks.workunit.client.1.smithi112.stdout:1/962: mkdir d8/d1a/d31/da1/dc3/d127 0 2024-09-21T10:40:53.825 INFO:tasks.workunit.client.1.smithi112.stdout:2/718: getdents d0/d12/d46 0 2024-09-21T10:40:53.826 INFO:tasks.workunit.client.1.smithi112.stdout:3/795: rename d2/fa to d2/d2f/d3f/ddf/f108 0 2024-09-21T10:40:53.826 INFO:tasks.workunit.client.1.smithi112.stdout:3/796: chown d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fb1 13259435 1 2024-09-21T10:40:53.826 INFO:tasks.workunit.client.1.smithi112.stdout:3/797: dread - d2/d2f/d3f/ddf/d31/d2a/d39/fce zero size 2024-09-21T10:40:53.828 INFO:tasks.workunit.client.0.smithi060.stdout:1/152: read d6/f20 [3660368,41913] 0 2024-09-21T10:40:53.828 INFO:tasks.workunit.client.0.smithi060.stdout:1/153: dread - d6/d24/da/db/f29 zero size 2024-09-21T10:40:53.829 INFO:tasks.workunit.client.1.smithi112.stdout:0/823: mknod d3/d18/d45/c114 0 2024-09-21T10:40:53.830 INFO:tasks.workunit.client.0.smithi060.stdout:7/213: dwrite da/d14/d2a/d49/f47 [0,4194304] 0 2024-09-21T10:40:53.830 INFO:tasks.workunit.client.0.smithi060.stdout:7/214: chown da/d14/d2a/d49/f47 4569 1 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.1.smithi112.stdout:6/866: dwrite d4/d6/da/d11/d1f/d22/fc4 [4194304,4194304] 0 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.1.smithi112.stdout:7/769: dwrite d7/f26 [0,4194304] 0 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.1.smithi112.stdout:7/770: fdatasync d7/d22/d86/dac/d8a/f8d 0 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.1.smithi112.stdout:9/848: dwrite d1/d2/d42/f72 [4194304,4194304] 0 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.1.smithi112.stdout:9/849: chown d1/l6 13863392 1 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.0.smithi060.stdout:1/154: creat d6/d24/f31 x:0 0 0 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.0.smithi060.stdout:1/155: write d6/d24/da/db/dd/f1d [619797,56808] 0 2024-09-21T10:40:53.831 INFO:tasks.workunit.client.0.smithi060.stdout:1/156: chown d6/d24/da/db/de/f21 31065417 1 2024-09-21T10:40:53.832 INFO:tasks.workunit.client.1.smithi112.stdout:1/963: getdents d8/d54/d6d/db5/d11b 0 2024-09-21T10:40:53.835 INFO:tasks.workunit.client.1.smithi112.stdout:2/719: truncate d0/d12/d46/da0/db9/dbd/d62/d89/fae 673991 0 2024-09-21T10:40:53.836 INFO:tasks.workunit.client.1.smithi112.stdout:3/798: truncate d2/d1f/f7d 65908 0 2024-09-21T10:40:53.838 INFO:tasks.workunit.client.0.smithi060.stdout:6/275: sync 2024-09-21T10:40:53.838 INFO:tasks.workunit.client.0.smithi060.stdout:6/276: fsync d3/d12/d16/d25/f3e 0 2024-09-21T10:40:53.839 INFO:tasks.workunit.client.1.smithi112.stdout:4/857: rmdir de/d33/d2f/d35 39 2024-09-21T10:40:53.842 INFO:tasks.workunit.client.1.smithi112.stdout:0/824: mkdir d3/d4a/d4e/dc2/d43/d115 0 2024-09-21T10:40:53.842 INFO:tasks.workunit.client.1.smithi112.stdout:0/825: truncate d3/d4a/f70 1164842 0 2024-09-21T10:40:53.842 INFO:tasks.workunit.client.1.smithi112.stdout:0/826: write d3/d18/d52/d55/dcc/fab [8926260,110264] 0 2024-09-21T10:40:53.843 INFO:tasks.workunit.client.1.smithi112.stdout:5/871: dread d9/fb3 [0,4194304] 0 2024-09-21T10:40:53.843 INFO:tasks.workunit.client.1.smithi112.stdout:5/872: write d9/d15/d18/f39 [1327734,5365] 0 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:1/157: mkdir d6/d24/da/db/de/d32 0 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:1/158: write d6/d24/da/f1f [418634,45282] 0 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:9/167: sync 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:4/260: sync 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:5/146: sync 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:3/103: sync 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:8/150: sync 2024-09-21T10:40:53.848 INFO:tasks.workunit.client.0.smithi060.stdout:4/261: fdatasync d0/d5/d12/d20/f43 0 2024-09-21T10:40:53.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/159: dread - d6/d24/f31 zero size 2024-09-21T10:40:53.849 INFO:tasks.workunit.client.0.smithi060.stdout:4/262: chown d0/d5/d12/d20 103 1 2024-09-21T10:40:53.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/160: chown d6/l9 0 1 2024-09-21T10:40:53.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/104: write d0/d1/f1a [2627024,42104] 0 2024-09-21T10:40:53.849 INFO:tasks.workunit.client.0.smithi060.stdout:2/95: sync 2024-09-21T10:40:53.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/105: write d0/d1/d11/f15 [492146,74914] 0 2024-09-21T10:40:53.851 INFO:tasks.workunit.client.0.smithi060.stdout:7/215: dread f0 [0,4194304] 0 2024-09-21T10:40:53.853 INFO:tasks.workunit.client.0.smithi060.stdout:6/277: unlink d3/dd/c2b 0 2024-09-21T10:40:53.858 INFO:tasks.workunit.client.1.smithi112.stdout:2/720: unlink d0/dd/d47/f6b 0 2024-09-21T10:40:53.858 INFO:tasks.workunit.client.1.smithi112.stdout:2/721: creat d0/da4/dc5/fec x:0 0 0 2024-09-21T10:40:53.860 INFO:tasks.workunit.client.1.smithi112.stdout:4/858: symlink de/d33/d2f/d35/df3/dcc/l120 0 2024-09-21T10:40:53.860 INFO:tasks.workunit.client.1.smithi112.stdout:4/859: write de/d33/d2f/d35/df3/dcc/fe0 [828888,30661] 0 2024-09-21T10:40:53.862 INFO:tasks.workunit.client.0.smithi060.stdout:8/151: link d2/c1d d2/d18/c33 0 2024-09-21T10:40:53.862 INFO:tasks.workunit.client.0.smithi060.stdout:8/152: creat d2/d18/f34 x:0 0 0 2024-09-21T10:40:53.862 INFO:tasks.workunit.client.0.smithi060.stdout:8/153: write d2/d26/f32 [190180,107866] 0 2024-09-21T10:40:53.862 INFO:tasks.workunit.client.0.smithi060.stdout:8/154: creat d2/d26/f35 x:0 0 0 2024-09-21T10:40:53.862 INFO:tasks.workunit.client.0.smithi060.stdout:8/155: creat d2/d18/f36 x:0 0 0 2024-09-21T10:40:53.863 INFO:tasks.workunit.client.0.smithi060.stdout:1/161: mknod d6/d24/da/db/de/d32/c33 0 2024-09-21T10:40:53.867 INFO:tasks.workunit.client.1.smithi112.stdout:0/827: creat d3/d4a/d4e/dc2/d1a/d21/d10e/f116 x:0 0 0 2024-09-21T10:40:53.868 INFO:tasks.workunit.client.0.smithi060.stdout:4/263: mkdir d0/d59 0 2024-09-21T10:40:53.868 INFO:tasks.workunit.client.0.smithi060.stdout:4/264: creat d0/d5/f5a x:0 0 0 2024-09-21T10:40:53.868 INFO:tasks.workunit.client.0.smithi060.stdout:4/265: fsync d0/d5/f10 0 2024-09-21T10:40:53.869 INFO:tasks.workunit.client.0.smithi060.stdout:0/135: dwrite d5/d10/d11/f1f [0,4194304] 0 2024-09-21T10:40:53.869 INFO:tasks.workunit.client.0.smithi060.stdout:0/136: fsync d5/d10/da/f13 0 2024-09-21T10:40:53.870 INFO:tasks.workunit.client.1.smithi112.stdout:3/799: dwrite d2/d2f/d3f/ddf/d31/faa [0,4194304] 0 2024-09-21T10:40:53.870 INFO:tasks.workunit.client.0.smithi060.stdout:5/147: dwrite d5/d9/fe [0,4194304] 0 2024-09-21T10:40:53.871 INFO:tasks.workunit.client.1.smithi112.stdout:1/964: getdents d8/d1a/d53/d76 0 2024-09-21T10:40:53.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/106: mknod d0/c1d 0 2024-09-21T10:40:53.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/107: dread - d0/d1/f18 zero size 2024-09-21T10:40:53.875 INFO:tasks.workunit.client.0.smithi060.stdout:7/216: rename da/d14/d15/f46 to da/d14/d25/f4a 0 2024-09-21T10:40:53.876 INFO:tasks.workunit.client.1.smithi112.stdout:2/722: dread d0/d12/d46/da0/db9/dbd/d62/d63/fcd [0,4194304] 0 2024-09-21T10:40:53.876 INFO:tasks.workunit.client.1.smithi112.stdout:2/723: creat d0/da4/dbe/fed x:0 0 0 2024-09-21T10:40:53.876 INFO:tasks.workunit.client.1.smithi112.stdout:2/724: write d0/d12/f7b [229554,33496] 0 2024-09-21T10:40:53.876 INFO:tasks.workunit.client.1.smithi112.stdout:4/860: creat de/df8/f121 x:0 0 0 2024-09-21T10:40:53.880 INFO:tasks.workunit.client.0.smithi060.stdout:9/168: rmdir d3/d16/d1a 39 2024-09-21T10:40:53.881 INFO:tasks.workunit.client.1.smithi112.stdout:0/828: dread d3/d4a/d4e/dc2/d10/f35 [0,4194304] 0 2024-09-21T10:40:53.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/156: mkdir d2/d26/d37 0 2024-09-21T10:40:53.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/157: creat d2/d26/f38 x:0 0 0 2024-09-21T10:40:53.891 INFO:tasks.workunit.client.0.smithi060.stdout:1/162: symlink d6/d24/da/l34 0 2024-09-21T10:40:53.891 INFO:tasks.workunit.client.0.smithi060.stdout:8/158: read d2/f23 [1067651,47470] 0 2024-09-21T10:40:53.894 INFO:tasks.workunit.client.0.smithi060.stdout:5/148: dwrite d5/d9/d10/d19/d21/f2d [0,4194304] 0 2024-09-21T10:40:53.897 INFO:tasks.workunit.client.1.smithi112.stdout:3/800: unlink d2/d2f/d3f/f89 0 2024-09-21T10:40:53.897 INFO:tasks.workunit.client.1.smithi112.stdout:3/801: read d2/d2f/daf/df4/fc9 [87119,70868] 0 2024-09-21T10:40:53.899 INFO:tasks.workunit.client.0.smithi060.stdout:0/137: truncate f2 8982068 0 2024-09-21T10:40:53.899 INFO:tasks.workunit.client.0.smithi060.stdout:0/138: stat d5/l1d 0 2024-09-21T10:40:53.900 INFO:tasks.workunit.client.1.smithi112.stdout:1/965: mknod d8/d45/dae/d114/c128 0 2024-09-21T10:40:53.901 INFO:tasks.workunit.client.1.smithi112.stdout:1/966: stat d8/d54/db0/db1/ceb 0 2024-09-21T10:40:53.902 INFO:tasks.workunit.client.0.smithi060.stdout:2/96: rmdir d3 39 2024-09-21T10:40:53.903 INFO:tasks.workunit.client.0.smithi060.stdout:3/108: dwrite d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:40:53.903 INFO:tasks.workunit.client.0.smithi060.stdout:3/109: fdatasync d0/d1/f18 0 2024-09-21T10:40:53.905 INFO:tasks.workunit.client.0.smithi060.stdout:7/217: link da/d14/d25/c42 da/d14/d2a/c4b 0 2024-09-21T10:40:53.906 INFO:tasks.workunit.client.1.smithi112.stdout:2/725: symlink d0/d12/d77/lee 0 2024-09-21T10:40:53.906 INFO:tasks.workunit.client.1.smithi112.stdout:2/726: chown d0/d12/d76/lcf 1590299 1 2024-09-21T10:40:53.907 INFO:tasks.workunit.client.0.smithi060.stdout:4/266: rename d0/d5/d12/d15/f2c to d0/d5/d12/d20/d32/d57/f5b 0 2024-09-21T10:40:53.907 INFO:tasks.workunit.client.0.smithi060.stdout:4/267: read - d0/d5/d12/d20/d32/d57/f5b zero size 2024-09-21T10:40:53.908 INFO:tasks.workunit.client.1.smithi112.stdout:4/861: mkdir de/d33/d2f/d122 0 2024-09-21T10:40:53.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/169: dwrite d3/fa [8388608,4194304] 0 2024-09-21T10:40:53.912 INFO:tasks.workunit.client.0.smithi060.stdout:6/278: rmdir d3/d12/d16 39 2024-09-21T10:40:53.914 INFO:tasks.workunit.client.1.smithi112.stdout:0/829: symlink d3/d4a/d4e/d72/l117 0 2024-09-21T10:40:53.914 INFO:tasks.workunit.client.1.smithi112.stdout:0/830: chown d3/d4a/d4e/dc2/d1a/d21/c2d 3849044 1 2024-09-21T10:40:53.914 INFO:tasks.workunit.client.1.smithi112.stdout:0/831: truncate d3/f50 434810 0 2024-09-21T10:40:53.914 INFO:tasks.workunit.client.1.smithi112.stdout:0/832: chown d3/d18/d52 4380 1 2024-09-21T10:40:53.914 INFO:tasks.workunit.client.0.smithi060.stdout:1/163: symlink d6/d24/da/l35 0 2024-09-21T10:40:53.916 INFO:tasks.workunit.client.1.smithi112.stdout:6/867: rename d4/dc/d1a to d4/d6/da/d11/d1f/d22/d100/d12c 0 2024-09-21T10:40:53.916 INFO:tasks.workunit.client.1.smithi112.stdout:6/868: write d4/d6/da/d11/d1f/d22/d86/ff2 [5050913,90059] 0 2024-09-21T10:40:53.916 INFO:tasks.workunit.client.1.smithi112.stdout:6/869: write d4/d6/da/d14/d49/d73/d74/f116 [816014,37709] 0 2024-09-21T10:40:53.916 INFO:tasks.workunit.client.0.smithi060.stdout:8/159: truncate d2/d18/f22 128743 0 2024-09-21T10:40:53.919 INFO:tasks.workunit.client.0.smithi060.stdout:5/149: dwrite d5/d9/d10/d19/d21/f2d [0,4194304] 0 2024-09-21T10:40:53.919 INFO:tasks.workunit.client.1.smithi112.stdout:3/802: symlink d2/d2f/d3f/l109 0 2024-09-21T10:40:53.924 INFO:tasks.workunit.client.1.smithi112.stdout:1/967: truncate d8/d1a/d31/d37/f81 512854 0 2024-09-21T10:40:53.924 INFO:tasks.workunit.client.0.smithi060.stdout:9/170: dread d3/fc [0,4194304] 0 2024-09-21T10:40:53.924 INFO:tasks.workunit.client.0.smithi060.stdout:9/171: fdatasync d3/d16/d20/d2f/f31 0 2024-09-21T10:40:53.925 INFO:tasks.workunit.client.0.smithi060.stdout:0/139: getdents d5/d10/da/d15 0 2024-09-21T10:40:53.925 INFO:tasks.workunit.client.1.smithi112.stdout:4/862: mknod de/d33/d6f/d9c/c123 0 2024-09-21T10:40:53.926 INFO:tasks.workunit.client.1.smithi112.stdout:4/863: write de/d18/d6d/f7e [3820603,24669] 0 2024-09-21T10:40:53.926 INFO:tasks.workunit.client.0.smithi060.stdout:2/97: unlink d3/d7/c8 0 2024-09-21T10:40:53.926 INFO:tasks.workunit.client.0.smithi060.stdout:2/98: readlink d3/d7/la 0 2024-09-21T10:40:53.927 INFO:tasks.workunit.client.0.smithi060.stdout:2/99: chown d3/d7/d18 2 1 2024-09-21T10:40:53.928 INFO:tasks.workunit.client.0.smithi060.stdout:3/110: mkdir d0/d1/d1e 0 2024-09-21T10:40:53.930 INFO:tasks.workunit.client.1.smithi112.stdout:9/850: rename d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101/d129 to d1/d2/d27/d37/d3b/d69/d77/da0/de4/d12c 0 2024-09-21T10:40:53.930 INFO:tasks.workunit.client.1.smithi112.stdout:5/873: rename d9/d15/d18/d3a to d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf/d117 22 2024-09-21T10:40:53.930 INFO:tasks.workunit.client.1.smithi112.stdout:5/874: stat d9/d15/d18/d3a/f2d 0 2024-09-21T10:40:53.931 INFO:tasks.workunit.client.0.smithi060.stdout:7/218: creat da/d14/d2a/d49/d27/f4c x:0 0 0 2024-09-21T10:40:53.933 INFO:tasks.workunit.client.0.smithi060.stdout:4/268: creat d0/d59/f5c x:0 0 0 2024-09-21T10:40:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:4/269: chown d0/d5/d12/d20/d32/c39 296751863 1 2024-09-21T10:40:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:4/270: read d0/d5/d12/d16/f1d [316605,65076] 0 2024-09-21T10:40:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:8/160: dwrite d2/d26/f32 [0,4194304] 0 2024-09-21T10:40:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:8/161: truncate d2/f1c 889767 0 2024-09-21T10:40:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:8/162: dread - d2/d18/f34 zero size 2024-09-21T10:40:53.935 INFO:tasks.workunit.client.1.smithi112.stdout:8/833: sync 2024-09-21T10:40:53.935 INFO:tasks.workunit.client.1.smithi112.stdout:8/834: chown d8/d9/dd/d2b/db8/fc5 1560193 1 2024-09-21T10:40:53.936 INFO:tasks.workunit.client.0.smithi060.stdout:6/279: creat d3/d12/f51 x:0 0 0 2024-09-21T10:40:53.936 INFO:tasks.workunit.client.0.smithi060.stdout:6/280: readlink d3/d12/d16/d22/l35 0 2024-09-21T10:40:53.937 INFO:tasks.workunit.client.0.smithi060.stdout:3/111: write d0/d1/d11/f15 [1771480,69685] 0 2024-09-21T10:40:53.939 INFO:tasks.workunit.client.0.smithi060.stdout:1/164: creat d6/d24/da/db/d1c/f36 x:0 0 0 2024-09-21T10:40:53.943 INFO:tasks.workunit.client.0.smithi060.stdout:5/150: mkdir d5/d9/d10/d19/d21/d30 0 2024-09-21T10:40:53.943 INFO:tasks.workunit.client.0.smithi060.stdout:5/151: chown d5/d9 16011487 1 2024-09-21T10:40:53.943 INFO:tasks.workunit.client.0.smithi060.stdout:5/152: fsync d5/d9/d10/f1b 0 2024-09-21T10:40:53.945 INFO:tasks.workunit.client.1.smithi112.stdout:3/803: symlink d2/d2f/daf/df4/ddd/l10a 0 2024-09-21T10:40:53.946 INFO:tasks.workunit.client.0.smithi060.stdout:9/172: mknod d3/c37 0 2024-09-21T10:40:53.950 INFO:tasks.workunit.client.0.smithi060.stdout:0/140: rename d5/d10/da/fb to d5/f25 0 2024-09-21T10:40:53.950 INFO:tasks.workunit.client.0.smithi060.stdout:0/141: fdatasync d5/d10/da/f12 0 2024-09-21T10:40:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:53 smithi112 ceph-mon[35117]: pgmap v13: 65 pgs: 65 active+clean; 1.4 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 152 MiB/s rd, 188 MiB/s wr, 377 op/s 2024-09-21T10:40:53.951 INFO:tasks.workunit.client.0.smithi060.stdout:2/100: link d3/lf d3/d7/d13/d15/l19 0 2024-09-21T10:40:53.951 INFO:tasks.workunit.client.0.smithi060.stdout:2/101: fsync d3/f12 0 2024-09-21T10:40:53.951 INFO:tasks.workunit.client.0.smithi060.stdout:5/153: dread d5/ff [0,4194304] 0 2024-09-21T10:40:53.953 INFO:tasks.workunit.client.1.smithi112.stdout:1/968: symlink d8/d1a/d53/d57/d83/l129 0 2024-09-21T10:40:53.953 INFO:tasks.workunit.client.1.smithi112.stdout:1/969: dread - d8/d45/dae/d114/fe5 zero size 2024-09-21T10:40:53.957 INFO:tasks.workunit.client.1.smithi112.stdout:0/833: mkdir d3/d4a/d4e/dc2/d1a/dba/d118 0 2024-09-21T10:40:53.958 INFO:tasks.workunit.client.0.smithi060.stdout:5/154: dread d5/d9/d10/f1b [0,4194304] 0 2024-09-21T10:40:53.958 INFO:tasks.workunit.client.0.smithi060.stdout:5/155: write d5/ff [3816580,110922] 0 2024-09-21T10:40:53.958 INFO:tasks.workunit.client.0.smithi060.stdout:8/163: mknod d2/d18/c39 0 2024-09-21T10:40:53.960 INFO:tasks.workunit.client.0.smithi060.stdout:0/142: write d5/d10/da/f13 [343669,128596] 0 2024-09-21T10:40:53.960 INFO:tasks.workunit.client.0.smithi060.stdout:0/143: readlink d5/l22 0 2024-09-21T10:40:53.963 INFO:tasks.workunit.client.1.smithi112.stdout:9/851: mkdir d1/d2/d27/d62/d70/d12d 0 2024-09-21T10:40:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:3/112: dwrite d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:9/173: mknod d3/d16/c38 0 2024-09-21T10:40:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:1/165: dwrite d6/f2c [0,4194304] 0 2024-09-21T10:40:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:9/174: readlink d3/d16/l34 0 2024-09-21T10:40:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:6/281: dwrite d3/d12/d16/f18 [4194304,4194304] 0 2024-09-21T10:40:53.967 INFO:tasks.workunit.client.1.smithi112.stdout:6/870: rename d4/d6/f109 to d4/d6/da/d11/d37/d19/df3/f12d 0 2024-09-21T10:40:53.967 INFO:tasks.workunit.client.1.smithi112.stdout:0/834: write d3/d4a/d4e/dc2/d1a/d21/f61 [1413443,30273] 0 2024-09-21T10:40:53.968 INFO:tasks.workunit.client.0.smithi060.stdout:4/271: rename d0/f6 to d0/d5/d3a/f5d 0 2024-09-21T10:40:53.968 INFO:tasks.workunit.client.0.smithi060.stdout:0/144: dread f0 [4194304,4194304] 0 2024-09-21T10:40:53.968 INFO:tasks.workunit.client.0.smithi060.stdout:0/145: truncate f0 8760904 0 2024-09-21T10:40:53.968 INFO:tasks.workunit.client.0.smithi060.stdout:0/146: write d5/f25 [5147660,113578] 0 2024-09-21T10:40:53.969 INFO:tasks.workunit.client.1.smithi112.stdout:7/771: sync 2024-09-21T10:40:53.969 INFO:tasks.workunit.client.1.smithi112.stdout:5/875: symlink d9/d15/d18/d20/l118 0 2024-09-21T10:40:53.971 INFO:tasks.workunit.client.1.smithi112.stdout:8/835: truncate d8/d18/f24 1605351 0 2024-09-21T10:40:53.972 INFO:tasks.workunit.client.0.smithi060.stdout:2/102: mknod d3/d7/d13/d17/c1a 0 2024-09-21T10:40:53.972 INFO:tasks.workunit.client.0.smithi060.stdout:2/103: stat d3/d7/d13/d15 0 2024-09-21T10:40:53.973 INFO:tasks.workunit.client.0.smithi060.stdout:6/282: read d3/f26 [2069320,84559] 0 2024-09-21T10:40:53.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/104: write d3/d7/fd [407512,110866] 0 2024-09-21T10:40:53.976 INFO:tasks.workunit.client.0.smithi060.stdout:5/156: creat d5/d9/d10/d19/f31 x:0 0 0 2024-09-21T10:40:53.979 INFO:tasks.workunit.client.0.smithi060.stdout:8/164: link d2/l10 d2/l3a 0 2024-09-21T10:40:53.980 INFO:tasks.workunit.client.1.smithi112.stdout:1/970: symlink d8/d1a/d31/da1/de7/l12a 0 2024-09-21T10:40:53.980 INFO:tasks.workunit.client.1.smithi112.stdout:1/971: truncate d8/d54/fa6 5157535 0 2024-09-21T10:40:53.981 INFO:tasks.workunit.client.1.smithi112.stdout:1/972: fdatasync d8/d54/ffa 0 2024-09-21T10:40:53.986 INFO:tasks.workunit.client.0.smithi060.stdout:3/113: symlink d0/d1/l1f 0 2024-09-21T10:40:53.986 INFO:tasks.workunit.client.0.smithi060.stdout:3/114: stat d0/f16 0 2024-09-21T10:40:53.986 INFO:tasks.workunit.client.0.smithi060.stdout:5/157: dread d5/d9/d10/d19/d21/f2d [0,4194304] 0 2024-09-21T10:40:53.986 INFO:tasks.workunit.client.0.smithi060.stdout:5/158: creat d5/d9/d10/d19/f32 x:0 0 0 2024-09-21T10:40:53.986 INFO:tasks.workunit.client.1.smithi112.stdout:9/852: mknod d1/d81/c12e 0 2024-09-21T10:40:53.988 INFO:tasks.workunit.client.0.smithi060.stdout:1/166: creat d6/d24/da/db/de/d32/f37 x:0 0 0 2024-09-21T10:40:53.988 INFO:tasks.workunit.client.0.smithi060.stdout:1/167: readlink d6/d24/l30 0 2024-09-21T10:40:53.989 INFO:tasks.workunit.client.0.smithi060.stdout:1/168: creat d6/d24/da/db/de/f38 x:0 0 0 2024-09-21T10:40:53.990 INFO:tasks.workunit.client.1.smithi112.stdout:4/864: rename de/d33/d6f/d9c/dc8/cf9 to de/d33/d6f/d9c/d3e/c124 0 2024-09-21T10:40:53.993 INFO:tasks.workunit.client.1.smithi112.stdout:6/871: symlink d4/d6/da/de1/l12e 0 2024-09-21T10:40:53.993 INFO:tasks.workunit.client.1.smithi112.stdout:6/872: readlink d4/d6/da/l3d 0 2024-09-21T10:40:53.994 INFO:tasks.workunit.client.0.smithi060.stdout:9/175: rename f2 to d3/d16/d20/f39 0 2024-09-21T10:40:53.994 INFO:tasks.workunit.client.0.smithi060.stdout:9/176: creat d3/d15/f3a x:0 0 0 2024-09-21T10:40:53.994 INFO:tasks.workunit.client.0.smithi060.stdout:9/177: fsync d3/d15/f22 0 2024-09-21T10:40:53.996 INFO:tasks.workunit.client.0.smithi060.stdout:4/272: creat d0/d5/d12/d20/d32/f5e x:0 0 0 2024-09-21T10:40:53.997 INFO:tasks.workunit.client.1.smithi112.stdout:0/835: getdents d3/d18/d52/d55/dcc/d10b/d7f 0 2024-09-21T10:40:53.997 INFO:tasks.workunit.client.1.smithi112.stdout:0/836: write d3/d18/f3b [4130729,2945] 0 2024-09-21T10:40:53.999 INFO:tasks.workunit.client.0.smithi060.stdout:0/147: symlink d5/d10/da/d16/l26 0 2024-09-21T10:40:53.999 INFO:tasks.workunit.client.0.smithi060.stdout:8/165: dwrite d2/d18/f30 [0,4194304] 0 2024-09-21T10:40:53.999 INFO:tasks.workunit.client.0.smithi060.stdout:8/166: stat d2/d18/f22 0 2024-09-21T10:40:54.000 INFO:tasks.workunit.client.0.smithi060.stdout:2/105: dwrite d3/d7/d13/f11 [0,4194304] 0 2024-09-21T10:40:54.000 INFO:tasks.workunit.client.0.smithi060.stdout:2/106: stat d3/f5 0 2024-09-21T10:40:54.000 INFO:tasks.workunit.client.0.smithi060.stdout:2/107: fdatasync d3/f5 0 2024-09-21T10:40:54.001 INFO:tasks.workunit.client.1.smithi112.stdout:5/876: symlink d9/d8a/l119 0 2024-09-21T10:40:54.001 INFO:tasks.workunit.client.1.smithi112.stdout:5/877: read - d9/d15/d1d/fe2 zero size 2024-09-21T10:40:54.001 INFO:tasks.workunit.client.0.smithi060.stdout:6/283: creat d3/f52 x:0 0 0 2024-09-21T10:40:54.001 INFO:tasks.workunit.client.0.smithi060.stdout:6/284: dread - d3/d12/d38/d41/f4d zero size 2024-09-21T10:40:54.001 INFO:tasks.workunit.client.0.smithi060.stdout:6/285: dread - d3/d12/d16/d22/f48 zero size 2024-09-21T10:40:54.001 INFO:tasks.workunit.client.0.smithi060.stdout:6/286: stat d3/d12/d16/d25/d27 0 2024-09-21T10:40:54.003 INFO:tasks.workunit.client.1.smithi112.stdout:8/836: symlink d8/d9/dd/d76/d97/lfc 0 2024-09-21T10:40:54.004 INFO:tasks.workunit.client.1.smithi112.stdout:1/973: dwrite d8/d1a/f2c [0,4194304] 0 2024-09-21T10:40:54.004 INFO:tasks.workunit.client.1.smithi112.stdout:1/974: creat d8/d7a/f12b x:0 0 0 2024-09-21T10:40:54.004 INFO:tasks.workunit.client.1.smithi112.stdout:2/727: sync 2024-09-21T10:40:54.004 INFO:tasks.workunit.client.0.smithi060.stdout:0/148: dread d5/f21 [0,4194304] 0 2024-09-21T10:40:54.006 INFO:tasks.workunit.client.1.smithi112.stdout:3/804: getdents d2/d2f/daf 0 2024-09-21T10:40:54.007 INFO:tasks.workunit.client.1.smithi112.stdout:8/837: read d8/d9/dd/d1a/f26 [26824,81558] 0 2024-09-21T10:40:54.009 INFO:tasks.workunit.client.0.smithi060.stdout:3/115: rename d0/d1/f1a to d0/d1/f20 0 2024-09-21T10:40:54.009 INFO:tasks.workunit.client.0.smithi060.stdout:3/116: write d0/f1c [247670,19225] 0 2024-09-21T10:40:54.010 INFO:tasks.workunit.client.0.smithi060.stdout:3/117: read d0/d1/f20 [4021473,110719] 0 2024-09-21T10:40:54.010 INFO:tasks.workunit.client.0.smithi060.stdout:3/118: readlink d0/d1/l3 0 2024-09-21T10:40:54.010 INFO:tasks.workunit.client.0.smithi060.stdout:8/167: dread d2/ff [4194304,4194304] 0 2024-09-21T10:40:54.010 INFO:tasks.workunit.client.0.smithi060.stdout:8/168: chown d2/d18/c27 550 1 2024-09-21T10:40:54.013 INFO:tasks.workunit.client.1.smithi112.stdout:9/853: creat d1/d2/d27/d37/d3b/dec/d107/d10c/f12f x:0 0 0 2024-09-21T10:40:54.015 INFO:tasks.workunit.client.1.smithi112.stdout:4/865: getdents de/d33/d2f/d35/df3/dcc 0 2024-09-21T10:40:54.015 INFO:tasks.workunit.client.0.smithi060.stdout:0/149: write d5/d10/f9 [278638,6389] 0 2024-09-21T10:40:54.018 INFO:tasks.workunit.client.1.smithi112.stdout:6/873: creat d4/d6/da/d11/d37/df6/f12f x:0 0 0 2024-09-21T10:40:54.019 INFO:tasks.workunit.client.1.smithi112.stdout:8/838: read d8/d9/d3c/d57/fb2 [364036,77148] 0 2024-09-21T10:40:54.020 INFO:tasks.workunit.client.0.smithi060.stdout:0/150: dread d5/d10/f8 [0,4194304] 0 2024-09-21T10:40:54.021 INFO:tasks.workunit.client.0.smithi060.stdout:9/178: dwrite d3/d16/d20/f25 [4194304,4194304] 0 2024-09-21T10:40:54.021 INFO:tasks.workunit.client.0.smithi060.stdout:5/159: link d5/d9/f2b d5/d9/d10/d19/f33 0 2024-09-21T10:40:54.022 INFO:tasks.workunit.client.0.smithi060.stdout:5/160: creat d5/d9/d10/d19/f34 x:0 0 0 2024-09-21T10:40:54.025 INFO:tasks.workunit.client.1.smithi112.stdout:5/878: rename d9/d15/d18/d3a/d61/d62/d6b/lb6 to d9/d15/d18/d20/l11a 0 2024-09-21T10:40:54.025 INFO:tasks.workunit.client.1.smithi112.stdout:5/879: read d9/d15/d18/d3a/d61/d93/f98 [1841785,117632] 0 2024-09-21T10:40:54.026 INFO:tasks.workunit.client.0.smithi060.stdout:3/119: write d0/d1/f12 [2504815,53322] 0 2024-09-21T10:40:54.029 INFO:tasks.workunit.client.0.smithi060.stdout:1/169: unlink d6/d24/c11 0 2024-09-21T10:40:54.029 INFO:tasks.workunit.client.1.smithi112.stdout:0/837: dwrite d3/d4a/d4e/d72/fa9 [0,4194304] 0 2024-09-21T10:40:54.030 INFO:tasks.workunit.client.1.smithi112.stdout:0/838: chown d3/d18/c110 0 1 2024-09-21T10:40:54.030 INFO:tasks.workunit.client.1.smithi112.stdout:4/866: write de/d2a/dbf/f92 [964516,88481] 0 2024-09-21T10:40:54.030 INFO:tasks.workunit.client.1.smithi112.stdout:0/839: dread - d3/d18/d45/fe2 zero size 2024-09-21T10:40:54.030 INFO:tasks.workunit.client.1.smithi112.stdout:0/840: dread - d3/d4a/f96 zero size 2024-09-21T10:40:54.032 INFO:tasks.workunit.client.1.smithi112.stdout:2/728: truncate d0/d12/f41 3007699 0 2024-09-21T10:40:54.033 INFO:tasks.workunit.client.0.smithi060.stdout:4/273: creat d0/d5/d12/f5f x:0 0 0 2024-09-21T10:40:54.033 INFO:tasks.workunit.client.0.smithi060.stdout:4/274: readlink d0/d5/d12/l25 0 2024-09-21T10:40:54.035 INFO:tasks.workunit.client.1.smithi112.stdout:3/805: unlink d2/d1f/c4c 0 2024-09-21T10:40:54.036 INFO:tasks.workunit.client.0.smithi060.stdout:9/179: dread d3/d16/d1f/f2c [0,4194304] 0 2024-09-21T10:40:54.037 INFO:tasks.workunit.client.0.smithi060.stdout:2/108: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:54.037 INFO:tasks.workunit.client.0.smithi060.stdout:0/151: dread d5/f25 [0,4194304] 0 2024-09-21T10:40:54.038 INFO:tasks.workunit.client.0.smithi060.stdout:0/152: write d5/f25 [2282605,31243] 0 2024-09-21T10:40:54.038 INFO:tasks.workunit.client.0.smithi060.stdout:0/153: fdatasync d5/f21 0 2024-09-21T10:40:54.038 INFO:tasks.workunit.client.1.smithi112.stdout:9/854: mkdir d1/d2/d27/d37/d3b/d69/d88/d130 0 2024-09-21T10:40:54.041 INFO:tasks.workunit.client.1.smithi112.stdout:6/874: mkdir d4/d4f/d130 0 2024-09-21T10:40:54.041 INFO:tasks.workunit.client.1.smithi112.stdout:6/875: creat d4/d6/da/d14/d49/d73/f131 x:0 0 0 2024-09-21T10:40:54.041 INFO:tasks.workunit.client.1.smithi112.stdout:8/839: dwrite d8/d9/d3c/d6d/f9d [0,4194304] 0 2024-09-21T10:40:54.042 INFO:tasks.workunit.client.1.smithi112.stdout:5/880: symlink d9/d15/d18/d3a/d61/d93/l11b 0 2024-09-21T10:40:54.044 INFO:tasks.workunit.client.0.smithi060.stdout:3/120: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:54.044 INFO:tasks.workunit.client.0.smithi060.stdout:3/121: creat d0/f21 x:0 0 0 2024-09-21T10:40:54.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/287: getdents d3/d12/d16/d22 0 2024-09-21T10:40:54.045 INFO:tasks.workunit.client.0.smithi060.stdout:1/170: dread d6/d24/da/db/de/f2e [0,4194304] 0 2024-09-21T10:40:54.048 INFO:tasks.workunit.client.0.smithi060.stdout:8/169: mknod d2/c3b 0 2024-09-21T10:40:54.048 INFO:tasks.workunit.client.0.smithi060.stdout:8/170: readlink d2/d18/l31 0 2024-09-21T10:40:54.050 INFO:tasks.workunit.client.1.smithi112.stdout:4/867: unlink de/d33/d6f/d9c/d3e/d57/c58 0 2024-09-21T10:40:54.051 INFO:tasks.workunit.client.1.smithi112.stdout:6/876: write d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/fff [2137013,58726] 0 2024-09-21T10:40:54.051 INFO:tasks.workunit.client.0.smithi060.stdout:2/109: dread f2 [4194304,4194304] 0 2024-09-21T10:40:54.054 INFO:tasks.workunit.client.1.smithi112.stdout:0/841: mkdir d3/d4a/d4e/dc2/d43/d119 0 2024-09-21T10:40:54.055 INFO:tasks.workunit.client.0.smithi060.stdout:5/161: rmdir d5/d9/d13 39 2024-09-21T10:40:54.057 INFO:tasks.workunit.client.0.smithi060.stdout:8/171: dread d2/f3 [0,4194304] 0 2024-09-21T10:40:54.057 INFO:tasks.workunit.client.0.smithi060.stdout:8/172: chown d2/d18/f30 3 1 2024-09-21T10:40:54.057 INFO:tasks.workunit.client.0.smithi060.stdout:8/173: getdents d2/d26/d37 0 2024-09-21T10:40:54.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/729: link d0/f90 d0/fef 0 2024-09-21T10:40:54.061 INFO:tasks.workunit.client.1.smithi112.stdout:8/840: dwrite d8/d9/dd/d1a/fe9 [0,4194304] 0 2024-09-21T10:40:54.062 INFO:tasks.workunit.client.1.smithi112.stdout:9/855: dread d1/d2/d27/d3a/d4c/fe7 [0,4194304] 0 2024-09-21T10:40:54.062 INFO:tasks.workunit.client.1.smithi112.stdout:9/856: creat d1/d2/d42/f131 x:0 0 0 2024-09-21T10:40:54.062 INFO:tasks.workunit.client.1.smithi112.stdout:3/806: creat d2/d2f/d3f/ddf/d31/d2a/f10b x:0 0 0 2024-09-21T10:40:54.067 INFO:tasks.workunit.client.0.smithi060.stdout:4/275: dwrite d0/d5/f10 [0,4194304] 0 2024-09-21T10:40:54.067 INFO:tasks.workunit.client.0.smithi060.stdout:3/122: symlink d0/l22 0 2024-09-21T10:40:54.067 INFO:tasks.workunit.client.0.smithi060.stdout:3/123: fsync d0/d1/f12 0 2024-09-21T10:40:54.071 INFO:tasks.workunit.client.0.smithi060.stdout:5/162: creat d5/d9/d10/d19/d21/d30/f35 x:0 0 0 2024-09-21T10:40:54.072 INFO:tasks.workunit.client.1.smithi112.stdout:5/881: symlink d9/d15/d18/d20/d47/dc6/df5/l11c 0 2024-09-21T10:40:54.074 INFO:tasks.workunit.client.0.smithi060.stdout:9/180: rename d3/d16/d20 to d3/d16/d1a/d3b 0 2024-09-21T10:40:54.081 INFO:tasks.workunit.client.1.smithi112.stdout:4/868: mkdir de/d33/d6f/d9c/d3e/dce/d125 0 2024-09-21T10:40:54.081 INFO:tasks.workunit.client.1.smithi112.stdout:4/869: creat de/d33/d6f/d9c/f126 x:0 0 0 2024-09-21T10:40:54.084 INFO:tasks.workunit.client.0.smithi060.stdout:9/181: write d3/d15/f22 [2695259,113019] 0 2024-09-21T10:40:54.084 INFO:tasks.workunit.client.1.smithi112.stdout:3/807: read d2/d2f/f53 [8387185,70637] 0 2024-09-21T10:40:54.085 INFO:tasks.workunit.client.1.smithi112.stdout:6/877: mkdir d4/d6/d9c/d132 0 2024-09-21T10:40:54.087 INFO:tasks.workunit.client.0.smithi060.stdout:5/163: mknod d5/d9/c36 0 2024-09-21T10:40:54.087 INFO:tasks.workunit.client.0.smithi060.stdout:5/164: dread - d5/d9/d10/d19/f32 zero size 2024-09-21T10:40:54.089 INFO:tasks.workunit.client.1.smithi112.stdout:0/842: symlink d3/d4a/l11a 0 2024-09-21T10:40:54.090 INFO:tasks.workunit.client.0.smithi060.stdout:1/171: rename d6/d24/da/db/de/l1e to d6/d24/da/db/de/d32/l39 0 2024-09-21T10:40:54.093 INFO:tasks.workunit.client.1.smithi112.stdout:2/730: mkdir d0/dd/da5/df0 0 2024-09-21T10:40:54.093 INFO:tasks.workunit.client.1.smithi112.stdout:2/731: write d0/d12/d46/d86/fa6 [659961,2005] 0 2024-09-21T10:40:54.094 INFO:tasks.workunit.client.0.smithi060.stdout:9/182: link d3/d15/f17 d3/d15/f3c 0 2024-09-21T10:40:54.097 INFO:tasks.workunit.client.0.smithi060.stdout:1/172: dread d6/d24/da/db/de/f1a [0,4194304] 0 2024-09-21T10:40:54.099 INFO:tasks.workunit.client.0.smithi060.stdout:2/110: rename d3/c10 to d3/d7/d13/d17/c1b 0 2024-09-21T10:40:54.099 INFO:tasks.workunit.client.0.smithi060.stdout:2/111: write f2 [459504,25146] 0 2024-09-21T10:40:54.103 INFO:tasks.workunit.client.1.smithi112.stdout:8/841: symlink d8/d9/dd/d76/d97/dfa/lfd 0 2024-09-21T10:40:54.103 INFO:tasks.workunit.client.1.smithi112.stdout:8/842: dread - d8/d9/d3c/d57/f96 zero size 2024-09-21T10:40:54.103 INFO:tasks.workunit.client.1.smithi112.stdout:8/843: dread - d8/d9/dd/d2b/f44 zero size 2024-09-21T10:40:54.105 INFO:tasks.workunit.client.1.smithi112.stdout:8/844: write d8/d9/d3c/f50 [236958,15644] 0 2024-09-21T10:40:54.105 INFO:tasks.workunit.client.1.smithi112.stdout:8/845: creat d8/d9/d3c/d90/de1/ffe x:0 0 0 2024-09-21T10:40:54.106 INFO:tasks.workunit.client.0.smithi060.stdout:1/173: symlink d6/d24/da/db/de/l3a 0 2024-09-21T10:40:54.106 INFO:tasks.workunit.client.0.smithi060.stdout:1/174: write d6/d24/da/db/de/d32/f37 [464118,3670] 0 2024-09-21T10:40:54.108 INFO:tasks.workunit.client.0.smithi060.stdout:1/175: dread d6/d24/da/db/de/f1a [0,4194304] 0 2024-09-21T10:40:54.108 INFO:tasks.workunit.client.1.smithi112.stdout:9/857: getdents d1/d2/d27/dc5/dd0 0 2024-09-21T10:40:54.111 INFO:tasks.workunit.client.1.smithi112.stdout:2/732: dread d0/dd/fa1 [0,4194304] 0 2024-09-21T10:40:54.114 INFO:tasks.workunit.client.0.smithi060.stdout:6/288: dwrite d3/d12/d16/d22/f4a [0,4194304] 0 2024-09-21T10:40:54.115 INFO:tasks.workunit.client.0.smithi060.stdout:9/183: rmdir d3 39 2024-09-21T10:40:54.116 INFO:tasks.workunit.client.0.smithi060.stdout:9/184: chown d3/d16/d1a/d3b/f25 19 1 2024-09-21T10:40:54.117 INFO:tasks.workunit.client.1.smithi112.stdout:4/870: link de/f117 de/d33/d2f/d35/df3/dc2/f127 0 2024-09-21T10:40:54.119 INFO:tasks.workunit.client.0.smithi060.stdout:1/176: rename d6/d24/f31 to d6/d24/da/db/de/d32/f3b 0 2024-09-21T10:40:54.120 INFO:tasks.workunit.client.1.smithi112.stdout:6/878: truncate d4/d6/da/d14/f8e 2447091 0 2024-09-21T10:40:54.122 INFO:tasks.workunit.client.0.smithi060.stdout:0/154: dwrite d5/d10/da/fc [0,4194304] 0 2024-09-21T10:40:54.124 INFO:tasks.workunit.client.0.smithi060.stdout:9/185: dread d3/fe [0,4194304] 0 2024-09-21T10:40:54.124 INFO:tasks.workunit.client.0.smithi060.stdout:9/186: chown d3/d16/d1a/d3b/f23 1968 1 2024-09-21T10:40:54.124 INFO:tasks.workunit.client.0.smithi060.stdout:9/187: write d3/d15/f2b [984238,56740] 0 2024-09-21T10:40:54.124 INFO:tasks.workunit.client.0.smithi060.stdout:6/289: creat d3/d12/d4e/f53 x:0 0 0 2024-09-21T10:40:54.127 INFO:tasks.workunit.client.0.smithi060.stdout:1/177: mknod d6/c3c 0 2024-09-21T10:40:54.128 INFO:tasks.workunit.client.1.smithi112.stdout:8/846: rmdir d8/d9/dd/d2a/d43 39 2024-09-21T10:40:54.129 INFO:tasks.workunit.client.1.smithi112.stdout:7/772: sync 2024-09-21T10:40:54.129 INFO:tasks.workunit.client.1.smithi112.stdout:7/773: fdatasync d7/d22/d73/faf 0 2024-09-21T10:40:54.130 INFO:tasks.workunit.client.0.smithi060.stdout:8/174: dwrite d2/d18/f30 [0,4194304] 0 2024-09-21T10:40:54.131 INFO:tasks.workunit.client.1.smithi112.stdout:1/975: sync 2024-09-21T10:40:54.131 INFO:tasks.workunit.client.1.smithi112.stdout:1/976: truncate d8/f113 15749 0 2024-09-21T10:40:54.131 INFO:tasks.workunit.client.1.smithi112.stdout:1/977: truncate d8/d45/dae/d114/fcf 1527104 0 2024-09-21T10:40:54.132 INFO:tasks.workunit.client.1.smithi112.stdout:9/858: mknod d1/d2/d27/d37/d3b/d69/d77/c132 0 2024-09-21T10:40:54.132 INFO:tasks.workunit.client.1.smithi112.stdout:9/859: fdatasync d1/f43 0 2024-09-21T10:40:54.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/155: truncate d5/f25 3521286 0 2024-09-21T10:40:54.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/156: creat d5/d10/da/d16/f27 x:0 0 0 2024-09-21T10:40:54.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/157: creat d5/d10/d11/f28 x:0 0 0 2024-09-21T10:40:54.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/158: stat d5/d10 0 2024-09-21T10:40:54.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/159: write d5/d10/da/f13 [1897277,10315] 0 2024-09-21T10:40:54.137 INFO:tasks.workunit.client.0.smithi060.stdout:3/124: dwrite d0/f21 [0,4194304] 0 2024-09-21T10:40:54.138 INFO:tasks.workunit.client.1.smithi112.stdout:8/847: symlink d8/d18/lff 0 2024-09-21T10:40:54.140 INFO:tasks.workunit.client.0.smithi060.stdout:0/160: dread d5/d10/f8 [0,4194304] 0 2024-09-21T10:40:54.140 INFO:tasks.workunit.client.0.smithi060.stdout:0/161: dread - d5/d10/da/d16/f27 zero size 2024-09-21T10:40:54.140 INFO:tasks.workunit.client.0.smithi060.stdout:9/188: mknod d3/d16/c3d 0 2024-09-21T10:40:54.141 INFO:tasks.workunit.client.1.smithi112.stdout:4/871: rename de/d33/d2f/d35/lc5 to de/d33/d2f/d35/df3/dc2/dad/l128 0 2024-09-21T10:40:54.141 INFO:tasks.workunit.client.1.smithi112.stdout:4/872: truncate de/d33/d6f/d9c/f126 540527 0 2024-09-21T10:40:54.141 INFO:tasks.workunit.client.1.smithi112.stdout:4/873: chown de/d18/d6d/fc9 1 1 2024-09-21T10:40:54.141 INFO:tasks.workunit.client.1.smithi112.stdout:4/874: truncate de/d33/d2f/d71/d40/d4f/f11d 572933 0 2024-09-21T10:40:54.143 INFO:tasks.workunit.client.1.smithi112.stdout:8/848: symlink d8/d9/dd/dab/d8e/dcb/d82/dcc/l100 0 2024-09-21T10:40:54.143 INFO:tasks.workunit.client.1.smithi112.stdout:8/849: fdatasync d8/d9/dd/d76/fac 0 2024-09-21T10:40:54.144 INFO:tasks.workunit.client.0.smithi060.stdout:4/276: dwrite d0/f4 [0,4194304] 0 2024-09-21T10:40:54.144 INFO:tasks.workunit.client.0.smithi060.stdout:1/178: creat d6/d24/da/db/dd/f3d x:0 0 0 2024-09-21T10:40:54.145 INFO:tasks.workunit.client.1.smithi112.stdout:7/774: dread d7/d22/f28 [0,4194304] 0 2024-09-21T10:40:54.146 INFO:tasks.workunit.client.1.smithi112.stdout:4/875: link de/d33/d6f/d9c/d3e/c124 de/d33/d2f/d71/d40/d4f/c129 0 2024-09-21T10:40:54.148 INFO:tasks.workunit.client.0.smithi060.stdout:8/175: mknod d2/c3c 0 2024-09-21T10:40:54.150 INFO:tasks.workunit.client.1.smithi112.stdout:4/876: rename de/d18/d6d/l116 to de/d33/d6f/d9c/l12a 0 2024-09-21T10:40:54.150 INFO:tasks.workunit.client.1.smithi112.stdout:4/877: stat de/d18/f76 0 2024-09-21T10:40:54.152 INFO:tasks.workunit.client.1.smithi112.stdout:3/808: dwrite d2/f14 [0,4194304] 0 2024-09-21T10:40:54.153 INFO:tasks.workunit.client.1.smithi112.stdout:4/878: creat de/d18/f12b x:0 0 0 2024-09-21T10:40:54.154 INFO:tasks.workunit.client.1.smithi112.stdout:0/843: dwrite d3/d18/d45/fc4 [0,4194304] 0 2024-09-21T10:40:54.154 INFO:tasks.workunit.client.1.smithi112.stdout:0/844: write d3/d4a/d4e/dc2/d10/fb5 [1013880,41257] 0 2024-09-21T10:40:54.154 INFO:tasks.workunit.client.1.smithi112.stdout:0/845: fdatasync d3/d4a/d4e/dc2/d43/faf 0 2024-09-21T10:40:54.155 INFO:tasks.workunit.client.1.smithi112.stdout:8/850: dread d8/d9/dd/fd1 [0,4194304] 0 2024-09-21T10:40:54.155 INFO:tasks.workunit.client.1.smithi112.stdout:8/851: truncate d8/d9/d3c/f50 1631534 0 2024-09-21T10:40:54.157 INFO:tasks.workunit.client.1.smithi112.stdout:3/809: symlink d2/d1f/d100/l10c 0 2024-09-21T10:40:54.159 INFO:tasks.workunit.client.0.smithi060.stdout:2/112: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:40:54.159 INFO:tasks.workunit.client.1.smithi112.stdout:4/879: rename de/d33/d2f/d35/d4c/d5c/l6c to de/l12c 0 2024-09-21T10:40:54.159 INFO:tasks.workunit.client.1.smithi112.stdout:4/880: truncate de/f117 4373156 0 2024-09-21T10:40:54.164 INFO:tasks.workunit.client.1.smithi112.stdout:4/881: creat de/d33/d2f/d35/df3/f12d x:0 0 0 2024-09-21T10:40:54.164 INFO:tasks.workunit.client.1.smithi112.stdout:4/882: chown de/d33/d2f/d35/df3/cf2 10683 1 2024-09-21T10:40:54.169 INFO:tasks.workunit.client.1.smithi112.stdout:6/879: dwrite d4/d6/da/d14/f27 [0,4194304] 0 2024-09-21T10:40:54.170 INFO:tasks.workunit.client.1.smithi112.stdout:9/860: dwrite d1/d2/d27/d3a/f11e [0,4194304] 0 2024-09-21T10:40:54.170 INFO:tasks.workunit.client.1.smithi112.stdout:9/861: getdents d1/d7f/df0/d11c 0 2024-09-21T10:40:54.170 INFO:tasks.workunit.client.1.smithi112.stdout:3/810: chown d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/cc2 10168194 1 2024-09-21T10:40:54.170 INFO:tasks.workunit.client.1.smithi112.stdout:3/811: chown d2/d2f/d3f/ddf/d31/dcf/cd6 49 1 2024-09-21T10:40:54.170 INFO:tasks.workunit.client.1.smithi112.stdout:3/812: rename d2/d2f/d3f/ddf/d31/d2a to d2/d2f/d3f/ddf/d31/d2a/d10d 22 2024-09-21T10:40:54.171 INFO:tasks.workunit.client.1.smithi112.stdout:1/978: dwrite d8/d20/f5f [0,4194304] 0 2024-09-21T10:40:54.171 INFO:tasks.workunit.client.0.smithi060.stdout:0/162: unlink d5/d10/d11/l1e 0 2024-09-21T10:40:54.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/733: dwrite d0/d12/d46/da0/db9/dbd/d62/d63/f4c [0,4194304] 0 2024-09-21T10:40:54.172 INFO:tasks.workunit.client.1.smithi112.stdout:2/734: chown d0/d12/d46/dd8 66 1 2024-09-21T10:40:54.172 INFO:tasks.workunit.client.0.smithi060.stdout:3/125: dwrite d0/f1c [0,4194304] 0 2024-09-21T10:40:54.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/126: creat d0/f23 x:0 0 0 2024-09-21T10:40:54.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/127: write d0/d1/f20 [3793939,70680] 0 2024-09-21T10:40:54.173 INFO:tasks.workunit.client.1.smithi112.stdout:7/775: dwrite d7/d3d/f67 [4194304,4194304] 0 2024-09-21T10:40:54.176 INFO:tasks.workunit.client.1.smithi112.stdout:1/979: read d8/d1a/d31/d37/f5e [728415,48586] 0 2024-09-21T10:40:54.176 INFO:tasks.workunit.client.1.smithi112.stdout:6/880: creat d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d11b/f133 x:0 0 0 2024-09-21T10:40:54.176 INFO:tasks.workunit.client.1.smithi112.stdout:6/881: stat d4/d6/da/f60 0 2024-09-21T10:40:54.179 INFO:tasks.workunit.client.0.smithi060.stdout:9/189: symlink d3/d16/d1a/d3b/d2f/l3e 0 2024-09-21T10:40:54.179 INFO:tasks.workunit.client.0.smithi060.stdout:6/290: mkdir d3/d54 0 2024-09-21T10:40:54.180 INFO:tasks.workunit.client.0.smithi060.stdout:4/277: unlink d0/d5/d12/d20/f43 0 2024-09-21T10:40:54.180 INFO:tasks.workunit.client.0.smithi060.stdout:4/278: truncate d0/d5/d12/d20/d32/d57/f5b 906266 0 2024-09-21T10:40:54.180 INFO:tasks.workunit.client.0.smithi060.stdout:4/279: fsync d0/d5/f10 0 2024-09-21T10:40:54.180 INFO:tasks.workunit.client.1.smithi112.stdout:9/862: mkdir d1/d2/d27/d37/d3b/d69/d77/d133 0 2024-09-21T10:40:54.182 INFO:tasks.workunit.client.1.smithi112.stdout:2/735: dread d0/d12/d46/da0/fab [0,4194304] 0 2024-09-21T10:40:54.182 INFO:tasks.workunit.client.1.smithi112.stdout:3/813: unlink d2/d2f/d3f/ddf/lc6 0 2024-09-21T10:40:54.182 INFO:tasks.workunit.client.1.smithi112.stdout:3/814: chown d2/d2f/daf/dca/ccb 325698224 1 2024-09-21T10:40:54.182 INFO:tasks.workunit.client.1.smithi112.stdout:2/736: creat d0/da2/ff1 x:0 0 0 2024-09-21T10:40:54.183 INFO:tasks.workunit.client.0.smithi060.stdout:1/179: symlink d6/d24/da/db/de/l3e 0 2024-09-21T10:40:54.186 INFO:tasks.workunit.client.0.smithi060.stdout:8/176: creat d2/d26/d37/f3d x:0 0 0 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:3/815: dread d2/d2f/daf/dca/ff7 [0,4194304] 0 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:4/883: dwrite de/d33/d2f/d35/df3/f12d [0,4194304] 0 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:3/816: chown d2/d2f/daf/dca/df0 3 1 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:3/817: chown d2/d2f/d3f/ddf/d31/d2a/dfe 101 1 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:3/818: dread - d2/d2f/d3f/ddf/d31/d2a/da1/fd3 zero size 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:3/819: read d2/d2f/f53 [6686963,78724] 0 2024-09-21T10:40:54.188 INFO:tasks.workunit.client.1.smithi112.stdout:3/820: chown d2/d8d/ffd 4033 1 2024-09-21T10:40:54.189 INFO:tasks.workunit.client.0.smithi060.stdout:6/291: write d3/d12/d16/d1a/f1e [2373351,129157] 0 2024-09-21T10:40:54.190 INFO:tasks.workunit.client.0.smithi060.stdout:2/113: link d3/d7/d13/f11 d3/d7/d18/f1c 0 2024-09-21T10:40:54.190 INFO:tasks.workunit.client.0.smithi060.stdout:8/177: dread d2/d18/f22 [0,4194304] 0 2024-09-21T10:40:54.191 INFO:tasks.workunit.client.1.smithi112.stdout:0/846: dwrite d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/fac [0,4194304] 0 2024-09-21T10:40:54.191 INFO:tasks.workunit.client.1.smithi112.stdout:0/847: truncate d3/d18/d52/d55/fd1 1459350 0 2024-09-21T10:40:54.192 INFO:tasks.workunit.client.1.smithi112.stdout:8/852: dwrite d8/d9/dd/d76/d97/fa8 [0,4194304] 0 2024-09-21T10:40:54.195 INFO:tasks.workunit.client.1.smithi112.stdout:6/882: dwrite d4/d6/da/d14/d49/d62/fda [0,4194304] 0 2024-09-21T10:40:54.195 INFO:tasks.workunit.client.1.smithi112.stdout:6/883: chown d4/d6/d75/lbe 20789534 1 2024-09-21T10:40:54.195 INFO:tasks.workunit.client.0.smithi060.stdout:0/163: rmdir d5/d10/da/d16/d24 0 2024-09-21T10:40:54.199 INFO:tasks.workunit.client.0.smithi060.stdout:4/280: dwrite d0/d5/d12/f19 [4194304,4194304] 0 2024-09-21T10:40:54.199 INFO:tasks.workunit.client.0.smithi060.stdout:4/281: creat d0/f60 x:0 0 0 2024-09-21T10:40:54.201 INFO:tasks.workunit.client.0.smithi060.stdout:3/128: mkdir d0/d1/d24 0 2024-09-21T10:40:54.201 INFO:tasks.workunit.client.0.smithi060.stdout:3/129: write d0/d1/f18 [983309,72022] 0 2024-09-21T10:40:54.203 INFO:tasks.workunit.client.0.smithi060.stdout:9/190: rmdir d3/d16/d1a/d3b 39 2024-09-21T10:40:54.209 INFO:tasks.workunit.client.0.smithi060.stdout:9/191: dread d3/fe [0,4194304] 0 2024-09-21T10:40:54.209 INFO:tasks.workunit.client.0.smithi060.stdout:9/192: dread - d3/d16/d1a/f26 zero size 2024-09-21T10:40:54.212 INFO:tasks.workunit.client.0.smithi060.stdout:1/180: getdents d6 0 2024-09-21T10:40:54.215 INFO:tasks.workunit.client.1.smithi112.stdout:1/980: truncate d8/f17 5064846 0 2024-09-21T10:40:54.219 INFO:tasks.workunit.client.1.smithi112.stdout:9/863: unlink d1/d2/d27/d37/d3b/d69/d77/dca/dae/fb2 0 2024-09-21T10:40:54.220 INFO:tasks.workunit.client.0.smithi060.stdout:4/282: dwrite d0/f60 [0,4194304] 0 2024-09-21T10:40:54.221 INFO:tasks.workunit.client.0.smithi060.stdout:2/114: link d3/d7/la d3/d7/d13/d15/l1d 0 2024-09-21T10:40:54.223 INFO:tasks.workunit.client.1.smithi112.stdout:2/737: rename d0/dd/l48 to d0/d12/d46/da0/db9/dbd/d62/d89/lf2 0 2024-09-21T10:40:54.223 INFO:tasks.workunit.client.1.smithi112.stdout:2/738: dread - d0/d12/d77/feb zero size 2024-09-21T10:40:54.223 INFO:tasks.workunit.client.0.smithi060.stdout:8/178: mknod d2/d26/d37/c3e 0 2024-09-21T10:40:54.225 INFO:tasks.workunit.client.0.smithi060.stdout:9/193: dwrite d3/f35 [0,4194304] 0 2024-09-21T10:40:54.225 INFO:tasks.workunit.client.0.smithi060.stdout:0/164: mknod d5/d10/da/d16/c29 0 2024-09-21T10:40:54.225 INFO:tasks.workunit.client.0.smithi060.stdout:0/165: chown d5/d10/da/d16/f27 33 1 2024-09-21T10:40:54.225 INFO:tasks.workunit.client.0.smithi060.stdout:0/166: write f0 [9579837,88220] 0 2024-09-21T10:40:54.230 INFO:tasks.workunit.client.1.smithi112.stdout:4/884: unlink de/l60 0 2024-09-21T10:40:54.231 INFO:tasks.workunit.client.1.smithi112.stdout:4/885: write de/d18/f21 [4179379,118249] 0 2024-09-21T10:40:54.232 INFO:tasks.workunit.client.1.smithi112.stdout:3/821: mknod d2/d1f/d100/c10e 0 2024-09-21T10:40:54.233 INFO:tasks.workunit.client.0.smithi060.stdout:3/130: creat d0/d1/d24/f25 x:0 0 0 2024-09-21T10:40:54.236 INFO:tasks.workunit.client.0.smithi060.stdout:6/292: mknod d3/c55 0 2024-09-21T10:40:54.244 INFO:tasks.workunit.client.0.smithi060.stdout:0/167: dwrite d5/d10/da/f12 [4194304,4194304] 0 2024-09-21T10:40:54.244 INFO:tasks.workunit.client.0.smithi060.stdout:2/115: mknod d3/d7/d13/c1e 0 2024-09-21T10:40:54.244 INFO:tasks.workunit.client.0.smithi060.stdout:2/116: chown d3/d7/la 778166 1 2024-09-21T10:40:54.245 INFO:tasks.workunit.client.1.smithi112.stdout:8/853: mkdir d8/d9/dd/dab/d101 0 2024-09-21T10:40:54.245 INFO:tasks.workunit.client.1.smithi112.stdout:8/854: fsync d8/d9/d3c/d57/ff3 0 2024-09-21T10:40:54.245 INFO:tasks.workunit.client.0.smithi060.stdout:8/179: mknod d2/c3f 0 2024-09-21T10:40:54.247 INFO:tasks.workunit.client.0.smithi060.stdout:8/180: read d2/d26/f29 [31299,56141] 0 2024-09-21T10:40:54.249 INFO:tasks.workunit.client.1.smithi112.stdout:3/822: dread d2/d1f/f2c [0,4194304] 0 2024-09-21T10:40:54.251 INFO:tasks.workunit.client.0.smithi060.stdout:4/283: dwrite d0/f60 [0,4194304] 0 2024-09-21T10:40:54.251 INFO:tasks.workunit.client.0.smithi060.stdout:9/194: rmdir d3/d16/d1f 39 2024-09-21T10:40:54.251 INFO:tasks.workunit.client.0.smithi060.stdout:9/195: chown d3/d15/f3c 1 1 2024-09-21T10:40:54.251 INFO:tasks.workunit.client.1.smithi112.stdout:5/882: sync 2024-09-21T10:40:54.253 INFO:tasks.workunit.client.1.smithi112.stdout:6/884: truncate d4/d6/da/d14/d49/d73/f7f 6497390 0 2024-09-21T10:40:54.253 INFO:tasks.workunit.client.1.smithi112.stdout:8/855: dread f3 [0,4194304] 0 2024-09-21T10:40:54.255 INFO:tasks.workunit.client.0.smithi060.stdout:3/131: creat d0/d1/f26 x:0 0 0 2024-09-21T10:40:54.255 INFO:tasks.workunit.client.0.smithi060.stdout:3/132: chown d0/c1d 1 1 2024-09-21T10:40:54.256 INFO:tasks.workunit.client.0.smithi060.stdout:3/133: write d0/d1/f18 [2061843,86369] 0 2024-09-21T10:40:54.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/981: link d8/d1a/d31/d37/f8a d8/d54/d6d/db5/dc2/d119/f12c 0 2024-09-21T10:40:54.257 INFO:tasks.workunit.client.1.smithi112.stdout:1/982: stat d8/d54/db0 0 2024-09-21T10:40:54.258 INFO:tasks.workunit.client.0.smithi060.stdout:9/196: dread d3/d16/d1f/f2c [0,4194304] 0 2024-09-21T10:40:54.259 INFO:tasks.workunit.client.1.smithi112.stdout:9/864: link d1/d2/d27/l2c d1/d2/d27/d37/d68/l134 0 2024-09-21T10:40:54.259 INFO:tasks.workunit.client.1.smithi112.stdout:9/865: readlink d1/d2/d27/d37/d68/l87 0 2024-09-21T10:40:54.260 INFO:tasks.workunit.client.1.smithi112.stdout:9/866: dread - d1/d2/d27/d37/f100 zero size 2024-09-21T10:40:54.261 INFO:tasks.workunit.client.0.smithi060.stdout:0/168: mkdir d5/d10/da/d16/d2a 0 2024-09-21T10:40:54.261 INFO:tasks.workunit.client.1.smithi112.stdout:9/867: dread d1/d2/d27/d3a/d6b/d30/fce [0,4194304] 0 2024-09-21T10:40:54.262 INFO:tasks.workunit.client.0.smithi060.stdout:6/293: dwrite d3/d12/d16/d22/f48 [0,4194304] 0 2024-09-21T10:40:54.262 INFO:tasks.workunit.client.1.smithi112.stdout:2/739: symlink d0/d12/d46/da0/db9/dbd/de1/lf3 0 2024-09-21T10:40:54.263 INFO:tasks.workunit.client.0.smithi060.stdout:2/117: mkdir d3/d7/d13/d15/d1f 0 2024-09-21T10:40:54.263 INFO:tasks.workunit.client.0.smithi060.stdout:2/118: chown d3/d7/d13/f11 0 1 2024-09-21T10:40:54.265 INFO:tasks.workunit.client.0.smithi060.stdout:3/134: dread d0/d1/f12 [0,4194304] 0 2024-09-21T10:40:54.266 INFO:tasks.workunit.client.0.smithi060.stdout:8/181: unlink d2/d18/c27 0 2024-09-21T10:40:54.267 INFO:tasks.workunit.client.1.smithi112.stdout:4/886: mknod de/d33/d2f/d71/c12e 0 2024-09-21T10:40:54.271 INFO:tasks.workunit.client.0.smithi060.stdout:4/284: link d0/d5/d12/d16/f47 d0/d5/d12/f61 0 2024-09-21T10:40:54.271 INFO:tasks.workunit.client.0.smithi060.stdout:4/285: chown d0/d5/d12/d16/d28/f3b 336324 1 2024-09-21T10:40:54.271 INFO:tasks.workunit.client.0.smithi060.stdout:4/286: truncate d0/d5/d12/f61 1149849 0 2024-09-21T10:40:54.272 INFO:tasks.workunit.client.1.smithi112.stdout:3/823: truncate d2/d1f/f8c 5838926 0 2024-09-21T10:40:54.275 INFO:tasks.workunit.client.0.smithi060.stdout:3/135: dread d0/f1c [0,4194304] 0 2024-09-21T10:40:54.275 INFO:tasks.workunit.client.1.smithi112.stdout:5/883: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf/l11d 0 2024-09-21T10:40:54.277 INFO:tasks.workunit.client.1.smithi112.stdout:4/887: dread de/f117 [0,4194304] 0 2024-09-21T10:40:54.278 INFO:tasks.workunit.client.1.smithi112.stdout:1/983: dwrite d8/d20/f5b [0,4194304] 0 2024-09-21T10:40:54.278 INFO:tasks.workunit.client.1.smithi112.stdout:8/856: creat d8/d9/dd/d2b/d31/d46/d86/f102 x:0 0 0 2024-09-21T10:40:54.278 INFO:tasks.workunit.client.1.smithi112.stdout:8/857: chown d8/d9/dd/d1a/fe7 114013 1 2024-09-21T10:40:54.279 INFO:tasks.workunit.client.1.smithi112.stdout:8/858: chown d8/d9/dd/d2b/d31/d46/d86/cda 1362904 1 2024-09-21T10:40:54.279 INFO:tasks.workunit.client.1.smithi112.stdout:8/859: dread - d8/d18/fee zero size 2024-09-21T10:40:54.279 INFO:tasks.workunit.client.0.smithi060.stdout:9/197: mknod d3/c3f 0 2024-09-21T10:40:54.280 INFO:tasks.workunit.client.0.smithi060.stdout:0/169: truncate d5/d10/d11/f1f 3802227 0 2024-09-21T10:40:54.284 INFO:tasks.workunit.client.1.smithi112.stdout:9/868: unlink d1/d2/d42/f72 0 2024-09-21T10:40:54.284 INFO:tasks.workunit.client.1.smithi112.stdout:9/869: fsync d1/d2/d27/d3a/f71 0 2024-09-21T10:40:54.287 INFO:tasks.workunit.client.0.smithi060.stdout:8/182: link d2/l6 d2/l40 0 2024-09-21T10:40:54.287 INFO:tasks.workunit.client.0.smithi060.stdout:8/183: fdatasync d2/d18/f34 0 2024-09-21T10:40:54.287 INFO:tasks.workunit.client.0.smithi060.stdout:8/184: read - d2/d18/f2c zero size 2024-09-21T10:40:54.288 INFO:tasks.workunit.client.0.smithi060.stdout:8/185: stat d2/c16 0 2024-09-21T10:40:54.288 INFO:tasks.workunit.client.0.smithi060.stdout:8/186: readlink d2/l10 0 2024-09-21T10:40:54.288 INFO:tasks.workunit.client.0.smithi060.stdout:8/187: write d2/d18/f36 [83856,94181] 0 2024-09-21T10:40:54.288 INFO:tasks.workunit.client.1.smithi112.stdout:3/824: mknod d2/d2f/d3f/ddf/c10f 0 2024-09-21T10:40:54.289 INFO:tasks.workunit.client.0.smithi060.stdout:4/287: symlink d0/d5/d12/d3d/l62 0 2024-09-21T10:40:54.290 INFO:tasks.workunit.client.1.smithi112.stdout:5/884: symlink d9/d15/d18/d3a/d4b/d74/d8d/l11e 0 2024-09-21T10:40:54.291 INFO:tasks.workunit.client.0.smithi060.stdout:3/136: truncate d0/d1/f14 2985594 0 2024-09-21T10:40:54.292 INFO:tasks.workunit.client.1.smithi112.stdout:6/885: mknod d4/d6/da/d11/d1f/d22/d100/c134 0 2024-09-21T10:40:54.292 INFO:tasks.workunit.client.1.smithi112.stdout:9/870: dread d1/d2/d27/f2f [0,4194304] 0 2024-09-21T10:40:54.293 INFO:tasks.workunit.client.0.smithi060.stdout:9/198: truncate d3/d16/d1f/f2c 1571279 0 2024-09-21T10:40:54.295 INFO:tasks.workunit.client.1.smithi112.stdout:4/888: symlink de/d33/d2f/d35/df3/dc2/l12f 0 2024-09-21T10:40:54.295 INFO:tasks.workunit.client.1.smithi112.stdout:4/889: write de/d33/d2f/d71/fa1 [1136297,18528] 0 2024-09-21T10:40:54.296 INFO:tasks.workunit.client.0.smithi060.stdout:0/170: link d5/l1d d5/d10/da/d16/l2b 0 2024-09-21T10:40:54.297 INFO:tasks.workunit.client.0.smithi060.stdout:0/171: stat d5/d10/da/d16/l1c 0 2024-09-21T10:40:54.299 INFO:tasks.workunit.client.0.smithi060.stdout:6/294: rename d3/d12/d16/d25/c49 to d3/c56 0 2024-09-21T10:40:54.301 INFO:tasks.workunit.client.0.smithi060.stdout:8/188: symlink d2/d26/l41 0 2024-09-21T10:40:54.301 INFO:tasks.workunit.client.0.smithi060.stdout:8/189: chown d2/c16 144828696 1 2024-09-21T10:40:54.303 INFO:tasks.workunit.client.1.smithi112.stdout:1/984: mknod d8/d54/d6d/db5/dc2/de6/d106/c12d 0 2024-09-21T10:40:54.304 INFO:tasks.workunit.client.0.smithi060.stdout:4/288: symlink d0/d5/d12/l63 0 2024-09-21T10:40:54.305 INFO:tasks.workunit.client.1.smithi112.stdout:7/776: sync 2024-09-21T10:40:54.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/860: truncate d8/d9/d3c/d90/de1/fec 2057309 0 2024-09-21T10:40:54.306 INFO:tasks.workunit.client.1.smithi112.stdout:8/861: write d8/d9/dd/d2b/d31/d46/d86/f102 [742933,109] 0 2024-09-21T10:40:54.306 INFO:tasks.workunit.client.0.smithi060.stdout:6/295: dread d3/d12/d16/d1a/f3c [0,4194304] 0 2024-09-21T10:40:54.306 INFO:tasks.workunit.client.0.smithi060.stdout:6/296: chown d3/dd/c50 95147028 1 2024-09-21T10:40:54.306 INFO:tasks.workunit.client.0.smithi060.stdout:6/297: chown d3/d12/d16/d25 2516923 1 2024-09-21T10:40:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:3/137: symlink d0/l27 0 2024-09-21T10:40:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:3/138: creat d0/f28 x:0 0 0 2024-09-21T10:40:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:3/139: fsync d0/f21 0 2024-09-21T10:40:54.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/199: symlink d3/d15/l40 0 2024-09-21T10:40:54.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/200: readlink d3/l7 0 2024-09-21T10:40:54.317 INFO:tasks.workunit.client.1.smithi112.stdout:4/890: dwrite de/f10 [0,4194304] 0 2024-09-21T10:40:54.318 INFO:tasks.workunit.client.0.smithi060.stdout:4/289: unlink d0/d5/d12/d20/c23 0 2024-09-21T10:40:54.318 INFO:tasks.workunit.client.0.smithi060.stdout:4/290: stat d0/d5/d12/d16/f47 0 2024-09-21T10:40:54.318 INFO:tasks.workunit.client.1.smithi112.stdout:3/825: read - d2/d2f/d3f/fec zero size 2024-09-21T10:40:54.320 INFO:tasks.workunit.client.0.smithi060.stdout:6/298: creat d3/d12/d16/d25/f57 x:0 0 0 2024-09-21T10:40:54.321 INFO:tasks.workunit.client.1.smithi112.stdout:5/885: getdents d9/d15/d18/d3a/d61/d62 0 2024-09-21T10:40:54.322 INFO:tasks.workunit.client.0.smithi060.stdout:8/190: dwrite d2/d26/f35 [0,4194304] 0 2024-09-21T10:40:54.322 INFO:tasks.workunit.client.1.smithi112.stdout:1/985: dwrite d8/d1a/d31/d66/d87/fc0 [0,4194304] 0 2024-09-21T10:40:54.324 INFO:tasks.workunit.client.1.smithi112.stdout:9/871: symlink d1/d2/d27/d37/d3b/d69/d77/l135 0 2024-09-21T10:40:54.325 INFO:tasks.workunit.client.0.smithi060.stdout:3/140: mknod d0/c29 0 2024-09-21T10:40:54.326 INFO:tasks.workunit.client.1.smithi112.stdout:8/862: truncate d8/d9/dd/dab/d8e/dcb/f81 3777084 0 2024-09-21T10:40:54.328 INFO:tasks.workunit.client.0.smithi060.stdout:9/201: creat d3/d15/f41 x:0 0 0 2024-09-21T10:40:54.329 INFO:tasks.workunit.client.1.smithi112.stdout:2/740: rename d0/d12/d6c to d0/da4/dbe/df4 0 2024-09-21T10:40:54.331 INFO:tasks.workunit.client.0.smithi060.stdout:2/119: rename d3/d7/d13 to d3/d20 0 2024-09-21T10:40:54.331 INFO:tasks.workunit.client.0.smithi060.stdout:2/120: read d3/d7/fd [668690,110390] 0 2024-09-21T10:40:54.333 INFO:tasks.workunit.client.1.smithi112.stdout:4/891: creat de/d2e/f130 x:0 0 0 2024-09-21T10:40:54.334 INFO:tasks.workunit.client.0.smithi060.stdout:3/141: dread d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:40:54.334 INFO:tasks.workunit.client.0.smithi060.stdout:4/291: creat d0/d5/d12/d3d/f64 x:0 0 0 2024-09-21T10:40:54.334 INFO:tasks.workunit.client.0.smithi060.stdout:4/292: chown d0/d5/d12/d15/l49 18151407 1 2024-09-21T10:40:54.336 INFO:tasks.workunit.client.1.smithi112.stdout:3/826: symlink d2/d2f/dc5/l110 0 2024-09-21T10:40:54.336 INFO:tasks.workunit.client.0.smithi060.stdout:6/299: dwrite d3/d12/f51 [0,4194304] 0 2024-09-21T10:40:54.337 INFO:tasks.workunit.client.0.smithi060.stdout:0/172: unlink d5/d10/d11/f1f 0 2024-09-21T10:40:54.346 INFO:tasks.workunit.client.1.smithi112.stdout:2/741: dwrite d0/f2f [0,4194304] 0 2024-09-21T10:40:54.347 INFO:tasks.workunit.client.1.smithi112.stdout:9/872: mknod d1/d2/d27/d37/d3b/d69/d77/da0/de4/d12c/c136 0 2024-09-21T10:40:54.348 INFO:tasks.workunit.client.0.smithi060.stdout:8/191: mknod d2/c42 0 2024-09-21T10:40:54.350 INFO:tasks.workunit.client.0.smithi060.stdout:9/202: mkdir d3/d16/d42 0 2024-09-21T10:40:54.351 INFO:tasks.workunit.client.1.smithi112.stdout:8/863: getdents d8/d9/ded 0 2024-09-21T10:40:54.351 INFO:tasks.workunit.client.1.smithi112.stdout:8/864: creat d8/d9/f103 x:0 0 0 2024-09-21T10:40:54.354 INFO:tasks.workunit.client.0.smithi060.stdout:3/142: mkdir d0/d1/d11/d2a 0 2024-09-21T10:40:54.356 INFO:tasks.workunit.client.0.smithi060.stdout:4/293: unlink d0/d5/d12/d15/d4d/l53 0 2024-09-21T10:40:54.356 INFO:tasks.workunit.client.0.smithi060.stdout:4/294: fsync d0/d5/f4b 0 2024-09-21T10:40:54.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/827: dwrite d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:54.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/828: fdatasync d2/d2f/d3f/ddf/d31/d2a/d39/d60/f6f 0 2024-09-21T10:40:54.357 INFO:tasks.workunit.client.1.smithi112.stdout:3/829: dread - d2/d2f/fd4 zero size 2024-09-21T10:40:54.359 INFO:tasks.workunit.client.1.smithi112.stdout:4/892: dwrite de/d33/d2f/ffc [0,4194304] 0 2024-09-21T10:40:54.364 INFO:tasks.workunit.client.0.smithi060.stdout:9/203: dread d3/f10 [0,4194304] 0 2024-09-21T10:40:54.364 INFO:tasks.workunit.client.1.smithi112.stdout:8/865: write d8/d9/dd/d2a/d43/f66 [1453539,69536] 0 2024-09-21T10:40:54.364 INFO:tasks.workunit.client.1.smithi112.stdout:8/866: dread - d8/fe3 zero size 2024-09-21T10:40:54.364 INFO:tasks.workunit.client.1.smithi112.stdout:8/867: stat d8/d9/dd/dab/d8e/dcb/d82/dcc/de8/lf5 0 2024-09-21T10:40:54.365 INFO:tasks.workunit.client.1.smithi112.stdout:2/742: creat d0/da4/dbe/df4/d7e/d8f/ff5 x:0 0 0 2024-09-21T10:40:54.367 INFO:tasks.workunit.client.0.smithi060.stdout:6/300: mkdir d3/d12/d16/d22/d58 0 2024-09-21T10:40:54.367 INFO:tasks.workunit.client.0.smithi060.stdout:6/301: write d3/d12/d38/d41/f46 [4809536,113815] 0 2024-09-21T10:40:54.368 INFO:tasks.workunit.client.1.smithi112.stdout:9/873: creat d1/d2/d27/d3a/d6b/d30/f137 x:0 0 0 2024-09-21T10:40:54.369 INFO:tasks.workunit.client.0.smithi060.stdout:4/295: dwrite d0/d5/d12/d20/d32/f5e [0,4194304] 0 2024-09-21T10:40:54.369 INFO:tasks.workunit.client.0.smithi060.stdout:4/296: readlink d0/d5/l21 0 2024-09-21T10:40:54.369 INFO:tasks.workunit.client.0.smithi060.stdout:0/173: symlink d5/d10/da/d20/l2c 0 2024-09-21T10:40:54.371 INFO:tasks.workunit.client.0.smithi060.stdout:3/143: dread d0/d1/f12 [0,4194304] 0 2024-09-21T10:40:54.371 INFO:tasks.workunit.client.1.smithi112.stdout:0/848: sync 2024-09-21T10:40:54.374 INFO:tasks.workunit.client.0.smithi060.stdout:2/121: mknod d3/c21 0 2024-09-21T10:40:54.379 INFO:tasks.workunit.client.0.smithi060.stdout:3/144: dread d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:40:54.379 INFO:tasks.workunit.client.0.smithi060.stdout:3/145: dread - d0/f28 zero size 2024-09-21T10:40:54.383 INFO:tasks.workunit.client.1.smithi112.stdout:8/868: symlink d8/d9/d3c/d90/de1/l104 0 2024-09-21T10:40:54.385 INFO:tasks.workunit.client.0.smithi060.stdout:9/204: mknod d3/d16/d1a/c43 0 2024-09-21T10:40:54.387 INFO:tasks.workunit.client.1.smithi112.stdout:2/743: unlink d0/dd/f2e 0 2024-09-21T10:40:54.388 INFO:tasks.workunit.client.1.smithi112.stdout:9/874: getdents d1/d7f/df0 0 2024-09-21T10:40:54.389 INFO:tasks.workunit.client.1.smithi112.stdout:0/849: mknod d3/d18/c11b 0 2024-09-21T10:40:54.391 INFO:tasks.workunit.client.1.smithi112.stdout:6/886: rename d4/d6/da/d14/d49/d73/d74 to d4/dc/d135 0 2024-09-21T10:40:54.393 INFO:tasks.workunit.client.0.smithi060.stdout:4/297: rename d0/d44 to d0/d5/d12/d20/d65 0 2024-09-21T10:40:54.393 INFO:tasks.workunit.client.0.smithi060.stdout:4/298: dread - d0/d59/f5c zero size 2024-09-21T10:40:54.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/146: mkdir d0/d2b 0 2024-09-21T10:40:54.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/147: fdatasync d0/d1/f26 0 2024-09-21T10:40:54.395 INFO:tasks.workunit.client.1.smithi112.stdout:2/744: getdents d0/d12/d46/da0/db9 0 2024-09-21T10:40:54.395 INFO:tasks.workunit.client.1.smithi112.stdout:2/745: write d0/da4/dbe/fdb [557612,56187] 0 2024-09-21T10:40:54.396 INFO:tasks.workunit.client.1.smithi112.stdout:2/746: creat d0/d12/d46/da0/db9/dbd/d62/d63/ff6 x:0 0 0 2024-09-21T10:40:54.397 INFO:tasks.workunit.client.0.smithi060.stdout:9/205: creat d3/d16/f44 x:0 0 0 2024-09-21T10:40:54.398 INFO:tasks.workunit.client.1.smithi112.stdout:9/875: symlink d1/d2/d27/d3a/de3/db5/l138 0 2024-09-21T10:40:54.400 INFO:tasks.workunit.client.1.smithi112.stdout:0/850: mkdir d3/d18/d11c 0 2024-09-21T10:40:54.401 INFO:tasks.workunit.client.1.smithi112.stdout:0/851: read - d3/d4a/d4e/dc2/d1a/d21/d4f/d83/fb0 zero size 2024-09-21T10:40:54.401 INFO:tasks.workunit.client.0.smithi060.stdout:6/302: rmdir d3/dd 39 2024-09-21T10:40:54.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/174: dwrite d5/d10/da/fc [0,4194304] 0 2024-09-21T10:40:54.403 INFO:tasks.workunit.client.0.smithi060.stdout:2/122: dwrite f2 [0,4194304] 0 2024-09-21T10:40:54.403 INFO:tasks.workunit.client.0.smithi060.stdout:2/123: write d3/d7/fd [1703747,91961] 0 2024-09-21T10:40:54.405 INFO:tasks.workunit.client.1.smithi112.stdout:7/777: rename d7/d22/d41/d56/d72/f8b to d7/d22/d73/ffe 0 2024-09-21T10:40:54.405 INFO:tasks.workunit.client.1.smithi112.stdout:7/778: creat d7/d22/d86/dac/fff x:0 0 0 2024-09-21T10:40:54.405 INFO:tasks.workunit.client.1.smithi112.stdout:7/779: creat d7/d22/d78/f100 x:0 0 0 2024-09-21T10:40:54.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/148: dread d0/f21 [0,4194304] 0 2024-09-21T10:40:54.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/149: write d0/d1/d24/f25 [34371,84892] 0 2024-09-21T10:40:54.409 INFO:tasks.workunit.client.0.smithi060.stdout:9/206: rename d3/d16/c18 to d3/d16/c45 0 2024-09-21T10:40:54.411 INFO:tasks.workunit.client.1.smithi112.stdout:6/887: mkdir d4/d6/da/d14/d49/d62/d96/d136 0 2024-09-21T10:40:54.414 INFO:tasks.workunit.client.1.smithi112.stdout:9/876: creat d1/d2/d27/d37/d68/f139 x:0 0 0 2024-09-21T10:40:54.414 INFO:tasks.workunit.client.1.smithi112.stdout:9/877: readlink d1/d2/d27/d62/l86 0 2024-09-21T10:40:54.416 INFO:tasks.workunit.client.1.smithi112.stdout:0/852: symlink d3/d18/l11d 0 2024-09-21T10:40:54.420 INFO:tasks.workunit.client.0.smithi060.stdout:3/150: rename d0/lf to d0/d1/l2c 0 2024-09-21T10:40:54.421 INFO:tasks.workunit.client.1.smithi112.stdout:5/886: rename d9/d15/ff2 to d9/d15/d18/d3a/f11f 0 2024-09-21T10:40:54.424 INFO:tasks.workunit.client.0.smithi060.stdout:9/207: rename d3/d15/f41 to d3/d16/d1a/d3b/d2f/f46 0 2024-09-21T10:40:54.426 INFO:tasks.workunit.client.0.smithi060.stdout:3/151: creat d0/d1/d11/d2a/f2d x:0 0 0 2024-09-21T10:40:54.426 INFO:tasks.workunit.client.0.smithi060.stdout:3/152: write d0/f16 [689521,67875] 0 2024-09-21T10:40:54.426 INFO:tasks.workunit.client.0.smithi060.stdout:3/153: truncate d0/f23 710430 0 2024-09-21T10:40:54.427 INFO:tasks.workunit.client.1.smithi112.stdout:7/780: mkdir d7/d22/d41/d4b/d52/d77/dbd/de4/d101 0 2024-09-21T10:40:54.428 INFO:tasks.workunit.client.0.smithi060.stdout:9/208: creat d3/f47 x:0 0 0 2024-09-21T10:40:54.428 INFO:tasks.workunit.client.1.smithi112.stdout:6/888: rmdir d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/d84 39 2024-09-21T10:40:54.428 INFO:tasks.workunit.client.1.smithi112.stdout:6/889: fsync d4/d6/da/d11/d37/d8b/fbf 0 2024-09-21T10:40:54.429 INFO:tasks.workunit.client.0.smithi060.stdout:9/209: symlink d3/d16/d1a/l48 0 2024-09-21T10:40:54.431 INFO:tasks.workunit.client.0.smithi060.stdout:9/210: read d3/d15/f2b [519619,121891] 0 2024-09-21T10:40:54.432 INFO:tasks.workunit.client.1.smithi112.stdout:0/853: creat d3/d18/d52/d55/dcc/d10b/ddf/de5/f11e x:0 0 0 2024-09-21T10:40:54.433 INFO:tasks.workunit.client.1.smithi112.stdout:5/887: dread d9/fe1 [0,4194304] 0 2024-09-21T10:40:54.433 INFO:tasks.workunit.client.1.smithi112.stdout:5/888: write d9/d15/d18/d3a/fe7 [687738,33775] 0 2024-09-21T10:40:54.433 INFO:tasks.workunit.client.1.smithi112.stdout:5/889: truncate d9/d15/d18/d3a/d4b/d74/d8d/fd5 1014235 0 2024-09-21T10:40:54.433 INFO:tasks.workunit.client.1.smithi112.stdout:3/830: rename d2/d2f/d3f/ddf/d31/d2a/d39/f7a to d2/d2f/f111 0 2024-09-21T10:40:54.433 INFO:tasks.workunit.client.1.smithi112.stdout:7/781: truncate d7/d22/f28 419400 0 2024-09-21T10:40:54.434 INFO:tasks.workunit.client.0.smithi060.stdout:6/303: dwrite d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:40:54.435 INFO:tasks.workunit.client.1.smithi112.stdout:9/878: getdents d1/d2/d27/d3a/d6b/d30/d5c 0 2024-09-21T10:40:54.436 INFO:tasks.workunit.client.0.smithi060.stdout:0/175: dwrite d5/d10/da/d16/f27 [0,4194304] 0 2024-09-21T10:40:54.437 INFO:tasks.workunit.client.0.smithi060.stdout:0/176: chown d5/f21 243 1 2024-09-21T10:40:54.437 INFO:tasks.workunit.client.0.smithi060.stdout:2/124: dwrite d3/f12 [4194304,4194304] 0 2024-09-21T10:40:54.437 INFO:tasks.workunit.client.0.smithi060.stdout:2/125: chown d3/d20 5 1 2024-09-21T10:40:54.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/890: symlink d9/d15/d18/d3a/d4b/d74/l120 0 2024-09-21T10:40:54.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/891: stat d9/d15/d1d/le3 0 2024-09-21T10:40:54.438 INFO:tasks.workunit.client.1.smithi112.stdout:3/831: dread d2/d2f/d3f/ddf/d31/d37/f83 [0,4194304] 0 2024-09-21T10:40:54.438 INFO:tasks.workunit.client.1.smithi112.stdout:3/832: fsync d2/d8d/f101 0 2024-09-21T10:40:54.438 INFO:tasks.workunit.client.1.smithi112.stdout:5/892: creat d9/d15/d18/d20/f121 x:0 0 0 2024-09-21T10:40:54.439 INFO:tasks.workunit.client.1.smithi112.stdout:3/833: getdents d2/d2f/d3f/ddf/d31/d2a/d39/d60/df9 0 2024-09-21T10:40:54.439 INFO:tasks.workunit.client.1.smithi112.stdout:8/869: rename d8/d18/fef to d8/d9/dd/d2a/db6/df0/f105 0 2024-09-21T10:40:54.439 INFO:tasks.workunit.client.1.smithi112.stdout:8/870: fdatasync d8/d9/dd/f2c 0 2024-09-21T10:40:54.439 INFO:tasks.workunit.client.1.smithi112.stdout:8/871: chown d8/d9/dd/dab/d8e/dcb/d82/dcc/de8/lf5 717 1 2024-09-21T10:40:54.441 INFO:tasks.workunit.client.1.smithi112.stdout:3/834: dread d2/d8d/f8f [0,4194304] 0 2024-09-21T10:40:54.444 INFO:tasks.workunit.client.1.smithi112.stdout:7/782: link d7/d22/d41/d56/ffb d7/d22/d41/d4b/d52/d77/dbd/f102 0 2024-09-21T10:40:54.445 INFO:tasks.workunit.client.1.smithi112.stdout:9/879: dread d1/d2/d27/f7d [4194304,4194304] 0 2024-09-21T10:40:54.445 INFO:tasks.workunit.client.1.smithi112.stdout:9/880: dread - d1/f128 zero size 2024-09-21T10:40:54.446 INFO:tasks.workunit.client.0.smithi060.stdout:6/304: dread d3/fb [0,4194304] 0 2024-09-21T10:40:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:5/165: sync 2024-09-21T10:40:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:7/219: sync 2024-09-21T10:40:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:7/220: chown da/d14/d15/c41 7 1 2024-09-21T10:40:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:7/221: dread - da/d14/d2a/d49/d27/f44 zero size 2024-09-21T10:40:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:5/166: creat d5/d9/d10/d19/f37 x:0 0 0 2024-09-21T10:40:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:0/177: mkdir d5/d10/da/d2d 0 2024-09-21T10:40:54.458 INFO:tasks.workunit.client.0.smithi060.stdout:2/126: symlink d3/d20/d15/l22 0 2024-09-21T10:40:54.460 INFO:tasks.workunit.client.1.smithi112.stdout:5/893: unlink d9/d6e/f91 0 2024-09-21T10:40:54.464 INFO:tasks.workunit.client.1.smithi112.stdout:2/747: rename d0/d12/d97/fb6 to d0/dd/da5/df0/ff7 0 2024-09-21T10:40:54.464 INFO:tasks.workunit.client.1.smithi112.stdout:2/748: dread - d0/da4/dc5/fd7 zero size 2024-09-21T10:40:54.466 INFO:tasks.workunit.client.1.smithi112.stdout:8/872: truncate d8/d9/dd/f2c 3168057 0 2024-09-21T10:40:54.466 INFO:tasks.workunit.client.1.smithi112.stdout:8/873: chown d8/fc 64923245 1 2024-09-21T10:40:54.466 INFO:tasks.workunit.client.1.smithi112.stdout:8/874: chown d8/d9/dd/d2b 709 1 2024-09-21T10:40:54.467 INFO:tasks.workunit.client.0.smithi060.stdout:7/222: getdents da/d14/d2a 0 2024-09-21T10:40:54.470 INFO:tasks.workunit.client.0.smithi060.stdout:2/127: unlink d3/c6 0 2024-09-21T10:40:54.471 INFO:tasks.workunit.client.1.smithi112.stdout:2/749: symlink d0/da4/dbe/df4/d7e/d8f/lf8 0 2024-09-21T10:40:54.475 INFO:tasks.workunit.client.1.smithi112.stdout:0/854: rename d3/d18/d45/cb3 to d3/d4a/d4e/dc2/d1a/dba/d10a/c11f 0 2024-09-21T10:40:54.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/855: creat d3/f120 x:0 0 0 2024-09-21T10:40:54.476 INFO:tasks.workunit.client.1.smithi112.stdout:0/856: chown d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/dde/c109 275169 1 2024-09-21T10:40:54.476 INFO:tasks.workunit.client.1.smithi112.stdout:5/894: dread d9/d15/d18/d20/d47/fa8 [4194304,4194304] 0 2024-09-21T10:40:54.476 INFO:tasks.workunit.client.0.smithi060.stdout:6/305: rmdir d3/d12/d38 39 2024-09-21T10:40:54.478 INFO:tasks.workunit.client.1.smithi112.stdout:8/875: getdents d8/d9/dd/dab 0 2024-09-21T10:40:54.479 INFO:tasks.workunit.client.0.smithi060.stdout:9/211: dwrite d3/d16/d1a/d3b/d2f/f31 [0,4194304] 0 2024-09-21T10:40:54.480 INFO:tasks.workunit.client.0.smithi060.stdout:7/223: link da/d14/d2a/c4b da/d14/d35/c4d 0 2024-09-21T10:40:54.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/212: write d3/fc [1490998,91903] 0 2024-09-21T10:40:54.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/213: write d3/d15/f22 [2648837,53496] 0 2024-09-21T10:40:54.488 INFO:tasks.workunit.client.1.smithi112.stdout:8/876: mkdir d8/d9/ded/d106 0 2024-09-21T10:40:54.489 INFO:tasks.workunit.client.0.smithi060.stdout:6/306: write d3/d12/d16/f40 [5871668,86884] 0 2024-09-21T10:40:54.490 INFO:tasks.workunit.client.1.smithi112.stdout:5/895: symlink d9/d15/l122 0 2024-09-21T10:40:54.490 INFO:tasks.workunit.client.1.smithi112.stdout:5/896: write d9/fb3 [1968246,37110] 0 2024-09-21T10:40:54.490 INFO:tasks.workunit.client.1.smithi112.stdout:5/897: write d9/d15/d18/d3a/d61/d62/d6b/faa [2455622,116940] 0 2024-09-21T10:40:54.490 INFO:tasks.workunit.client.1.smithi112.stdout:5/898: write d9/d15/d18/d20/d55/dbb/fbe [4814666,95775] 0 2024-09-21T10:40:54.491 INFO:tasks.workunit.client.0.smithi060.stdout:7/224: mknod da/d14/d2a/d49/d2e/c4e 0 2024-09-21T10:40:54.492 INFO:tasks.workunit.client.1.smithi112.stdout:8/877: mkdir d8/d9/dd/d2b/d107 0 2024-09-21T10:40:54.492 INFO:tasks.workunit.client.1.smithi112.stdout:8/878: stat d8/d9/d3c/d90/de1 0 2024-09-21T10:40:54.493 INFO:tasks.workunit.client.0.smithi060.stdout:2/128: dread f2 [4194304,4194304] 0 2024-09-21T10:40:54.495 INFO:tasks.workunit.client.1.smithi112.stdout:1/986: sync 2024-09-21T10:40:54.495 INFO:tasks.workunit.client.1.smithi112.stdout:4/893: sync 2024-09-21T10:40:54.495 INFO:tasks.workunit.client.1.smithi112.stdout:4/894: fdatasync de/d2a/fa6 0 2024-09-21T10:40:54.495 INFO:tasks.workunit.client.0.smithi060.stdout:9/214: creat d3/d16/d1f/f49 x:0 0 0 2024-09-21T10:40:54.495 INFO:tasks.workunit.client.0.smithi060.stdout:9/215: chown d3/fc 1956114 1 2024-09-21T10:40:54.496 INFO:tasks.workunit.client.0.smithi060.stdout:9/216: truncate d3/d16/d1a/d3b/d2f/f46 795135 0 2024-09-21T10:40:54.496 INFO:tasks.workunit.client.0.smithi060.stdout:7/225: symlink da/d14/d35/l4f 0 2024-09-21T10:40:54.496 INFO:tasks.workunit.client.0.smithi060.stdout:7/226: stat da/d14/d33/f38 0 2024-09-21T10:40:54.496 INFO:tasks.workunit.client.0.smithi060.stdout:3/154: dwrite d0/f16 [0,4194304] 0 2024-09-21T10:40:54.497 INFO:tasks.workunit.client.1.smithi112.stdout:5/899: mknod d9/d15/d18/d3a/d4b/d74/c123 0 2024-09-21T10:40:54.498 INFO:tasks.workunit.client.1.smithi112.stdout:5/900: chown d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/ffc 23 1 2024-09-21T10:40:54.498 INFO:tasks.workunit.client.1.smithi112.stdout:5/901: chown d9/d8a/cf1 5609 1 2024-09-21T10:40:54.499 INFO:tasks.workunit.client.1.smithi112.stdout:3/835: dwrite d2/d8d/ffd [4194304,4194304] 0 2024-09-21T10:40:54.500 INFO:tasks.workunit.client.1.smithi112.stdout:1/987: rename d8/d1a/db8 to d8/d1a/d53/d57/d83/d109/d12e 0 2024-09-21T10:40:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/217: link d3/d15/f3a d3/d15/f4a 0 2024-09-21T10:40:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/218: fsync d3/f9 0 2024-09-21T10:40:54.503 INFO:tasks.workunit.client.1.smithi112.stdout:5/902: creat d9/d6e/dfb/d100/f124 x:0 0 0 2024-09-21T10:40:54.503 INFO:tasks.workunit.client.1.smithi112.stdout:8/879: dread d8/d9/f25 [0,4194304] 0 2024-09-21T10:40:54.504 INFO:tasks.workunit.client.1.smithi112.stdout:1/988: dread d8/d54/f5d [0,4194304] 0 2024-09-21T10:40:54.504 INFO:tasks.workunit.client.1.smithi112.stdout:7/783: dwrite d7/d22/f35 [0,4194304] 0 2024-09-21T10:40:54.504 INFO:tasks.workunit.client.1.smithi112.stdout:7/784: dread - d7/dbc/fd2 zero size 2024-09-21T10:40:54.504 INFO:tasks.workunit.client.1.smithi112.stdout:7/785: chown d7/d22/d41/d56/d72/df0 3261 1 2024-09-21T10:40:54.504 INFO:tasks.workunit.client.0.smithi060.stdout:0/178: dwrite d5/d10/f8 [0,4194304] 0 2024-09-21T10:40:54.504 INFO:tasks.workunit.client.1.smithi112.stdout:9/881: dwrite d1/d2/d27/d3a/de3/ffe [0,4194304] 0 2024-09-21T10:40:54.506 INFO:tasks.workunit.client.1.smithi112.stdout:2/750: dwrite d0/da4/dbe/df4/d7e/d8f/d51/f70 [0,4194304] 0 2024-09-21T10:40:54.506 INFO:tasks.workunit.client.1.smithi112.stdout:0/857: dwrite d3/d4a/d4e/f63 [0,4194304] 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/227: symlink da/d14/d33/l50 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/228: fdatasync da/f24 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/229: write da/d14/d2a/d49/d27/f4c [569781,64829] 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/230: write da/d14/d35/f30 [1019543,91251] 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/231: readlink da/d14/d15/l31 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:5/167: dwrite d5/d9/d10/d19/d21/d30/f35 [0,4194304] 0 2024-09-21T10:40:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:5/168: write d5/d9/d10/d19/f31 [134781,37164] 0 2024-09-21T10:40:54.508 INFO:tasks.workunit.client.1.smithi112.stdout:3/836: creat d2/d2f/d3f/ddf/d31/d2a/d39/d3a/f112 x:0 0 0 2024-09-21T10:40:54.510 INFO:tasks.workunit.client.0.smithi060.stdout:3/155: rename d0/d1/f12 to d0/d1/d11/d2a/f2e 0 2024-09-21T10:40:54.512 INFO:tasks.workunit.client.1.smithi112.stdout:5/903: creat d9/d15/d18/d20/d47/dc6/f125 x:0 0 0 2024-09-21T10:40:54.513 INFO:tasks.workunit.client.1.smithi112.stdout:1/989: symlink d8/d1a/d31/da1/l12f 0 2024-09-21T10:40:54.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/786: mkdir d7/d22/d103 0 2024-09-21T10:40:54.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/787: chown d7/d22/d41/c88 132911818 1 2024-09-21T10:40:54.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/788: dread - d7/d22/d78/f100 zero size 2024-09-21T10:40:54.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/789: read - d7/d22/d41/d4b/d52/d77/dbd/fc0 zero size 2024-09-21T10:40:54.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/790: fsync d7/dbc/fd2 0 2024-09-21T10:40:54.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/791: stat d7/d22/d86/dac/d8a/ffc 0 2024-09-21T10:40:54.526 INFO:tasks.workunit.client.0.smithi060.stdout:2/129: rmdir d3 39 2024-09-21T10:40:54.527 INFO:tasks.workunit.client.0.smithi060.stdout:0/179: symlink d5/d10/da/l2e 0 2024-09-21T10:40:54.529 INFO:tasks.workunit.client.1.smithi112.stdout:9/882: mknod d1/d2/d27/d3a/de3/db5/c13a 0 2024-09-21T10:40:54.531 INFO:tasks.workunit.client.1.smithi112.stdout:9/883: dread d1/d2/d27/f2f [4194304,4194304] 0 2024-09-21T10:40:54.532 INFO:tasks.workunit.client.1.smithi112.stdout:2/751: mknod d0/da4/dbe/df4/d7e/d8f/d51/cf9 0 2024-09-21T10:40:54.532 INFO:tasks.workunit.client.1.smithi112.stdout:2/752: chown d0/da4/dbe/c8c 9327 1 2024-09-21T10:40:54.535 INFO:tasks.workunit.client.0.smithi060.stdout:7/232: symlink da/d14/d33/l51 0 2024-09-21T10:40:54.535 INFO:tasks.workunit.client.1.smithi112.stdout:8/880: dwrite d8/d9/dd/d2a/d43/f9e [0,4194304] 0 2024-09-21T10:40:54.536 INFO:tasks.workunit.client.1.smithi112.stdout:8/881: readlink d8/d9/dd/d2b/l6a 0 2024-09-21T10:40:54.536 INFO:tasks.workunit.client.1.smithi112.stdout:0/858: dwrite d3/d18/d52/d55/f101 [0,4194304] 0 2024-09-21T10:40:54.537 INFO:tasks.workunit.client.0.smithi060.stdout:9/219: dwrite d3/d15/f4a [0,4194304] 0 2024-09-21T10:40:54.538 INFO:tasks.workunit.client.1.smithi112.stdout:3/837: dwrite d2/d2f/d3f/ddf/d31/d37/f52 [0,4194304] 0 2024-09-21T10:40:54.540 INFO:tasks.workunit.client.1.smithi112.stdout:5/904: creat d9/d15/d18/d3a/d4b/d74/d8d/f126 x:0 0 0 2024-09-21T10:40:54.543 INFO:tasks.workunit.client.0.smithi060.stdout:5/169: mknod d5/d9/d10/d19/d21/d30/c38 0 2024-09-21T10:40:54.543 INFO:tasks.workunit.client.0.smithi060.stdout:5/170: truncate d5/ff 4012519 0 2024-09-21T10:40:54.544 INFO:tasks.workunit.client.1.smithi112.stdout:1/990: creat d8/d1a/d53/d76/f130 x:0 0 0 2024-09-21T10:40:54.546 INFO:tasks.workunit.client.0.smithi060.stdout:9/220: write d3/fa [1659832,98813] 0 2024-09-21T10:40:54.546 INFO:tasks.workunit.client.0.smithi060.stdout:9/221: creat d3/d16/f4b x:0 0 0 2024-09-21T10:40:54.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/156: mknod d0/c2f 0 2024-09-21T10:40:54.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/157: read d0/d1/d11/f15 [372329,34949] 0 2024-09-21T10:40:54.547 INFO:tasks.workunit.client.0.smithi060.stdout:3/158: chown d0/d1/d24 3639731 1 2024-09-21T10:40:54.547 INFO:tasks.workunit.client.0.smithi060.stdout:3/159: read - d0/d1/f26 zero size 2024-09-21T10:40:54.547 INFO:tasks.workunit.client.0.smithi060.stdout:3/160: read d0/d1/d24/f25 [64930,129364] 0 2024-09-21T10:40:54.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/792: symlink d7/d22/d41/d56/l104 0 2024-09-21T10:40:54.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/130: truncate f2 6884428 0 2024-09-21T10:40:54.549 INFO:tasks.workunit.client.1.smithi112.stdout:2/753: rmdir d0/d12/d46/da0 39 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/180: mkdir d5/d10/da/d2f 0 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/181: chown d5/d10/da/d20 365656 1 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/182: stat d5/d10/d11/c14 0 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/183: chown l3 206564305 1 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/184: creat d5/d10/da/d16/f30 x:0 0 0 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/185: fdatasync d5/d10/da/d16/f30 0 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/186: write d5/d10/da/d16/f27 [4836047,86039] 0 2024-09-21T10:40:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/187: readlink d5/d10/da/l2e 0 2024-09-21T10:40:54.552 INFO:tasks.workunit.client.0.smithi060.stdout:7/233: creat da/d14/d35/d32/f52 x:0 0 0 2024-09-21T10:40:54.556 INFO:tasks.workunit.client.0.smithi060.stdout:2/131: dread d3/d20/f11 [0,4194304] 0 2024-09-21T10:40:54.556 INFO:tasks.workunit.client.0.smithi060.stdout:2/132: chown d3/d20/ce 132 1 2024-09-21T10:40:54.557 INFO:tasks.workunit.client.1.smithi112.stdout:7/793: dread d7/d22/d41/d56/d72/dc4/f7e [0,4194304] 0 2024-09-21T10:40:54.557 INFO:tasks.workunit.client.1.smithi112.stdout:7/794: read - d7/d22/d41/d4b/d52/d77/dbd/f102 zero size 2024-09-21T10:40:54.557 INFO:tasks.workunit.client.1.smithi112.stdout:7/795: chown d7/d22/c5f 21346 1 2024-09-21T10:40:54.557 INFO:tasks.workunit.client.1.smithi112.stdout:7/796: write d7/d22/d86/dac/fcf [1849797,48177] 0 2024-09-21T10:40:54.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/859: mknod d3/d4a/d4e/dc2/d1a/c121 0 2024-09-21T10:40:54.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/860: write d3/d4a/d4e/dc2/d10/d8b/ff4 [893633,11278] 0 2024-09-21T10:40:54.559 INFO:tasks.workunit.client.1.smithi112.stdout:0/861: write d3/d4a/d4e/dc2/d10/dc6/fff [1087194,131034] 0 2024-09-21T10:40:54.563 INFO:tasks.workunit.client.1.smithi112.stdout:1/991: mknod d8/d45/c131 0 2024-09-21T10:40:54.563 INFO:tasks.workunit.client.1.smithi112.stdout:8/882: dwrite d8/d9/dd/d2b/fcd [0,4194304] 0 2024-09-21T10:40:54.564 INFO:tasks.workunit.client.1.smithi112.stdout:5/905: dwrite d9/d15/d18/d3a/f11f [0,4194304] 0 2024-09-21T10:40:54.564 INFO:tasks.workunit.client.1.smithi112.stdout:5/906: truncate d9/fa5 4886344 0 2024-09-21T10:40:54.565 INFO:tasks.workunit.client.1.smithi112.stdout:2/754: mkdir d0/d12/d46/d86/dc0/dc8/dfa 0 2024-09-21T10:40:54.570 INFO:tasks.workunit.client.1.smithi112.stdout:0/862: mkdir d3/d4a/d4e/dc2/d1a/d21/d46/d122 0 2024-09-21T10:40:54.574 INFO:tasks.workunit.client.1.smithi112.stdout:3/838: rename d2/d2f/d3f/l109 to d2/dd5/l113 0 2024-09-21T10:40:54.574 INFO:tasks.workunit.client.1.smithi112.stdout:3/839: write d2/d2f/d3f/ddf/d31/d2a/d39/d60/f6f [1060695,97123] 0 2024-09-21T10:40:54.575 INFO:tasks.workunit.client.0.smithi060.stdout:5/171: creat d5/f39 x:0 0 0 2024-09-21T10:40:54.577 INFO:tasks.workunit.client.1.smithi112.stdout:1/992: mkdir d8/d45/dae/d114/d132 0 2024-09-21T10:40:54.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/797: dwrite d7/d22/f46 [0,4194304] 0 2024-09-21T10:40:54.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/798: write d7/f49 [1449123,95297] 0 2024-09-21T10:40:54.579 INFO:tasks.workunit.client.1.smithi112.stdout:7/799: chown d7/d22/f38 0 1 2024-09-21T10:40:54.582 INFO:tasks.workunit.client.1.smithi112.stdout:5/907: write d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd0 [772555,129224] 0 2024-09-21T10:40:54.582 INFO:tasks.workunit.client.1.smithi112.stdout:5/908: fdatasync d9/f11 0 2024-09-21T10:40:54.583 INFO:tasks.workunit.client.0.smithi060.stdout:9/222: creat d3/d16/d1a/f4c x:0 0 0 2024-09-21T10:40:54.584 INFO:tasks.workunit.client.0.smithi060.stdout:3/161: symlink d0/d1/d1e/l30 0 2024-09-21T10:40:54.585 INFO:tasks.workunit.client.1.smithi112.stdout:5/909: dread d9/d15/d18/f39 [0,4194304] 0 2024-09-21T10:40:54.585 INFO:tasks.workunit.client.1.smithi112.stdout:8/883: symlink d8/d9/dd/d2b/d31/d46/l108 0 2024-09-21T10:40:54.590 INFO:tasks.workunit.client.0.smithi060.stdout:0/188: mkdir d5/d10/da/d15/d31 0 2024-09-21T10:40:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:7/234: mknod da/d14/d15/c53 0 2024-09-21T10:40:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:7/235: chown f8 25886 1 2024-09-21T10:40:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:7/236: stat da 0 2024-09-21T10:40:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:7/237: dread - da/d14/d2a/f2b zero size 2024-09-21T10:40:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:7/238: dread - da/d14/d25/f4a zero size 2024-09-21T10:40:54.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/239: truncate da/d14/d2a/d49/d27/f4c 1198774 0 2024-09-21T10:40:54.592 INFO:tasks.workunit.client.1.smithi112.stdout:0/863: chown d3/d4a/d4e/dc2/d1a/dba/fdb 238305 1 2024-09-21T10:40:54.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/840: mknod d2/d2f/d3f/ddf/d31/d37/c114 0 2024-09-21T10:40:54.597 INFO:tasks.workunit.client.1.smithi112.stdout:6/890: sync 2024-09-21T10:40:54.598 INFO:tasks.workunit.client.1.smithi112.stdout:2/755: dwrite d0/fef [0,4194304] 0 2024-09-21T10:40:54.600 INFO:tasks.workunit.client.0.smithi060.stdout:9/223: mknod d3/c4d 0 2024-09-21T10:40:54.604 INFO:tasks.workunit.client.1.smithi112.stdout:1/993: rename d8/d54/fa6 to d8/d1a/d31/da1/f133 0 2024-09-21T10:40:54.605 INFO:tasks.workunit.client.0.smithi060.stdout:5/172: dwrite d5/d9/d10/d19/d21/f2d [4194304,4194304] 0 2024-09-21T10:40:54.605 INFO:tasks.workunit.client.0.smithi060.stdout:5/173: write d5/d9/f1d [1617935,89203] 0 2024-09-21T10:40:54.606 INFO:tasks.workunit.client.0.smithi060.stdout:3/162: read d0/f1c [3356209,6212] 0 2024-09-21T10:40:54.607 INFO:tasks.workunit.client.0.smithi060.stdout:0/189: mknod d5/d10/da/d2f/c32 0 2024-09-21T10:40:54.609 INFO:tasks.workunit.client.1.smithi112.stdout:7/800: mkdir d7/d3d/da7/d105 0 2024-09-21T10:40:54.611 INFO:tasks.workunit.client.1.smithi112.stdout:7/801: dread d7/d22/f28 [0,4194304] 0 2024-09-21T10:40:54.611 INFO:tasks.workunit.client.0.smithi060.stdout:7/240: getdents da/d14/d25 0 2024-09-21T10:40:54.613 INFO:tasks.workunit.client.0.smithi060.stdout:1/181: sync 2024-09-21T10:40:54.613 INFO:tasks.workunit.client.0.smithi060.stdout:1/182: creat d6/d24/f3f x:0 0 0 2024-09-21T10:40:54.615 INFO:tasks.workunit.client.0.smithi060.stdout:9/224: rename d3/d16/l32 to d3/d15/l4e 0 2024-09-21T10:40:54.617 INFO:tasks.workunit.client.1.smithi112.stdout:8/884: mknod d8/d9/dd/d2b/d107/c109 0 2024-09-21T10:40:54.617 INFO:tasks.workunit.client.1.smithi112.stdout:8/885: stat d8/d9/dd/d2b/d31/d46/d86/fb5 0 2024-09-21T10:40:54.620 INFO:tasks.workunit.client.1.smithi112.stdout:6/891: rmdir d4/d6/da/d14/d49 39 2024-09-21T10:40:54.623 INFO:tasks.workunit.client.0.smithi060.stdout:0/190: mkdir d5/d10/da/d20/d33 0 2024-09-21T10:40:54.623 INFO:tasks.workunit.client.0.smithi060.stdout:0/191: write d5/d10/da/f13 [4549111,28051] 0 2024-09-21T10:40:54.627 INFO:tasks.workunit.client.0.smithi060.stdout:9/225: link d3/f35 d3/f4f 0 2024-09-21T10:40:54.627 INFO:tasks.workunit.client.0.smithi060.stdout:9/226: chown d3/d16/d1a/c2e 90736379 1 2024-09-21T10:40:54.628 INFO:tasks.workunit.client.1.smithi112.stdout:2/756: dwrite d0/f9 [0,4194304] 0 2024-09-21T10:40:54.628 INFO:tasks.workunit.client.1.smithi112.stdout:2/757: readlink d0/da4/dbe/df4/d7e/d8f/d51/l79 0 2024-09-21T10:40:54.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/163: getdents d0/d1/d24 0 2024-09-21T10:40:54.630 INFO:tasks.workunit.client.1.smithi112.stdout:6/892: dread d4/d6/da/d14/f8e [0,4194304] 0 2024-09-21T10:40:54.630 INFO:tasks.workunit.client.0.smithi060.stdout:0/192: symlink d5/l34 0 2024-09-21T10:40:54.634 INFO:tasks.workunit.client.0.smithi060.stdout:0/193: link d5/d10/d11/c14 d5/d10/da/c35 0 2024-09-21T10:40:54.634 INFO:tasks.workunit.client.1.smithi112.stdout:1/994: symlink d8/d1a/d31/d66/l134 0 2024-09-21T10:40:54.637 INFO:tasks.workunit.client.0.smithi060.stdout:9/227: write d3/f4f [223732,84688] 0 2024-09-21T10:40:54.638 INFO:tasks.workunit.client.1.smithi112.stdout:8/886: link d8/d9/f13 d8/d9/dd/d2b/f10a 0 2024-09-21T10:40:54.638 INFO:tasks.workunit.client.1.smithi112.stdout:8/887: write d8/d9/d3c/d57/f96 [342731,42004] 0 2024-09-21T10:40:54.640 INFO:tasks.workunit.client.1.smithi112.stdout:6/893: creat d4/d4f/f137 x:0 0 0 2024-09-21T10:40:54.644 INFO:tasks.workunit.client.1.smithi112.stdout:0/864: dwrite d3/d4a/d4e/dc2/d10/f35 [0,4194304] 0 2024-09-21T10:40:54.644 INFO:tasks.workunit.client.1.smithi112.stdout:3/841: dwrite d2/d1f/fc8 [0,4194304] 0 2024-09-21T10:40:54.644 INFO:tasks.workunit.client.1.smithi112.stdout:2/758: link d0/da4/dbe/df4/d7e/d8f/d51/d57/f40 d0/d12/d46/d86/ffb 0 2024-09-21T10:40:54.644 INFO:tasks.workunit.client.1.smithi112.stdout:2/759: chown d0/d12/d46/da0/db9/cbb 1833947851 1 2024-09-21T10:40:54.645 INFO:tasks.workunit.client.0.smithi060.stdout:5/174: dwrite d5/d9/f2b [0,4194304] 0 2024-09-21T10:40:54.646 INFO:tasks.workunit.client.0.smithi060.stdout:9/228: read d3/d16/d1f/f2c [1188641,108855] 0 2024-09-21T10:40:54.646 INFO:tasks.workunit.client.0.smithi060.stdout:9/229: read d3/d16/d1a/d3b/f39 [161549,70004] 0 2024-09-21T10:40:54.646 INFO:tasks.workunit.client.0.smithi060.stdout:9/230: chown d3/d16/d1a/d3b/d2f/l3e 45 1 2024-09-21T10:40:54.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/183: dwrite d6/f2c [0,4194304] 0 2024-09-21T10:40:54.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/184: dread - d6/d24/da/db/d1c/f36 zero size 2024-09-21T10:40:54.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/185: fdatasync d6/d24/da/db/de/f38 0 2024-09-21T10:40:54.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/186: read d6/d24/da/db/de/f18 [201188,76860] 0 2024-09-21T10:40:54.648 INFO:tasks.workunit.client.1.smithi112.stdout:6/894: link d4/d6/da/f105 d4/d6/da/d11/d1f/d22/d100/d12c/d31/f138 0 2024-09-21T10:40:54.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/164: dwrite d0/f16 [0,4194304] 0 2024-09-21T10:40:54.649 INFO:tasks.workunit.client.0.smithi060.stdout:1/187: dread d6/d24/da/db/de/f1a [0,4194304] 0 2024-09-21T10:40:54.649 INFO:tasks.workunit.client.0.smithi060.stdout:1/188: fdatasync d6/d24/da/db/de/f21 0 2024-09-21T10:40:54.649 INFO:tasks.workunit.client.0.smithi060.stdout:1/189: readlink d6/d24/da/db/de/d32/l39 0 2024-09-21T10:40:54.651 INFO:tasks.workunit.client.0.smithi060.stdout:0/194: dwrite d5/d10/f9 [0,4194304] 0 2024-09-21T10:40:54.653 INFO:tasks.workunit.client.0.smithi060.stdout:5/175: mkdir d5/d9/d13/d3a 0 2024-09-21T10:40:54.657 INFO:tasks.workunit.client.1.smithi112.stdout:3/842: link d2/d2f/d3f/ddf/d31/cfc d2/d2f/c115 0 2024-09-21T10:40:54.657 INFO:tasks.workunit.client.1.smithi112.stdout:3/843: stat d2/d2f/d3f/ddf/d31/d2a/d39 0 2024-09-21T10:40:54.659 INFO:tasks.workunit.client.1.smithi112.stdout:2/760: rename d0/d12/d46/d86/dc0/dc8/ccc to d0/d12/d46/d86/dc0/dc8/cfc 0 2024-09-21T10:40:54.659 INFO:tasks.workunit.client.1.smithi112.stdout:2/761: readlink d0/da4/dbe/df4/d7e/d8f/l43 0 2024-09-21T10:40:54.659 INFO:tasks.workunit.client.1.smithi112.stdout:2/762: stat d0/d12/d46/da0/db9/dbd/d62/lc4 0 2024-09-21T10:40:54.659 INFO:tasks.workunit.client.1.smithi112.stdout:2/763: truncate d0/da4/dbe/df4/d7e/d8f/d51/d57/f84 5152068 0 2024-09-21T10:40:54.661 INFO:tasks.workunit.client.1.smithi112.stdout:8/888: rmdir d8/d9/dd/d2b/d31/d46/d86 39 2024-09-21T10:40:54.661 INFO:tasks.workunit.client.1.smithi112.stdout:8/889: chown d8/d9/dd/dab/d8e/dcb/d82/dcc/de8/lf5 1755081481 1 2024-09-21T10:40:54.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/890: write d8/d9/dd/d2a/d43/f47 [5007708,127888] 0 2024-09-21T10:40:54.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/891: fdatasync d8/f8c 0 2024-09-21T10:40:54.662 INFO:tasks.workunit.client.1.smithi112.stdout:8/892: fdatasync d8/d18/f5b 0 2024-09-21T10:40:54.663 INFO:tasks.workunit.client.0.smithi060.stdout:9/231: creat d3/d16/d1a/d3b/d2f/f50 x:0 0 0 2024-09-21T10:40:54.665 INFO:tasks.workunit.client.1.smithi112.stdout:6/895: mknod d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/d84/c139 0 2024-09-21T10:40:54.666 INFO:tasks.workunit.client.0.smithi060.stdout:3/165: creat d0/d2b/f31 x:0 0 0 2024-09-21T10:40:54.666 INFO:tasks.workunit.client.0.smithi060.stdout:3/166: stat d0/l5 0 2024-09-21T10:40:54.668 INFO:tasks.workunit.client.0.smithi060.stdout:1/190: creat d6/f40 x:0 0 0 2024-09-21T10:40:54.669 INFO:tasks.workunit.client.1.smithi112.stdout:2/764: dread d0/da4/dbe/df4/d7e/d8f/d51/f70 [0,4194304] 0 2024-09-21T10:40:54.670 INFO:tasks.workunit.client.0.smithi060.stdout:9/232: dread d3/f4f [0,4194304] 0 2024-09-21T10:40:54.670 INFO:tasks.workunit.client.0.smithi060.stdout:9/233: read d3/f4f [1510130,14566] 0 2024-09-21T10:40:54.670 INFO:tasks.workunit.client.0.smithi060.stdout:9/234: write d3/d16/d1a/d3b/f39 [2026750,818] 0 2024-09-21T10:40:54.673 INFO:tasks.workunit.client.1.smithi112.stdout:6/896: rename d4/d6/da/d11/d1f/l6a to d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/l13a 0 2024-09-21T10:40:54.673 INFO:tasks.workunit.client.1.smithi112.stdout:6/897: chown d4/d6/da/d11/d37/d19/f2e 28 1 2024-09-21T10:40:54.675 INFO:tasks.workunit.client.0.smithi060.stdout:9/235: dread d3/ff [0,4194304] 0 2024-09-21T10:40:54.675 INFO:tasks.workunit.client.0.smithi060.stdout:9/236: chown d3/fc 7 1 2024-09-21T10:40:54.675 INFO:tasks.workunit.client.0.smithi060.stdout:9/237: creat d3/d16/d1a/f51 x:0 0 0 2024-09-21T10:40:54.676 INFO:tasks.workunit.client.1.smithi112.stdout:8/893: dwrite d8/d9/dd/d2a/f30 [0,4194304] 0 2024-09-21T10:40:54.679 INFO:tasks.workunit.client.1.smithi112.stdout:3/844: link d2/d2f/l65 d2/d2f/d3f/ddf/d31/d2a/d39/d3a/l116 0 2024-09-21T10:40:54.682 INFO:tasks.workunit.client.1.smithi112.stdout:6/898: mkdir d4/d6/da/d11/d37/d19/d13b 0 2024-09-21T10:40:54.684 INFO:tasks.workunit.client.1.smithi112.stdout:6/899: dread d4/d4f/f8c [0,4194304] 0 2024-09-21T10:40:54.687 INFO:tasks.workunit.client.1.smithi112.stdout:8/894: creat d8/d9/d3c/f10b x:0 0 0 2024-09-21T10:40:54.688 INFO:tasks.workunit.client.0.smithi060.stdout:1/191: dwrite d6/d24/da/db/de/d32/f37 [0,4194304] 0 2024-09-21T10:40:54.691 INFO:tasks.workunit.client.1.smithi112.stdout:6/900: rename f1 to d4/d6/da/d14/d49/d73/f13c 0 2024-09-21T10:40:54.692 INFO:tasks.workunit.client.1.smithi112.stdout:8/895: dread d8/d9/dd/f9c [0,4194304] 0 2024-09-21T10:40:54.693 INFO:tasks.workunit.client.1.smithi112.stdout:2/765: dwrite d0/da4/dbe/df4/fad [0,4194304] 0 2024-09-21T10:40:54.693 INFO:tasks.workunit.client.1.smithi112.stdout:3/845: truncate d2/d2f/d3f/f99 2964876 0 2024-09-21T10:40:54.693 INFO:tasks.workunit.client.0.smithi060.stdout:9/238: dwrite d3/f4f [0,4194304] 0 2024-09-21T10:40:54.693 INFO:tasks.workunit.client.0.smithi060.stdout:9/239: dread - d3/f14 zero size 2024-09-21T10:40:54.694 INFO:tasks.workunit.client.0.smithi060.stdout:3/167: getdents d0/d1 0 2024-09-21T10:40:54.695 INFO:tasks.workunit.client.1.smithi112.stdout:6/901: creat d4/dc/d7e/f13d x:0 0 0 2024-09-21T10:40:54.698 INFO:tasks.workunit.client.0.smithi060.stdout:1/192: dread d6/d24/da/db/dd/f14 [0,4194304] 0 2024-09-21T10:40:54.704 INFO:tasks.workunit.client.0.smithi060.stdout:9/240: rename d3/l27 to d3/d16/d42/l52 0 2024-09-21T10:40:54.704 INFO:tasks.workunit.client.0.smithi060.stdout:3/168: write d0/f21 [571574,44627] 0 2024-09-21T10:40:54.705 INFO:tasks.workunit.client.1.smithi112.stdout:8/896: truncate d8/d9/dd/d76/d97/fa8 1702165 0 2024-09-21T10:40:54.705 INFO:tasks.workunit.client.1.smithi112.stdout:8/897: write d8/d9/dd/d1a/fe7 [636923,81302] 0 2024-09-21T10:40:54.707 INFO:tasks.workunit.client.1.smithi112.stdout:2/766: mknod d0/d12/d46/da0/db9/cfd 0 2024-09-21T10:40:54.713 INFO:tasks.workunit.client.0.smithi060.stdout:1/193: symlink d6/d24/da/db/de/d32/l41 0 2024-09-21T10:40:54.713 INFO:tasks.workunit.client.0.smithi060.stdout:1/194: creat d6/d24/da/db/d1c/f42 x:0 0 0 2024-09-21T10:40:54.713 INFO:tasks.workunit.client.0.smithi060.stdout:1/195: stat d6/d24/da/db/de/d32/l41 0 2024-09-21T10:40:54.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/241: write d3/f10 [635875,82093] 0 2024-09-21T10:40:54.718 INFO:tasks.workunit.client.0.smithi060.stdout:3/169: creat d0/d1/d11/f32 x:0 0 0 2024-09-21T10:40:54.718 INFO:tasks.workunit.client.0.smithi060.stdout:3/170: creat d0/d1/d11/d2a/f33 x:0 0 0 2024-09-21T10:40:54.722 INFO:tasks.workunit.client.1.smithi112.stdout:8/898: dread d8/d9/dd/d76/fac [0,4194304] 0 2024-09-21T10:40:54.722 INFO:tasks.workunit.client.1.smithi112.stdout:8/899: dread - d8/d9/dd/d76/f79 zero size 2024-09-21T10:40:54.724 INFO:tasks.workunit.client.1.smithi112.stdout:6/902: dwrite d4/d6/f87 [0,4194304] 0 2024-09-21T10:40:54.724 INFO:tasks.workunit.client.1.smithi112.stdout:6/903: chown d4/d6/da/l3d 13226 1 2024-09-21T10:40:54.724 INFO:tasks.workunit.client.1.smithi112.stdout:6/904: chown d4/d6/f15 2 1 2024-09-21T10:40:54.724 INFO:tasks.workunit.client.1.smithi112.stdout:6/905: write d4/d6/da/f105 [4423509,13626] 0 2024-09-21T10:40:54.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/171: mkdir d0/d1/d1e/d34 0 2024-09-21T10:40:54.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/172: dread - d0/f28 zero size 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.0.smithi060.stdout:3/173: dread - d0/d2b/f31 zero size 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.0.smithi060.stdout:9/242: dread d3/fe [0,4194304] 0 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.1.smithi112.stdout:3/846: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/fe2 [0,4194304] 0 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.1.smithi112.stdout:3/847: fdatasync d2/d2f/d3f/ddf/d31/d2a/d39/d60/f6f 0 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.1.smithi112.stdout:8/900: stat d8/d18/l73 0 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.0.smithi060.stdout:1/196: unlink d6/d24/da/db/d1c/f42 0 2024-09-21T10:40:54.726 INFO:tasks.workunit.client.0.smithi060.stdout:1/197: rename d6/d24/da to d6/d24/da/db/d43 22 2024-09-21T10:40:54.728 INFO:tasks.workunit.client.1.smithi112.stdout:4/895: sync 2024-09-21T10:40:54.729 INFO:tasks.workunit.client.1.smithi112.stdout:2/767: dwrite d0/dd/fc2 [0,4194304] 0 2024-09-21T10:40:54.729 INFO:tasks.workunit.client.1.smithi112.stdout:2/768: readlink d0/da2/ld6 0 2024-09-21T10:40:54.730 INFO:tasks.workunit.client.0.smithi060.stdout:3/174: creat d0/d1/d1e/f35 x:0 0 0 2024-09-21T10:40:54.732 INFO:tasks.workunit.client.1.smithi112.stdout:6/906: creat d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/f13e x:0 0 0 2024-09-21T10:40:54.734 INFO:tasks.workunit.client.1.smithi112.stdout:9/884: sync 2024-09-21T10:40:54.738 INFO:tasks.workunit.client.0.smithi060.stdout:1/198: rename d6/d24/da/f23 to d6/f44 0 2024-09-21T10:40:54.739 INFO:tasks.workunit.client.0.smithi060.stdout:1/199: chown d6/d24/da/f1f 8225 1 2024-09-21T10:40:54.739 INFO:tasks.workunit.client.0.smithi060.stdout:9/243: getdents d3/d16/d1f 0 2024-09-21T10:40:54.743 INFO:tasks.workunit.client.0.smithi060.stdout:1/200: mkdir d6/d24/da/d45 0 2024-09-21T10:40:54.743 INFO:tasks.workunit.client.0.smithi060.stdout:1/201: dread - d6/d24/da/db/de/d32/f3b zero size 2024-09-21T10:40:54.743 INFO:tasks.workunit.client.1.smithi112.stdout:6/907: dread d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:54.743 INFO:tasks.workunit.client.1.smithi112.stdout:6/908: chown d4/d6/da/f2c 0 1 2024-09-21T10:40:54.743 INFO:tasks.workunit.client.1.smithi112.stdout:6/909: chown d4/dc/d135 7214950 1 2024-09-21T10:40:54.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/175: rename d0/c29 to d0/d1/c36 0 2024-09-21T10:40:54.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/176: chown d0/lc 186370 1 2024-09-21T10:40:54.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/177: fdatasync d0/d1/d24/f25 0 2024-09-21T10:40:54.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/178: dread - d0/d2b/f31 zero size 2024-09-21T10:40:54.748 INFO:tasks.workunit.client.0.smithi060.stdout:3/179: write d0/f23 [194894,32171] 0 2024-09-21T10:40:54.748 INFO:tasks.workunit.client.0.smithi060.stdout:3/180: dread - d0/d1/d11/d2a/f33 zero size 2024-09-21T10:40:54.749 INFO:tasks.workunit.client.0.smithi060.stdout:9/244: mkdir d3/d15/d53 0 2024-09-21T10:40:54.753 INFO:tasks.workunit.client.0.smithi060.stdout:1/202: mknod d6/d24/c46 0 2024-09-21T10:40:54.753 INFO:tasks.workunit.client.0.smithi060.stdout:1/203: dread - d6/d24/f3f zero size 2024-09-21T10:40:54.757 INFO:tasks.workunit.client.0.smithi060.stdout:3/181: unlink d0/fd 0 2024-09-21T10:40:54.762 INFO:tasks.workunit.client.1.smithi112.stdout:3/848: rename d2/f19 to d2/d2f/daf/df4/f117 0 2024-09-21T10:40:54.765 INFO:tasks.workunit.client.0.smithi060.stdout:9/245: symlink d3/d16/d42/l54 0 2024-09-21T10:40:54.765 INFO:tasks.workunit.client.0.smithi060.stdout:9/246: write d3/d16/d1a/f26 [571651,44549] 0 2024-09-21T10:40:54.766 INFO:tasks.workunit.client.1.smithi112.stdout:8/901: creat d8/d9/dd/dab/f10c x:0 0 0 2024-09-21T10:40:54.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/204: mkdir d6/d24/da/d45/d47 0 2024-09-21T10:40:54.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/205: chown d6/d24/da/l34 0 1 2024-09-21T10:40:54.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/206: chown d6/d24/da/f12 0 1 2024-09-21T10:40:54.768 INFO:tasks.workunit.client.0.smithi060.stdout:9/247: mknod d3/d16/d42/c55 0 2024-09-21T10:40:54.768 INFO:tasks.workunit.client.0.smithi060.stdout:9/248: chown d3/d16/d1f/f2c 908353 1 2024-09-21T10:40:54.768 INFO:tasks.workunit.client.0.smithi060.stdout:9/249: write d3/d16/d1a/f51 [409639,112167] 0 2024-09-21T10:40:54.771 INFO:tasks.workunit.client.1.smithi112.stdout:1/995: dwrite d8/d1a/d31/d37/f81 [0,4194304] 0 2024-09-21T10:40:54.771 INFO:tasks.workunit.client.0.smithi060.stdout:1/207: mkdir d6/d24/da/d45/d48 0 2024-09-21T10:40:54.771 INFO:tasks.workunit.client.0.smithi060.stdout:1/208: creat d6/d24/f49 x:0 0 0 2024-09-21T10:40:54.771 INFO:tasks.workunit.client.0.smithi060.stdout:3/182: dread d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:40:54.772 INFO:tasks.workunit.client.0.smithi060.stdout:5/176: rmdir d5 39 2024-09-21T10:40:54.773 INFO:tasks.workunit.client.1.smithi112.stdout:6/910: dwrite d4/d6/da/d14/d49/d73/fa4 [0,4194304] 0 2024-09-21T10:40:54.775 INFO:tasks.workunit.client.1.smithi112.stdout:9/885: creat d1/d2/d27/d37/f13b x:0 0 0 2024-09-21T10:40:54.784 INFO:tasks.workunit.client.1.smithi112.stdout:3/849: creat d2/dd5/d107/f118 x:0 0 0 2024-09-21T10:40:54.784 INFO:tasks.workunit.client.1.smithi112.stdout:3/850: stat d2/d2f/daf/ff1 0 2024-09-21T10:40:54.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/177: mkdir d5/d9/d3b 0 2024-09-21T10:40:54.787 INFO:tasks.workunit.client.1.smithi112.stdout:8/902: mkdir d8/d9/dd/d76/d97/dfa/d10d 0 2024-09-21T10:40:54.791 INFO:tasks.workunit.client.1.smithi112.stdout:4/896: getdents de/d2a/dbf 0 2024-09-21T10:40:54.791 INFO:tasks.workunit.client.1.smithi112.stdout:4/897: write de/d2e/f48 [781590,90401] 0 2024-09-21T10:40:54.798 INFO:tasks.workunit.client.0.smithi060.stdout:1/209: dwrite d6/d24/da/db/d1c/f26 [0,4194304] 0 2024-09-21T10:40:54.798 INFO:tasks.workunit.client.0.smithi060.stdout:1/210: readlink d6/d24/da/db/dd/l25 0 2024-09-21T10:40:54.798 INFO:tasks.workunit.client.1.smithi112.stdout:6/911: mkdir d4/d6/d75/db7/d13f 0 2024-09-21T10:40:54.800 INFO:tasks.workunit.client.1.smithi112.stdout:1/996: dwrite d8/d1a/d31/da1/de7/ff3 [0,4194304] 0 2024-09-21T10:40:54.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/769: rmdir d0/da2 39 2024-09-21T10:40:54.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/770: chown d0/d12/d46/da0/db9/dbd 1295 1 2024-09-21T10:40:54.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/771: read - d0/da4/dbe/df4/d7e/d8f/fe0 zero size 2024-09-21T10:40:54.801 INFO:tasks.workunit.client.1.smithi112.stdout:2/772: truncate d0/dd/da5/df0/ff7 79568 0 2024-09-21T10:40:54.802 INFO:tasks.workunit.client.1.smithi112.stdout:2/773: stat d0/d12/d46/da0/db9/dbd/d62/fa8 0 2024-09-21T10:40:54.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/178: read d5/d9/d10/d19/f33 [2694053,22513] 0 2024-09-21T10:40:54.804 INFO:tasks.workunit.client.0.smithi060.stdout:9/250: dwrite d3/d16/d1a/f1d [0,4194304] 0 2024-09-21T10:40:54.804 INFO:tasks.workunit.client.1.smithi112.stdout:9/886: link d1/d2/d27/d3a/f2d d1/d2/d27/d3a/d6b/d30/da5/f13c 0 2024-09-21T10:40:54.807 INFO:tasks.workunit.client.1.smithi112.stdout:3/851: symlink d2/dd5/d107/l119 0 2024-09-21T10:40:54.809 INFO:tasks.workunit.client.1.smithi112.stdout:8/903: truncate d8/f8c 661429 0 2024-09-21T10:40:54.811 INFO:tasks.workunit.client.0.smithi060.stdout:1/211: mkdir d6/d4a 0 2024-09-21T10:40:54.811 INFO:tasks.workunit.client.1.smithi112.stdout:4/898: dwrite de/d33/d2f/d35/df3/dcc/fd4 [0,4194304] 0 2024-09-21T10:40:54.812 INFO:tasks.workunit.client.1.smithi112.stdout:6/912: mknod d4/dc/d135/c140 0 2024-09-21T10:40:54.812 INFO:tasks.workunit.client.1.smithi112.stdout:6/913: fdatasync d4/d6/da/d11/d1f/d22/d100/f85 0 2024-09-21T10:40:54.812 INFO:tasks.workunit.client.1.smithi112.stdout:6/914: chown d4/d6/da/d11/d37/d19/d13b 14 1 2024-09-21T10:40:54.819 INFO:tasks.workunit.client.0.smithi060.stdout:5/179: mknod d5/d9/d10/d19/d21/d30/c3c 0 2024-09-21T10:40:54.820 INFO:tasks.workunit.client.1.smithi112.stdout:1/997: rmdir d8/d45/dae/d114 39 2024-09-21T10:40:54.820 INFO:tasks.workunit.client.1.smithi112.stdout:1/998: creat d8/f135 x:0 0 0 2024-09-21T10:40:54.821 INFO:tasks.workunit.client.0.smithi060.stdout:5/180: dread d5/d9/d13/f20 [0,4194304] 0 2024-09-21T10:40:54.822 INFO:tasks.workunit.client.1.smithi112.stdout:8/904: dread d8/d9/dd/d2a/f77 [0,4194304] 0 2024-09-21T10:40:54.823 INFO:tasks.workunit.client.1.smithi112.stdout:4/899: dread de/d33/d2f/ffc [0,4194304] 0 2024-09-21T10:40:54.823 INFO:tasks.workunit.client.1.smithi112.stdout:2/774: creat d0/d12/d77/ffe x:0 0 0 2024-09-21T10:40:54.826 INFO:tasks.workunit.client.0.smithi060.stdout:9/251: rmdir d3/d16/d1f 39 2024-09-21T10:40:54.828 INFO:tasks.workunit.client.1.smithi112.stdout:9/887: creat d1/d2/d27/d3a/d6b/d30/d121/f13d x:0 0 0 2024-09-21T10:40:54.829 INFO:tasks.workunit.client.1.smithi112.stdout:8/905: dread d8/d9/d3c/d90/de1/fec [0,4194304] 0 2024-09-21T10:40:54.829 INFO:tasks.workunit.client.1.smithi112.stdout:8/906: stat d8/d9/d3c 0 2024-09-21T10:40:54.831 INFO:tasks.workunit.client.1.smithi112.stdout:3/852: creat d2/d1f/d100/f11a x:0 0 0 2024-09-21T10:40:54.832 INFO:tasks.workunit.client.0.smithi060.stdout:5/181: mknod d5/d9/d10/c3d 0 2024-09-21T10:40:54.832 INFO:tasks.workunit.client.0.smithi060.stdout:5/182: chown d5/d9/d13/l23 2650 1 2024-09-21T10:40:54.835 INFO:tasks.workunit.client.1.smithi112.stdout:8/907: dread d8/d9/f13 [0,4194304] 0 2024-09-21T10:40:54.835 INFO:tasks.workunit.client.1.smithi112.stdout:8/908: write d8/d9/dd/d1a/f80 [1099667,3260] 0 2024-09-21T10:40:54.836 INFO:tasks.workunit.client.1.smithi112.stdout:6/915: mknod d4/d6/da/d11/d37/d19/df3/d118/c141 0 2024-09-21T10:40:54.836 INFO:tasks.workunit.client.1.smithi112.stdout:6/916: truncate d4/d6/da/d11/d1f/d22/d100/f106 873289 0 2024-09-21T10:40:54.841 INFO:tasks.workunit.client.0.smithi060.stdout:9/252: symlink d3/d16/d42/l56 0 2024-09-21T10:40:54.841 INFO:tasks.workunit.client.0.smithi060.stdout:9/253: chown d3/f47 39782 1 2024-09-21T10:40:54.841 INFO:tasks.workunit.client.0.smithi060.stdout:9/254: write d3/ff [669756,62346] 0 2024-09-21T10:40:54.841 INFO:tasks.workunit.client.0.smithi060.stdout:9/255: write d3/d16/f4b [530127,16089] 0 2024-09-21T10:40:54.842 INFO:tasks.workunit.client.0.smithi060.stdout:9/256: fsync d3/fe 0 2024-09-21T10:40:54.842 INFO:tasks.workunit.client.0.smithi060.stdout:9/257: chown d3/d16/d1a/d3b/c33 1313761 1 2024-09-21T10:40:54.844 INFO:tasks.workunit.client.1.smithi112.stdout:9/888: mkdir d1/d7f/df0/d11c/d13e 0 2024-09-21T10:40:54.844 INFO:tasks.workunit.client.1.smithi112.stdout:9/889: write d1/f1b [1398013,20327] 0 2024-09-21T10:40:54.846 INFO:tasks.workunit.client.0.smithi060.stdout:5/183: mkdir d5/d9/d3e 0 2024-09-21T10:40:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:9/258: dread d3/f4f [0,4194304] 0 2024-09-21T10:40:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:9/259: readlink d3/l5 0 2024-09-21T10:40:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:9/260: readlink l1 0 2024-09-21T10:40:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:9/261: stat d3/l7 0 2024-09-21T10:40:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:9/262: creat d3/d16/d1a/d3b/d2f/f57 x:0 0 0 2024-09-21T10:40:54.851 INFO:tasks.workunit.client.0.smithi060.stdout:5/184: rename d5/d9/d10/c14 to d5/d9/d13/d3a/c3f 0 2024-09-21T10:40:54.851 INFO:tasks.workunit.client.0.smithi060.stdout:5/185: chown d5/d9/c36 2579 1 2024-09-21T10:40:54.853 INFO:tasks.workunit.client.1.smithi112.stdout:8/909: mkdir d8/d9/dd/dab/d8e/dcb/d82/dcc/d10e 0 2024-09-21T10:40:54.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/917: dwrite d4/d6/da/d11/d1f/d22/f26 [0,4194304] 0 2024-09-21T10:40:54.857 INFO:tasks.workunit.client.0.smithi060.stdout:8/192: sync 2024-09-21T10:40:54.859 INFO:tasks.workunit.client.1.smithi112.stdout:9/890: truncate d1/f43 3634396 0 2024-09-21T10:40:54.861 INFO:tasks.workunit.client.1.smithi112.stdout:3/853: link d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/cc2 d2/d2f/d3f/c11b 0 2024-09-21T10:40:54.862 INFO:tasks.workunit.client.1.smithi112.stdout:6/918: symlink d4/d6/da/d14/d49/d62/l142 0 2024-09-21T10:40:54.863 INFO:tasks.workunit.client.1.smithi112.stdout:8/910: dread d8/f14 [0,4194304] 0 2024-09-21T10:40:54.864 INFO:tasks.workunit.client.0.smithi060.stdout:5/186: dwrite d5/d9/d10/d19/f34 [0,4194304] 0 2024-09-21T10:40:54.864 INFO:tasks.workunit.client.0.smithi060.stdout:5/187: truncate d5/d9/d10/d19/f37 112120 0 2024-09-21T10:40:54.864 INFO:tasks.workunit.client.0.smithi060.stdout:9/263: mkdir d3/d15/d58 0 2024-09-21T10:40:54.864 INFO:tasks.workunit.client.1.smithi112.stdout:9/891: mknod d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/c13f 0 2024-09-21T10:40:54.865 INFO:tasks.workunit.client.0.smithi060.stdout:8/193: rename d2/l6 to d2/d26/l43 0 2024-09-21T10:40:54.866 INFO:tasks.workunit.client.0.smithi060.stdout:8/194: write d2/f2d [757794,33273] 0 2024-09-21T10:40:54.866 INFO:tasks.workunit.client.0.smithi060.stdout:8/195: creat d2/d26/f44 x:0 0 0 2024-09-21T10:40:54.866 INFO:tasks.workunit.client.0.smithi060.stdout:8/196: truncate d2/fe 366121 0 2024-09-21T10:40:54.866 INFO:tasks.workunit.client.1.smithi112.stdout:3/854: write d2/d2f/d3f/ddf/d31/d2a/d39/d3a/f47 [1494240,117807] 0 2024-09-21T10:40:54.868 INFO:tasks.workunit.client.1.smithi112.stdout:6/919: rmdir d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56 39 2024-09-21T10:40:54.868 INFO:tasks.workunit.client.1.smithi112.stdout:6/920: creat d4/d6/da/d14/d49/d62/f143 x:0 0 0 2024-09-21T10:40:54.868 INFO:tasks.workunit.client.1.smithi112.stdout:6/921: truncate d4/d6/da/fab 1401337 0 2024-09-21T10:40:54.870 INFO:tasks.workunit.client.0.smithi060.stdout:5/188: unlink d5/f39 0 2024-09-21T10:40:54.870 INFO:tasks.workunit.client.0.smithi060.stdout:5/189: readlink d5/d9/l28 0 2024-09-21T10:40:54.871 INFO:tasks.workunit.client.1.smithi112.stdout:9/892: truncate d1/d7f/f9b 3404292 0 2024-09-21T10:40:54.873 INFO:tasks.workunit.client.0.smithi060.stdout:9/264: symlink d3/d15/d58/l59 0 2024-09-21T10:40:54.874 INFO:tasks.workunit.client.1.smithi112.stdout:3/855: symlink d2/d2f/d3f/ddf/d31/d2a/dff/l11c 0 2024-09-21T10:40:54.875 INFO:tasks.workunit.client.1.smithi112.stdout:6/922: dread d4/d4f/f5d [0,4194304] 0 2024-09-21T10:40:54.875 INFO:tasks.workunit.client.1.smithi112.stdout:6/923: write d4/d6/da/d11/d37/d19/df3/f12d [4832004,23966] 0 2024-09-21T10:40:54.879 INFO:tasks.workunit.client.1.smithi112.stdout:8/911: link d8/d9/ff8 d8/dd5/f10f 0 2024-09-21T10:40:54.882 INFO:tasks.workunit.client.1.smithi112.stdout:8/912: write d8/d9/dd/d2b/fca [1024468,18647] 0 2024-09-21T10:40:54.883 INFO:tasks.workunit.client.0.smithi060.stdout:8/197: link d2/d26/f44 d2/d26/d37/f45 0 2024-09-21T10:40:54.883 INFO:tasks.workunit.client.0.smithi060.stdout:8/198: truncate d2/d26/f44 303954 0 2024-09-21T10:40:54.883 INFO:tasks.workunit.client.0.smithi060.stdout:8/199: chown d2/f15 0 1 2024-09-21T10:40:54.883 INFO:tasks.workunit.client.0.smithi060.stdout:8/200: chown d2/d18/f30 42636 1 2024-09-21T10:40:54.883 INFO:tasks.workunit.client.0.smithi060.stdout:8/201: fdatasync d2/f1f 0 2024-09-21T10:40:54.883 INFO:tasks.workunit.client.1.smithi112.stdout:7/802: sync 2024-09-21T10:40:54.884 INFO:tasks.workunit.client.1.smithi112.stdout:5/910: sync 2024-09-21T10:40:54.886 INFO:tasks.workunit.client.1.smithi112.stdout:3/856: rename d2/d2f/d3f/ddf/d31/d2a/d39/lb5 to d2/l11d 0 2024-09-21T10:40:54.888 INFO:tasks.workunit.client.0.smithi060.stdout:8/202: link d2/d18/f34 d2/f46 0 2024-09-21T10:40:54.888 INFO:tasks.workunit.client.0.smithi060.stdout:8/203: creat d2/f47 x:0 0 0 2024-09-21T10:40:54.890 INFO:tasks.workunit.client.1.smithi112.stdout:9/893: dwrite d1/d2/d27/d3a/f2d [0,4194304] 0 2024-09-21T10:40:54.895 INFO:tasks.workunit.client.0.smithi060.stdout:8/204: truncate d2/d26/f32 2096046 0 2024-09-21T10:40:54.895 INFO:tasks.workunit.client.0.smithi060.stdout:3/183: rmdir d0 39 2024-09-21T10:40:54.899 INFO:tasks.workunit.client.0.smithi060.stdout:5/190: dwrite d5/d9/f15 [0,4194304] 0 2024-09-21T10:40:54.899 INFO:tasks.workunit.client.0.smithi060.stdout:3/184: creat d0/d1/d1e/f37 x:0 0 0 2024-09-21T10:40:54.899 INFO:tasks.workunit.client.0.smithi060.stdout:3/185: fsync d0/d1/f18 0 2024-09-21T10:40:54.899 INFO:tasks.workunit.client.0.smithi060.stdout:9/265: dwrite d3/d16/d1a/d3b/f39 [0,4194304] 0 2024-09-21T10:40:54.899 INFO:tasks.workunit.client.1.smithi112.stdout:0/865: sync 2024-09-21T10:40:54.901 INFO:tasks.workunit.client.0.smithi060.stdout:8/205: dread d2/f2d [0,4194304] 0 2024-09-21T10:40:54.902 INFO:tasks.workunit.client.1.smithi112.stdout:8/913: unlink d8/d9/dd/dab/d8e/dcb/f81 0 2024-09-21T10:40:54.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/914: chown d8/d9/dd/d2a/d43/f47 2 1 2024-09-21T10:40:54.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/915: truncate d8/dd5/f10f 271877 0 2024-09-21T10:40:54.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/916: readlink d8/d9/dd/d2b/l37 0 2024-09-21T10:40:54.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/917: write d8/d9/dd/dab/f10c [310612,96059] 0 2024-09-21T10:40:54.903 INFO:tasks.workunit.client.1.smithi112.stdout:8/918: readlink d8/d9/d3c/la5 0 2024-09-21T10:40:54.906 INFO:tasks.workunit.client.1.smithi112.stdout:7/803: creat d7/d22/d41/d4b/da2/dea/f106 x:0 0 0 2024-09-21T10:40:54.907 INFO:tasks.workunit.client.0.smithi060.stdout:9/266: mkdir d3/d15/d5a 0 2024-09-21T10:40:54.907 INFO:tasks.workunit.client.0.smithi060.stdout:9/267: chown d3/d15 37108 1 2024-09-21T10:40:54.907 INFO:tasks.workunit.client.0.smithi060.stdout:9/268: write d3/d16/d1f/f49 [158334,45419] 0 2024-09-21T10:40:54.907 INFO:tasks.workunit.client.0.smithi060.stdout:1/212: getdents d6/d24 0 2024-09-21T10:40:54.910 INFO:tasks.workunit.client.1.smithi112.stdout:7/804: dread d7/d22/d41/d56/d72/dc4/fe9 [4194304,4194304] 0 2024-09-21T10:40:54.910 INFO:tasks.workunit.client.1.smithi112.stdout:7/805: fdatasync d7/d22/f48 0 2024-09-21T10:40:54.910 INFO:tasks.workunit.client.1.smithi112.stdout:7/806: fdatasync d7/d22/d41/d56/faa 0 2024-09-21T10:40:54.910 INFO:tasks.workunit.client.1.smithi112.stdout:9/894: mkdir d1/d2/d27/d3a/d6b/d30/da5/d140 0 2024-09-21T10:40:54.912 INFO:tasks.workunit.client.1.smithi112.stdout:9/895: dread d1/d2/f79 [0,4194304] 0 2024-09-21T10:40:54.912 INFO:tasks.workunit.client.1.smithi112.stdout:0/866: mknod d3/d18/d52/d55/dcc/d10b/ddf/c123 0 2024-09-21T10:40:54.912 INFO:tasks.workunit.client.1.smithi112.stdout:0/867: stat d3/d4a/d4e/dc2/d1a/d21/d4f 0 2024-09-21T10:40:54.912 INFO:tasks.workunit.client.1.smithi112.stdout:0/868: write d3/d18/d45/fe7 [415490,104563] 0 2024-09-21T10:40:54.913 INFO:tasks.workunit.client.0.smithi060.stdout:1/213: mkdir d6/d24/da/db/d1c/d4b 0 2024-09-21T10:40:54.913 INFO:tasks.workunit.client.0.smithi060.stdout:1/214: truncate d6/d24/f3f 375757 0 2024-09-21T10:40:54.913 INFO:tasks.workunit.client.0.smithi060.stdout:1/215: creat d6/d24/da/db/d1c/f4c x:0 0 0 2024-09-21T10:40:54.913 INFO:tasks.workunit.client.0.smithi060.stdout:1/216: creat d6/d24/da/db/dd/f4d x:0 0 0 2024-09-21T10:40:54.914 INFO:tasks.workunit.client.0.smithi060.stdout:1/217: dread d6/d24/da/db/de/f18 [0,4194304] 0 2024-09-21T10:40:54.915 INFO:tasks.workunit.client.0.smithi060.stdout:1/218: fdatasync d6/d24/da/db/f29 0 2024-09-21T10:40:54.924 INFO:tasks.workunit.client.0.smithi060.stdout:1/219: dread d6/d24/da/db/dd/f14 [0,4194304] 0 2024-09-21T10:40:54.924 INFO:tasks.workunit.client.0.smithi060.stdout:1/220: write d6/d24/da/db/dd/f4d [775117,95889] 0 2024-09-21T10:40:54.924 INFO:tasks.workunit.client.0.smithi060.stdout:1/221: chown d6/d24/f49 4114479 1 2024-09-21T10:40:54.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/911: getdents d9/d15/d18/d20 0 2024-09-21T10:40:54.924 INFO:tasks.workunit.client.1.smithi112.stdout:5/912: dread - d9/d15/d18/d20/d55/fff zero size 2024-09-21T10:40:54.926 INFO:tasks.workunit.client.0.smithi060.stdout:1/222: symlink d6/d24/da/db/d1c/d4b/l4e 0 2024-09-21T10:40:54.926 INFO:tasks.workunit.client.0.smithi060.stdout:1/223: stat d6/d24/da/db/d1c/f26 0 2024-09-21T10:40:54.926 INFO:tasks.workunit.client.0.smithi060.stdout:1/224: write d6/d24/da/db/de/d32/f3b [3553,18492] 0 2024-09-21T10:40:54.926 INFO:tasks.workunit.client.0.smithi060.stdout:1/225: write d6/f44 [124261,75953] 0 2024-09-21T10:40:54.927 INFO:tasks.workunit.client.1.smithi112.stdout:7/807: symlink d7/d3d/da7/l107 0 2024-09-21T10:40:54.927 INFO:tasks.workunit.client.1.smithi112.stdout:7/808: chown d7/d22/d41/d56/d72/dc4/d4a 7070940 1 2024-09-21T10:40:54.928 INFO:tasks.workunit.client.1.smithi112.stdout:5/913: dread d9/d8a/f95 [0,4194304] 0 2024-09-21T10:40:54.929 INFO:tasks.workunit.client.1.smithi112.stdout:9/896: link d1/d2/d27/d37/d68/fdd d1/d7f/df0/f141 0 2024-09-21T10:40:54.930 INFO:tasks.workunit.client.1.smithi112.stdout:0/869: creat d3/d4a/d4e/dc2/d43/f124 x:0 0 0 2024-09-21T10:40:54.931 INFO:tasks.workunit.client.1.smithi112.stdout:0/870: dread - d3/ff1 zero size 2024-09-21T10:40:54.932 INFO:tasks.workunit.client.1.smithi112.stdout:8/919: rmdir d8/d18 39 2024-09-21T10:40:54.934 INFO:tasks.workunit.client.1.smithi112.stdout:7/809: truncate d7/d22/f35 3368389 0 2024-09-21T10:40:54.934 INFO:tasks.workunit.client.1.smithi112.stdout:7/810: creat d7/d22/d78/f108 x:0 0 0 2024-09-21T10:40:54.935 INFO:tasks.workunit.client.1.smithi112.stdout:5/914: creat d9/d15/f127 x:0 0 0 2024-09-21T10:40:54.937 INFO:tasks.workunit.client.0.smithi060.stdout:5/191: dwrite d5/d9/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:40:54.937 INFO:tasks.workunit.client.1.smithi112.stdout:9/897: symlink d1/d2/d27/d3a/d6b/d30/da5/d140/l142 0 2024-09-21T10:40:54.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/920: mknod d8/d9/d3c/d57/c110 0 2024-09-21T10:40:54.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/921: truncate d8/d9/dd/dab/d8e/fc6 252900 0 2024-09-21T10:40:54.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/922: chown d8/d9/d3c/c4f 99695 1 2024-09-21T10:40:54.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/923: write d8/d9/dd/d76/fac [4685546,34227] 0 2024-09-21T10:40:54.940 INFO:tasks.workunit.client.1.smithi112.stdout:8/924: chown d8/d9/dd/c29 85978251 1 2024-09-21T10:40:54.943 INFO:tasks.workunit.client.1.smithi112.stdout:7/811: creat d7/d22/d41/d56/dc9/f109 x:0 0 0 2024-09-21T10:40:54.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/269: dwrite d3/fc [0,4194304] 0 2024-09-21T10:40:54.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/270: stat d3/d16/d1a/d3b/f23 0 2024-09-21T10:40:54.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/226: dwrite d6/d24/da/db/d1c/f36 [0,4194304] 0 2024-09-21T10:40:54.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/227: write d6/d24/da/f12 [894987,49557] 0 2024-09-21T10:40:54.945 INFO:tasks.workunit.client.1.smithi112.stdout:3/857: dwrite d2/d2f/d3f/f94 [0,4194304] 0 2024-09-21T10:40:54.947 INFO:tasks.workunit.client.1.smithi112.stdout:9/898: mknod d1/d2/d27/d37/d3b/d69/d88/c143 0 2024-09-21T10:40:54.948 INFO:tasks.workunit.client.0.smithi060.stdout:5/192: write d5/d9/d10/d19/d21/d30/f35 [2279041,61010] 0 2024-09-21T10:40:54.950 INFO:tasks.workunit.client.0.smithi060.stdout:4/299: sync 2024-09-21T10:40:54.951 INFO:tasks.workunit.client.1.smithi112.stdout:0/871: dwrite d3/d4a/d4e/d72/da0/fa2 [0,4194304] 0 2024-09-21T10:40:54.951 INFO:tasks.workunit.client.1.smithi112.stdout:0/872: write d3/d4a/d4e/f78 [911926,122389] 0 2024-09-21T10:40:54.951 INFO:tasks.workunit.client.0.smithi060.stdout:2/133: sync 2024-09-21T10:40:54.958 INFO:tasks.workunit.client.0.smithi060.stdout:1/228: getdents d6/d24/da 0 2024-09-21T10:40:54.960 INFO:tasks.workunit.client.0.smithi060.stdout:2/134: mkdir d3/d7/d23 0 2024-09-21T10:40:54.965 INFO:tasks.workunit.client.0.smithi060.stdout:1/229: rename d6/d24/da/db/de/c1b to d6/d24/da/db/de/c4f 0 2024-09-21T10:40:54.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/899: mkdir d1/d2/d27/d3a/de3/db5/d144 0 2024-09-21T10:40:54.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/900: fsync d1/d2/d27/d3a/f33 0 2024-09-21T10:40:54.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/901: chown d1/c63 44 1 2024-09-21T10:40:54.967 INFO:tasks.workunit.client.0.smithi060.stdout:2/135: rmdir d3/d20/d17 39 2024-09-21T10:40:54.969 INFO:tasks.workunit.client.0.smithi060.stdout:2/136: mkdir d3/d7/d24 0 2024-09-21T10:40:54.973 INFO:tasks.workunit.client.0.smithi060.stdout:2/137: unlink d3/d7/d18/f1c 0 2024-09-21T10:40:54.975 INFO:tasks.workunit.client.1.smithi112.stdout:8/925: dwrite d8/d9/dd/d1a/fe6 [0,4194304] 0 2024-09-21T10:40:54.975 INFO:tasks.workunit.client.0.smithi060.stdout:4/300: dwrite d0/d3c/f56 [0,4194304] 0 2024-09-21T10:40:54.975 INFO:tasks.workunit.client.0.smithi060.stdout:9/271: dwrite d3/d15/f17 [0,4194304] 0 2024-09-21T10:40:54.976 INFO:tasks.workunit.client.1.smithi112.stdout:0/873: mknod d3/d4a/d4e/dc2/d1a/c125 0 2024-09-21T10:40:54.976 INFO:tasks.workunit.client.1.smithi112.stdout:0/874: fsync d3/ffa 0 2024-09-21T10:40:54.976 INFO:tasks.workunit.client.1.smithi112.stdout:0/875: fdatasync d3/f1b 0 2024-09-21T10:40:54.976 INFO:tasks.workunit.client.0.smithi060.stdout:8/206: rename d2/d26/l43 to d2/l48 0 2024-09-21T10:40:54.978 INFO:tasks.workunit.client.0.smithi060.stdout:2/138: mkdir d3/d7/d24/d25 0 2024-09-21T10:40:54.978 INFO:tasks.workunit.client.0.smithi060.stdout:2/139: chown d3/d7/fd 254655121 1 2024-09-21T10:40:54.980 INFO:tasks.workunit.client.1.smithi112.stdout:3/858: dwrite d2/d2f/f6a [0,4194304] 0 2024-09-21T10:40:54.980 INFO:tasks.workunit.client.1.smithi112.stdout:3/859: chown d2/f1b 50128095 1 2024-09-21T10:40:54.980 INFO:tasks.workunit.client.1.smithi112.stdout:9/902: creat d1/d2/d27/d3a/d6b/d30/da5/f145 x:0 0 0 2024-09-21T10:40:54.981 INFO:tasks.workunit.client.1.smithi112.stdout:7/812: dwrite d7/d22/d41/d4b/da2/dea/fa6 [0,4194304] 0 2024-09-21T10:40:54.987 INFO:tasks.workunit.client.0.smithi060.stdout:9/272: mkdir d3/d16/d1a/d3b/d2f/d5b 0 2024-09-21T10:40:54.989 INFO:tasks.workunit.client.0.smithi060.stdout:1/230: rename d6/d24/da/d45/d48 to d6/d24/d50 0 2024-09-21T10:40:54.993 INFO:tasks.workunit.client.0.smithi060.stdout:8/207: mkdir d2/d26/d49 0 2024-09-21T10:40:54.995 INFO:tasks.workunit.client.0.smithi060.stdout:9/273: dread d3/d16/f4b [0,4194304] 0 2024-09-21T10:40:54.996 INFO:tasks.workunit.client.0.smithi060.stdout:9/274: chown d3/d16/d1a/d3b/d2f/l3e 1001830 1 2024-09-21T10:40:54.997 INFO:tasks.workunit.client.1.smithi112.stdout:3/860: readlink d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/l90 0 2024-09-21T10:40:54.999 INFO:tasks.workunit.client.1.smithi112.stdout:0/876: dwrite d3/d4a/d4e/dc2/d1a/d21/f111 [0,4194304] 0 2024-09-21T10:40:54.999 INFO:tasks.workunit.client.1.smithi112.stdout:0/877: fdatasync d3/d4a/d4e/dc2/d1a/d21/fd7 0 2024-09-21T10:40:55.000 INFO:tasks.workunit.client.1.smithi112.stdout:9/903: mknod d1/d2/d27/d62/da1/d122/c146 0 2024-09-21T10:40:55.000 INFO:tasks.workunit.client.1.smithi112.stdout:9/904: truncate d1/d2/d27/d62/f8f 140463 0 2024-09-21T10:40:55.002 INFO:tasks.workunit.client.0.smithi060.stdout:4/301: rename d0/d5/d12/f61 to d0/d5/f66 0 2024-09-21T10:40:55.002 INFO:tasks.workunit.client.0.smithi060.stdout:4/302: write d0/d59/f5c [393350,105185] 0 2024-09-21T10:40:55.002 INFO:tasks.workunit.client.0.smithi060.stdout:4/303: write d0/d5/d12/d16/f1d [666470,83181] 0 2024-09-21T10:40:55.004 INFO:tasks.workunit.client.0.smithi060.stdout:8/208: link d2/d26/d37/c3e d2/d18/c4a 0 2024-09-21T10:40:55.004 INFO:tasks.workunit.client.0.smithi060.stdout:9/275: write d3/d16/d1a/d3b/d2f/f31 [585183,33157] 0 2024-09-21T10:40:55.004 INFO:tasks.workunit.client.0.smithi060.stdout:9/276: fdatasync d3/d16/d1a/f1d 0 2024-09-21T10:40:55.006 INFO:tasks.workunit.client.1.smithi112.stdout:7/813: rename d7/d22/f31 to d7/d22/d41/d56/db7/f10a 0 2024-09-21T10:40:55.008 INFO:tasks.workunit.client.0.smithi060.stdout:4/304: mkdir d0/d3c/d67 0 2024-09-21T10:40:55.008 INFO:tasks.workunit.client.0.smithi060.stdout:4/305: readlink d0/d5/d12/d3d/l62 0 2024-09-21T10:40:55.008 INFO:tasks.workunit.client.0.smithi060.stdout:4/306: readlink d0/d5/d12/d3d/l52 0 2024-09-21T10:40:55.010 INFO:tasks.workunit.client.1.smithi112.stdout:3/861: mkdir d2/d2f/d3f/ddf/d31/d2a/dfe/d11e 0 2024-09-21T10:40:55.010 INFO:tasks.workunit.client.1.smithi112.stdout:3/862: read d2/d1f/f6d [3997306,51996] 0 2024-09-21T10:40:55.011 INFO:tasks.workunit.client.0.smithi060.stdout:3/186: rmdir d0/d1/d1e 39 2024-09-21T10:40:55.014 INFO:tasks.workunit.client.0.smithi060.stdout:9/277: mknod d3/d16/d1f/c5c 0 2024-09-21T10:40:55.014 INFO:tasks.workunit.client.0.smithi060.stdout:2/140: dwrite d3/d7/fd [0,4194304] 0 2024-09-21T10:40:55.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/187: getdents d0/d1/d1e 0 2024-09-21T10:40:55.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/188: write d0/f1c [461169,34026] 0 2024-09-21T10:40:55.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/189: chown d0/d1/d11/f15 33 1 2024-09-21T10:40:55.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/190: truncate d0/d1/f26 29667 0 2024-09-21T10:40:55.016 INFO:tasks.workunit.client.0.smithi060.stdout:4/307: write d0/d5/f10 [659707,98945] 0 2024-09-21T10:40:55.017 INFO:tasks.workunit.client.1.smithi112.stdout:0/878: symlink d3/d18/d52/d55/dcc/d10b/ddf/l126 0 2024-09-21T10:40:55.019 INFO:tasks.workunit.client.0.smithi060.stdout:9/278: creat d3/d16/d42/f5d x:0 0 0 2024-09-21T10:40:55.020 INFO:tasks.workunit.client.1.smithi112.stdout:7/814: mkdir d7/d22/d41/d54/d4d/d10b 0 2024-09-21T10:40:55.020 INFO:tasks.workunit.client.1.smithi112.stdout:7/815: fdatasync d7/f19 0 2024-09-21T10:40:55.022 INFO:tasks.workunit.client.1.smithi112.stdout:3/863: symlink d2/d2f/l11f 0 2024-09-21T10:40:55.022 INFO:tasks.workunit.client.1.smithi112.stdout:3/864: fdatasync d2/d2f/daf/dca/ff7 0 2024-09-21T10:40:55.023 INFO:tasks.workunit.client.0.smithi060.stdout:6/307: sync 2024-09-21T10:40:55.024 INFO:tasks.workunit.client.0.smithi060.stdout:7/241: sync 2024-09-21T10:40:55.024 INFO:tasks.workunit.client.0.smithi060.stdout:6/308: chown d3/d12/d38/f3a 128158860 1 2024-09-21T10:40:55.024 INFO:tasks.workunit.client.0.smithi060.stdout:0/195: sync 2024-09-21T10:40:55.027 INFO:tasks.workunit.client.0.smithi060.stdout:4/308: write d0/d5/d12/d16/d28/f3b [1478245,78290] 0 2024-09-21T10:40:55.027 INFO:tasks.workunit.client.1.smithi112.stdout:0/879: rename d3/d18/d52/d55/l84 to d3/d4a/d4e/dc2/d43/l127 0 2024-09-21T10:40:55.027 INFO:tasks.workunit.client.1.smithi112.stdout:0/880: truncate d3/d4a/d4e/dc2/d1a/d21/fd7 478232 0 2024-09-21T10:40:55.028 INFO:tasks.workunit.client.0.smithi060.stdout:2/141: mknod d3/d20/d15/d1f/c26 0 2024-09-21T10:40:55.029 INFO:tasks.workunit.client.1.smithi112.stdout:7/816: mkdir d7/d22/d41/d56/db7/df2/d10c 0 2024-09-21T10:40:55.029 INFO:tasks.workunit.client.1.smithi112.stdout:7/817: dread - d7/d22/d41/d54/d4d/fd9 zero size 2024-09-21T10:40:55.030 INFO:tasks.workunit.client.1.smithi112.stdout:7/818: fsync d7/d22/d41/d4b/d52/da3/fb9 0 2024-09-21T10:40:55.030 INFO:tasks.workunit.client.1.smithi112.stdout:7/819: truncate d7/d22/d41/d56/d72/dc4/d4a/ff7 484625 0 2024-09-21T10:40:55.031 INFO:tasks.workunit.client.0.smithi060.stdout:7/242: write da/d14/d2a/d49/f47 [2867308,128944] 0 2024-09-21T10:40:55.031 INFO:tasks.workunit.client.0.smithi060.stdout:7/243: creat da/d14/f54 x:0 0 0 2024-09-21T10:40:55.031 INFO:tasks.workunit.client.0.smithi060.stdout:7/244: write da/d14/f19 [1862015,129155] 0 2024-09-21T10:40:55.032 INFO:tasks.workunit.client.0.smithi060.stdout:6/309: dread d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:40:55.032 INFO:tasks.workunit.client.1.smithi112.stdout:0/881: creat d3/d18/d11c/f128 x:0 0 0 2024-09-21T10:40:55.032 INFO:tasks.workunit.client.1.smithi112.stdout:0/882: write d3/d4a/ff7 [565320,10997] 0 2024-09-21T10:40:55.032 INFO:tasks.workunit.client.0.smithi060.stdout:0/196: symlink d5/d10/da/d2d/l36 0 2024-09-21T10:40:55.033 INFO:tasks.workunit.client.1.smithi112.stdout:3/865: dread d2/d8d/feb [0,4194304] 0 2024-09-21T10:40:55.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/866: read d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/f8e [119294,60684] 0 2024-09-21T10:40:55.034 INFO:tasks.workunit.client.1.smithi112.stdout:7/820: mkdir d7/dbc/d10d 0 2024-09-21T10:40:55.034 INFO:tasks.workunit.client.1.smithi112.stdout:3/867: truncate d2/d1f/f7d 1008773 0 2024-09-21T10:40:55.035 INFO:tasks.workunit.client.0.smithi060.stdout:0/197: write d5/d10/da/d16/f27 [4604026,125581] 0 2024-09-21T10:40:55.035 INFO:tasks.workunit.client.0.smithi060.stdout:2/142: mknod d3/d7/d24/d25/c27 0 2024-09-21T10:40:55.042 INFO:tasks.workunit.client.0.smithi060.stdout:7/245: symlink da/d14/d2a/l55 0 2024-09-21T10:40:55.042 INFO:tasks.workunit.client.0.smithi060.stdout:5/193: dwrite d5/d9/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:40:55.042 INFO:tasks.workunit.client.0.smithi060.stdout:7/246: write da/d14/d25/f4a [427797,85879] 0 2024-09-21T10:40:55.042 INFO:tasks.workunit.client.0.smithi060.stdout:8/209: dwrite d2/f23 [0,4194304] 0 2024-09-21T10:40:55.043 INFO:tasks.workunit.client.0.smithi060.stdout:4/309: read d0/f60 [4057077,75269] 0 2024-09-21T10:40:55.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/310: symlink d3/d12/d38/l59 0 2024-09-21T10:40:55.050 INFO:tasks.workunit.client.1.smithi112.stdout:8/926: dwrite d8/d9/dd/f5f [4194304,4194304] 0 2024-09-21T10:40:55.050 INFO:tasks.workunit.client.1.smithi112.stdout:8/927: rename d8/d9/dd/dab/d8e/dcb/d82 to d8/d9/dd/dab/d8e/dcb/d82/dcc/d10e/d111 22 2024-09-21T10:40:55.051 INFO:tasks.workunit.client.0.smithi060.stdout:0/198: dread d5/f25 [0,4194304] 0 2024-09-21T10:40:55.051 INFO:tasks.workunit.client.0.smithi060.stdout:0/199: write d5/d10/da/d15/f1b [4927184,30982] 0 2024-09-21T10:40:55.052 INFO:tasks.workunit.client.0.smithi060.stdout:3/191: dread d0/f1c [0,4194304] 0 2024-09-21T10:40:55.052 INFO:tasks.workunit.client.0.smithi060.stdout:2/143: creat d3/d20/d15/d1f/f28 x:0 0 0 2024-09-21T10:40:55.052 INFO:tasks.workunit.client.0.smithi060.stdout:1/231: dwrite d6/d24/da/db/d1c/f4c [0,4194304] 0 2024-09-21T10:40:55.052 INFO:tasks.workunit.client.0.smithi060.stdout:9/279: dwrite d3/d16/d1f/f2a [0,4194304] 0 2024-09-21T10:40:55.053 INFO:tasks.workunit.client.0.smithi060.stdout:5/194: getdents d5/d9/d13 0 2024-09-21T10:40:55.055 INFO:tasks.workunit.client.0.smithi060.stdout:7/247: mkdir da/d14/d25/d56 0 2024-09-21T10:40:55.059 INFO:tasks.workunit.client.1.smithi112.stdout:1/999: sync 2024-09-21T10:40:55.059 INFO:tasks.workunit.client.1.smithi112.stdout:6/924: sync 2024-09-21T10:40:55.059 INFO:tasks.workunit.client.1.smithi112.stdout:2/775: sync 2024-09-21T10:40:55.060 INFO:tasks.workunit.client.1.smithi112.stdout:4/900: sync 2024-09-21T10:40:55.060 INFO:tasks.workunit.client.1.smithi112.stdout:7/821: dwrite d7/d3d/fc7 [0,4194304] 0 2024-09-21T10:40:55.061 INFO:tasks.workunit.client.1.smithi112.stdout:0/883: dwrite d3/d4a/f99 [0,4194304] 0 2024-09-21T10:40:55.062 INFO:tasks.workunit.client.0.smithi060.stdout:8/210: mkdir d2/d18/d4b 0 2024-09-21T10:40:55.062 INFO:tasks.workunit.client.0.smithi060.stdout:2/144: write f2 [1197008,74985] 0 2024-09-21T10:40:55.063 INFO:tasks.workunit.client.1.smithi112.stdout:3/868: rmdir d2/d2f/d3f/ddf/d31/d2a/d39 39 2024-09-21T10:40:55.064 INFO:tasks.workunit.client.0.smithi060.stdout:4/310: unlink d0/d5/d12/d16/f1d 0 2024-09-21T10:40:55.068 INFO:tasks.workunit.client.1.smithi112.stdout:8/928: symlink d8/d9/d3c/d90/de1/l112 0 2024-09-21T10:40:55.069 INFO:tasks.workunit.client.0.smithi060.stdout:0/200: symlink d5/d10/da/d16/l37 0 2024-09-21T10:40:55.071 INFO:tasks.workunit.client.0.smithi060.stdout:3/192: mknod d0/d2b/c38 0 2024-09-21T10:40:55.073 INFO:tasks.workunit.client.1.smithi112.stdout:2/776: creat d0/da4/fff x:0 0 0 2024-09-21T10:40:55.073 INFO:tasks.workunit.client.1.smithi112.stdout:7/822: write d7/d22/d41/d4b/da2/dea/fa6 [3178077,99081] 0 2024-09-21T10:40:55.074 INFO:tasks.workunit.client.1.smithi112.stdout:0/884: dread d3/d4a/d4e/dc2/d1a/d21/f6d [0,4194304] 0 2024-09-21T10:40:55.075 INFO:tasks.workunit.client.1.smithi112.stdout:4/901: creat de/d33/d2f/d71/d40/d4f/d10c/f131 x:0 0 0 2024-09-21T10:40:55.075 INFO:tasks.workunit.client.1.smithi112.stdout:4/902: fsync de/d33/d2f/f52 0 2024-09-21T10:40:55.079 INFO:tasks.workunit.client.0.smithi060.stdout:0/201: write d5/d10/da/fc [1298117,34521] 0 2024-09-21T10:40:55.080 INFO:tasks.workunit.client.0.smithi060.stdout:9/280: truncate d3/f35 1928267 0 2024-09-21T10:40:55.082 INFO:tasks.workunit.client.1.smithi112.stdout:3/869: rename d2/d2f/dc5/dcc to d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/d98/d120 0 2024-09-21T10:40:55.084 INFO:tasks.workunit.client.0.smithi060.stdout:1/232: symlink d6/d24/da/db/l51 0 2024-09-21T10:40:55.085 INFO:tasks.workunit.client.1.smithi112.stdout:3/870: dread d2/d2f/d3f/ddf/d31/d37/f83 [0,4194304] 0 2024-09-21T10:40:55.085 INFO:tasks.workunit.client.1.smithi112.stdout:4/903: dread de/d18/f76 [4194304,4194304] 0 2024-09-21T10:40:55.085 INFO:tasks.workunit.client.1.smithi112.stdout:8/929: symlink d8/d9/dd/d76/d97/dfa/l113 0 2024-09-21T10:40:55.087 INFO:tasks.workunit.client.0.smithi060.stdout:5/195: link d5/d9/d10/d19/f33 d5/d9/f40 0 2024-09-21T10:40:55.087 INFO:tasks.workunit.client.0.smithi060.stdout:4/311: dwrite d0/d5/d12/d3d/f64 [0,4194304] 0 2024-09-21T10:40:55.088 INFO:tasks.workunit.client.0.smithi060.stdout:0/202: dread d5/d10/da/f12 [4194304,4194304] 0 2024-09-21T10:40:55.088 INFO:tasks.workunit.client.1.smithi112.stdout:6/925: rmdir d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d11b 39 2024-09-21T10:40:55.089 INFO:tasks.workunit.client.1.smithi112.stdout:6/926: stat d4/d6/d75/db7/cfe 0 2024-09-21T10:40:55.089 INFO:tasks.workunit.client.0.smithi060.stdout:5/196: dread d5/d9/d10/d19/f31 [0,4194304] 0 2024-09-21T10:40:55.089 INFO:tasks.workunit.client.0.smithi060.stdout:5/197: write d5/d9/fe [4423121,129989] 0 2024-09-21T10:40:55.089 INFO:tasks.workunit.client.0.smithi060.stdout:5/198: chown d5/d9/d13/f20 922 1 2024-09-21T10:40:55.089 INFO:tasks.workunit.client.0.smithi060.stdout:5/199: write d5/d9/d10/d19/f33 [1555821,121181] 0 2024-09-21T10:40:55.090 INFO:tasks.workunit.client.0.smithi060.stdout:7/248: symlink da/d14/d35/d32/l57 0 2024-09-21T10:40:55.094 INFO:tasks.workunit.client.1.smithi112.stdout:2/777: creat d0/da4/dbe/df4/f100 x:0 0 0 2024-09-21T10:40:55.096 INFO:tasks.workunit.client.1.smithi112.stdout:0/885: mkdir d3/d4a/d4e/dc2/d1a/d21/d46/d122/d129 0 2024-09-21T10:40:55.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/778: dread d0/d12/d46/da0/db9/dbd/f73 [0,4194304] 0 2024-09-21T10:40:55.097 INFO:tasks.workunit.client.1.smithi112.stdout:2/779: fsync d0/d12/d46/da0/db9/fca 0 2024-09-21T10:40:55.100 INFO:tasks.workunit.client.0.smithi060.stdout:0/203: dread f2 [0,4194304] 0 2024-09-21T10:40:55.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/823: rename d7/d22/d41/d54/cc8 to d7/d22/d41/d4b/d5e/c10e 0 2024-09-21T10:40:55.100 INFO:tasks.workunit.client.1.smithi112.stdout:7/824: stat d7/f26 0 2024-09-21T10:40:55.102 INFO:tasks.workunit.client.1.smithi112.stdout:4/904: unlink de/d33/d2f/d71/c68 0 2024-09-21T10:40:55.103 INFO:tasks.workunit.client.0.smithi060.stdout:5/200: dwrite d5/d9/d10/d19/f37 [0,4194304] 0 2024-09-21T10:40:55.107 INFO:tasks.workunit.client.1.smithi112.stdout:6/927: unlink d4/d4f/f137 0 2024-09-21T10:40:55.111 INFO:tasks.workunit.client.0.smithi060.stdout:7/249: read f0 [3056193,12807] 0 2024-09-21T10:40:55.111 INFO:tasks.workunit.client.0.smithi060.stdout:0/204: write d5/d10/f9 [3179109,40947] 0 2024-09-21T10:40:55.111 INFO:tasks.workunit.client.0.smithi060.stdout:0/205: fsync d5/d10/da/f13 0 2024-09-21T10:40:55.111 INFO:tasks.workunit.client.0.smithi060.stdout:0/206: truncate d5/d10/d11/f28 46230 0 2024-09-21T10:40:55.119 INFO:tasks.workunit.client.1.smithi112.stdout:4/905: truncate de/d33/d6f/d9c/d3e/fbd 2573039 0 2024-09-21T10:40:55.119 INFO:tasks.workunit.client.1.smithi112.stdout:4/906: readlink de/d2a/d31/l4e 0 2024-09-21T10:40:55.121 INFO:tasks.workunit.client.1.smithi112.stdout:8/930: mknod d8/c114 0 2024-09-21T10:40:55.123 INFO:tasks.workunit.client.0.smithi060.stdout:8/211: mknod d2/d18/c4c 0 2024-09-21T10:40:55.123 INFO:tasks.workunit.client.0.smithi060.stdout:8/212: fsync d2/d26/f44 0 2024-09-21T10:40:55.124 INFO:tasks.workunit.client.1.smithi112.stdout:7/825: write d7/d22/f2e [992748,128384] 0 2024-09-21T10:40:55.124 INFO:tasks.workunit.client.1.smithi112.stdout:7/826: stat d7/d22/fdc 0 2024-09-21T10:40:55.124 INFO:tasks.workunit.client.1.smithi112.stdout:6/928: rmdir d4/d6/d75/dd8 0 2024-09-21T10:40:55.124 INFO:tasks.workunit.client.1.smithi112.stdout:6/929: chown d4/d6/da/d14/d49/fad 1117 1 2024-09-21T10:40:55.124 INFO:tasks.workunit.client.1.smithi112.stdout:6/930: chown d4/d6/da/d11/d1f/d22/d100 36658 1 2024-09-21T10:40:55.125 INFO:tasks.workunit.client.1.smithi112.stdout:2/780: dwrite d0/da4/dbe/fa7 [0,4194304] 0 2024-09-21T10:40:55.127 INFO:tasks.workunit.client.0.smithi060.stdout:2/145: symlink d3/d20/d17/l29 0 2024-09-21T10:40:55.129 INFO:tasks.workunit.client.1.smithi112.stdout:8/931: mkdir d8/d9/dd/d76/d97/d115 0 2024-09-21T10:40:55.130 INFO:tasks.workunit.client.1.smithi112.stdout:0/886: dwrite d3/d18/fdd [0,4194304] 0 2024-09-21T10:40:55.130 INFO:tasks.workunit.client.1.smithi112.stdout:0/887: fsync d3/d4a/d4e/dc2/d10/f3c 0 2024-09-21T10:40:55.131 INFO:tasks.workunit.client.0.smithi060.stdout:7/250: dwrite da/d14/d15/f13 [0,4194304] 0 2024-09-21T10:40:55.132 INFO:tasks.workunit.client.0.smithi060.stdout:8/213: dread d2/f23 [0,4194304] 0 2024-09-21T10:40:55.132 INFO:tasks.workunit.client.1.smithi112.stdout:7/827: creat d7/d22/d41/d56/dc9/dd3/dd8/f10f x:0 0 0 2024-09-21T10:40:55.135 INFO:tasks.workunit.client.0.smithi060.stdout:9/281: mkdir d3/d5e 0 2024-09-21T10:40:55.137 INFO:tasks.workunit.client.1.smithi112.stdout:6/931: mkdir d4/d6/da/d11/d1f/d22/d100/d12c/d144 0 2024-09-21T10:40:55.140 INFO:tasks.workunit.client.0.smithi060.stdout:1/233: rename d6/d24/da/db/dd/c27 to d6/d24/da/db/c52 0 2024-09-21T10:40:55.144 INFO:tasks.workunit.client.1.smithi112.stdout:4/907: rmdir de/d2a/dbf/d82 39 2024-09-21T10:40:55.145 INFO:tasks.workunit.client.1.smithi112.stdout:4/908: readlink de/l69 0 2024-09-21T10:40:55.146 INFO:tasks.workunit.client.0.smithi060.stdout:4/312: unlink d0/d5/d12/d3d/f64 0 2024-09-21T10:40:55.146 INFO:tasks.workunit.client.0.smithi060.stdout:4/313: stat d0/d5/d12/d20/d65/d51 0 2024-09-21T10:40:55.148 INFO:tasks.workunit.client.1.smithi112.stdout:5/915: sync 2024-09-21T10:40:55.148 INFO:tasks.workunit.client.1.smithi112.stdout:5/916: dread - d9/d15/d18/d20/f108 zero size 2024-09-21T10:40:55.148 INFO:tasks.workunit.client.1.smithi112.stdout:5/917: truncate d9/d15/d18/f39 2109024 0 2024-09-21T10:40:55.150 INFO:tasks.workunit.client.1.smithi112.stdout:2/781: dwrite d0/d12/f39 [0,4194304] 0 2024-09-21T10:40:55.150 INFO:tasks.workunit.client.1.smithi112.stdout:2/782: truncate d0/d12/f41 3769869 0 2024-09-21T10:40:55.150 INFO:tasks.workunit.client.1.smithi112.stdout:2/783: creat d0/d12/d77/f101 x:0 0 0 2024-09-21T10:40:55.150 INFO:tasks.workunit.client.1.smithi112.stdout:0/888: dwrite d3/d18/d45/fc4 [4194304,4194304] 0 2024-09-21T10:40:55.151 INFO:tasks.workunit.client.1.smithi112.stdout:8/932: dwrite d8/d9/dd/dab/d8e/fc6 [0,4194304] 0 2024-09-21T10:40:55.152 INFO:tasks.workunit.client.1.smithi112.stdout:7/828: creat d7/d22/d73/dee/f110 x:0 0 0 2024-09-21T10:40:55.152 INFO:tasks.workunit.client.1.smithi112.stdout:7/829: write d7/d22/d86/f7d [258306,101077] 0 2024-09-21T10:40:55.154 INFO:tasks.workunit.client.1.smithi112.stdout:8/933: dread d8/d9/dd/d2b/fca [0,4194304] 0 2024-09-21T10:40:55.155 INFO:tasks.workunit.client.0.smithi060.stdout:3/193: getdents d0/d2b 0 2024-09-21T10:40:55.156 INFO:tasks.workunit.client.1.smithi112.stdout:6/932: rename d4/d6/da/d11/d37/l41 to d4/d6/da/d14/d49/d62/dcf/l145 0 2024-09-21T10:40:55.158 INFO:tasks.workunit.client.0.smithi060.stdout:5/201: creat d5/d9/d3b/f41 x:0 0 0 2024-09-21T10:40:55.158 INFO:tasks.workunit.client.1.smithi112.stdout:5/918: dread d9/d15/d18/f77 [0,4194304] 0 2024-09-21T10:40:55.159 INFO:tasks.workunit.client.1.smithi112.stdout:4/909: mknod de/d2a/dbf/d82/de8/c132 0 2024-09-21T10:40:55.161 INFO:tasks.workunit.client.0.smithi060.stdout:0/207: symlink d5/d10/da/d16/d2a/l38 0 2024-09-21T10:40:55.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/208: dread d5/d10/d11/f28 [0,4194304] 0 2024-09-21T10:40:55.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/209: write d5/f21 [901806,124192] 0 2024-09-21T10:40:55.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/210: chown d5/f21 139144817 1 2024-09-21T10:40:55.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/211: creat d5/d10/da/f39 x:0 0 0 2024-09-21T10:40:55.167 INFO:tasks.workunit.client.0.smithi060.stdout:2/146: creat d3/d7/d24/f2a x:0 0 0 2024-09-21T10:40:55.168 INFO:tasks.workunit.client.0.smithi060.stdout:5/202: dread d5/d9/f1d [0,4194304] 0 2024-09-21T10:40:55.168 INFO:tasks.workunit.client.1.smithi112.stdout:0/889: mknod d3/d4a/d4e/dc2/d10/dc6/c12a 0 2024-09-21T10:40:55.168 INFO:tasks.workunit.client.1.smithi112.stdout:0/890: chown d3/d18/d52/d55/dcc/f10d 416508 1 2024-09-21T10:40:55.169 INFO:tasks.workunit.client.0.smithi060.stdout:8/214: truncate d2/f1e 5868902 0 2024-09-21T10:40:55.174 INFO:tasks.workunit.client.0.smithi060.stdout:9/282: mkdir d3/d16/d5f 0 2024-09-21T10:40:55.177 INFO:tasks.workunit.client.0.smithi060.stdout:7/251: rename da/d14/d2a/d49/d27/f39 to da/d14/d25/d56/f58 0 2024-09-21T10:40:55.180 INFO:tasks.workunit.client.0.smithi060.stdout:1/234: mknod d6/d24/da/db/de/d32/c53 0 2024-09-21T10:40:55.180 INFO:tasks.workunit.client.0.smithi060.stdout:1/235: fsync d6/d24/f49 0 2024-09-21T10:40:55.181 INFO:tasks.workunit.client.0.smithi060.stdout:8/215: write d2/f8 [2651623,74012] 0 2024-09-21T10:40:55.182 INFO:tasks.workunit.client.0.smithi060.stdout:8/216: read d2/d26/d37/f45 [268551,112515] 0 2024-09-21T10:40:55.182 INFO:tasks.workunit.client.0.smithi060.stdout:8/217: write d2/f15 [1748426,113604] 0 2024-09-21T10:40:55.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/194: unlink d0/f23 0 2024-09-21T10:40:55.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/195: chown d0/d1/l1f 3 1 2024-09-21T10:40:55.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/196: fdatasync d0/f1c 0 2024-09-21T10:40:55.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/197: write d0/f21 [88655,61279] 0 2024-09-21T10:40:55.196 INFO:tasks.workunit.client.1.smithi112.stdout:7/830: mkdir d7/d3d/da7/d111 0 2024-09-21T10:40:55.199 INFO:tasks.workunit.client.1.smithi112.stdout:8/934: link d8/d9/dd/d2b/f10a d8/d9/d3c/f116 0 2024-09-21T10:40:55.199 INFO:tasks.workunit.client.0.smithi060.stdout:7/252: dwrite da/d14/d35/f1d [0,4194304] 0 2024-09-21T10:40:55.201 INFO:tasks.workunit.client.1.smithi112.stdout:5/919: creat d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/f128 x:0 0 0 2024-09-21T10:40:55.201 INFO:tasks.workunit.client.1.smithi112.stdout:5/920: creat d9/d15/d18/d3a/f129 x:0 0 0 2024-09-21T10:40:55.201 INFO:tasks.workunit.client.1.smithi112.stdout:5/921: stat d9/d8a 0 2024-09-21T10:40:55.202 INFO:tasks.workunit.client.1.smithi112.stdout:0/891: mknod d3/d18/dc0/c12b 0 2024-09-21T10:40:55.204 INFO:tasks.workunit.client.0.smithi060.stdout:5/203: rename d5/d9/l2c to d5/l42 0 2024-09-21T10:40:55.207 INFO:tasks.workunit.client.0.smithi060.stdout:1/236: unlink d6/d24/da/c13 0 2024-09-21T10:40:55.208 INFO:tasks.workunit.client.1.smithi112.stdout:8/935: symlink d8/d9/dd/dab/d101/l117 0 2024-09-21T10:40:55.208 INFO:tasks.workunit.client.1.smithi112.stdout:8/936: fdatasync d8/d9/dd/dab/d8e/dcb/d82/f87 0 2024-09-21T10:40:55.209 INFO:tasks.workunit.client.0.smithi060.stdout:3/198: mknod d0/d1/d1e/c39 0 2024-09-21T10:40:55.210 INFO:tasks.workunit.client.0.smithi060.stdout:3/199: readlink d0/lc 0 2024-09-21T10:40:55.210 INFO:tasks.workunit.client.1.smithi112.stdout:7/831: getdents d7/d22/d73 0 2024-09-21T10:40:55.211 INFO:tasks.workunit.client.1.smithi112.stdout:7/832: truncate d7/d22/d41/d56/d5c/f92 619869 0 2024-09-21T10:40:55.211 INFO:tasks.workunit.client.0.smithi060.stdout:5/204: truncate d5/d9/d10/d19/d21/f2d 7299467 0 2024-09-21T10:40:55.211 INFO:tasks.workunit.client.0.smithi060.stdout:5/205: stat d5/d9/d10/d19/f37 0 2024-09-21T10:40:55.211 INFO:tasks.workunit.client.0.smithi060.stdout:5/206: read - d5/d9/d10/d19/f32 zero size 2024-09-21T10:40:55.214 INFO:tasks.workunit.client.0.smithi060.stdout:1/237: link d6/d24/da/db/c19 d6/d24/c54 0 2024-09-21T10:40:55.215 INFO:tasks.workunit.client.0.smithi060.stdout:3/200: creat d0/d1/d11/d2a/f3a x:0 0 0 2024-09-21T10:40:55.215 INFO:tasks.workunit.client.0.smithi060.stdout:3/201: chown d0/d1/f20 731025 1 2024-09-21T10:40:55.215 INFO:tasks.workunit.client.0.smithi060.stdout:3/202: truncate d0/d1/f26 979418 0 2024-09-21T10:40:55.218 INFO:tasks.workunit.client.0.smithi060.stdout:5/207: dread d5/f16 [0,4194304] 0 2024-09-21T10:40:55.223 INFO:tasks.workunit.client.0.smithi060.stdout:1/238: write d6/f2c [2892890,14694] 0 2024-09-21T10:40:55.223 INFO:tasks.workunit.client.0.smithi060.stdout:1/239: creat d6/d24/da/db/d1c/f55 x:0 0 0 2024-09-21T10:40:55.226 INFO:tasks.workunit.client.1.smithi112.stdout:2/784: dwrite d0/da4/dbe/fed [0,4194304] 0 2024-09-21T10:40:55.227 INFO:tasks.workunit.client.0.smithi060.stdout:5/208: write d5/d9/fe [1560733,63616] 0 2024-09-21T10:40:55.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/209: creat d5/d9/d3e/f43 x:0 0 0 2024-09-21T10:40:55.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/210: dread - d5/d9/d3b/f41 zero size 2024-09-21T10:40:55.229 INFO:tasks.workunit.client.1.smithi112.stdout:2/785: dread d0/d12/d76/f94 [0,4194304] 0 2024-09-21T10:40:55.229 INFO:tasks.workunit.client.0.smithi060.stdout:7/253: write da/d14/f19 [755287,56798] 0 2024-09-21T10:40:55.233 INFO:tasks.workunit.client.1.smithi112.stdout:7/833: dread d7/d22/f28 [0,4194304] 0 2024-09-21T10:40:55.233 INFO:tasks.workunit.client.0.smithi060.stdout:5/211: rmdir d5/d9/d3b 39 2024-09-21T10:40:55.236 INFO:tasks.workunit.client.1.smithi112.stdout:7/834: symlink d7/d22/d41/d54/l112 0 2024-09-21T10:40:55.236 INFO:tasks.workunit.client.1.smithi112.stdout:7/835: readlink d7/l81 0 2024-09-21T10:40:55.236 INFO:tasks.workunit.client.1.smithi112.stdout:7/836: write d7/d22/f63 [4479455,113900] 0 2024-09-21T10:40:55.237 INFO:tasks.workunit.client.0.smithi060.stdout:2/147: write d3/f12 [5810937,62462] 0 2024-09-21T10:40:55.237 INFO:tasks.workunit.client.0.smithi060.stdout:2/148: rename d3/d7 to d3/d7/d24/d25/d2b 22 2024-09-21T10:40:55.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/212: creat d5/d9/d10/d19/d21/f44 x:0 0 0 2024-09-21T10:40:55.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/213: readlink d5/d9/d10/l1f 0 2024-09-21T10:40:55.240 INFO:tasks.workunit.client.0.smithi060.stdout:2/149: mknod d3/d20/d15/c2c 0 2024-09-21T10:40:55.241 INFO:tasks.workunit.client.1.smithi112.stdout:7/837: creat d7/d22/d41/d4b/d52/d77/dbd/de4/f113 x:0 0 0 2024-09-21T10:40:55.242 INFO:tasks.workunit.client.0.smithi060.stdout:5/214: mkdir d5/d45 0 2024-09-21T10:40:55.243 INFO:tasks.workunit.client.1.smithi112.stdout:5/922: dread d9/f11 [0,4194304] 0 2024-09-21T10:40:55.243 INFO:tasks.workunit.client.1.smithi112.stdout:4/910: dwrite de/d18/d6d/f8c [0,4194304] 0 2024-09-21T10:40:55.243 INFO:tasks.workunit.client.1.smithi112.stdout:5/923: truncate d9/d15/d18/d20/f108 500668 0 2024-09-21T10:40:55.244 INFO:tasks.workunit.client.0.smithi060.stdout:5/215: creat d5/d45/f46 x:0 0 0 2024-09-21T10:40:55.245 INFO:tasks.workunit.client.1.smithi112.stdout:5/924: symlink d9/d15/d18/d3a/d4b/db4/l12a 0 2024-09-21T10:40:55.254 INFO:tasks.workunit.client.1.smithi112.stdout:7/838: dread f6 [0,4194304] 0 2024-09-21T10:40:55.256 INFO:tasks.workunit.client.1.smithi112.stdout:7/839: dread d7/d22/d41/d56/d72/dc4/d4a/ff7 [0,4194304] 0 2024-09-21T10:40:55.256 INFO:tasks.workunit.client.1.smithi112.stdout:7/840: chown d7/l11 301 1 2024-09-21T10:40:55.256 INFO:tasks.workunit.client.1.smithi112.stdout:5/925: dread d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd9 [0,4194304] 0 2024-09-21T10:40:55.257 INFO:tasks.workunit.client.1.smithi112.stdout:5/926: mkdir d9/d15/d18/d3a/d4b/d71/d113/d12b 0 2024-09-21T10:40:55.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/927: dread d9/d15/d18/d3a/d4b/ff7 [0,4194304] 0 2024-09-21T10:40:55.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/928: stat d9/d15/d18/d3a/f11f 0 2024-09-21T10:40:55.263 INFO:tasks.workunit.client.1.smithi112.stdout:5/929: dread d9/d15/d18/d3a/d4b/ff7 [0,4194304] 0 2024-09-21T10:40:55.268 INFO:tasks.workunit.client.0.smithi060.stdout:9/283: dwrite d3/fc [0,4194304] 0 2024-09-21T10:40:55.270 INFO:tasks.workunit.client.0.smithi060.stdout:8/218: dwrite d2/d26/f35 [0,4194304] 0 2024-09-21T10:40:55.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/786: dwrite d0/d12/d77/f101 [0,4194304] 0 2024-09-21T10:40:55.271 INFO:tasks.workunit.client.0.smithi060.stdout:3/203: dwrite d0/d1/f26 [0,4194304] 0 2024-09-21T10:40:55.271 INFO:tasks.workunit.client.0.smithi060.stdout:1/240: dwrite d6/d24/da/db/dd/f3d [0,4194304] 0 2024-09-21T10:40:55.271 INFO:tasks.workunit.client.0.smithi060.stdout:1/241: getdents d6/d4a 0 2024-09-21T10:40:55.272 INFO:tasks.workunit.client.0.smithi060.stdout:0/212: dwrite d5/d10/da/f13 [0,4194304] 0 2024-09-21T10:40:55.276 INFO:tasks.workunit.client.1.smithi112.stdout:7/841: dwrite d7/d22/d41/d4b/da2/fba [0,4194304] 0 2024-09-21T10:40:55.283 INFO:tasks.workunit.client.0.smithi060.stdout:3/204: symlink d0/d2b/l3b 0 2024-09-21T10:40:55.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/842: dread d7/d22/d41/d56/dc9/fd1 [4194304,4194304] 0 2024-09-21T10:40:55.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/843: creat d7/d22/d41/d4b/d52/d77/dbd/de4/f114 x:0 0 0 2024-09-21T10:40:55.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/844: creat d7/d22/d41/d4b/da2/dea/f115 x:0 0 0 2024-09-21T10:40:55.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/845: chown d7/d22/d73/fa8 301136 1 2024-09-21T10:40:55.284 INFO:tasks.workunit.client.1.smithi112.stdout:9/905: sync 2024-09-21T10:40:55.285 INFO:tasks.workunit.client.1.smithi112.stdout:2/787: dread d0/d12/d46/da0/db9/dbd/d62/d63/f35 [0,4194304] 0 2024-09-21T10:40:55.288 INFO:tasks.workunit.client.0.smithi060.stdout:1/242: link d6/d24/da/db/d1c/f4c d6/d24/da/db/f56 0 2024-09-21T10:40:55.288 INFO:tasks.workunit.client.0.smithi060.stdout:1/243: dread - d6/d24/da/db/d1c/f55 zero size 2024-09-21T10:40:55.288 INFO:tasks.workunit.client.0.smithi060.stdout:0/213: dread d5/d10/da/d15/f1b [0,4194304] 0 2024-09-21T10:40:55.291 INFO:tasks.workunit.client.1.smithi112.stdout:7/846: creat d7/d22/d41/d80/f116 x:0 0 0 2024-09-21T10:40:55.293 INFO:tasks.workunit.client.1.smithi112.stdout:9/906: creat d1/d2/d27/d37/d3b/d69/d77/dca/dae/f147 x:0 0 0 2024-09-21T10:40:55.294 INFO:tasks.workunit.client.0.smithi060.stdout:3/205: symlink d0/l3c 0 2024-09-21T10:40:55.294 INFO:tasks.workunit.client.0.smithi060.stdout:3/206: write d0/f28 [1022198,107326] 0 2024-09-21T10:40:55.294 INFO:tasks.workunit.client.0.smithi060.stdout:3/207: creat d0/d1/d11/d2a/f3d x:0 0 0 2024-09-21T10:40:55.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/847: creat d7/d22/d41/d4b/d52/d77/f117 x:0 0 0 2024-09-21T10:40:55.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/848: readlink d7/d22/d41/d54/d4d/lc2 0 2024-09-21T10:40:55.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/849: creat d7/d22/d41/d56/dc9/dd3/dd8/f118 x:0 0 0 2024-09-21T10:40:55.296 INFO:tasks.workunit.client.1.smithi112.stdout:7/850: chown d7/d22/d41/d56/d72/dc4/cf3 6628353 1 2024-09-21T10:40:55.296 INFO:tasks.workunit.client.0.smithi060.stdout:1/244: creat d6/d24/da/db/f57 x:0 0 0 2024-09-21T10:40:55.296 INFO:tasks.workunit.client.0.smithi060.stdout:1/245: write d6/d24/da/db/d1c/f36 [5146614,15949] 0 2024-09-21T10:40:55.297 INFO:tasks.workunit.client.1.smithi112.stdout:2/788: dread d0/dd/d47/f50 [0,4194304] 0 2024-09-21T10:40:55.298 INFO:tasks.workunit.client.0.smithi060.stdout:0/214: rmdir d5/d10/da/d15/d31 0 2024-09-21T10:40:55.298 INFO:tasks.workunit.client.0.smithi060.stdout:0/215: fsync d5/d10/f8 0 2024-09-21T10:40:55.298 INFO:tasks.workunit.client.0.smithi060.stdout:0/216: chown d5/d10/d11 3205 1 2024-09-21T10:40:55.298 INFO:tasks.workunit.client.0.smithi060.stdout:1/246: dread d6/d24/da/db/dd/f1d [0,4194304] 0 2024-09-21T10:40:55.299 INFO:tasks.workunit.client.0.smithi060.stdout:1/247: fdatasync d6/d24/da/db/d1c/f55 0 2024-09-21T10:40:55.301 INFO:tasks.workunit.client.1.smithi112.stdout:5/930: dwrite d9/d15/d18/d3a/d4b/d74/fc1 [4194304,4194304] 0 2024-09-21T10:40:55.302 INFO:tasks.workunit.client.1.smithi112.stdout:7/851: mknod d7/d22/d41/d4b/d52/da3/c119 0 2024-09-21T10:40:55.302 INFO:tasks.workunit.client.1.smithi112.stdout:7/852: write d7/d22/d73/ffe [39075,95078] 0 2024-09-21T10:40:55.302 INFO:tasks.workunit.client.1.smithi112.stdout:7/853: truncate d7/d22/d41/d56/dc9/dd3/dd8/f10f 107533 0 2024-09-21T10:40:55.302 INFO:tasks.workunit.client.0.smithi060.stdout:9/284: dwrite d3/f4f [0,4194304] 0 2024-09-21T10:40:55.303 INFO:tasks.workunit.client.0.smithi060.stdout:9/285: getdents d3/d5e 0 2024-09-21T10:40:55.303 INFO:tasks.workunit.client.0.smithi060.stdout:3/208: creat d0/d1/d1e/f3e x:0 0 0 2024-09-21T10:40:55.303 INFO:tasks.workunit.client.0.smithi060.stdout:3/209: chown d0/c2f 761 1 2024-09-21T10:40:55.303 INFO:tasks.workunit.client.0.smithi060.stdout:3/210: chown d0/d1/f14 141998846 1 2024-09-21T10:40:55.304 INFO:tasks.workunit.client.1.smithi112.stdout:2/789: creat d0/da2/dd3/f102 x:0 0 0 2024-09-21T10:40:55.306 INFO:tasks.workunit.client.1.smithi112.stdout:9/907: dread d1/d2/d27/d62/d70/fa6 [0,4194304] 0 2024-09-21T10:40:55.306 INFO:tasks.workunit.client.0.smithi060.stdout:8/219: dwrite d2/f23 [4194304,4194304] 0 2024-09-21T10:40:55.309 INFO:tasks.workunit.client.0.smithi060.stdout:0/217: rmdir d5/d10 39 2024-09-21T10:40:55.309 INFO:tasks.workunit.client.0.smithi060.stdout:0/218: dread - d5/d10/da/f39 zero size 2024-09-21T10:40:55.310 INFO:tasks.workunit.client.0.smithi060.stdout:9/286: write d3/fe [3671148,24039] 0 2024-09-21T10:40:55.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/287: write d3/f10 [3589229,38398] 0 2024-09-21T10:40:55.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/288: chown d3/c37 548 1 2024-09-21T10:40:55.311 INFO:tasks.workunit.client.0.smithi060.stdout:9/289: chown d3/d15/f2b 7467390 1 2024-09-21T10:40:55.315 INFO:tasks.workunit.client.1.smithi112.stdout:2/790: dread d0/f2d [0,4194304] 0 2024-09-21T10:40:55.316 INFO:tasks.workunit.client.0.smithi060.stdout:0/219: read d5/f21 [151230,20174] 0 2024-09-21T10:40:55.319 INFO:tasks.workunit.client.1.smithi112.stdout:7/854: mknod d7/d3d/da7/d105/c11a 0 2024-09-21T10:40:55.320 INFO:tasks.workunit.client.1.smithi112.stdout:9/908: creat d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/f148 x:0 0 0 2024-09-21T10:40:55.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/791: creat d0/da2/f103 x:0 0 0 2024-09-21T10:40:55.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/792: creat d0/d12/f104 x:0 0 0 2024-09-21T10:40:55.323 INFO:tasks.workunit.client.1.smithi112.stdout:2/793: fdatasync d0/d12/d46/da0/db9/dbd/f5a 0 2024-09-21T10:40:55.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/216: getdents d5/d9/d10/d19/d21 0 2024-09-21T10:40:55.324 INFO:tasks.workunit.client.0.smithi060.stdout:0/220: getdents d5/d10 0 2024-09-21T10:40:55.326 INFO:tasks.workunit.client.0.smithi060.stdout:8/220: dwrite d2/d18/f34 [0,4194304] 0 2024-09-21T10:40:55.326 INFO:tasks.workunit.client.1.smithi112.stdout:9/909: mknod d1/d2/d27/d37/c149 0 2024-09-21T10:40:55.328 INFO:tasks.workunit.client.0.smithi060.stdout:3/211: dwrite d0/d1/d1e/f3e [0,4194304] 0 2024-09-21T10:40:55.328 INFO:tasks.workunit.client.0.smithi060.stdout:3/212: chown d0/d1/l1f 66207 1 2024-09-21T10:40:55.328 INFO:tasks.workunit.client.0.smithi060.stdout:5/217: link d5/d9/d10/d19/f33 d5/d9/d10/d19/d21/d30/f47 0 2024-09-21T10:40:55.331 INFO:tasks.workunit.client.1.smithi112.stdout:3/871: sync 2024-09-21T10:40:55.331 INFO:tasks.workunit.client.1.smithi112.stdout:2/794: symlink d0/da4/dbe/l105 0 2024-09-21T10:40:55.333 INFO:tasks.workunit.client.1.smithi112.stdout:9/910: mkdir d1/d2/d27/d62/da1/d122/d14a 0 2024-09-21T10:40:55.334 INFO:tasks.workunit.client.0.smithi060.stdout:8/221: mkdir d2/d18/d4b/d4d 0 2024-09-21T10:40:55.336 INFO:tasks.workunit.client.1.smithi112.stdout:7/855: dwrite d7/d22/d41/d54/d4d/fad [0,4194304] 0 2024-09-21T10:40:55.336 INFO:tasks.workunit.client.1.smithi112.stdout:3/872: symlink d2/d2f/d3f/ddf/l121 0 2024-09-21T10:40:55.336 INFO:tasks.workunit.client.1.smithi112.stdout:3/873: truncate d2/fa4 1230163 0 2024-09-21T10:40:55.337 INFO:tasks.workunit.client.1.smithi112.stdout:2/795: truncate d0/dd/fc2 589624 0 2024-09-21T10:40:55.339 INFO:tasks.workunit.client.1.smithi112.stdout:9/911: mknod d1/c14b 0 2024-09-21T10:40:55.339 INFO:tasks.workunit.client.1.smithi112.stdout:9/912: dread - d1/d2/d27/d3a/d6b/d30/d121/f13d zero size 2024-09-21T10:40:55.339 INFO:tasks.workunit.client.0.smithi060.stdout:3/213: creat d0/d1/f3f x:0 0 0 2024-09-21T10:40:55.341 INFO:tasks.workunit.client.0.smithi060.stdout:5/218: creat d5/f48 x:0 0 0 2024-09-21T10:40:55.341 INFO:tasks.workunit.client.0.smithi060.stdout:5/219: chown d5/f16 38626128 1 2024-09-21T10:40:55.341 INFO:tasks.workunit.client.0.smithi060.stdout:5/220: chown d5/d9/fe 4681180 1 2024-09-21T10:40:55.345 INFO:tasks.workunit.client.0.smithi060.stdout:8/222: link d2/d18/c33 d2/c4e 0 2024-09-21T10:40:55.345 INFO:tasks.workunit.client.0.smithi060.stdout:8/223: fdatasync d2/f14 0 2024-09-21T10:40:55.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/221: dwrite d5/d10/d11/f28 [0,4194304] 0 2024-09-21T10:40:55.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/222: readlink d5/d10/ld 0 2024-09-21T10:40:55.349 INFO:tasks.workunit.client.1.smithi112.stdout:2/796: read d0/da4/dbe/df4/d7e/d8f/f3c [1404635,67734] 0 2024-09-21T10:40:55.349 INFO:tasks.workunit.client.0.smithi060.stdout:8/224: symlink d2/d18/d4b/d4d/l4f 0 2024-09-21T10:40:55.353 INFO:tasks.workunit.client.0.smithi060.stdout:8/225: rmdir d2/d18/d4b 39 2024-09-21T10:40:55.353 INFO:tasks.workunit.client.0.smithi060.stdout:8/226: fsync d2/f14 0 2024-09-21T10:40:55.355 INFO:tasks.workunit.client.0.smithi060.stdout:3/214: dwrite d0/d1/d1e/f37 [0,4194304] 0 2024-09-21T10:40:55.355 INFO:tasks.workunit.client.1.smithi112.stdout:7/856: unlink d7/d22/d41/d56/dc9/dd3/dd8/f118 0 2024-09-21T10:40:55.356 INFO:tasks.workunit.client.0.smithi060.stdout:8/227: symlink d2/d26/d37/l50 0 2024-09-21T10:40:55.356 INFO:tasks.workunit.client.0.smithi060.stdout:8/228: chown d2/c1b 112 1 2024-09-21T10:40:55.356 INFO:tasks.workunit.client.0.smithi060.stdout:8/229: dread - d2/f14 zero size 2024-09-21T10:40:55.356 INFO:tasks.workunit.client.0.smithi060.stdout:8/230: fsync d2/f47 0 2024-09-21T10:40:55.359 INFO:tasks.workunit.client.0.smithi060.stdout:0/223: dread d5/d10/d11/f28 [0,4194304] 0 2024-09-21T10:40:55.360 INFO:tasks.workunit.client.1.smithi112.stdout:9/913: getdents d1/d2/d27/d37/d3b/d69/d77/da0/de4/d12c 0 2024-09-21T10:40:55.363 INFO:tasks.workunit.client.1.smithi112.stdout:2/797: creat d0/da4/dbe/df4/d7e/f106 x:0 0 0 2024-09-21T10:40:55.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/221: dwrite d5/d9/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:40:55.365 INFO:tasks.workunit.client.0.smithi060.stdout:3/215: unlink d0/d1/d11/d2a/f3a 0 2024-09-21T10:40:55.365 INFO:tasks.workunit.client.0.smithi060.stdout:3/216: readlink d0/d1/l1f 0 2024-09-21T10:40:55.366 INFO:tasks.workunit.client.1.smithi112.stdout:7/857: creat d7/d22/d41/d56/d72/dc4/d4a/f11b x:0 0 0 2024-09-21T10:40:55.369 INFO:tasks.workunit.client.0.smithi060.stdout:0/224: dread d5/f25 [0,4194304] 0 2024-09-21T10:40:55.369 INFO:tasks.workunit.client.1.smithi112.stdout:9/914: getdents d1/d2/d27/d37/d3b 0 2024-09-21T10:40:55.371 INFO:tasks.workunit.client.0.smithi060.stdout:8/231: dwrite d2/f15 [0,4194304] 0 2024-09-21T10:40:55.371 INFO:tasks.workunit.client.1.smithi112.stdout:7/858: creat d7/d22/d103/f11c x:0 0 0 2024-09-21T10:40:55.373 INFO:tasks.workunit.client.1.smithi112.stdout:2/798: dread d0/da4/dbe/fed [0,4194304] 0 2024-09-21T10:40:55.373 INFO:tasks.workunit.client.1.smithi112.stdout:3/874: rename d2/d2f/d3f/ddf/d31/d2a/d39/d3a/c58 to d2/d2f/d3f/ddf/d31/d2a/d39/d3a/c122 0 2024-09-21T10:40:55.373 INFO:tasks.workunit.client.1.smithi112.stdout:3/875: write d2/f18 [4652002,118974] 0 2024-09-21T10:40:55.376 INFO:tasks.workunit.client.1.smithi112.stdout:9/915: creat d1/d2/d27/d37/d3b/f14c x:0 0 0 2024-09-21T10:40:55.377 INFO:tasks.workunit.client.0.smithi060.stdout:0/225: write d5/d10/d11/f28 [2088506,7060] 0 2024-09-21T10:40:55.377 INFO:tasks.workunit.client.0.smithi060.stdout:0/226: rename d5/d10/da/d15/d17 to d5/d10/da/d15/d17/d3a 22 2024-09-21T10:40:55.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/859: rename d7/d22/d41/d4b/d52/da3 to d7/d22/d73/d11d 0 2024-09-21T10:40:55.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/860: fdatasync d7/d22/d78/f100 0 2024-09-21T10:40:55.379 INFO:tasks.workunit.client.1.smithi112.stdout:7/861: dread - d7/d22/d73/dee/f110 zero size 2024-09-21T10:40:55.380 INFO:tasks.workunit.client.0.smithi060.stdout:8/232: link d2/c16 d2/c51 0 2024-09-21T10:40:55.382 INFO:tasks.workunit.client.1.smithi112.stdout:2/799: creat d0/d12/d46/f107 x:0 0 0 2024-09-21T10:40:55.387 INFO:tasks.workunit.client.0.smithi060.stdout:0/227: write d5/d10/da/d16/f27 [3055176,36320] 0 2024-09-21T10:40:55.388 INFO:tasks.workunit.client.1.smithi112.stdout:3/876: rename d2/d2f/d3f/ddf/d31/d2a/d39/d60/l88 to d2/dd5/d107/l123 0 2024-09-21T10:40:55.388 INFO:tasks.workunit.client.1.smithi112.stdout:3/877: dread - d2/d2f/d3f/ddf/d31/d2a/d39/d3a/f112 zero size 2024-09-21T10:40:55.388 INFO:tasks.workunit.client.0.smithi060.stdout:5/222: dwrite d5/d9/d13/f17 [0,4194304] 0 2024-09-21T10:40:55.389 INFO:tasks.workunit.client.0.smithi060.stdout:5/223: dread - d5/d9/d10/d19/f32 zero size 2024-09-21T10:40:55.389 INFO:tasks.workunit.client.0.smithi060.stdout:8/233: rename d2/l19 to d2/d18/d4b/d4d/l52 0 2024-09-21T10:40:55.389 INFO:tasks.workunit.client.0.smithi060.stdout:8/234: chown d2/d18/l1a 401297247 1 2024-09-21T10:40:55.389 INFO:tasks.workunit.client.1.smithi112.stdout:9/916: read d1/d2/d27/d3a/d6b/d30/fd3 [1937974,2186] 0 2024-09-21T10:40:55.390 INFO:tasks.workunit.client.1.smithi112.stdout:7/862: symlink d7/d22/d73/dee/l11e 0 2024-09-21T10:40:55.393 INFO:tasks.workunit.client.1.smithi112.stdout:9/917: creat d1/d2/d27/d62/d70/d12d/f14d x:0 0 0 2024-09-21T10:40:55.394 INFO:tasks.workunit.client.1.smithi112.stdout:5/931: dwrite d9/d15/d18/f31 [0,4194304] 0 2024-09-21T10:40:55.395 INFO:tasks.workunit.client.0.smithi060.stdout:0/228: unlink d5/d10/da/d16/f19 0 2024-09-21T10:40:55.395 INFO:tasks.workunit.client.0.smithi060.stdout:0/229: creat d5/d10/d11/f3b x:0 0 0 2024-09-21T10:40:55.395 INFO:tasks.workunit.client.1.smithi112.stdout:2/800: write d0/dd/d47/f58 [2201475,54185] 0 2024-09-21T10:40:55.396 INFO:tasks.workunit.client.1.smithi112.stdout:7/863: link d7/d22/d41/d4b/da2/dea/f106 d7/d22/d41/d56/d72/df0/f11f 0 2024-09-21T10:40:55.396 INFO:tasks.workunit.client.1.smithi112.stdout:7/864: fdatasync d7/d22/d41/d4b/d5e/f82 0 2024-09-21T10:40:55.398 INFO:tasks.workunit.client.0.smithi060.stdout:5/224: mkdir d5/d9/d10/d19/d21/d30/d49 0 2024-09-21T10:40:55.403 INFO:tasks.workunit.client.1.smithi112.stdout:5/932: dread d9/d15/d18/d20/d47/fed [0,4194304] 0 2024-09-21T10:40:55.404 INFO:tasks.workunit.client.1.smithi112.stdout:7/865: write d7/d22/d73/faf [921687,22290] 0 2024-09-21T10:40:55.405 INFO:tasks.workunit.client.1.smithi112.stdout:2/801: rename d0/d12/d46/da0/db9/dbd/d62/d89 to d0/d12/d46/d86/dc0/dc8/d108 0 2024-09-21T10:40:55.406 INFO:tasks.workunit.client.0.smithi060.stdout:0/230: rename d5/d10/da/d16/l2b to d5/d10/da/d20/l3c 0 2024-09-21T10:40:55.407 INFO:tasks.workunit.client.0.smithi060.stdout:5/225: mknod d5/d9/d10/d19/c4a 0 2024-09-21T10:40:55.408 INFO:tasks.workunit.client.1.smithi112.stdout:2/802: creat d0/d12/d46/da0/db9/f109 x:0 0 0 2024-09-21T10:40:55.411 INFO:tasks.workunit.client.1.smithi112.stdout:2/803: unlink d0/da4/dbe/fed 0 2024-09-21T10:40:55.411 INFO:tasks.workunit.client.1.smithi112.stdout:2/804: write d0/d12/d46/da0/db9/dbd/d62/d63/f35 [247256,3510] 0 2024-09-21T10:40:55.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/918: dwrite d1/f118 [0,4194304] 0 2024-09-21T10:40:55.412 INFO:tasks.workunit.client.1.smithi112.stdout:9/919: write d1/d2/d27/d37/f11a [287272,111314] 0 2024-09-21T10:40:55.412 INFO:tasks.workunit.client.1.smithi112.stdout:0/892: sync 2024-09-21T10:40:55.412 INFO:tasks.workunit.client.1.smithi112.stdout:8/937: sync 2024-09-21T10:40:55.413 INFO:tasks.workunit.client.1.smithi112.stdout:6/933: sync 2024-09-21T10:40:55.413 INFO:tasks.workunit.client.1.smithi112.stdout:6/934: chown d4/d6/da/d11/d37/d8b/da0/dfa/cb1 7369 1 2024-09-21T10:40:55.415 INFO:tasks.workunit.client.1.smithi112.stdout:2/805: link d0/d12/d46/da0/db9/dbd/d62/d63/l71 d0/d12/d46/d86/l10a 0 2024-09-21T10:40:55.415 INFO:tasks.workunit.client.1.smithi112.stdout:2/806: readlink d0/d12/d46/d86/dc0/dc8/d108/lf2 0 2024-09-21T10:40:55.418 INFO:tasks.workunit.client.1.smithi112.stdout:7/866: dread d7/d22/d41/d56/d72/dc4/fda [0,4194304] 0 2024-09-21T10:40:55.418 INFO:tasks.workunit.client.1.smithi112.stdout:7/867: dread - d7/d22/d41/d54/ff9 zero size 2024-09-21T10:40:55.419 INFO:tasks.workunit.client.1.smithi112.stdout:4/911: sync 2024-09-21T10:40:55.420 INFO:tasks.workunit.client.1.smithi112.stdout:5/933: read d9/d15/d18/d20/d47/dc6/df5/f10a [3286768,27573] 0 2024-09-21T10:40:55.420 INFO:tasks.workunit.client.1.smithi112.stdout:6/935: mkdir d4/d146 0 2024-09-21T10:40:55.421 INFO:tasks.workunit.client.0.smithi060.stdout:8/235: rmdir d2/d26/d37 39 2024-09-21T10:40:55.424 INFO:tasks.workunit.client.1.smithi112.stdout:7/868: creat d7/dbc/f120 x:0 0 0 2024-09-21T10:40:55.426 INFO:tasks.workunit.client.0.smithi060.stdout:8/236: unlink d2/c51 0 2024-09-21T10:40:55.430 INFO:tasks.workunit.client.1.smithi112.stdout:9/920: dread d1/d2/d27/d37/d3b/f78 [0,4194304] 0 2024-09-21T10:40:55.430 INFO:tasks.workunit.client.1.smithi112.stdout:9/921: write d1/d2/d27/d62/d70/fa6 [5013815,19063] 0 2024-09-21T10:40:55.430 INFO:tasks.workunit.client.1.smithi112.stdout:9/922: truncate d1/d2/f7b 4449877 0 2024-09-21T10:40:55.432 INFO:tasks.workunit.client.1.smithi112.stdout:4/912: rename de/d2a/dbf/f92 to de/d33/d2f/d35/d4c/d5c/dfa/f133 0 2024-09-21T10:40:55.435 INFO:tasks.workunit.client.0.smithi060.stdout:8/237: rename d2/d18/f2c to d2/d18/d4b/d4d/f53 0 2024-09-21T10:40:55.437 INFO:tasks.workunit.client.1.smithi112.stdout:6/936: truncate d4/d6/da/d11/d1f/fd9 221601 0 2024-09-21T10:40:55.437 INFO:tasks.workunit.client.1.smithi112.stdout:6/937: creat d4/d6/da/d11/d37/df6/f147 x:0 0 0 2024-09-21T10:40:55.439 INFO:tasks.workunit.client.0.smithi060.stdout:8/238: link d2/l48 d2/d18/l54 0 2024-09-21T10:40:55.441 INFO:tasks.workunit.client.0.smithi060.stdout:8/239: creat d2/d26/d37/f55 x:0 0 0 2024-09-21T10:40:55.448 INFO:tasks.workunit.client.1.smithi112.stdout:9/923: rmdir d1/d2/d27/d37/d3b/d69/d77/dca/dae 39 2024-09-21T10:40:55.448 INFO:tasks.workunit.client.1.smithi112.stdout:9/924: fdatasync d1/d2/d27/d62/d70/d12d/f14d 0 2024-09-21T10:40:55.449 INFO:tasks.workunit.client.1.smithi112.stdout:0/893: dwrite d3/d4a/d4e/dc2/fe [0,4194304] 0 2024-09-21T10:40:55.449 INFO:tasks.workunit.client.1.smithi112.stdout:9/925: creat d1/d2/d27/d62/da1/d122/d14a/f14e x:0 0 0 2024-09-21T10:40:55.451 INFO:tasks.workunit.client.1.smithi112.stdout:0/894: mknod d3/d18/d52/d55/dec/c12c 0 2024-09-21T10:40:55.453 INFO:tasks.workunit.client.1.smithi112.stdout:0/895: unlink d3/d23/f3f 0 2024-09-21T10:40:55.454 INFO:tasks.workunit.client.1.smithi112.stdout:0/896: creat d3/d4a/d4e/dc2/d43/d115/f12d x:0 0 0 2024-09-21T10:40:55.462 INFO:tasks.workunit.client.0.smithi060.stdout:5/226: dwrite d5/d9/d10/d19/f33 [0,4194304] 0 2024-09-21T10:40:55.462 INFO:tasks.workunit.client.0.smithi060.stdout:5/227: creat d5/d45/f4b x:0 0 0 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/231: dwrite d5/d10/d11/f28 [4194304,4194304] 0 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/232: write d5/f25 [2597714,96543] 0 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/233: chown d5/f21 367811 1 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/234: fdatasync d5/d10/da/f13 0 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/235: chown d5/d10/da/f13 1 1 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/236: chown d5/d10/da/f39 207954260 1 2024-09-21T10:40:55.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/237: chown l3 454620 1 2024-09-21T10:40:55.464 INFO:tasks.workunit.client.0.smithi060.stdout:5/228: mknod d5/d9/d10/d19/d21/d30/d49/c4c 0 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:2/807: dwrite d0/d12/d97/faa [8388608,4194304] 0 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/897: dread d3/d4a/f6a [0,4194304] 0 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:0/898: chown d3/d4a/d4e/dc2/d1a/d21/c2d 875 1 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:5/934: dwrite d9/d15/d18/d20/f108 [0,4194304] 0 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:7/869: dwrite d7/d22/d41/d56/dc9/dd3/dd8/f10f [0,4194304] 0 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:7/870: stat d7/d3d/da7/d111 0 2024-09-21T10:40:55.465 INFO:tasks.workunit.client.1.smithi112.stdout:7/871: write d7/dbc/fcb [1678997,79018] 0 2024-09-21T10:40:55.467 INFO:tasks.workunit.client.0.smithi060.stdout:0/238: creat d5/d10/f3d x:0 0 0 2024-09-21T10:40:55.468 INFO:tasks.workunit.client.1.smithi112.stdout:2/808: creat d0/d12/d46/d86/dc0/dc8/d108/f10b x:0 0 0 2024-09-21T10:40:55.468 INFO:tasks.workunit.client.1.smithi112.stdout:2/809: stat d0/d12/f41 0 2024-09-21T10:40:55.469 INFO:tasks.workunit.client.0.smithi060.stdout:5/229: symlink d5/d9/d10/d19/d21/d30/d49/l4d 0 2024-09-21T10:40:55.469 INFO:tasks.workunit.client.0.smithi060.stdout:5/230: fsync d5/d9/d10/d19/f33 0 2024-09-21T10:40:55.470 INFO:tasks.workunit.client.0.smithi060.stdout:8/240: getdents d2 0 2024-09-21T10:40:55.473 INFO:tasks.workunit.client.0.smithi060.stdout:5/231: creat d5/d9/d10/d19/f4e x:0 0 0 2024-09-21T10:40:55.473 INFO:tasks.workunit.client.0.smithi060.stdout:5/232: read - d5/d9/d10/d19/d21/f44 zero size 2024-09-21T10:40:55.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/239: dread d5/d10/f8 [4194304,4194304] 0 2024-09-21T10:40:55.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/240: fsync d5/d10/d11/f3b 0 2024-09-21T10:40:55.474 INFO:tasks.workunit.client.1.smithi112.stdout:0/899: mknod d3/d4a/d4e/dc2/d43/d119/c12e 0 2024-09-21T10:40:55.476 INFO:tasks.workunit.client.0.smithi060.stdout:8/241: rename d2/c3f to d2/d18/d4b/c56 0 2024-09-21T10:40:55.477 INFO:tasks.workunit.client.1.smithi112.stdout:9/926: dwrite d1/d2/f5 [0,4194304] 0 2024-09-21T10:40:55.478 INFO:tasks.workunit.client.0.smithi060.stdout:0/241: rmdir d5/d10/da/d15 39 2024-09-21T10:40:55.478 INFO:tasks.workunit.client.0.smithi060.stdout:0/242: creat d5/f3e x:0 0 0 2024-09-21T10:40:55.478 INFO:tasks.workunit.client.0.smithi060.stdout:0/243: fsync d5/d10/da/f13 0 2024-09-21T10:40:55.480 INFO:tasks.workunit.client.0.smithi060.stdout:8/242: creat d2/d26/d49/f57 x:0 0 0 2024-09-21T10:40:55.481 INFO:tasks.workunit.client.1.smithi112.stdout:7/872: mkdir d7/d22/d41/d4b/d52/d77/dbd/de4/d101/d121 0 2024-09-21T10:40:55.482 INFO:tasks.workunit.client.0.smithi060.stdout:8/243: dread d2/d18/f22 [0,4194304] 0 2024-09-21T10:40:55.482 INFO:tasks.workunit.client.0.smithi060.stdout:8/244: write d2/d26/f38 [974982,54503] 0 2024-09-21T10:40:55.483 INFO:tasks.workunit.client.0.smithi060.stdout:8/245: read d2/f1f [655480,92496] 0 2024-09-21T10:40:55.483 INFO:tasks.workunit.client.0.smithi060.stdout:8/246: creat d2/d26/d37/f58 x:0 0 0 2024-09-21T10:40:55.490 INFO:tasks.workunit.client.0.smithi060.stdout:5/233: dwrite d5/d9/d10/d19/f31 [0,4194304] 0 2024-09-21T10:40:55.490 INFO:tasks.workunit.client.0.smithi060.stdout:5/234: truncate d5/f48 747624 0 2024-09-21T10:40:55.491 INFO:tasks.workunit.client.0.smithi060.stdout:8/247: mkdir d2/d26/d37/d59 0 2024-09-21T10:40:55.492 INFO:tasks.workunit.client.1.smithi112.stdout:7/873: dread d7/d22/d86/dac/f98 [0,4194304] 0 2024-09-21T10:40:55.492 INFO:tasks.workunit.client.1.smithi112.stdout:7/874: fsync d7/d22/d41/f84 0 2024-09-21T10:40:55.492 INFO:tasks.workunit.client.1.smithi112.stdout:9/927: creat d1/d2/d27/d37/d3b/d69/d88/f14f x:0 0 0 2024-09-21T10:40:55.494 INFO:tasks.workunit.client.1.smithi112.stdout:2/810: getdents d0/da2/dd3 0 2024-09-21T10:40:55.494 INFO:tasks.workunit.client.1.smithi112.stdout:2/811: creat d0/da4/dbe/df4/d7e/f10c x:0 0 0 2024-09-21T10:40:55.497 INFO:tasks.workunit.client.1.smithi112.stdout:0/900: getdents d3/d23 0 2024-09-21T10:40:55.497 INFO:tasks.workunit.client.1.smithi112.stdout:0/901: dread - d3/d18/d52/f77 zero size 2024-09-21T10:40:55.499 INFO:tasks.workunit.client.1.smithi112.stdout:9/928: dread d1/f43 [0,4194304] 0 2024-09-21T10:40:55.499 INFO:tasks.workunit.client.1.smithi112.stdout:7/875: rmdir d7/d22/d73/d11d 39 2024-09-21T10:40:55.500 INFO:tasks.workunit.client.0.smithi060.stdout:5/235: rename d5/d9/d13/d3a/c3f to d5/d9/d10/d19/c4f 0 2024-09-21T10:40:55.502 INFO:tasks.workunit.client.1.smithi112.stdout:2/812: mknod d0/d12/d46/d86/dc0/c10d 0 2024-09-21T10:40:55.504 INFO:tasks.workunit.client.1.smithi112.stdout:0/902: link d3/d18/d52/d55/dcc/d10b/ddf/ff0 d3/d18/d52/d55/dcc/d10b/f12f 0 2024-09-21T10:40:55.505 INFO:tasks.workunit.client.1.smithi112.stdout:9/929: mknod d1/d2/d27/d3a/d6b/d30/c150 0 2024-09-21T10:40:55.505 INFO:tasks.workunit.client.1.smithi112.stdout:7/876: chown d7/d3d/f50 984969 1 2024-09-21T10:40:55.507 INFO:tasks.workunit.client.1.smithi112.stdout:9/930: symlink d1/d2/d27/d37/d68/l151 0 2024-09-21T10:40:55.507 INFO:tasks.workunit.client.0.smithi060.stdout:0/244: truncate d5/d10/da/f13 2022584 0 2024-09-21T10:40:55.508 INFO:tasks.workunit.client.0.smithi060.stdout:8/248: dwrite d2/f23 [0,4194304] 0 2024-09-21T10:40:55.510 INFO:tasks.workunit.client.1.smithi112.stdout:7/877: creat d7/d22/d41/d56/d5c/f122 x:0 0 0 2024-09-21T10:40:55.510 INFO:tasks.workunit.client.1.smithi112.stdout:7/878: dread - d7/d22/d41/d4b/d5e/f95 zero size 2024-09-21T10:40:55.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/931: truncate d1/d2/fc4 102263 0 2024-09-21T10:40:55.512 INFO:tasks.workunit.client.1.smithi112.stdout:9/932: creat d1/d2/d27/d3a/de3/db5/f152 x:0 0 0 2024-09-21T10:40:55.513 INFO:tasks.workunit.client.1.smithi112.stdout:3/878: sync 2024-09-21T10:40:55.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/245: truncate d5/d10/da/f12 929286 0 2024-09-21T10:40:55.516 INFO:tasks.workunit.client.0.smithi060.stdout:5/236: dread d5/d9/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:40:55.516 INFO:tasks.workunit.client.0.smithi060.stdout:5/237: chown d5/d9/d10/d19/d21/d30/d49/c4c 15 1 2024-09-21T10:40:55.517 INFO:tasks.workunit.client.1.smithi112.stdout:7/879: creat d7/d22/d73/da1/f123 x:0 0 0 2024-09-21T10:40:55.520 INFO:tasks.workunit.client.0.smithi060.stdout:0/246: mkdir d5/d10/da/d20/d33/d3f 0 2024-09-21T10:40:55.520 INFO:tasks.workunit.client.0.smithi060.stdout:0/247: chown d5/d10/d11 123 1 2024-09-21T10:40:55.522 INFO:tasks.workunit.client.1.smithi112.stdout:9/933: creat d1/d2/d27/d37/d3b/d69/d77/dca/f153 x:0 0 0 2024-09-21T10:40:55.522 INFO:tasks.workunit.client.0.smithi060.stdout:5/238: mkdir d5/d9/d3e/d50 0 2024-09-21T10:40:55.522 INFO:tasks.workunit.client.1.smithi112.stdout:9/934: write d1/d2/d27/d37/f11a [127119,89098] 0 2024-09-21T10:40:55.523 INFO:tasks.workunit.client.1.smithi112.stdout:2/813: dwrite d0/f11 [0,4194304] 0 2024-09-21T10:40:55.523 INFO:tasks.workunit.client.1.smithi112.stdout:3/879: truncate d2/d2f/d3f/ddf/f29 1904632 0 2024-09-21T10:40:55.525 INFO:tasks.workunit.client.0.smithi060.stdout:0/248: rmdir d5/d10/da/d16/d2a 39 2024-09-21T10:40:55.527 INFO:tasks.workunit.client.1.smithi112.stdout:9/935: rename d1/d2/d27/f9a to d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/d101/f154 0 2024-09-21T10:40:55.528 INFO:tasks.workunit.client.0.smithi060.stdout:5/239: mknod d5/c51 0 2024-09-21T10:40:55.528 INFO:tasks.workunit.client.0.smithi060.stdout:5/240: write d5/d9/d10/d19/d21/f44 [386125,65005] 0 2024-09-21T10:40:55.528 INFO:tasks.workunit.client.0.smithi060.stdout:5/241: stat d5/d9/d3b 0 2024-09-21T10:40:55.530 INFO:tasks.workunit.client.1.smithi112.stdout:2/814: link d0/fef d0/da4/dbe/df4/d7e/d8f/d51/f10e 0 2024-09-21T10:40:55.530 INFO:tasks.workunit.client.1.smithi112.stdout:2/815: chown d0/d12/d46/da0/db9/dbd/d62/fa8 21 1 2024-09-21T10:40:55.530 INFO:tasks.workunit.client.1.smithi112.stdout:2/816: truncate d0/d12/d46/d86/dc0/dc8/d108/fae 1042060 0 2024-09-21T10:40:55.530 INFO:tasks.workunit.client.1.smithi112.stdout:2/817: chown d0/f19 31 1 2024-09-21T10:40:55.530 INFO:tasks.workunit.client.1.smithi112.stdout:2/818: chown d0/f1d 33314625 1 2024-09-21T10:40:55.530 INFO:tasks.workunit.client.1.smithi112.stdout:2/819: truncate d0/dd/d47/fc3 527624 0 2024-09-21T10:40:55.531 INFO:tasks.workunit.client.0.smithi060.stdout:5/242: symlink d5/d9/l52 0 2024-09-21T10:40:55.535 INFO:tasks.workunit.client.0.smithi060.stdout:5/243: creat d5/d9/d13/d3a/f53 x:0 0 0 2024-09-21T10:40:55.535 INFO:tasks.workunit.client.0.smithi060.stdout:5/244: chown d5/d9/cd 1821202 1 2024-09-21T10:40:55.535 INFO:tasks.workunit.client.0.smithi060.stdout:5/245: chown d5/d9/d13/l23 833012466 1 2024-09-21T10:40:55.535 INFO:tasks.workunit.client.1.smithi112.stdout:3/880: symlink d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/l124 0 2024-09-21T10:40:55.536 INFO:tasks.workunit.client.0.smithi060.stdout:8/249: dwrite d2/d18/d4b/d4d/f53 [0,4194304] 0 2024-09-21T10:40:55.536 INFO:tasks.workunit.client.0.smithi060.stdout:8/250: chown d2 15319 1 2024-09-21T10:40:55.537 INFO:tasks.workunit.client.1.smithi112.stdout:9/936: unlink d1/d2/d27/d37/d3b/dec/f126 0 2024-09-21T10:40:55.537 INFO:tasks.workunit.client.0.smithi060.stdout:5/246: symlink d5/d9/d3e/d50/l54 0 2024-09-21T10:40:55.538 INFO:tasks.workunit.client.1.smithi112.stdout:9/937: dread d1/d2/d27/d3a/d6b/f97 [0,4194304] 0 2024-09-21T10:40:55.539 INFO:tasks.workunit.client.0.smithi060.stdout:8/251: mkdir d2/d5a 0 2024-09-21T10:40:55.539 INFO:tasks.workunit.client.0.smithi060.stdout:5/247: mknod d5/d9/d10/d19/d21/c55 0 2024-09-21T10:40:55.540 INFO:tasks.workunit.client.1.smithi112.stdout:2/820: write d0/f11 [231004,76448] 0 2024-09-21T10:40:55.540 INFO:tasks.workunit.client.1.smithi112.stdout:2/821: chown d0/d12/d46/da0/db9/dbd 211017346 1 2024-09-21T10:40:55.540 INFO:tasks.workunit.client.0.smithi060.stdout:8/252: mknod d2/c5b 0 2024-09-21T10:40:55.541 INFO:tasks.workunit.client.1.smithi112.stdout:2/822: mkdir d0/d12/d46/d10f 0 2024-09-21T10:40:55.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/248: getdents d5/d45 0 2024-09-21T10:40:55.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/249: chown d5/d9/d13/d3a 3347050 1 2024-09-21T10:40:55.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/250: truncate d5/d9/d10/d19/d21/f44 649203 0 2024-09-21T10:40:55.543 INFO:tasks.workunit.client.0.smithi060.stdout:5/251: mknod d5/d9/c56 0 2024-09-21T10:40:55.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/880: dwrite d7/d22/d41/d56/dc9/fdb [0,4194304] 0 2024-09-21T10:40:55.543 INFO:tasks.workunit.client.1.smithi112.stdout:7/881: fsync d7/f49 0 2024-09-21T10:40:55.545 INFO:tasks.workunit.client.0.smithi060.stdout:5/252: rmdir d5/d9/d3e/d50 39 2024-09-21T10:40:55.545 INFO:tasks.workunit.client.0.smithi060.stdout:5/253: creat d5/d9/d3e/f57 x:0 0 0 2024-09-21T10:40:55.546 INFO:tasks.workunit.client.1.smithi112.stdout:3/881: read d2/f14 [2561288,10056] 0 2024-09-21T10:40:55.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/882: mknod d7/d22/d86/dac/c124 0 2024-09-21T10:40:55.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/883: truncate d7/d22/d41/d4b/d52/d77/dbd/de4/f114 564235 0 2024-09-21T10:40:55.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/884: fdatasync d7/d22/d41/d56/faa 0 2024-09-21T10:40:55.547 INFO:tasks.workunit.client.1.smithi112.stdout:7/885: dread - d7/d22/d86/dac/fff zero size 2024-09-21T10:40:55.548 INFO:tasks.workunit.client.1.smithi112.stdout:7/886: truncate d7/d22/d41/d4b/d5e/fbe 217771 0 2024-09-21T10:40:55.552 INFO:tasks.workunit.client.0.smithi060.stdout:5/254: creat d5/d9/d3e/d50/f58 x:0 0 0 2024-09-21T10:40:55.552 INFO:tasks.workunit.client.0.smithi060.stdout:8/253: write d2/ff [592884,11399] 0 2024-09-21T10:40:55.553 INFO:tasks.workunit.client.0.smithi060.stdout:8/254: creat d2/d18/f5c x:0 0 0 2024-09-21T10:40:55.554 INFO:tasks.workunit.client.0.smithi060.stdout:0/249: dread d5/d10/da/d16/f27 [0,4194304] 0 2024-09-21T10:40:55.554 INFO:tasks.workunit.client.1.smithi112.stdout:7/887: symlink d7/d22/d41/d56/d72/de0/l125 0 2024-09-21T10:40:55.554 INFO:tasks.workunit.client.1.smithi112.stdout:7/888: truncate d7/f3f 5196578 0 2024-09-21T10:40:55.555 INFO:tasks.workunit.client.1.smithi112.stdout:2/823: dread d0/da4/dbe/df4/d7e/d8f/d51/f70 [0,4194304] 0 2024-09-21T10:40:55.555 INFO:tasks.workunit.client.1.smithi112.stdout:0/903: dwrite d3/d4a/d4e/dc2/d10/f100 [0,4194304] 0 2024-09-21T10:40:55.556 INFO:tasks.workunit.client.1.smithi112.stdout:0/904: fdatasync d3/d4a/d4e/dc2/d1a/d21/fd7 0 2024-09-21T10:40:55.558 INFO:tasks.workunit.client.0.smithi060.stdout:8/255: link d2/f3 d2/f5d 0 2024-09-21T10:40:55.562 INFO:tasks.workunit.client.1.smithi112.stdout:7/889: rename d7/d22/d41/d4b/d52/lc5 to d7/d22/d41/d4b/d52/l126 0 2024-09-21T10:40:55.562 INFO:tasks.workunit.client.1.smithi112.stdout:7/890: chown d7/d22/l30 24983586 1 2024-09-21T10:40:55.562 INFO:tasks.workunit.client.1.smithi112.stdout:7/891: creat d7/d22/d41/d4b/d52/d77/dbd/de4/f127 x:0 0 0 2024-09-21T10:40:55.563 INFO:tasks.workunit.client.0.smithi060.stdout:5/255: write d5/d9/f2b [354109,87525] 0 2024-09-21T10:40:55.563 INFO:tasks.workunit.client.0.smithi060.stdout:5/256: chown d5/d9/f40 2 1 2024-09-21T10:40:55.563 INFO:tasks.workunit.client.0.smithi060.stdout:5/257: creat d5/d9/d3e/d50/f59 x:0 0 0 2024-09-21T10:40:55.564 INFO:tasks.workunit.client.0.smithi060.stdout:5/258: truncate d5/d9/d3e/d50/f59 931678 0 2024-09-21T10:40:55.564 INFO:tasks.workunit.client.0.smithi060.stdout:0/250: rmdir d5/d10/da/d15/d17 0 2024-09-21T10:40:55.568 INFO:tasks.workunit.client.1.smithi112.stdout:2/824: dread d0/d12/d46/da0/db9/dbd/d62/d63/f4f [0,4194304] 0 2024-09-21T10:40:55.569 INFO:tasks.workunit.client.0.smithi060.stdout:0/251: write d5/d10/da/f13 [1962129,44109] 0 2024-09-21T10:40:55.574 INFO:tasks.workunit.client.1.smithi112.stdout:2/825: dread d0/da4/dbe/fdb [0,4194304] 0 2024-09-21T10:40:55.574 INFO:tasks.workunit.client.1.smithi112.stdout:7/892: symlink d7/dbc/d10d/l128 0 2024-09-21T10:40:55.574 INFO:tasks.workunit.client.1.smithi112.stdout:7/893: read - d7/d22/d86/dac/fff zero size 2024-09-21T10:40:55.575 INFO:tasks.workunit.client.0.smithi060.stdout:5/259: rename d5/d9/d13 to d5/d45/d5a 0 2024-09-21T10:40:55.576 INFO:tasks.workunit.client.1.smithi112.stdout:2/826: symlink d0/d12/d46/d86/dc0/dc8/dfa/l110 0 2024-09-21T10:40:55.577 INFO:tasks.workunit.client.0.smithi060.stdout:5/260: symlink d5/d9/d3b/l5b 0 2024-09-21T10:40:55.578 INFO:tasks.workunit.client.1.smithi112.stdout:2/827: rmdir d0/da4/dbe/df4/d7e/d8f 39 2024-09-21T10:40:55.579 INFO:tasks.workunit.client.1.smithi112.stdout:2/828: mkdir d0/d12/d46/d86/dc0/dc8/d111 0 2024-09-21T10:40:55.579 INFO:tasks.workunit.client.1.smithi112.stdout:2/829: stat d0/da4/dc5/fd7 0 2024-09-21T10:40:55.581 INFO:tasks.workunit.client.1.smithi112.stdout:2/830: getdents d0/d12/d46/d86/dc0/dc8/d108 0 2024-09-21T10:40:55.593 INFO:tasks.workunit.client.1.smithi112.stdout:3/882: dwrite d2/d2f/d3f/ddf/d31/d2a/d39/d3a/f5b [4194304,4194304] 0 2024-09-21T10:40:55.594 INFO:tasks.workunit.client.1.smithi112.stdout:3/883: write d2/d2f/d3f/ddf/d31/d2a/f9e [634776,34506] 0 2024-09-21T10:40:55.594 INFO:tasks.workunit.client.1.smithi112.stdout:9/938: dwrite d1/d2/d27/d3a/d6b/fac [0,4194304] 0 2024-09-21T10:40:55.599 INFO:tasks.workunit.client.1.smithi112.stdout:9/939: rename d1/d2/d27/d37/d3b/f14c to d1/d2/d27/dc5/dd0/f155 0 2024-09-21T10:40:55.601 INFO:tasks.workunit.client.1.smithi112.stdout:9/940: dread d1/d7f/df0/f141 [0,4194304] 0 2024-09-21T10:40:55.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/884: dread d2/d2f/d3f/ddf/d31/d37/f52 [0,4194304] 0 2024-09-21T10:40:55.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/885: stat d2/d2f/d3f/ddf/d31/d37/c114 0 2024-09-21T10:40:55.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/886: write d2/d2f/daf/df4/fa7 [700551,107001] 0 2024-09-21T10:40:55.604 INFO:tasks.workunit.client.1.smithi112.stdout:3/887: write d2/d2f/daf/df4/fa7 [545018,41805] 0 2024-09-21T10:40:55.605 INFO:tasks.workunit.client.1.smithi112.stdout:3/888: mkdir d2/d1f/d100/d125 0 2024-09-21T10:40:55.606 INFO:tasks.workunit.client.1.smithi112.stdout:3/889: mkdir d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dd8/d126 0 2024-09-21T10:40:55.607 INFO:tasks.workunit.client.1.smithi112.stdout:3/890: creat d2/d2f/d3f/ddf/d31/d2a/dfe/d11e/f127 x:0 0 0 2024-09-21T10:40:55.609 INFO:tasks.workunit.client.1.smithi112.stdout:9/941: write d1/d2/f5 [260280,80724] 0 2024-09-21T10:40:55.611 INFO:tasks.workunit.client.1.smithi112.stdout:9/942: creat d1/d2/d27/d3a/d6b/d30/d5c/f156 x:0 0 0 2024-09-21T10:40:55.611 INFO:tasks.workunit.client.1.smithi112.stdout:9/943: write d1/d2/d27/d37/f100 [427862,98177] 0 2024-09-21T10:40:55.614 INFO:tasks.workunit.client.1.smithi112.stdout:9/944: dread d1/d2/d27/dc5/f11d [0,4194304] 0 2024-09-21T10:40:55.615 INFO:tasks.workunit.client.1.smithi112.stdout:3/891: dread d2/d1f/f8c [0,4194304] 0 2024-09-21T10:40:55.615 INFO:tasks.workunit.client.1.smithi112.stdout:9/945: rename d1/d2/f79 to d1/d81/f157 0 2024-09-21T10:40:55.617 INFO:tasks.workunit.client.1.smithi112.stdout:9/946: mknod d1/d2/d27/d3a/d6b/d30/da5/d140/c158 0 2024-09-21T10:40:55.623 INFO:tasks.workunit.client.1.smithi112.stdout:0/905: dwrite d3/d18/d52/d55/dcc/d10b/f91 [0,4194304] 0 2024-09-21T10:40:55.624 INFO:tasks.workunit.client.0.smithi060.stdout:8/256: dwrite d2/d18/f36 [0,4194304] 0 2024-09-21T10:40:55.625 INFO:tasks.workunit.client.1.smithi112.stdout:9/947: write d1/d2/f3e [80089,56008] 0 2024-09-21T10:40:55.627 INFO:tasks.workunit.client.1.smithi112.stdout:2/831: dwrite d0/d12/d46/da0/db9/dbd/d62/fa8 [0,4194304] 0 2024-09-21T10:40:55.627 INFO:tasks.workunit.client.1.smithi112.stdout:2/832: truncate d0/dd/fc2 1531836 0 2024-09-21T10:40:55.627 INFO:tasks.workunit.client.1.smithi112.stdout:2/833: chown d0/da4/dbe/df4/d7e/f106 12182184 1 2024-09-21T10:40:55.627 INFO:tasks.workunit.client.0.smithi060.stdout:5/261: dwrite d5/d9/d10/d19/d21/d30/f35 [0,4194304] 0 2024-09-21T10:40:55.627 INFO:tasks.workunit.client.1.smithi112.stdout:7/894: dwrite d7/f10 [0,4194304] 0 2024-09-21T10:40:55.628 INFO:tasks.workunit.client.1.smithi112.stdout:3/892: read d2/d2f/d3f/ddf/d31/d2a/d39/f81 [1281377,96233] 0 2024-09-21T10:40:55.631 INFO:tasks.workunit.client.1.smithi112.stdout:3/893: dread d2/f14 [0,4194304] 0 2024-09-21T10:40:55.631 INFO:tasks.workunit.client.1.smithi112.stdout:3/894: write d2/d2f/d3f/ddf/d31/f97 [1737837,49570] 0 2024-09-21T10:40:55.635 INFO:tasks.workunit.client.0.smithi060.stdout:8/257: write d2/d18/f34 [2266262,21359] 0 2024-09-21T10:40:55.635 INFO:tasks.workunit.client.0.smithi060.stdout:8/258: creat d2/d18/f5e x:0 0 0 2024-09-21T10:40:55.636 INFO:tasks.workunit.client.1.smithi112.stdout:0/906: write d3/d4a/d4e/dc2/d1a/d21/d4f/f7e [3279463,49912] 0 2024-09-21T10:40:55.638 INFO:tasks.workunit.client.1.smithi112.stdout:3/895: write d2/d2f/d3f/ddf/d31/dcf/fc4 [893751,61848] 0 2024-09-21T10:40:55.638 INFO:tasks.workunit.client.1.smithi112.stdout:3/896: chown d2/d2f/daf/dca/ff7 107 1 2024-09-21T10:40:55.646 INFO:tasks.workunit.client.0.smithi060.stdout:5/262: dwrite d5/d9/d3e/d50/f58 [0,4194304] 0 2024-09-21T10:40:55.654 INFO:tasks.workunit.client.1.smithi112.stdout:3/897: dwrite d2/d2f/f6a [0,4194304] 0 2024-09-21T10:40:55.655 INFO:tasks.workunit.client.1.smithi112.stdout:3/898: write d2/f78 [280515,128576] 0 2024-09-21T10:40:55.656 INFO:tasks.workunit.client.1.smithi112.stdout:3/899: write d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/fb1 [356094,130084] 0 2024-09-21T10:40:55.656 INFO:tasks.workunit.client.1.smithi112.stdout:3/900: write d2/d2f/d3f/ddf/f5e [6267032,92495] 0 2024-09-21T10:40:55.658 INFO:tasks.workunit.client.1.smithi112.stdout:8/938: sync 2024-09-21T10:40:55.659 INFO:tasks.workunit.client.1.smithi112.stdout:9/948: rmdir d1/d2/d27/d3a/d6b/d30/d121 39 2024-09-21T10:40:55.661 INFO:tasks.workunit.client.1.smithi112.stdout:2/834: rmdir d0/d12/d46/dd8 39 2024-09-21T10:40:55.663 INFO:tasks.workunit.client.0.smithi060.stdout:8/259: unlink d2/l10 0 2024-09-21T10:40:55.665 INFO:tasks.workunit.client.1.smithi112.stdout:7/895: getdents d7/d22/d41/d4b/d52/d77 0 2024-09-21T10:40:55.665 INFO:tasks.workunit.client.1.smithi112.stdout:7/896: chown d7/d22/d41/d4b/d52/d77/dbd/fc0 46 1 2024-09-21T10:40:55.665 INFO:tasks.workunit.client.1.smithi112.stdout:7/897: chown d7/d22/d41/d56/d72/dc4/d4a/ff7 12192 1 2024-09-21T10:40:55.665 INFO:tasks.workunit.client.1.smithi112.stdout:7/898: readlink d7/d22/l39 0 2024-09-21T10:40:55.668 INFO:tasks.workunit.client.1.smithi112.stdout:8/939: getdents d8/d9/dd/dab/d101 0 2024-09-21T10:40:55.669 INFO:tasks.workunit.client.0.smithi060.stdout:5/263: mknod d5/d9/d3e/c5c 0 2024-09-21T10:40:55.669 INFO:tasks.workunit.client.0.smithi060.stdout:5/264: chown d5/d9/d3e 254 1 2024-09-21T10:40:55.670 INFO:tasks.workunit.client.1.smithi112.stdout:0/907: dwrite d3/d4a/d4e/dc2/d10/f35 [0,4194304] 0 2024-09-21T10:40:55.670 INFO:tasks.workunit.client.1.smithi112.stdout:0/908: write d3/d4a/d4e/dc2/d1a/d21/d4f/dc3/fb7 [4813085,106887] 0 2024-09-21T10:40:55.670 INFO:tasks.workunit.client.1.smithi112.stdout:0/909: dread - d3/d18/d52/d55/dcc/f10d zero size 2024-09-21T10:40:55.670 INFO:tasks.workunit.client.1.smithi112.stdout:3/901: dwrite d2/d2f/daf/ff1 [0,4194304] 0 2024-09-21T10:40:55.672 INFO:tasks.workunit.client.1.smithi112.stdout:9/949: rename d1/d7f/c105 to d1/d2/d27/d37/d3b/d69/d77/da0/de4/d12c/c159 0 2024-09-21T10:40:55.673 INFO:tasks.workunit.client.0.smithi060.stdout:8/260: mknod d2/d5a/c5f 0 2024-09-21T10:40:55.675 INFO:tasks.workunit.client.1.smithi112.stdout:2/835: creat d0/dd/d47/dd0/f112 x:0 0 0 2024-09-21T10:40:55.675 INFO:tasks.workunit.client.1.smithi112.stdout:2/836: write d0/d12/f104 [360994,54335] 0 2024-09-21T10:40:55.675 INFO:tasks.workunit.client.1.smithi112.stdout:6/938: sync 2024-09-21T10:40:55.675 INFO:tasks.workunit.client.1.smithi112.stdout:2/837: write d0/da4/dbe/df4/fd9 [270541,50182] 0 2024-09-21T10:40:55.675 INFO:tasks.workunit.client.1.smithi112.stdout:2/838: creat d0/d12/d77/f113 x:0 0 0 2024-09-21T10:40:55.675 INFO:tasks.workunit.client.1.smithi112.stdout:2/839: fdatasync d0/d12/d46/da0/db9/dbd/d62/d63/f8b 0 2024-09-21T10:40:55.677 INFO:tasks.workunit.client.0.smithi060.stdout:5/265: creat d5/d45/d5a/f5d x:0 0 0 2024-09-21T10:40:55.680 INFO:tasks.workunit.client.0.smithi060.stdout:8/261: rmdir d2/d26/d37/d59 0 2024-09-21T10:40:55.680 INFO:tasks.workunit.client.0.smithi060.stdout:8/262: stat d2/d18/f22 0 2024-09-21T10:40:55.680 INFO:tasks.workunit.client.0.smithi060.stdout:8/263: write d2/f8 [3978289,18606] 0 2024-09-21T10:40:55.680 INFO:tasks.workunit.client.0.smithi060.stdout:8/264: chown d2/c3b 155939 1 2024-09-21T10:40:55.680 INFO:tasks.workunit.client.1.smithi112.stdout:5/935: sync 2024-09-21T10:40:55.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/913: sync 2024-09-21T10:40:55.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/914: write de/d18/d6d/ff0 [224949,22338] 0 2024-09-21T10:40:55.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/915: fdatasync de/d33/d2f/d71/fa1 0 2024-09-21T10:40:55.681 INFO:tasks.workunit.client.1.smithi112.stdout:4/916: write de/d18/d6d/fc9 [76758,74272] 0 2024-09-21T10:40:55.683 INFO:tasks.workunit.client.0.smithi060.stdout:5/266: creat d5/d45/d5a/d3a/f5e x:0 0 0 2024-09-21T10:40:55.687 INFO:tasks.workunit.client.1.smithi112.stdout:3/902: unlink d2/d2f/d3f/ddf/d31/d2a/dfe/f104 0 2024-09-21T10:40:55.690 INFO:tasks.workunit.client.1.smithi112.stdout:9/950: dwrite d1/d2/d42/fdc [0,4194304] 0 2024-09-21T10:40:55.691 INFO:tasks.workunit.client.1.smithi112.stdout:3/903: dread d2/f93 [0,4194304] 0 2024-09-21T10:40:55.692 INFO:tasks.workunit.client.1.smithi112.stdout:2/840: truncate d0/dd/d47/fc3 254815 0 2024-09-21T10:40:55.693 INFO:tasks.workunit.client.1.smithi112.stdout:5/936: creat d9/d15/d18/d20/f12c x:0 0 0 2024-09-21T10:40:55.694 INFO:tasks.workunit.client.1.smithi112.stdout:7/899: dwrite d7/f14 [0,4194304] 0 2024-09-21T10:40:55.694 INFO:tasks.workunit.client.1.smithi112.stdout:7/900: read d7/f19 [82792,18684] 0 2024-09-21T10:40:55.694 INFO:tasks.workunit.client.1.smithi112.stdout:8/940: dwrite d8/d9/dd/d2b/db8/fc5 [0,4194304] 0 2024-09-21T10:40:55.707 INFO:tasks.workunit.client.1.smithi112.stdout:5/937: write d9/d15/d18/d20/d55/dbb/fbe [1540770,18253] 0 2024-09-21T10:40:55.716 INFO:tasks.workunit.client.1.smithi112.stdout:3/904: dwrite d2/d2f/daf/df4/f117 [0,4194304] 0 2024-09-21T10:40:55.723 INFO:tasks.workunit.client.1.smithi112.stdout:3/905: write d2/d1f/f40 [1268329,65900] 0 2024-09-21T10:40:55.818 INFO:tasks.workunit.client.1.smithi112.stdout:4/917: mkdir de/d33/d2f/d134 0 2024-09-21T10:40:55.818 INFO:tasks.workunit.client.1.smithi112.stdout:4/918: write de/d33/d2f/d35/d4c/d5c/fd6 [428951,45532] 0 2024-09-21T10:40:55.824 INFO:tasks.workunit.client.0.smithi060.stdout:5/267: rmdir d5/d9/d3e 39 2024-09-21T10:40:55.832 INFO:tasks.workunit.client.0.smithi060.stdout:8/265: rmdir d2/d26/d37 39 2024-09-21T10:40:55.835 INFO:tasks.workunit.client.1.smithi112.stdout:2/841: mknod d0/d12/d46/d86/dc0/dc8/d111/c114 0 2024-09-21T10:40:55.838 INFO:tasks.workunit.client.1.smithi112.stdout:7/901: creat d7/d22/d41/d56/d5c/f129 x:0 0 0 2024-09-21T10:40:55.838 INFO:tasks.workunit.client.1.smithi112.stdout:7/902: chown d7/f1a 123 1 2024-09-21T10:40:55.847 INFO:tasks.workunit.client.1.smithi112.stdout:5/938: rmdir d9/d15/d18/d3a/d61/d62 39 2024-09-21T10:40:55.925 INFO:tasks.workunit.client.1.smithi112.stdout:4/919: creat de/d109/f135 x:0 0 0 2024-09-21T10:40:55.927 INFO:tasks.workunit.client.1.smithi112.stdout:0/910: rename d3/d4a/d4e/dc2/d1a/d21 to d3/d18/d52/df9/d130 0 2024-09-21T10:40:55.928 INFO:tasks.workunit.client.1.smithi112.stdout:7/903: creat d7/d3d/f12a x:0 0 0 2024-09-21T10:40:55.930 INFO:tasks.workunit.client.1.smithi112.stdout:7/904: mkdir d7/d22/d41/d4b/d52/d77/dbd/d12b 0 2024-09-21T10:40:55.943 INFO:tasks.workunit.client.1.smithi112.stdout:0/911: dwrite d3/d18/d52/df9/d130/d10e/f116 [0,4194304] 0 2024-09-21T10:40:55.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:55 smithi060 ceph-mon[28215]: pgmap v14: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 281 MiB/s rd, 333 MiB/s wr, 581 op/s 2024-09-21T10:40:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:55 smithi112 ceph-mon[35117]: pgmap v14: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 281 MiB/s rd, 333 MiB/s wr, 581 op/s 2024-09-21T10:40:55.989 INFO:tasks.workunit.client.1.smithi112.stdout:0/912: unlink d3/d4a/d4e/dc2/d10/d8b/f9a 0 2024-09-21T10:40:55.989 INFO:tasks.workunit.client.1.smithi112.stdout:0/913: write d3/d4a/d4e/dc2/d1a/dba/d10a/f113 [790564,130230] 0 2024-09-21T10:40:56.004 INFO:tasks.workunit.client.1.smithi112.stdout:6/939: rename d4/d6/da/d14/d49/d73/fdc to d4/d6/da/d12a/f148 0 2024-09-21T10:40:56.005 INFO:tasks.workunit.client.1.smithi112.stdout:9/951: rename d1/d2/d42/f131 to d1/d2/d27/d37/d3b/d69/d77/dca/dae/dd5/f15a 0 2024-09-21T10:40:56.005 INFO:tasks.workunit.client.1.smithi112.stdout:9/952: chown d1/d2/d27/d3a/d4c/lee 53946 1 2024-09-21T10:40:56.005 INFO:tasks.workunit.client.1.smithi112.stdout:9/953: stat d1/d2/d27/d3a/d6b/d30/da5/d140/c158 0 2024-09-21T10:40:56.006 INFO:tasks.workunit.client.1.smithi112.stdout:6/940: creat d4/d6/da/d14/f149 x:0 0 0 2024-09-21T10:40:56.006 INFO:tasks.workunit.client.1.smithi112.stdout:6/941: fdatasync d4/d6/da/d11/d1f/d22/d100/d12c/f61 0 2024-09-21T10:40:56.008 INFO:tasks.workunit.client.1.smithi112.stdout:9/954: mknod d1/d2/d27/d3a/de3/db5/c15b 0 2024-09-21T10:40:56.009 INFO:tasks.workunit.client.1.smithi112.stdout:6/942: stat d4/d6/da/l3d 0 2024-09-21T10:40:56.010 INFO:tasks.workunit.client.1.smithi112.stdout:9/955: write d1/d2/d27/d3a/d6b/f1f [114286,84349] 0 2024-09-21T10:40:56.012 INFO:tasks.workunit.client.1.smithi112.stdout:6/943: creat d4/d6/da/d11/d1f/d22/d100/d12c/d31/d102/f14a x:0 0 0 2024-09-21T10:40:56.013 INFO:tasks.workunit.client.1.smithi112.stdout:9/956: unlink d1/d2/d27/d3a/d6b/d30/d5c/fc2 0 2024-09-21T10:40:56.015 INFO:tasks.workunit.client.1.smithi112.stdout:8/941: rename d8/d9/dd/dab to d8/d9/d3c/d90/dfb/d118 0 2024-09-21T10:40:56.015 INFO:tasks.workunit.client.1.smithi112.stdout:3/906: rename d2/d2f to d2/d2f/d3f/ddf/d31/d2a/d39/d128 22 2024-09-21T10:40:56.016 INFO:tasks.workunit.client.1.smithi112.stdout:6/944: creat d4/d6/da/d11/d37/d19/df3/d118/f14b x:0 0 0 2024-09-21T10:40:56.016 INFO:tasks.workunit.client.1.smithi112.stdout:6/945: fsync d4/d6/da/d11/d1f/d22/d86/ff2 0 2024-09-21T10:40:56.018 INFO:tasks.workunit.client.1.smithi112.stdout:2/842: rename d0/da4/dbe/df4/d7e/d8f/d51/d57/fb3 to d0/d12/d46/da0/db9/dbd/f115 0 2024-09-21T10:40:56.018 INFO:tasks.workunit.client.1.smithi112.stdout:2/843: fsync d0/d12/d46/da0/db9/dbd/d62/f87 0 2024-09-21T10:40:56.018 INFO:tasks.workunit.client.1.smithi112.stdout:8/942: symlink d8/d9/d3c/d90/dfb/d118/d101/l119 0 2024-09-21T10:40:56.020 INFO:tasks.workunit.client.1.smithi112.stdout:5/939: rename d9/d15/d18/d20/l11a to d9/d15/dc7/l12d 0 2024-09-21T10:40:56.021 INFO:tasks.workunit.client.1.smithi112.stdout:2/844: unlink d0/dd/d47/c75 0 2024-09-21T10:40:56.022 INFO:tasks.workunit.client.1.smithi112.stdout:9/957: dread d1/d2/d27/d3a/de3/ffe [0,4194304] 0 2024-09-21T10:40:56.023 INFO:tasks.workunit.client.1.smithi112.stdout:3/907: dread d2/d2f/d3f/f94 [0,4194304] 0 2024-09-21T10:40:56.023 INFO:tasks.workunit.client.1.smithi112.stdout:4/920: rename de/d33/d6f/d9c/cd7 to de/d2a/dbf/d82/de8/c136 0 2024-09-21T10:40:56.025 INFO:tasks.workunit.client.1.smithi112.stdout:5/940: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/l12e 0 2024-09-21T10:40:56.026 INFO:tasks.workunit.client.1.smithi112.stdout:2/845: symlink d0/da4/dc5/l116 0 2024-09-21T10:40:56.026 INFO:tasks.workunit.client.1.smithi112.stdout:2/846: fdatasync d0/dd/d47/f58 0 2024-09-21T10:40:56.027 INFO:tasks.workunit.client.1.smithi112.stdout:3/908: symlink d2/d2f/d3f/ddf/d31/l129 0 2024-09-21T10:40:56.030 INFO:tasks.workunit.client.1.smithi112.stdout:7/905: rename d7/ff to d7/d22/d41/d56/d72/dc4/d4a/f12c 0 2024-09-21T10:40:56.030 INFO:tasks.workunit.client.1.smithi112.stdout:4/921: getdents de/d33/d2f/d35/d4c/d5c/dfa 0 2024-09-21T10:40:56.030 INFO:tasks.workunit.client.1.smithi112.stdout:4/922: chown de/d33/db5/c106 1717893 1 2024-09-21T10:40:56.031 INFO:tasks.workunit.client.1.smithi112.stdout:5/941: symlink d9/d15/d18/d3a/d4b/d74/l12f 0 2024-09-21T10:40:56.032 INFO:tasks.workunit.client.1.smithi112.stdout:5/942: fsync d9/d15/d18/d3a/d4b/d74/f106 0 2024-09-21T10:40:56.033 INFO:tasks.workunit.client.1.smithi112.stdout:0/914: rename d3/d18/d52/df9/d130/d46/c106 to d3/d4a/d4e/dc2/d1a/c131 0 2024-09-21T10:40:56.034 INFO:tasks.workunit.client.1.smithi112.stdout:7/906: mknod d7/d22/d41/d4b/d52/d77/dbd/de4/d101/d121/c12d 0 2024-09-21T10:40:56.036 INFO:tasks.workunit.client.1.smithi112.stdout:4/923: mkdir de/d33/d6f/d9c/d137 0 2024-09-21T10:40:56.036 INFO:tasks.workunit.client.1.smithi112.stdout:4/924: write de/d33/d2f/d71/d40/d4f/fbb [1137878,123692] 0 2024-09-21T10:40:56.038 INFO:tasks.workunit.client.1.smithi112.stdout:0/915: rename d3/d18/d52/d55/f5e to d3/d4a/d4e/dc2/d43/d115/f132 0 2024-09-21T10:40:56.038 INFO:tasks.workunit.client.1.smithi112.stdout:0/916: chown d3/d18/c11b 201442090 1 2024-09-21T10:40:56.039 INFO:tasks.workunit.client.1.smithi112.stdout:7/907: link d7/l81 d7/d22/d41/d56/d72/l12e 0 2024-09-21T10:40:56.041 INFO:tasks.workunit.client.1.smithi112.stdout:6/946: dwrite d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/f13e [0,4194304] 0 2024-09-21T10:40:56.041 INFO:tasks.workunit.client.1.smithi112.stdout:9/958: dread d1/d2/d27/d3a/d6b/d30/d5c/d7c/ffd [0,4194304] 0 2024-09-21T10:40:56.041 INFO:tasks.workunit.client.1.smithi112.stdout:6/947: dread - d4/f120 zero size 2024-09-21T10:40:56.041 INFO:tasks.workunit.client.0.smithi060.stdout:7/254: sync 2024-09-21T10:40:56.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/314: sync 2024-09-21T10:40:56.042 INFO:tasks.workunit.client.0.smithi060.stdout:6/311: sync 2024-09-21T10:40:56.042 INFO:tasks.workunit.client.1.smithi112.stdout:4/925: symlink de/d2e/df4/l138 0 2024-09-21T10:40:56.043 INFO:tasks.workunit.client.1.smithi112.stdout:0/917: mkdir d3/d4a/d4e/dc2/d1a/dba/deb/d133 0 2024-09-21T10:40:56.043 INFO:tasks.workunit.client.1.smithi112.stdout:0/918: readlink d3/d4a/d4e/dc2/d1a/l2c 0 2024-09-21T10:40:56.044 INFO:tasks.workunit.client.1.smithi112.stdout:8/943: dwrite d8/fc [0,4194304] 0 2024-09-21T10:40:56.044 INFO:tasks.workunit.client.1.smithi112.stdout:8/944: creat d8/d9/dd/d2b/f11a x:0 0 0 2024-09-21T10:40:56.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/312: creat d3/d12/d16/d25/d27/f5a x:0 0 0 2024-09-21T10:40:56.047 INFO:tasks.workunit.client.0.smithi060.stdout:7/255: creat da/f59 x:0 0 0 2024-09-21T10:40:56.047 INFO:tasks.workunit.client.1.smithi112.stdout:7/908: getdents d7/d22/d41/d54 0 2024-09-21T10:40:56.047 INFO:tasks.workunit.client.1.smithi112.stdout:7/909: truncate d7/d22/d41/d4b/d5e/fdf 1001717 0 2024-09-21T10:40:56.049 INFO:tasks.workunit.client.0.smithi060.stdout:4/315: getdents d0/d5/d12/d15 0 2024-09-21T10:40:56.049 INFO:tasks.workunit.client.0.smithi060.stdout:4/316: fsync d0/f4 0 2024-09-21T10:40:56.051 INFO:tasks.workunit.client.1.smithi112.stdout:2/847: rename d0/d12/d46/da0/db9/dbd/f115 to d0/d12/d46/d86/dc0/f117 0 2024-09-21T10:40:56.052 INFO:tasks.workunit.client.0.smithi060.stdout:7/256: rename da/d14/d15/l31 to da/d14/l5a 0 2024-09-21T10:40:56.055 INFO:tasks.workunit.client.0.smithi060.stdout:4/317: unlink d0/d5/d12/f19 0 2024-09-21T10:40:56.059 INFO:tasks.workunit.client.0.smithi060.stdout:7/257: link da/d14/d35/d32/l57 da/d14/d25/l5b 0 2024-09-21T10:40:56.061 INFO:tasks.workunit.client.0.smithi060.stdout:4/318: creat d0/d3c/d67/f68 x:0 0 0 2024-09-21T10:40:56.061 INFO:tasks.workunit.client.0.smithi060.stdout:4/319: read d0/f60 [3490818,11805] 0 2024-09-21T10:40:56.064 INFO:tasks.workunit.client.0.smithi060.stdout:7/258: symlink da/d14/d2a/l5c 0 2024-09-21T10:40:56.064 INFO:tasks.workunit.client.0.smithi060.stdout:7/259: chown f6 781008 1 2024-09-21T10:40:56.064 INFO:tasks.workunit.client.0.smithi060.stdout:7/260: chown da/d14/d2a/d49/l21 591 1 2024-09-21T10:40:56.065 INFO:tasks.workunit.client.1.smithi112.stdout:6/948: mkdir d4/d6/da/d11/d37/df6/d14c 0 2024-09-21T10:40:56.067 INFO:tasks.workunit.client.1.smithi112.stdout:4/926: rmdir de/d2a 39 2024-09-21T10:40:56.067 INFO:tasks.workunit.client.1.smithi112.stdout:4/927: readlink de/l20 0 2024-09-21T10:40:56.068 INFO:tasks.workunit.client.1.smithi112.stdout:2/848: dwrite d0/d12/d76/f82 [0,4194304] 0 2024-09-21T10:40:56.069 INFO:tasks.workunit.client.0.smithi060.stdout:6/313: dwrite d3/d12/d38/d41/f44 [0,4194304] 0 2024-09-21T10:40:56.069 INFO:tasks.workunit.client.0.smithi060.stdout:4/320: truncate d0/d5/d12/d20/d32/d57/f5b 803127 0 2024-09-21T10:40:56.077 INFO:tasks.workunit.client.1.smithi112.stdout:2/849: dread d0/da4/dbe/df4/d7e/d8f/f27 [0,4194304] 0 2024-09-21T10:40:56.077 INFO:tasks.workunit.client.1.smithi112.stdout:2/850: dread - d0/da4/dc5/fd7 zero size 2024-09-21T10:40:56.077 INFO:tasks.workunit.client.1.smithi112.stdout:0/919: symlink d3/d18/l134 0 2024-09-21T10:40:56.078 INFO:tasks.workunit.client.0.smithi060.stdout:6/314: getdents d3/dd 0 2024-09-21T10:40:56.078 INFO:tasks.workunit.client.0.smithi060.stdout:6/315: stat d3/d12/d38/d41/f44 0 2024-09-21T10:40:56.082 INFO:tasks.workunit.client.0.smithi060.stdout:6/316: mkdir d3/d12/d16/d5b 0 2024-09-21T10:40:56.082 INFO:tasks.workunit.client.0.smithi060.stdout:6/317: write d3/fb [2121319,43705] 0 2024-09-21T10:40:56.086 INFO:tasks.workunit.client.0.smithi060.stdout:6/318: getdents d3 0 2024-09-21T10:40:56.086 INFO:tasks.workunit.client.0.smithi060.stdout:7/261: dwrite da/d14/d35/f40 [0,4194304] 0 2024-09-21T10:40:56.087 INFO:tasks.workunit.client.1.smithi112.stdout:0/920: read d3/d4a/d4e/dc2/d10/f100 [1737307,48101] 0 2024-09-21T10:40:56.088 INFO:tasks.workunit.client.0.smithi060.stdout:6/319: symlink d3/d12/l5c 0 2024-09-21T10:40:56.093 INFO:tasks.workunit.client.0.smithi060.stdout:4/321: dread d0/d5/d12/d20/d32/d57/f5b [0,4194304] 0 2024-09-21T10:40:56.093 INFO:tasks.workunit.client.0.smithi060.stdout:7/262: mknod da/d14/d35/c5d 0 2024-09-21T10:40:56.093 INFO:tasks.workunit.client.0.smithi060.stdout:7/263: write da/d14/d35/f36 [70497,62206] 0 2024-09-21T10:40:56.093 INFO:tasks.workunit.client.0.smithi060.stdout:7/264: write da/d14/d35/d32/f52 [601900,82911] 0 2024-09-21T10:40:56.093 INFO:tasks.workunit.client.0.smithi060.stdout:7/265: creat da/d14/d15/f5e x:0 0 0 2024-09-21T10:40:56.094 INFO:tasks.workunit.client.1.smithi112.stdout:6/949: dwrite d4/d6/f15 [0,4194304] 0 2024-09-21T10:40:56.098 INFO:tasks.workunit.client.0.smithi060.stdout:6/320: mkdir d3/d12/d16/d22/d5d 0 2024-09-21T10:40:56.098 INFO:tasks.workunit.client.0.smithi060.stdout:6/321: chown d3/d12/d16/d22/d58 112 1 2024-09-21T10:40:56.100 INFO:tasks.workunit.client.1.smithi112.stdout:8/945: truncate d8/f14 3673342 0 2024-09-21T10:40:56.100 INFO:tasks.workunit.client.1.smithi112.stdout:8/946: getdents d8/d9/dd/d2b/d31/d46/df6 0 2024-09-21T10:40:56.102 INFO:tasks.workunit.client.1.smithi112.stdout:5/943: rename d9/d15/dc7 to d9/d15/d18/d3a/d130 0 2024-09-21T10:40:56.104 INFO:tasks.workunit.client.0.smithi060.stdout:7/266: rename da/d14/d2a/d49/f47 to da/d14/d2a/d49/f5f 0 2024-09-21T10:40:56.104 INFO:tasks.workunit.client.1.smithi112.stdout:6/950: dread d4/dc/d7e/f88 [0,4194304] 0 2024-09-21T10:40:56.105 INFO:tasks.workunit.client.0.smithi060.stdout:6/322: symlink d3/d12/d16/d1a/d21/l5e 0 2024-09-21T10:40:56.106 INFO:tasks.workunit.client.0.smithi060.stdout:6/323: fsync d3/d12/d16/d1a/f4c 0 2024-09-21T10:40:56.106 INFO:tasks.workunit.client.0.smithi060.stdout:6/324: fsync d3/d12/d16/f18 0 2024-09-21T10:40:56.108 INFO:tasks.workunit.client.1.smithi112.stdout:2/851: mkdir d0/d12/d46/da0/db9/dbd/d62/d63/d118 0 2024-09-21T10:40:56.109 INFO:tasks.workunit.client.0.smithi060.stdout:7/267: mkdir da/d60 0 2024-09-21T10:40:56.109 INFO:tasks.workunit.client.0.smithi060.stdout:7/268: truncate da/d14/f48 591368 0 2024-09-21T10:40:56.109 INFO:tasks.workunit.client.0.smithi060.stdout:7/269: chown da/d14/d25/l5b 1394 1 2024-09-21T10:40:56.111 INFO:tasks.workunit.client.1.smithi112.stdout:0/921: rmdir d3/d18/d45/df5 0 2024-09-21T10:40:56.111 INFO:tasks.workunit.client.1.smithi112.stdout:6/951: dread d4/d6/da/d11/d37/f70 [0,4194304] 0 2024-09-21T10:40:56.111 INFO:tasks.workunit.client.1.smithi112.stdout:6/952: chown d4/d6/da/d11/d1f/d22/d100/d12c/ccb 4609389 1 2024-09-21T10:40:56.117 INFO:tasks.workunit.client.0.smithi060.stdout:4/322: mkdir d0/d3c/d69 0 2024-09-21T10:40:56.118 INFO:tasks.workunit.client.1.smithi112.stdout:2/852: dread d0/d12/d46/da0/db9/dbd/d62/d63/f1a [0,4194304] 0 2024-09-21T10:40:56.121 INFO:tasks.workunit.client.1.smithi112.stdout:9/959: rename d1/d2/d27/d3a/d6b/d30/da5/d140/c158 to d1/d2/d27/d62/d70/d12d/c15c 0 2024-09-21T10:40:56.122 INFO:tasks.workunit.client.1.smithi112.stdout:9/960: chown d1/d2/d27/d3a/d6b/d30/da5/d140 3309 1 2024-09-21T10:40:56.122 INFO:tasks.workunit.client.1.smithi112.stdout:9/961: stat d1/d2/d42/c74 0 2024-09-21T10:40:56.126 INFO:tasks.workunit.client.1.smithi112.stdout:6/953: getdents d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/d9b/de2 0 2024-09-21T10:40:56.130 INFO:tasks.workunit.client.1.smithi112.stdout:7/910: rename d7/f71 to d7/d22/d41/d56/db7/df2/d10c/f12f 0 2024-09-21T10:40:56.131 INFO:tasks.workunit.client.1.smithi112.stdout:7/911: readlink d7/l11 0 2024-09-21T10:40:56.131 INFO:tasks.workunit.client.1.smithi112.stdout:7/912: stat d7/d3d/f50 0 2024-09-21T10:40:56.131 INFO:tasks.workunit.client.1.smithi112.stdout:0/922: dwrite d3/d23/f67 [0,4194304] 0 2024-09-21T10:40:56.131 INFO:tasks.workunit.client.1.smithi112.stdout:0/923: getdents d3/d4a/d4e/dc2/d10 0 2024-09-21T10:40:56.132 INFO:tasks.workunit.client.1.smithi112.stdout:5/944: mknod d9/d15/d18/d20/d47/c131 0 2024-09-21T10:40:56.134 INFO:tasks.workunit.client.1.smithi112.stdout:6/954: creat d4/d6/da/d14/d49/d62/d96/f14d x:0 0 0 2024-09-21T10:40:56.134 INFO:tasks.workunit.client.1.smithi112.stdout:6/955: fdatasync d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/f13e 0 2024-09-21T10:40:56.135 INFO:tasks.workunit.client.1.smithi112.stdout:6/956: dread d4/d4f/f8c [0,4194304] 0 2024-09-21T10:40:56.135 INFO:tasks.workunit.client.1.smithi112.stdout:6/957: stat d4/d6/da/d11/d1f/d22/dde 0 2024-09-21T10:40:56.136 INFO:tasks.workunit.client.1.smithi112.stdout:4/928: rename de/d33/d2f/d71/d40/d4f/f11e to de/d33/d6f/d9c/d3e/d75/f139 0 2024-09-21T10:40:56.136 INFO:tasks.workunit.client.1.smithi112.stdout:2/853: dwrite d0/da4/dc5/fec [0,4194304] 0 2024-09-21T10:40:56.136 INFO:tasks.workunit.client.1.smithi112.stdout:0/924: creat d3/d18/d52/df9/d130/d4f/dc3/f135 x:0 0 0 2024-09-21T10:40:56.137 INFO:tasks.workunit.client.1.smithi112.stdout:5/945: rmdir d9/d8a 39 2024-09-21T10:40:56.137 INFO:tasks.workunit.client.1.smithi112.stdout:5/946: creat d9/d6e/dfb/d100/f132 x:0 0 0 2024-09-21T10:40:56.137 INFO:tasks.workunit.client.1.smithi112.stdout:5/947: truncate d9/d6e/dfb/d100/f124 233231 0 2024-09-21T10:40:56.138 INFO:tasks.workunit.client.1.smithi112.stdout:6/958: truncate d4/d6/da/d14/f27 2105207 0 2024-09-21T10:40:56.138 INFO:tasks.workunit.client.1.smithi112.stdout:6/959: chown d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d64/d84 3572 1 2024-09-21T10:40:56.138 INFO:tasks.workunit.client.1.smithi112.stdout:6/960: stat d4/d6/da/d11/d1f/d22/d100/l95 0 2024-09-21T10:40:56.138 INFO:tasks.workunit.client.1.smithi112.stdout:3/909: sync 2024-09-21T10:40:56.139 INFO:tasks.workunit.client.1.smithi112.stdout:4/929: rmdir de 39 2024-09-21T10:40:56.141 INFO:tasks.workunit.client.0.smithi060.stdout:6/325: truncate d3/fb 2245132 0 2024-09-21T10:40:56.141 INFO:tasks.workunit.client.0.smithi060.stdout:6/326: write d3/d12/d16/d25/f3e [1375181,43625] 0 2024-09-21T10:40:56.141 INFO:tasks.workunit.client.1.smithi112.stdout:8/947: rename d8/d9/f13 to d8/d9/d3c/d57/f11b 0 2024-09-21T10:40:56.144 INFO:tasks.workunit.client.1.smithi112.stdout:0/925: truncate d3/d18/f80 126641 0 2024-09-21T10:40:56.144 INFO:tasks.workunit.client.0.smithi060.stdout:6/327: getdents d3/d12/d4e 0 2024-09-21T10:40:56.145 INFO:tasks.workunit.client.1.smithi112.stdout:2/854: write d0/d12/f41 [1761329,126735] 0 2024-09-21T10:40:56.146 INFO:tasks.workunit.client.1.smithi112.stdout:2/855: readlink d0/d12/d46/da0/db9/dbd/d62/d63/l1c 0 2024-09-21T10:40:56.146 INFO:tasks.workunit.client.0.smithi060.stdout:6/328: mknod d3/d12/d38/d41/c5f 0 2024-09-21T10:40:56.147 INFO:tasks.workunit.client.1.smithi112.stdout:6/961: dread d4/d6/da/d11/d37/f70 [0,4194304] 0 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.1.smithi112.stdout:4/930: chown c3 8240320 1 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/948: creat d9/d15/d18/d3a/d61/f133 x:0 0 0 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/949: chown d9/d15/d18/d20/d47/dc6/l112 1015 1 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/950: read d9/d15/d18/d3a/d4b/d74/d8d/d9a/dbf/fd9 [3947324,128215] 0 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/951: chown d9/fb3 465860 1 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.1.smithi112.stdout:5/952: dread - d9/d15/d18/d3a/d61/d62/d6b/fda zero size 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/329: rmdir d3/d12/d16/d1a/d21 39 2024-09-21T10:40:56.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/330: fsync d3/d12/d16/d1a/f4f 0 2024-09-21T10:40:56.151 INFO:tasks.workunit.client.1.smithi112.stdout:7/913: rename d7/d22/d41/d56/d72/lbb to d7/d3d/da7/d105/l130 0 2024-09-21T10:40:56.152 INFO:tasks.workunit.client.1.smithi112.stdout:8/948: creat d8/d9/d3c/d6d/dd0/f11c x:0 0 0 2024-09-21T10:40:56.156 INFO:tasks.workunit.client.1.smithi112.stdout:0/926: mknod d3/d18/d52/d55/dcc/d10b/c136 0 2024-09-21T10:40:56.156 INFO:tasks.workunit.client.0.smithi060.stdout:4/323: dwrite d0/d5/d12/d16/d28/f2d [0,4194304] 0 2024-09-21T10:40:56.165 INFO:tasks.workunit.client.1.smithi112.stdout:4/931: truncate de/d33/d2f/d71/f101 6050555 0 2024-09-21T10:40:56.166 INFO:tasks.workunit.client.1.smithi112.stdout:5/953: read d9/d15/d18/f82 [1559288,40939] 0 2024-09-21T10:40:56.166 INFO:tasks.workunit.client.1.smithi112.stdout:5/954: chown d9/c7b 33267726 1 2024-09-21T10:40:56.169 INFO:tasks.workunit.client.1.smithi112.stdout:7/914: rename d7/d3d/da7/d111 to d7/d3d/d131 0 2024-09-21T10:40:56.170 INFO:tasks.workunit.client.0.smithi060.stdout:4/324: mkdir d0/d3c/d69/d6a 0 2024-09-21T10:40:56.173 INFO:tasks.workunit.client.1.smithi112.stdout:5/955: creat d9/d15/d18/d20/d55/dbb/f134 x:0 0 0 2024-09-21T10:40:56.173 INFO:tasks.workunit.client.1.smithi112.stdout:5/956: chown d9/d15/f6a 0 1 2024-09-21T10:40:56.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/949: rename d8/d9/dd/d76/fac to d8/d9/d3c/d90/dfb/d118/d8e/dcb/d82/f11d 0 2024-09-21T10:40:56.175 INFO:tasks.workunit.client.1.smithi112.stdout:8/950: fsync d8/d9/d3c/d6d/f9d 0 2024-09-21T10:40:56.175 INFO:tasks.workunit.client.1.smithi112.stdout:7/915: symlink d7/d22/d41/d54/d4d/d10b/l132 0 2024-09-21T10:40:56.176 INFO:tasks.workunit.client.1.smithi112.stdout:7/916: write d7/d22/d41/d4b/d52/d77/f117 [936337,92005] 0 2024-09-21T10:40:56.176 INFO:tasks.workunit.client.1.smithi112.stdout:4/932: getdents de/d18 0 2024-09-21T10:40:56.177 INFO:tasks.workunit.client.1.smithi112.stdout:5/957: mknod d9/d15/d18/d20/c135 0 2024-09-21T10:40:56.181 INFO:tasks.workunit.client.0.smithi060.stdout:4/325: write d0/d5/f1a [250951,114233] 0 2024-09-21T10:40:56.185 INFO:tasks.workunit.client.1.smithi112.stdout:7/917: read d7/d22/f35 [1513684,40298] 0 2024-09-21T10:40:56.185 INFO:tasks.workunit.client.1.smithi112.stdout:3/910: dwrite d2/d2f/d3f/ddf/d31/f36 [0,4194304] 0 2024-09-21T10:40:56.185 INFO:tasks.workunit.client.1.smithi112.stdout:3/911: stat d2/d2f/d3f/ddf/c73 0 2024-09-21T10:40:56.187 INFO:tasks.workunit.client.1.smithi112.stdout:3/912: creat d2/d2f/d3f/ddf/d31/d2a/dff/f12a x:0 0 0 2024-09-21T10:40:56.187 INFO:tasks.workunit.client.1.smithi112.stdout:8/951: dread d8/d9/dd/d2b/d31/d46/d86/f91 [0,4194304] 0 2024-09-21T10:40:56.188 INFO:tasks.workunit.client.1.smithi112.stdout:8/952: truncate d8/d9/fba 2644062 0 2024-09-21T10:40:56.190 INFO:tasks.workunit.client.1.smithi112.stdout:6/962: dwrite d4/d4f/fea [4194304,4194304] 0 2024-09-21T10:40:56.191 INFO:tasks.workunit.client.1.smithi112.stdout:6/963: fdatasync d4/d6/da/d14/d49/d73/f13c 0 2024-09-21T10:40:56.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/331: dwrite d3/d12/d16/f40 [4194304,4194304] 0 2024-09-21T10:40:56.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/332: chown d3/d12/d38/d41/f44 135222844 1 2024-09-21T10:40:56.191 INFO:tasks.workunit.client.0.smithi060.stdout:6/333: truncate d3/f30 5213792 0 2024-09-21T10:40:56.192 INFO:tasks.workunit.client.0.smithi060.stdout:6/334: mkdir d3/d12/d16/d1a/d60 0 2024-09-21T10:40:56.193 INFO:tasks.workunit.client.1.smithi112.stdout:2/856: dwrite d0/da4/dbe/f8e [0,4194304] 0 2024-09-21T10:40:56.195 INFO:tasks.workunit.client.0.smithi060.stdout:6/335: link d3/d12/d16/d25/d27/f5a d3/d12/d16/d25/d27/f61 0 2024-09-21T10:40:56.196 INFO:tasks.workunit.client.1.smithi112.stdout:4/933: write de/d33/d2f/d71/f9e [179207,123577] 0 2024-09-21T10:40:56.196 INFO:tasks.workunit.client.1.smithi112.stdout:0/927: dwrite d3/d4a/d4e/d72/da0/f107 [0,4194304] 0 2024-09-21T10:40:56.200 INFO:tasks.workunit.client.0.smithi060.stdout:6/336: creat d3/d12/d38/d41/f62 x:0 0 0 2024-09-21T10:40:56.204 INFO:tasks.workunit.client.1.smithi112.stdout:4/934: creat de/d33/d2f/d35/df3/dcc/f13a x:0 0 0 2024-09-21T10:40:56.205 INFO:tasks.workunit.client.0.smithi060.stdout:6/337: creat d3/d12/d16/d22/f63 x:0 0 0 2024-09-21T10:40:56.207 INFO:tasks.workunit.client.1.smithi112.stdout:5/958: dwrite d9/d8a/fa0 [0,4194304] 0 2024-09-21T10:40:56.207 INFO:tasks.workunit.client.1.smithi112.stdout:5/959: write d9/fb3 [4988378,105203] 0 2024-09-21T10:40:56.208 INFO:tasks.workunit.client.0.smithi060.stdout:2/150: sync 2024-09-21T10:40:56.209 INFO:tasks.workunit.client.0.smithi060.stdout:6/338: creat d3/dd/f64 x:0 0 0 2024-09-21T10:40:56.209 INFO:tasks.workunit.client.0.smithi060.stdout:6/339: write d3/d12/d16/d1a/f3c [958111,51928] 0 2024-09-21T10:40:56.211 INFO:tasks.workunit.client.1.smithi112.stdout:4/935: rmdir de/d18/d6d 39 2024-09-21T10:40:56.214 INFO:tasks.workunit.client.0.smithi060.stdout:1/248: sync 2024-09-21T10:40:56.214 INFO:tasks.workunit.client.0.smithi060.stdout:1/249: chown d6/f44 59036702 1 2024-09-21T10:40:56.214 INFO:tasks.workunit.client.0.smithi060.stdout:1/250: creat d6/f58 x:0 0 0 2024-09-21T10:40:56.215 INFO:tasks.workunit.client.0.smithi060.stdout:6/340: rmdir d3 39 2024-09-21T10:40:56.220 INFO:tasks.workunit.client.0.smithi060.stdout:2/151: dread f2 [4194304,4194304] 0 2024-09-21T10:40:56.223 INFO:tasks.workunit.client.1.smithi112.stdout:5/960: creat d9/d8a/d101/f136 x:0 0 0 2024-09-21T10:40:56.223 INFO:tasks.workunit.client.1.smithi112.stdout:5/961: truncate d9/d15/d18/f39 2841777 0 2024-09-21T10:40:56.227 INFO:tasks.workunit.client.1.smithi112.stdout:4/936: rename de/d33/d2f/d35/f36 to de/d33/d2f/d35/df3/dc2/dad/f13b 0 2024-09-21T10:40:56.227 INFO:tasks.workunit.client.1.smithi112.stdout:4/937: chown de/l1f 3503 1 2024-09-21T10:40:56.229 INFO:tasks.workunit.client.1.smithi112.stdout:5/962: mkdir d9/d6e/dfb/d137 0 2024-09-21T10:40:56.229 INFO:tasks.workunit.client.1.smithi112.stdout:5/963: readlink d9/d15/d18/d20/d55/l84 0 2024-09-21T10:40:56.239 INFO:tasks.workunit.client.1.smithi112.stdout:0/928: dwrite d3/d4a/d4e/dc2/d43/faf [0,4194304] 0 2024-09-21T10:40:56.239 INFO:tasks.workunit.client.1.smithi112.stdout:0/929: write d3/d4a/f96 [329553,12604] 0 2024-09-21T10:40:56.239 INFO:tasks.workunit.client.1.smithi112.stdout:6/964: dwrite d4/d6/da/d11/d37/fee [0,4194304] 0 2024-09-21T10:40:56.244 INFO:tasks.workunit.client.1.smithi112.stdout:6/965: rename d4/d6/da/d14/d49/d73/fac to d4/d4f/f14e 0 2024-09-21T10:40:56.248 INFO:tasks.workunit.client.1.smithi112.stdout:0/930: dread d3/d18/d52/d55/dcc/d10b/d7f/f82 [0,4194304] 0 2024-09-21T10:40:56.249 INFO:tasks.workunit.client.1.smithi112.stdout:0/931: rename d3/d4a/d4e/dc2/d1a/c3e to d3/d18/d52/d55/dcc/d10b/ddf/c137 0 2024-09-21T10:40:56.257 INFO:tasks.workunit.client.1.smithi112.stdout:3/913: dwrite d2/d2f/d3f/ddf/d31/f62 [0,4194304] 0 2024-09-21T10:40:56.259 INFO:tasks.workunit.client.1.smithi112.stdout:8/953: dwrite d8/d9/f103 [0,4194304] 0 2024-09-21T10:40:56.259 INFO:tasks.workunit.client.1.smithi112.stdout:3/914: dread d2/d2f/d3f/ddf/d31/d2a/d39/d3a/d76/f8e [0,4194304] 0 2024-09-21T10:40:56.259 INFO:tasks.workunit.client.1.smithi112.stdout:2/857: dwrite d0/f10 [4194304,4194304] 0 2024-09-21T10:40:56.260 INFO:tasks.workunit.client.0.smithi060.stdout:1/251: dwrite d6/d24/da/db/de/d32/f37 [4194304,4194304] 0 2024-09-21T10:40:56.260 INFO:tasks.workunit.client.1.smithi112.stdout:6/966: dread d4/d6/da/d11/d1f/d22/d100/f85 [0,4194304] 0 2024-09-21T10:40:56.260 INFO:tasks.workunit.client.1.smithi112.stdout:7/918: dwrite d7/d3d/f67 [0,4194304] 0 2024-09-21T10:40:56.260 INFO:tasks.workunit.client.1.smithi112.stdout:7/919: write d7/d22/d86/fb5 [214749,91969] 0 2024-09-21T10:40:56.265 INFO:tasks.workunit.client.1.smithi112.stdout:8/954: mkdir d8/d9/d3c/d90/dfb/d11e 0 2024-09-21T10:40:56.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/915: symlink d2/dd5/l12b 0 2024-09-21T10:40:56.268 INFO:tasks.workunit.client.1.smithi112.stdout:3/916: dread - d2/d2f/d3f/ddf/d31/d2a/d39/d3a/f112 zero size 2024-09-21T10:40:56.268 INFO:tasks.workunit.client.0.smithi060.stdout:1/252: rmdir d6/d24/da/db/d1c 39 2024-09-21T10:40:56.268 INFO:tasks.workunit.client.0.smithi060.stdout:1/253: chown d6/d24/da/db/de/l3e 1 1 2024-09-21T10:40:56.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/858: write d0/d12/d46/da0/fab [11604165,97704] 0 2024-09-21T10:40:56.270 INFO:tasks.workunit.client.1.smithi112.stdout:2/859: write d0/da4/dbe/df4/d7e/d8f/d51/d57/fb2 [4773225,68164] 0 2024-09-21T10:40:56.271 INFO:tasks.workunit.client.0.smithi060.stdout:1/254: creat d6/d24/f59 x:0 0 0 2024-09-21T10:40:56.271 INFO:tasks.workunit.client.0.smithi060.stdout:1/255: fdatasync d6/d24/da/db/f29 0 2024-09-21T10:40:56.273 INFO:tasks.workunit.client.1.smithi112.stdout:6/967: write d4/d6/da/d14/d49/d73/f7f [1596821,15797] 0 2024-09-21T10:40:56.273 INFO:tasks.workunit.client.0.smithi060.stdout:1/256: mkdir d6/d4a/d5a 0 2024-09-21T10:40:56.275 INFO:tasks.workunit.client.0.smithi060.stdout:2/152: dwrite d3/f12 [4194304,4194304] 0 2024-09-21T10:40:56.275 INFO:tasks.workunit.client.0.smithi060.stdout:2/153: fsync d3/f12 0 2024-09-21T10:40:56.275 INFO:tasks.workunit.client.0.smithi060.stdout:2/154: rename d3/d20/d15 to d3/d20/d15/d2d 22 2024-09-21T10:40:56.275 INFO:tasks.workunit.client.0.smithi060.stdout:2/155: chown d3/d20/d15/c2c 1661 1 2024-09-21T10:40:56.275 INFO:tasks.workunit.client.1.smithi112.stdout:5/964: dwrite d9/d6e/dfb/f103 [0,4194304] 0 2024-09-21T10:40:56.276 INFO:tasks.workunit.client.0.smithi060.stdout:1/257: stat d6/d24/c54 0 2024-09-21T10:40:56.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/920: symlink d7/d22/d41/d4b/d52/d77/dbd/de4/l133 0 2024-09-21T10:40:56.284 INFO:tasks.workunit.client.1.smithi112.stdout:7/921: fsync d7/d22/d41/d56/ffb 0 2024-09-21T10:40:56.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/922: write d7/f26 [4955047,52062] 0 2024-09-21T10:40:56.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/923: creat d7/d22/d41/d4b/d52/d77/dbd/f134 x:0 0 0 2024-09-21T10:40:56.285 INFO:tasks.workunit.client.1.smithi112.stdout:8/955: dwrite d8/d18/f5b [4194304,4194304] 0 2024-09-21T10:40:56.289 INFO:tasks.workunit.client.1.smithi112.stdout:2/860: symlink d0/dd/d47/dd0/l119 0 2024-09-21T10:40:56.289 INFO:tasks.workunit.client.1.smithi112.stdout:2/861: read - d0/da4/dbe/df4/d7e/f81 zero size 2024-09-21T10:40:56.294 INFO:tasks.workunit.client.1.smithi112.stdout:5/965: creat d9/d15/d18/d3a/d4b/d74/f138 x:0 0 0 2024-09-21T10:40:56.295 INFO:tasks.workunit.client.1.smithi112.stdout:7/924: symlink d7/d22/d41/d56/d5c/d9b/l135 0 2024-09-21T10:40:56.297 INFO:tasks.workunit.client.1.smithi112.stdout:8/956: rmdir d8/d9/d3c/d90/dfb/d118/d101 39 2024-09-21T10:40:56.299 INFO:tasks.workunit.client.1.smithi112.stdout:3/917: link d2/d8d/f8f d2/d2f/d3f/f12c 0 2024-09-21T10:40:56.299 INFO:tasks.workunit.client.1.smithi112.stdout:3/918: read - d2/d2f/d3f/ddf/d31/d2a/dff/f12a zero size 2024-09-21T10:40:56.299 INFO:tasks.workunit.client.1.smithi112.stdout:3/919: write d2/dd5/d107/f118 [586987,34634] 0 2024-09-21T10:40:56.299 INFO:tasks.workunit.client.1.smithi112.stdout:3/920: fdatasync d2/d2f/f6a 0 2024-09-21T10:40:56.301 INFO:tasks.workunit.client.1.smithi112.stdout:2/862: creat d0/d12/d46/da0/db9/dbd/f11a x:0 0 0 2024-09-21T10:40:56.302 INFO:tasks.workunit.client.1.smithi112.stdout:5/966: symlink d9/d15/d18/d3a/d4b/d74/d8d/d9a/ddf/l139 0 2024-09-21T10:40:56.302 INFO:tasks.workunit.client.1.smithi112.stdout:5/967: chown d9/d15/d18/d3a/f5b 1 1 2024-09-21T10:40:56.302 INFO:tasks.workunit.client.1.smithi112.stdout:5/968: chown d9/d15/d18/d3a/d4b/d74/d8d/fd5 3214 1 2024-09-21T10:40:56.304 INFO:tasks.workunit.client.1.smithi112.stdout:8/957: unlink d8/d9/d3c/d90/dfb/d118/d8e/dcb/f5e 0 2024-09-21T10:40:56.304 INFO:tasks.workunit.client.1.smithi112.stdout:8/958: chown d8/d9/d3c/d90/dfb/d118/d101/l119 52116 1 2024-09-21T10:40:56.304 INFO:tasks.workunit.client.1.smithi112.stdout:8/959: write d8/d9/dd/d2b/d31/d46/d86/fb5 [555121,110638] 0 2024-09-21T10:40:56.304 INFO:tasks.workunit.client.0.smithi060.stdout:1/258: dwrite d6/d24/da/db/de/f1a [0,4194304] 0 2024-09-21T10:40:56.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/156: dwrite d3/d20/f11 [0,4194304] 0 2024-09-21T10:40:56.305 INFO:tasks.workunit.client.0.smithi060.stdout:2/157: write d3/d20/d15/d1f/f28 [466147,125193] 0 2024-09-21T10:40:56.305 INFO:tasks.workunit.client.1.smithi112.stdout:3/921: symlink d2/dd5/l12d 0 2024-09-21T10:40:56.305 INFO:tasks.workunit.client.1.smithi112.stdout:3/922: dread - d2/d2f/d3f/ddf/d31/d2a/d39/fc7 zero size 2024-09-21T10:40:56.307 INFO:tasks.workunit.client.1.smithi112.stdout:2/863: mknod d0/d12/d76/c11b 0 2024-09-21T10:40:56.307 INFO:tasks.workunit.client.1.smithi112.stdout:9/962: sync 2024-09-21T10:40:56.309 INFO:tasks.workunit.client.1.smithi112.stdout:8/960: mknod d8/d9/dd/d2b/db8/c11f 0 2024-09-21T10:40:56.310 INFO:tasks.workunit.client.1.smithi112.stdout:7/925: write d7/d22/d86/dac/d8a/f8d [3764334,94649] 0 2024-09-21T10:40:56.310 INFO:tasks.workunit.client.1.smithi112.stdout:7/926: write d7/d22/fdc [531032,97103] 0 2024-09-21T10:40:56.311 INFO:tasks.workunit.client.0.smithi060.stdout:1/259: creat d6/d4a/d5a/f5b x:0 0 0 2024-09-21T10:40:56.312 INFO:tasks.workunit.client.1.smithi112.stdout:8/961: dread d8/d9/d3c/d90/dfb/d118/f10c [0,4194304] 0 2024-09-21T10:40:56.314 INFO:tasks.workunit.client.1.smithi112.stdout:9/963: rename d1/d81/ce9 to d1/d2/d27/d37/c15d 0 2024-09-21T10:40:56.315 INFO:tasks.workunit.client.0.smithi060.stdout:2/158: mknod d3/d20/d17/c2e 0 2024-09-21T10:40:56.317 INFO:tasks.workunit.client.1.smithi112.stdout:7/927: mkdir d7/d22/d86/dac/d8a/d136 0 2024-09-21T10:40:56.319 INFO:tasks.workunit.client.0.smithi060.stdout:1/260: link d6/d24/da/db/dd/l25 d6/d24/da/db/d1c/d4b/l5c 0 2024-09-21T10:40:56.319 INFO:tasks.workunit.client.1.smithi112.stdout:2/864: getdents d0/d12/d97 0 2024-09-21T10:40:56.321 INFO:tasks.workunit.client.1.smithi112.stdout:3/923: dwrite d2/d1f/f4f [0,4194304] 0 2024-09-21T10:40:56.323 INFO:tasks.workunit.client.1.smithi112.stdout:5/969: dwrite d9/d15/d18/d3a/f44 [0,4194304] 0 2024-09-21T10:40:56.324 INFO:tasks.workunit.client.0.smithi060.stdout:2/159: creat d3/d7/d23/f2f x:0 0 0 2024-09-21T10:40:56.325 INFO:tasks.workunit.client.1.smithi112.stdout:8/962: symlink d8/d9/dd/d2b/l120 0 2024-09-21T10:40:56.325 INFO:tasks.workunit.client.1.smithi112.stdout:8/963: chown d8/d9/dd/d76/d97/cdb 156391448 1 2024-09-21T10:40:56.326 INFO:tasks.workunit.client.1.smithi112.stdout:2/865: link d0/d12/d46/d86/dc0/dc8/d108/f92 d0/d12/d46/d86/dc0/dc8/dfa/f11c 0 2024-09-21T10:40:56.327 INFO:tasks.workunit.client.0.smithi060.stdout:2/160: mkdir d3/d20/d15/d30 0 2024-09-21T10:40:56.329 INFO:tasks.workunit.client.1.smithi112.stdout:3/924: creat d2/d2f/d3f/ddf/d31/df5/f12e x:0 0 0 2024-09-21T10:40:56.329 INFO:tasks.workunit.client.1.smithi112.stdout:3/925: write d2/d2f/fd4 [571299,61509] 0 2024-09-21T10:40:56.333 INFO:tasks.workunit.client.1.smithi112.stdout:5/970: mknod d9/d15/d18/d3a/d4b/d71/d113/c13a 0 2024-09-21T10:40:56.334 INFO:tasks.workunit.client.1.smithi112.stdout:8/964: rmdir d8/d9/dd/d2b/d31 39 2024-09-21T10:40:56.336 INFO:tasks.workunit.client.1.smithi112.stdout:2/866: creat d0/da4/dbe/df4/d7e/d8f/f11d x:0 0 0 2024-09-21T10:40:56.337 INFO:tasks.workunit.client.1.smithi112.stdout:2/867: fsync d0/da4/dbe/df4/f100 0 2024-09-21T10:40:56.337 INFO:tasks.workunit.client.1.smithi112.stdout:3/926: fsync d2/d2f/d3f/ddf/d31/d2a/d39/d3a/fb6 0 2024-09-21T10:40:56.339 INFO:tasks.workunit.client.1.smithi112.stdout:5/971: creat d9/d8a/f13b x:0 0 0 2024-09-21T10:40:56.340 INFO:tasks.workunit.client.1.smithi112.stdout:8/965: mkdir d8/d9/dd/d2a/db6/d121 0 2024-09-21T10:40:56.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/868: symlink d0/d12/d76/l11e 0 2024-09-21T10:40:56.343 INFO:tasks.workunit.client.1.smithi112.stdout:2/869: stat d0/d12/d46/da0/db9/dbd/d62/f87 0 2024-09-21T10:40:56.343 INFO:tasks.workunit.client.1.smithi112.stdout:3/927: creat d2/d2f/d3f/ddf/d31/d37/f12f x:0 0 0 2024-09-21T10:40:56.344 INFO:tasks.workunit.client.1.smithi112.stdout:9/964: dwrite d1/d2/d27/d3a/de3/db5/fea [0,4194304] 0 2024-09-21T10:40:56.346 INFO:tasks.workunit.client.1.smithi112.stdout:5/972: mkdir d9/d15/d18/d3a/d4b/d71/d113/d13c 0 2024-09-21T10:40:56.347 INFO:tasks.workunit.client.1.smithi112.stdout:3/928: creat d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dd8/f130 x:0 0 0 2024-09-21T10:40:56.347 INFO:tasks.workunit.client.1.smithi112.stdout:3/929: write d2/d2f/d3f/ddf/d31/dcf/fb2 [305716,84361] 0 2024-09-21T10:40:56.347 INFO:tasks.workunit.client.1.smithi112.stdout:3/930: stat d2/d2f/f111 0 2024-09-21T10:40:56.349 INFO:tasks.workunit.client.1.smithi112.stdout:9/965: truncate d1/d2/d27/d3a/d6b/d30/f54 1275964 0 2024-09-21T10:40:56.351 INFO:tasks.workunit.client.0.smithi060.stdout:1/261: dwrite d6/d24/fc [8388608,4194304] 0 2024-09-21T10:40:56.351 INFO:tasks.workunit.client.0.smithi060.stdout:1/262: write d6/d24/f59 [884630,47496] 0 2024-09-21T10:40:56.351 INFO:tasks.workunit.client.1.smithi112.stdout:3/931: rename d2/d2f/d3f/ddf/d31/dcf/fb2 to d2/d2f/d3f/ddf/d31/d2a/f131 0 2024-09-21T10:40:56.354 INFO:tasks.workunit.client.1.smithi112.stdout:9/966: unlink d1/d2/d27/d3a/d6b/d30/c150 0 2024-09-21T10:40:56.354 INFO:tasks.workunit.client.1.smithi112.stdout:8/966: dread d8/d9/f25 [0,4194304] 0 2024-09-21T10:40:56.356 INFO:tasks.workunit.client.0.smithi060.stdout:2/161: dwrite d3/d7/fd [0,4194304] 0 2024-09-21T10:40:56.356 INFO:tasks.workunit.client.0.smithi060.stdout:2/162: dread - d3/d7/d23/f2f zero size 2024-09-21T10:40:56.356 INFO:tasks.workunit.client.0.smithi060.stdout:2/163: truncate d3/d20/f11 4373547 0 2024-09-21T10:40:56.359 INFO:tasks.workunit.client.1.smithi112.stdout:8/967: link d8/d9/d3c/d57/cd9 d8/d9/dd/d76/c122 0 2024-09-21T10:40:56.361 INFO:tasks.workunit.client.1.smithi112.stdout:3/932: rmdir d2/d2f/d3f/ddf/d31/d2a/dfe/d11e 39 2024-09-21T10:40:56.364 INFO:tasks.workunit.client.0.smithi060.stdout:1/263: link d6/c7 d6/d24/da/db/d1c/c5d 0 2024-09-21T10:40:56.364 INFO:tasks.workunit.client.0.smithi060.stdout:1/264: readlink d6/l9 0 2024-09-21T10:40:56.365 INFO:tasks.workunit.client.0.smithi060.stdout:1/265: write d6/d24/da/db/de/f21 [3228506,25330] 0 2024-09-21T10:40:56.365 INFO:tasks.workunit.client.1.smithi112.stdout:8/968: getdents d8/d9/d3c/d90/dfb/d118/d8e 0 2024-09-21T10:40:56.368 INFO:tasks.workunit.client.1.smithi112.stdout:3/933: unlink d2/d2f/d3f/ddf/d31/d2a/d39/d60/d86/dd8/f130 0 2024-09-21T10:40:56.370 INFO:tasks.workunit.client.0.smithi060.stdout:2/164: rename d3/d20/d15/d1f/c26 to d3/d20/d15/d30/c31 0 2024-09-21T10:40:56.370 INFO:tasks.workunit.client.0.smithi060.stdout:2/165: rename d3 to d3/d7/d24/d32 22 2024-09-21T10:40:56.370 INFO:tasks.workunit.client.0.smithi060.stdout:2/166: write d3/d7/d24/f2a [647509,88942] 0 2024-09-21T10:40:56.371 INFO:tasks.workunit.client.0.smithi060.stdout:2/167: read f2 [2256860,18964] 0 2024-09-21T10:40:56.371 INFO:tasks.workunit.client.0.smithi060.stdout:2/168: write d3/d20/f11 [4534429,119167] 0 2024-09-21T10:40:56.371 INFO:tasks.workunit.client.1.smithi112.stdout:8/969: truncate d8/d9/dd/d2a/d43/f6f 80644 0 2024-09-21T10:40:56.371 INFO:tasks.workunit.client.1.smithi112.stdout:8/970: write d8/d9/d3c/f50 [470442,72634] 0 2024-09-21T10:40:56.375 INFO:tasks.workunit.client.1.smithi112.stdout:2/870: dwrite d0/d12/d46/da0/db9/dbd/d62/fa8 [0,4194304] 0 2024-09-21T10:40:56.375 INFO:tasks.workunit.client.1.smithi112.stdout:5/973: dwrite d9/d15/d18/d20/d55/dbb/fdd [4194304,4194304] 0 2024-09-21T10:40:56.376 INFO:tasks.workunit.client.1.smithi112.stdout:3/934: unlink d2/d2f/d3f/ddf/d31/d37/cb7 0 2024-09-21T10:40:56.381 INFO:tasks.workunit.client.1.smithi112.stdout:9/967: dwrite d1/d2/d27/f2f [0,4194304] 0 2024-09-21T10:40:56.382 INFO:tasks.workunit.client.1.smithi112.stdout:8/971: mkdir d8/d9/dd/d2a/db6/df0/d123 0 2024-09-21T10:40:56.384 INFO:tasks.workunit.client.1.smithi112.stdout:2/871: mknod d0/da4/dbe/c11f 0 2024-09-21T10:40:56.384 INFO:tasks.workunit.client.1.smithi112.stdout:4/938: sync 2024-09-21T10:40:56.385 INFO:tasks.workunit.client.1.smithi112.stdout:5/974: mknod d9/d15/d18/d3a/d61/d62/d6b/c13d 0 2024-09-21T10:40:56.385 INFO:tasks.workunit.client.1.smithi112.stdout:5/975: read d9/d15/d18/d3a/d4b/ff7 [68903,37921] 0 2024-09-21T10:40:56.387 INFO:tasks.workunit.client.0.smithi060.stdout:1/266: dwrite d6/d24/da/db/de/f21 [0,4194304] 0 2024-09-21T10:40:56.391 INFO:tasks.workunit.client.1.smithi112.stdout:8/972: mkdir d8/d9/d3c/d90/dfb/d118/d8e/dcb/d82/dcc/d124 0 2024-09-21T10:40:56.392 INFO:tasks.workunit.client.0.smithi060.stdout:1/267: dread d6/d24/da/db/de/d32/f3b [0,4194304] 0 2024-09-21T10:40:56.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/169: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:40:56.393 INFO:tasks.workunit.client.1.smithi112.stdout:2/872: dread d0/da4/dbe/df4/d7e/d8f/d51/d57/fb2 [0,4194304] 0 2024-09-21T10:40:56.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/290: sync 2024-09-21T10:40:56.394 INFO:tasks.workunit.client.0.smithi060.stdout:8/266: sync 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/217: sync 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.0.smithi060.stdout:5/268: sync 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.0.smithi060.stdout:5/269: chown d5/d9/d10/d19/d21/d30/f47 35036 1 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.0.smithi060.stdout:0/252: sync 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.0.smithi060.stdout:1/268: getdents d6/d24/da/d45 0 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.1.smithi112.stdout:8/973: creat d8/d9/dd/d2a/d43/f125 x:0 0 0 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.1.smithi112.stdout:8/974: chown d8/d9/d3c/d90/dfb/d118/f10c 3109 1 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.1.smithi112.stdout:8/975: fsync d8/d9/ff8 0 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.1.smithi112.stdout:4/939: dread de/d33/d2f/d35/d4c/fcd [0,4194304] 0 2024-09-21T10:40:56.395 INFO:tasks.workunit.client.1.smithi112.stdout:4/940: write de/d33/d2f/fff [220461,17188] 0 2024-09-21T10:40:56.396 INFO:tasks.workunit.client.1.smithi112.stdout:4/941: readlink de/d33/d6f/l86 0 2024-09-21T10:40:56.398 INFO:tasks.workunit.client.1.smithi112.stdout:8/976: dread d8/d9/dd/d2b/fca [0,4194304] 0 2024-09-21T10:40:56.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/270: dread d5/d9/f1d [0,4194304] 0 2024-09-21T10:40:56.400 INFO:tasks.workunit.client.1.smithi112.stdout:4/942: mkdir de/d33/d6f/d9c/dc8/d13c 0 2024-09-21T10:40:56.403 INFO:tasks.workunit.client.1.smithi112.stdout:8/977: mknod d8/d9/d3c/d90/c126 0 2024-09-21T10:40:56.403 INFO:tasks.workunit.client.1.smithi112.stdout:8/978: chown d8/d9/d3c/d90/c126 36 1 2024-09-21T10:40:56.406 INFO:tasks.workunit.client.1.smithi112.stdout:4/943: mkdir de/d13d 0 2024-09-21T10:40:56.407 INFO:tasks.workunit.client.0.smithi060.stdout:7/270: sync 2024-09-21T10:40:56.407 INFO:tasks.workunit.client.0.smithi060.stdout:4/326: sync 2024-09-21T10:40:56.407 INFO:tasks.workunit.client.0.smithi060.stdout:4/327: fdatasync d0/d5/f4b 0 2024-09-21T10:40:56.409 INFO:tasks.workunit.client.0.smithi060.stdout:2/170: write d3/d7/fd [1124875,130990] 0 2024-09-21T10:40:56.410 INFO:tasks.workunit.client.1.smithi112.stdout:8/979: symlink d8/d9/l127 0 2024-09-21T10:40:56.411 INFO:tasks.workunit.client.0.smithi060.stdout:3/218: creat d0/d1/d24/f40 x:0 0 0 2024-09-21T10:40:56.413 INFO:tasks.workunit.client.1.smithi112.stdout:4/944: symlink de/d2a/d31/l13e 0 2024-09-21T10:40:56.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/253: mkdir d5/d10/da/d16/d2a/d40 0 2024-09-21T10:40:56.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/254: chown d5/d10/da/d16 2 1 2024-09-21T10:40:56.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/255: dread - d5/d10/da/f39 zero size 2024-09-21T10:40:56.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/256: chown d5/d10/f8 1 1 2024-09-21T10:40:56.414 INFO:tasks.workunit.client.0.smithi060.stdout:0/257: read f2 [1352229,82667] 0 2024-09-21T10:40:56.415 INFO:tasks.workunit.client.1.smithi112.stdout:8/980: rename d8/d9/d3c/f10b to d8/d9/d3c/d90/dfb/d118/d101/f128 0 2024-09-21T10:40:56.417 INFO:tasks.workunit.client.0.smithi060.stdout:7/271: symlink da/d14/d15/l61 0 2024-09-21T10:40:56.419 INFO:tasks.workunit.client.0.smithi060.stdout:8/267: mkdir d2/d18/d60 0 2024-09-21T10:40:56.421 INFO:tasks.workunit.client.0.smithi060.stdout:0/258: creat d5/d10/da/d15/f41 x:0 0 0 2024-09-21T10:40:56.422 INFO:tasks.workunit.client.0.smithi060.stdout:5/271: getdents d5/d9/d10/d19 0 2024-09-21T10:40:56.422 INFO:tasks.workunit.client.0.smithi060.stdout:5/272: readlink d5/d9/d3e/d50/l54 0 2024-09-21T10:40:56.422 INFO:tasks.workunit.client.1.smithi112.stdout:0/932: sync 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:6/968: sync 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:6/969: fsync d4/d6/da/fa7 0 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/928: sync 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/929: creat d7/d22/d41/d80/f137 x:0 0 0 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:7/930: chown d7/d22/d41/d56/db7/f10a 1231163545 1 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/976: dwrite d9/d15/f24 [0,4194304] 0 2024-09-21T10:40:56.423 INFO:tasks.workunit.client.1.smithi112.stdout:5/977: chown d9/d15/d18/d3a/fad 195140 1 2024-09-21T10:40:56.424 INFO:tasks.workunit.client.1.smithi112.stdout:0/933: mkdir d3/d18/d52/df9/d130/d4f/d83/dd5/d138 0 2024-09-21T10:40:56.426 INFO:tasks.workunit.client.1.smithi112.stdout:4/945: write de/d18/fc6 [2744398,101625] 0 2024-09-21T10:40:56.426 INFO:tasks.workunit.client.1.smithi112.stdout:2/873: dwrite d0/d12/d76/f91 [0,4194304] 0 2024-09-21T10:40:56.427 INFO:tasks.workunit.client.0.smithi060.stdout:0/259: symlink d5/d10/da/d16/l42 0 2024-09-21T10:40:56.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/268: read d2/f15 [1898429,90309] 0 2024-09-21T10:40:56.429 INFO:tasks.workunit.client.0.smithi060.stdout:1/269: dwrite d6/d24/da/db/dd/f1d [0,4194304] 0 2024-09-21T10:40:56.430 INFO:tasks.workunit.client.1.smithi112.stdout:2/874: read d0/dd/fc2 [1267796,87656] 0 2024-09-21T10:40:56.431 INFO:tasks.workunit.client.1.smithi112.stdout:6/970: unlink d4/dc/d7e/f92 0 2024-09-21T10:40:56.433 INFO:tasks.workunit.client.0.smithi060.stdout:4/328: rename d0/d5/d12/d20 to d0/d3c/d69/d6a/d6b 0 2024-09-21T10:40:56.434 INFO:tasks.workunit.client.0.smithi060.stdout:0/260: dread d5/d10/da/f13 [0,4194304] 0 2024-09-21T10:40:56.435 INFO:tasks.workunit.client.1.smithi112.stdout:7/931: creat d7/d22/d41/d56/d5c/f138 x:0 0 0 2024-09-21T10:40:56.435 INFO:tasks.workunit.client.1.smithi112.stdout:7/932: stat d7/d3d/da7 0 2024-09-21T10:40:56.435 INFO:tasks.workunit.client.1.smithi112.stdout:7/933: fsync d7/d22/f46 0 2024-09-21T10:40:56.437 INFO:tasks.workunit.client.0.smithi060.stdout:6/341: sync 2024-09-21T10:40:56.437 INFO:tasks.workunit.client.0.smithi060.stdout:6/342: chown d3/d12/d16/d22/f48 55539 1 2024-09-21T10:40:56.438 INFO:tasks.workunit.client.1.smithi112.stdout:8/981: dwrite d8/d18/f24 [0,4194304] 0 2024-09-21T10:40:56.440 INFO:tasks.workunit.client.0.smithi060.stdout:7/272: rename da/d14/d35/f40 to da/d14/d25/d56/f62 0 2024-09-21T10:40:56.441 INFO:tasks.workunit.client.1.smithi112.stdout:0/934: truncate d3/d4a/d4e/dc2/f1d 6904866 0 2024-09-21T10:40:56.442 INFO:tasks.workunit.client.0.smithi060.stdout:2/171: truncate d3/f12 1565070 0 2024-09-21T10:40:56.442 INFO:tasks.workunit.client.1.smithi112.stdout:2/875: dread d0/dd/f3b [0,4194304] 0 2024-09-21T10:40:56.442 INFO:tasks.workunit.client.0.smithi060.stdout:4/329: readlink d0/d3c/l42 0 2024-09-21T10:40:56.442 INFO:tasks.workunit.client.0.smithi060.stdout:4/330: readlink d0/d5/d12/l63 0 2024-09-21T10:40:56.443 INFO:tasks.workunit.client.1.smithi112.stdout:2/876: dread d0/d12/d46/d86/ffb [0,4194304] 0 2024-09-21T10:40:56.443 INFO:tasks.workunit.client.1.smithi112.stdout:2/877: fsync d0/dd/fc2 0 2024-09-21T10:40:56.446 INFO:tasks.workunit.client.1.smithi112.stdout:4/946: unlink de/d33/d2f/d35/d4c/f97 0 2024-09-21T10:40:56.448 INFO:tasks.workunit.client.0.smithi060.stdout:6/343: mkdir d3/d12/d65 0 2024-09-21T10:40:56.450 INFO:tasks.workunit.client.0.smithi060.stdout:8/269: stat d2/d18/d4b/c56 0 2024-09-21T10:40:56.456 INFO:tasks.workunit.client.0.smithi060.stdout:0/261: rename d5/d10/da/d20/d33/d3f to d5/d10/d43 0 2024-09-21T10:40:56.457 INFO:tasks.workunit.client.1.smithi112.stdout:6/971: creat d4/d6/d75/db7/d13f/f14f x:0 0 0 2024-09-21T10:40:56.458 INFO:tasks.workunit.client.0.smithi060.stdout:7/273: symlink da/d14/d25/l63 0 2024-09-21T10:40:56.459 INFO:tasks.workunit.client.1.smithi112.stdout:7/934: symlink d7/d22/d41/d4b/d52/d77/dbd/l139 0 2024-09-21T10:40:56.459 INFO:tasks.workunit.client.1.smithi112.stdout:7/935: chown d7/d22/d78/f100 240 1 2024-09-21T10:40:56.460 INFO:tasks.workunit.client.0.smithi060.stdout:2/172: mkdir d3/d7/d24/d33 0 2024-09-21T10:40:56.461 INFO:tasks.workunit.client.1.smithi112.stdout:8/982: link d8/d9/dd/d2b/d31/d46/d86/cc8 d8/d9/dd/d2a/c129 0 2024-09-21T10:40:56.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/344: mkdir d3/d12/d65/d66 0 2024-09-21T10:40:56.463 INFO:tasks.workunit.client.1.smithi112.stdout:8/983: dread d8/d9/ff8 [0,4194304] 0 2024-09-21T10:40:56.463 INFO:tasks.workunit.client.1.smithi112.stdout:5/978: mkdir d9/d15/d13e 0 2024-09-21T10:40:56.465 INFO:tasks.workunit.client.0.smithi060.stdout:8/270: mkdir d2/d18/d4b/d61 0 2024-09-21T10:40:56.467 INFO:tasks.workunit.client.1.smithi112.stdout:4/947: creat de/d33/db5/f13f x:0 0 0 2024-09-21T10:40:56.467 INFO:tasks.workunit.client.1.smithi112.stdout:4/948: chown de/d33/d2f/d71/d40/l44 1004210224 1 2024-09-21T10:40:56.467 INFO:tasks.workunit.client.0.smithi060.stdout:0/262: truncate d5/d10/da/f13 697989 0 2024-09-21T10:40:56.469 INFO:tasks.workunit.client.1.smithi112.stdout:6/972: creat d4/d6/da/d14/d49/f150 x:0 0 0 2024-09-21T10:40:56.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/274: link da/d14/d35/f36 da/d14/d2a/d49/d27/f64 0 2024-09-21T10:40:56.472 INFO:tasks.workunit.client.0.smithi060.stdout:5/273: dwrite d5/d9/f2b [0,4194304] 0 2024-09-21T10:40:56.474 INFO:tasks.workunit.client.1.smithi112.stdout:8/984: link d8/d9/d3c/f52 d8/d9/d3c/d6d/dd0/f12a 0 2024-09-21T10:40:56.475 INFO:tasks.workunit.client.0.smithi060.stdout:2/173: unlink d3/d20/d15/d1f/f28 0 2024-09-21T10:40:56.477 INFO:tasks.workunit.client.1.smithi112.stdout:4/949: unlink de/d33/d2f/d71/d40/d4f/f6b 0 2024-09-21T10:40:56.478 INFO:tasks.workunit.client.0.smithi060.stdout:6/345: rename d3/d12/d16/d1a/d21/l5e to d3/d54/l67 0 2024-09-21T10:40:56.478 INFO:tasks.workunit.client.0.smithi060.stdout:6/346: creat d3/d12/d38/d41/f68 x:0 0 0 2024-09-21T10:40:56.479 INFO:tasks.workunit.client.0.smithi060.stdout:8/271: fdatasync d2/d18/f30 0 2024-09-21T10:40:56.479 INFO:tasks.workunit.client.1.smithi112.stdout:8/985: mknod d8/d9/d3c/d90/dfb/d118/d8e/dcb/c12b 0 2024-09-21T10:40:56.479 INFO:tasks.workunit.client.1.smithi112.stdout:8/986: fsync d8/d9/dd/d1a/f80 0 2024-09-21T10:40:56.479 INFO:tasks.workunit.client.1.smithi112.stdout:8/987: fsync d8/d9/dd/f5f 0 2024-09-21T10:40:56.480 INFO:tasks.workunit.client.0.smithi060.stdout:0/263: link d5/d10/da/l2e d5/d10/d11/l44 0 2024-09-21T10:40:56.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/275: creat da/d14/d2a/d49/d2e/f65 x:0 0 0 2024-09-21T10:40:56.482 INFO:tasks.workunit.client.1.smithi112.stdout:8/988: unlink d8/d9/d3c/d90/dfb/d118/d8e/dcb/d82/dcc/fce 0 2024-09-21T10:40:56.484 INFO:tasks.workunit.client.1.smithi112.stdout:8/989: symlink d8/d9/d3c/d90/l12c 0 2024-09-21T10:40:56.484 INFO:tasks.workunit.client.1.smithi112.stdout:8/990: fsync d8/d9/dd/d2b/d31/d46/d86/f102 0 2024-09-21T10:40:56.487 INFO:tasks.workunit.client.0.smithi060.stdout:0/264: rename d5/d10/da/d16 to d5/d10/da/d20/d45 0 2024-09-21T10:40:56.489 INFO:tasks.workunit.client.0.smithi060.stdout:7/276: rename da/d14/d33/c45 to da/d14/d2a/d49/d2e/c66 0 2024-09-21T10:40:56.490 INFO:tasks.workunit.client.1.smithi112.stdout:7/936: dread d7/d3d/fc7 [0,4194304] 0 2024-09-21T10:40:56.490 INFO:tasks.workunit.client.1.smithi112.stdout:7/937: chown d7/dbc/fd2 29847 1 2024-09-21T10:40:56.490 INFO:tasks.workunit.client.1.smithi112.stdout:7/938: chown d7/d22/d41/d54 15709 1 2024-09-21T10:40:56.490 INFO:tasks.workunit.client.1.smithi112.stdout:7/939: truncate d7/d3d/da7/fe1 303590 0 2024-09-21T10:40:56.491 INFO:tasks.workunit.client.0.smithi060.stdout:0/265: creat d5/d10/da/d20/d45/d2a/d40/f46 x:0 0 0 2024-09-21T10:40:56.493 INFO:tasks.workunit.client.1.smithi112.stdout:7/940: rename d7/d22/c29 to d7/d22/d41/d4b/d52/d77/dbd/de4/c13a 0 2024-09-21T10:40:56.493 INFO:tasks.workunit.client.1.smithi112.stdout:7/941: creat d7/d22/d41/d4b/d52/d77/dbd/de4/f13b x:0 0 0 2024-09-21T10:40:56.493 INFO:tasks.workunit.client.1.smithi112.stdout:7/942: stat d7/d22/d41/d4b/d5e/f82 0 2024-09-21T10:40:56.495 INFO:tasks.workunit.client.0.smithi060.stdout:7/277: dread da/d14/d25/f4a [0,4194304] 0 2024-09-21T10:40:56.497 INFO:tasks.workunit.client.0.smithi060.stdout:7/278: creat da/d14/d2a/d49/f67 x:0 0 0 2024-09-21T10:40:56.497 INFO:tasks.workunit.client.0.smithi060.stdout:7/279: chown da/d14/d15/ff 8140884 1 2024-09-21T10:40:56.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/280: creat da/d14/d35/d32/f68 x:0 0 0 2024-09-21T10:40:56.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/281: write da/d14/f19 [831456,69692] 0 2024-09-21T10:40:56.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/282: write da/d14/d15/f18 [3661528,110231] 0 2024-09-21T10:40:56.498 INFO:tasks.workunit.client.0.smithi060.stdout:7/283: creat da/d14/d33/f69 x:0 0 0 2024-09-21T10:40:56.499 INFO:tasks.workunit.client.1.smithi112.stdout:4/950: dwrite de/d2e/f130 [0,4194304] 0 2024-09-21T10:40:56.505 INFO:tasks.workunit.client.0.smithi060.stdout:5/274: write d5/f8 [2366310,92703] 0 2024-09-21T10:40:56.508 INFO:tasks.workunit.client.0.smithi060.stdout:8/272: dread d2/f1e [0,4194304] 0 2024-09-21T10:40:56.508 INFO:tasks.workunit.client.0.smithi060.stdout:8/273: stat d2/d26/f38 0 2024-09-21T10:40:56.508 INFO:tasks.workunit.client.0.smithi060.stdout:5/275: creat d5/d9/d10/d19/d21/f5f x:0 0 0 2024-09-21T10:40:56.508 INFO:tasks.workunit.client.0.smithi060.stdout:5/276: dread - d5/d45/d5a/f5d zero size 2024-09-21T10:40:56.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/274: mkdir d2/d26/d37/d62 0 2024-09-21T10:40:56.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/275: fdatasync d2/f47 0 2024-09-21T10:40:56.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/276: readlink d2/d26/l41 0 2024-09-21T10:40:56.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/277: write d2/d26/d37/f3d [482906,102118] 0 2024-09-21T10:40:56.511 INFO:tasks.workunit.client.0.smithi060.stdout:7/284: dread da/d14/d15/f13 [0,4194304] 0 2024-09-21T10:40:56.511 INFO:tasks.workunit.client.0.smithi060.stdout:7/285: dread - da/d14/d2a/d49/f67 zero size 2024-09-21T10:40:56.511 INFO:tasks.workunit.client.0.smithi060.stdout:7/286: fsync da/f24 0 2024-09-21T10:40:56.511 INFO:tasks.workunit.client.0.smithi060.stdout:5/277: mkdir d5/d9/d3e/d60 0 2024-09-21T10:40:56.512 INFO:tasks.workunit.client.0.smithi060.stdout:7/287: read da/d14/d35/d32/f52 [157720,89253] 0 2024-09-21T10:40:56.512 INFO:tasks.workunit.client.0.smithi060.stdout:5/278: truncate d5/d9/fe 4085133 0 2024-09-21T10:40:56.514 INFO:tasks.workunit.client.1.smithi112.stdout:4/951: dread de/f15 [0,4194304] 0 2024-09-21T10:40:56.514 INFO:tasks.workunit.client.0.smithi060.stdout:7/288: creat da/d14/d25/d56/f6a x:0 0 0 2024-09-21T10:40:56.514 INFO:tasks.workunit.client.0.smithi060.stdout:5/279: mkdir d5/d9/d3e/d60/d61 0 2024-09-21T10:40:56.517 INFO:tasks.workunit.client.0.smithi060.stdout:0/266: write d5/d10/f8 [1923587,115416] 0 2024-09-21T10:40:56.519 INFO:tasks.workunit.client.0.smithi060.stdout:8/278: write d2/d18/f30 [3901254,5712] 0 2024-09-21T10:40:56.521 INFO:tasks.workunit.client.0.smithi060.stdout:8/279: creat d2/d26/d37/d62/f63 x:0 0 0 2024-09-21T10:40:56.523 INFO:tasks.workunit.client.0.smithi060.stdout:1/270: dwrite d6/d24/f49 [0,4194304] 0 2024-09-21T10:40:56.523 INFO:tasks.workunit.client.0.smithi060.stdout:1/271: dread - d6/d4a/d5a/f5b zero size 2024-09-21T10:40:56.523 INFO:tasks.workunit.client.0.smithi060.stdout:1/272: fdatasync d6/d24/da/db/d1c/f26 0 2024-09-21T10:40:56.523 INFO:tasks.workunit.client.1.smithi112.stdout:0/935: dwrite d3/d18/d52/df9/d130/d4f/dc3/f135 [0,4194304] 0 2024-09-21T10:40:56.525 INFO:tasks.workunit.client.1.smithi112.stdout:4/952: dread de/d33/d2f/d35/df3/dc2/dad/f13b [0,4194304] 0 2024-09-21T10:40:56.554 INFO:tasks.workunit.client.0.smithi060.stdout:4/331: dwrite d0/d3c/d69/d6a/d6b/f22 [0,4194304] 0 2024-09-21T10:40:56.554 INFO:tasks.workunit.client.1.smithi112.stdout:5/979: dwrite d9/d15/f63 [4194304,4194304] 0 2024-09-21T10:40:56.554 INFO:tasks.workunit.client.1.smithi112.stdout:5/980: stat d9/d15/d18/d3a/d130 0 2024-09-21T10:40:56.555 INFO:tasks.workunit.client.0.smithi060.stdout:4/332: write d0/d5/d3a/f5d [1467682,878] 0 2024-09-21T10:40:56.561 INFO:tasks.workunit.client.1.smithi112.stdout:2/878: dwrite d0/d12/d46/da0/db9/dbd/d62/d63/f8b [0,4194304] 0 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/879: chown d0/d12/d46/d86/l10a 4742242 1 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:6/973: dwrite d4/d6/da/d11/d1f/d22/d100/f4c [4194304,4194304] 0 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:6/974: chown d4/dc/d135/db5 17771744 1 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/880: write d0/da4/dbe/df4/f100 [483807,14717] 0 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/881: chown d0/da4/dbe/df4/d7e/d8f/l43 428751417 1 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:2/882: fsync d0/d12/d46/da0/db9/fea 0 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.1.smithi112.stdout:8/991: dwrite d8/d9/dd/d1a/f51 [0,4194304] 0 2024-09-21T10:40:56.562 INFO:tasks.workunit.client.0.smithi060.stdout:4/333: dread d0/d5/d12/d16/d28/f2d [0,4194304] 0 2024-09-21T10:40:56.569 INFO:tasks.workunit.client.0.smithi060.stdout:2/174: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:40:56.569 INFO:tasks.workunit.client.0.smithi060.stdout:2/175: fsync d3/f12 0 2024-09-21T10:40:56.571 INFO:tasks.workunit.client.1.smithi112.stdout:7/943: dwrite d7/d22/d41/d80/f116 [0,4194304] 0 2024-09-21T10:40:56.572 INFO:tasks.workunit.client.0.smithi060.stdout:7/289: dwrite da/d14/d2a/d49/f67 [0,4194304] 0 2024-09-21T10:40:56.572 INFO:tasks.workunit.client.1.smithi112.stdout:5/981: dwrite d9/d15/f127 [0,4194304] 0 2024-09-21T10:40:56.573 INFO:tasks.workunit.client.0.smithi060.stdout:1/273: dwrite d6/d24/da/db/dd/f4d [0,4194304] 0 2024-09-21T10:40:56.573 INFO:tasks.workunit.client.0.smithi060.stdout:1/274: truncate d6/f44 799087 0 2024-09-21T10:40:56.573 INFO:tasks.workunit.client.0.smithi060.stdout:1/275: fdatasync d6/d24/f59 0 2024-09-21T10:40:56.573 INFO:tasks.workunit.client.0.smithi060.stdout:5/280: dwrite d5/d9/d3e/d50/f59 [0,4194304] 0 2024-09-21T10:40:56.594 INFO:tasks.workunit.client.1.smithi112.stdout:7/944: dwrite d7/d22/d41/d4b/da2/dea/fae [0,4194304] 0 2024-09-21T10:40:56.594 INFO:tasks.workunit.client.1.smithi112.stdout:7/945: chown d7/d3d/f40 4 1 2024-09-21T10:40:56.597 INFO:tasks.workunit.client.0.smithi060.stdout:8/280: rmdir d2/d18/d60 0 2024-09-21T10:40:56.598 INFO:tasks.workunit.client.0.smithi060.stdout:8/281: write d2/f1c [47018,41661] 0 2024-09-21T10:40:56.604 INFO:tasks.workunit.client.1.smithi112.stdout:0/936: creat d3/d23/f139 x:0 0 0 2024-09-21T10:40:56.605 INFO:tasks.workunit.client.1.smithi112.stdout:4/953: symlink de/df8/l140 0 2024-09-21T10:40:56.606 INFO:tasks.workunit.client.0.smithi060.stdout:4/334: stat d0/d3c/d67 0 2024-09-21T10:40:56.607 INFO:tasks.workunit.client.0.smithi060.stdout:4/335: write d0/d3c/d69/d6a/d6b/d32/d57/f5b [1603516,81041] 0 2024-09-21T10:40:56.613 INFO:tasks.workunit.client.1.smithi112.stdout:6/975: truncate d4/d6/d75/f128 2995268 0 2024-09-21T10:40:56.615 INFO:tasks.workunit.client.0.smithi060.stdout:0/267: truncate d5/d10/da/f13 1069065 0 2024-09-21T10:40:56.615 INFO:tasks.workunit.client.0.smithi060.stdout:0/268: write d5/d10/da/d15/f1b [2140395,68927] 0 2024-09-21T10:40:56.615 INFO:tasks.workunit.client.0.smithi060.stdout:8/282: dwrite d2/d26/f44 [0,4194304] 0 2024-09-21T10:40:56.616 INFO:tasks.workunit.client.1.smithi112.stdout:2/883: creat d0/da4/dbe/df4/f120 x:0 0 0 2024-09-21T10:40:56.626 INFO:tasks.workunit.client.0.smithi060.stdout:7/290: link da/d14/d25/d56/f62 da/d14/f6b 0 2024-09-21T10:40:56.626 INFO:tasks.workunit.client.0.smithi060.stdout:7/291: creat da/d14/d2a/d49/f6c x:0 0 0 2024-09-21T10:40:56.626 INFO:tasks.workunit.client.0.smithi060.stdout:7/292: creat da/d14/d2a/d49/f6d x:0 0 0 2024-09-21T10:40:56.626 INFO:tasks.workunit.client.0.smithi060.stdout:7/293: write da/d14/d2a/f2d [2723937,110111] 0 2024-09-21T10:40:56.631 INFO:tasks.workunit.client.0.smithi060.stdout:1/276: truncate d6/f2c 3753852 0 2024-09-21T10:40:56.631 INFO:tasks.workunit.client.0.smithi060.stdout:1/277: write d6/d24/da/db/f57 [324632,84815] 0 2024-09-21T10:40:56.631 INFO:tasks.workunit.client.0.smithi060.stdout:1/278: fsync d6/d24/da/db/d1c/f36 0 2024-09-21T10:40:56.636 INFO:tasks.workunit.client.0.smithi060.stdout:5/281: link d5/d45/d5a/d3a/f53 d5/d45/d5a/f62 0 2024-09-21T10:40:56.636 INFO:tasks.workunit.client.0.smithi060.stdout:5/282: chown d5/d45/d5a/f5d 17539 1 2024-09-21T10:40:56.642 INFO:tasks.workunit.client.0.smithi060.stdout:4/336: link d0/d5/d12/d16/d28/l31 d0/d59/l6c 0 2024-09-21T10:40:56.646 INFO:tasks.workunit.client.0.smithi060.stdout:0/269: rename d5/d10/da/d20/d45/c29 to d5/d10/da/d20/d45/c47 0 2024-09-21T10:40:56.646 INFO:tasks.workunit.client.0.smithi060.stdout:0/270: dread - d5/d10/da/f39 zero size 2024-09-21T10:40:56.646 INFO:tasks.workunit.client.0.smithi060.stdout:0/271: dread - d5/f3e zero size 2024-09-21T10:40:56.646 INFO:tasks.workunit.client.0.smithi060.stdout:0/272: chown d5/d10/da/d20/d45/d2a/d40 1302 1 2024-09-21T10:40:56.646 INFO:tasks.workunit.client.1.smithi112.stdout:5/982: mkdir d9/d15/d18/d3a/d61/d62/d13f 0 2024-09-21T10:40:56.652 INFO:tasks.workunit.client.0.smithi060.stdout:8/283: mkdir d2/d26/d37/d64 0 2024-09-21T10:40:56.653 INFO:tasks.workunit.client.1.smithi112.stdout:7/946: rename d7/d22/d41/d56/d72/de0/ff8 to d7/d22/d86/dac/d8a/f13c 0 2024-09-21T10:40:56.655 INFO:tasks.workunit.client.1.smithi112.stdout:0/937: mknod d3/d23/c13a 0 2024-09-21T10:40:56.657 INFO:tasks.workunit.client.1.smithi112.stdout:4/954: mknod de/d33/d2f/d35/d111/c141 0 2024-09-21T10:40:56.657 INFO:tasks.workunit.client.1.smithi112.stdout:0/938: write d3/d4a/fbd [756009,14360] 0 2024-09-21T10:40:56.659 INFO:tasks.workunit.client.1.smithi112.stdout:6/976: creat d4/d6/da/d14/d49/d73/f151 x:0 0 0 2024-09-21T10:40:56.660 INFO:tasks.workunit.client.0.smithi060.stdout:5/283: symlink d5/d9/d3e/d50/l63 0 2024-09-21T10:40:56.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/884: creat d0/d12/d76/f121 x:0 0 0 2024-09-21T10:40:56.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/885: stat d0/da4/dbe/df4/d7e/d8f/fe0 0 2024-09-21T10:40:56.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/886: dread - d0/da4/dbe/df4/f120 zero size 2024-09-21T10:40:56.664 INFO:tasks.workunit.client.1.smithi112.stdout:8/992: getdents d8/d9/dd/d2b/db8 0 2024-09-21T10:40:56.665 INFO:tasks.workunit.client.0.smithi060.stdout:0/273: mkdir d5/d10/da/d20/d45/d2a/d40/d48 0 2024-09-21T10:40:56.667 INFO:tasks.workunit.client.1.smithi112.stdout:5/983: mkdir d9/d15/d18/d3a/d4b/d74/d8d/d140 0 2024-09-21T10:40:56.667 INFO:tasks.workunit.client.1.smithi112.stdout:5/984: write d9/d15/d18/d3a/d4b/ff7 [557398,29525] 0 2024-09-21T10:40:56.667 INFO:tasks.workunit.client.1.smithi112.stdout:5/985: write d9/d15/d18/d3a/d4b/fab [875283,32487] 0 2024-09-21T10:40:56.669 INFO:tasks.workunit.client.1.smithi112.stdout:7/947: symlink d7/d22/d73/d11d/l13d 0 2024-09-21T10:40:56.671 INFO:tasks.workunit.client.1.smithi112.stdout:4/955: mkdir de/d109/d142 0 2024-09-21T10:40:56.671 INFO:tasks.workunit.client.1.smithi112.stdout:4/956: read de/d2a/dbf/fea [823313,70170] 0 2024-09-21T10:40:56.671 INFO:tasks.workunit.client.1.smithi112.stdout:4/957: read - de/d33/d6f/d9c/f49 zero size 2024-09-21T10:40:56.674 INFO:tasks.workunit.client.1.smithi112.stdout:0/939: creat d3/d18/d52/df9/d130/d46/d122/f13b x:0 0 0 2024-09-21T10:40:56.674 INFO:tasks.workunit.client.0.smithi060.stdout:0/274: dread d5/d10/da/fc [0,4194304] 0 2024-09-21T10:40:56.675 INFO:tasks.workunit.client.1.smithi112.stdout:4/958: write de/d2a/dbf/d82/f95 [3171796,95681] 0 2024-09-21T10:40:56.676 INFO:tasks.workunit.client.1.smithi112.stdout:2/887: creat d0/d12/d77/f122 x:0 0 0 2024-09-21T10:40:56.676 INFO:tasks.workunit.client.1.smithi112.stdout:2/888: write d0/f11 [4881697,44828] 0 2024-09-21T10:40:56.680 INFO:tasks.workunit.client.0.smithi060.stdout:5/284: creat d5/d9/f64 x:0 0 0 2024-09-21T10:40:56.681 INFO:tasks.workunit.client.1.smithi112.stdout:8/993: symlink d8/d9/dd/d2b/d107/l12d 0 2024-09-21T10:40:56.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/337: truncate d0/d3c/f48 2107560 0 2024-09-21T10:40:56.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/338: chown d0/d5/d12/d16/d28/f2d 1773793 1 2024-09-21T10:40:56.685 INFO:tasks.workunit.client.1.smithi112.stdout:4/959: dread de/f12 [0,4194304] 0 2024-09-21T10:40:56.685 INFO:tasks.workunit.client.1.smithi112.stdout:4/960: write de/d18/d6d/faa [4653942,41291] 0 2024-09-21T10:40:56.685 INFO:tasks.workunit.client.0.smithi060.stdout:7/294: rename da/d14/d33 to da/d60/d6e 0 2024-09-21T10:40:56.686 INFO:tasks.workunit.client.0.smithi060.stdout:7/295: write da/d14/d25/d56/f62 [5216725,121046] 0 2024-09-21T10:40:56.686 INFO:tasks.workunit.client.0.smithi060.stdout:7/296: write da/d14/f19 [102012,63301] 0 2024-09-21T10:40:56.686 INFO:tasks.workunit.client.0.smithi060.stdout:7/297: fdatasync da/d14/d25/f2c 0 2024-09-21T10:40:56.686 INFO:tasks.workunit.client.0.smithi060.stdout:7/298: write da/d14/d15/f18 [4497004,36030] 0 2024-09-21T10:40:56.687 INFO:tasks.workunit.client.0.smithi060.stdout:5/285: mknod d5/d9/d3b/c65 0 2024-09-21T10:40:56.689 INFO:tasks.workunit.client.1.smithi112.stdout:0/940: link d3/d4a/f6a d3/d18/d52/d55/dcc/d10b/ddf/de5/f13c 0 2024-09-21T10:40:56.691 INFO:tasks.workunit.client.0.smithi060.stdout:1/279: rename d6/d24/da/db/dd/f14 to d6/d4a/d5a/f5e 0 2024-09-21T10:40:56.693 INFO:tasks.workunit.client.1.smithi112.stdout:8/994: write d8/f14 [2949418,58944] 0 2024-09-21T10:40:56.693 INFO:tasks.workunit.client.1.smithi112.stdout:2/889: dread d0/da4/dbe/df4/d7e/d8f/f3c [0,4194304] 0 2024-09-21T10:40:56.695 INFO:tasks.workunit.client.1.smithi112.stdout:0/941: getdents d3/d18 0 2024-09-21T10:40:56.696 INFO:tasks.workunit.client.1.smithi112.stdout:4/961: dread de/d18/f26 [4194304,4194304] 0 2024-09-21T10:40:56.697 INFO:tasks.workunit.client.0.smithi060.stdout:7/299: link da/d14/d35/c4d da/d14/d2a/d49/d27/c6f 0 2024-09-21T10:40:56.701 INFO:tasks.workunit.client.1.smithi112.stdout:8/995: unlink d8/d9/d3c/c4f 0 2024-09-21T10:40:56.705 INFO:tasks.workunit.client.1.smithi112.stdout:0/942: symlink d3/d18/d52/df9/l13d 0 2024-09-21T10:40:56.705 INFO:tasks.workunit.client.1.smithi112.stdout:0/943: stat d3/d18/d45/c94 0 2024-09-21T10:40:56.709 INFO:tasks.workunit.client.0.smithi060.stdout:7/300: getdents da 0 2024-09-21T10:40:56.711 INFO:tasks.workunit.client.1.smithi112.stdout:0/944: mknod d3/d18/d52/d55/c13e 0 2024-09-21T10:40:56.712 INFO:tasks.workunit.client.0.smithi060.stdout:8/284: rename d2/d26/d49 to d2/d26/d37/d64/d65 0 2024-09-21T10:40:56.713 INFO:tasks.workunit.client.1.smithi112.stdout:2/890: rename d0/da4/dbe/df4 to d0/d12/d76/d123 0 2024-09-21T10:40:56.718 INFO:tasks.workunit.client.0.smithi060.stdout:8/285: write d2/f17 [3109550,627] 0 2024-09-21T10:40:56.719 INFO:tasks.workunit.client.0.smithi060.stdout:8/286: chown d2/f15 10 1 2024-09-21T10:40:56.719 INFO:tasks.workunit.client.1.smithi112.stdout:0/945: dread d3/d18/d52/df9/d130/d4f/d83/fb8 [0,4194304] 0 2024-09-21T10:40:56.719 INFO:tasks.workunit.client.0.smithi060.stdout:8/287: truncate d2/d18/f30 1471103 0 2024-09-21T10:40:56.720 INFO:tasks.workunit.client.1.smithi112.stdout:9/968: sync 2024-09-21T10:40:56.720 INFO:tasks.workunit.client.1.smithi112.stdout:3/935: sync 2024-09-21T10:40:56.720 INFO:tasks.workunit.client.1.smithi112.stdout:9/969: write d1/d2/d27/d3a/d4c/fbd [4253882,105016] 0 2024-09-21T10:40:56.720 INFO:tasks.workunit.client.1.smithi112.stdout:9/970: write d1/d2/d27/d3a/d6b/f97 [477644,37465] 0 2024-09-21T10:40:56.721 INFO:tasks.workunit.client.1.smithi112.stdout:0/946: unlink d3/d4a/d4e/dc2/f5 0 2024-09-21T10:40:56.721 INFO:tasks.workunit.client.1.smithi112.stdout:2/891: dread d0/d12/d76/d123/d7e/d8f/f6f [0,4194304] 0 2024-09-21T10:40:56.721 INFO:tasks.workunit.client.1.smithi112.stdout:2/892: truncate d0/d12/d46/d86/dc0/dc8/d108/fae 2001337 0 2024-09-21T10:40:56.722 INFO:tasks.workunit.client.1.smithi112.stdout:2/893: readlink d0/d12/d46/da0/lbf 0 2024-09-21T10:40:56.722 INFO:tasks.workunit.client.1.smithi112.stdout:3/936: unlink d2/d2f/d3f/ddf/d31/d2a/l4e 0 2024-09-21T10:40:56.722 INFO:tasks.workunit.client.1.smithi112.stdout:3/937: write d2/d2f/d3f/ddf/d31/d2a/f10b [958540,88478] 0 2024-09-21T10:40:56.723 INFO:tasks.workunit.client.1.smithi112.stdout:9/971: mkdir d1/d2/d27/d3a/d6b/d15e 0 2024-09-21T10:40:56.723 INFO:tasks.workunit.client.1.smithi112.stdout:0/947: mknod d3/d18/d45/c13f 0 2024-09-21T10:40:56.725 INFO:tasks.workunit.client.1.smithi112.stdout:9/972: mknod d1/d7f/df0/d11c/d13e/c15f 0 2024-09-21T10:40:56.726 INFO:tasks.workunit.client.1.smithi112.stdout:0/948: mknod d3/d4a/d4e/dc2/d1a/dba/deb/c140 0 2024-09-21T10:40:56.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/894: link d0/d12/d76/d123/d7e/d8f/d51/d57/l34 d0/d12/d46/d86/dc0/l124 0 2024-09-21T10:40:56.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/895: fsync d0/d12/d76/d123/d7e/d8f/d51/d57/f84 0 2024-09-21T10:40:56.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/896: write d0/d12/d77/ffe [732864,125012] 0 2024-09-21T10:40:56.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/897: stat d0/d12/d76/d123/f9a 0 2024-09-21T10:40:56.728 INFO:tasks.workunit.client.1.smithi112.stdout:2/898: write d0/d12/d76/d123/d7e/d8f/d51/f8d [607857,44441] 0 2024-09-21T10:40:56.728 INFO:tasks.workunit.client.1.smithi112.stdout:3/938: symlink d2/d2f/d3f/ddf/d31/d2a/d39/d3a/l132 0 2024-09-21T10:40:56.729 INFO:tasks.workunit.client.1.smithi112.stdout:9/973: symlink d1/d2/d27/d37/d3b/d69/d77/da0/de4/d12c/l160 0 2024-09-21T10:40:56.736 INFO:tasks.workunit.client.1.smithi112.stdout:5/986: dwrite d9/d15/d18/d3a/d4b/d74/fc1 [4194304,4194304] 0 2024-09-21T10:40:56.739 INFO:tasks.workunit.client.1.smithi112.stdout:5/987: creat d9/d15/d18/d3a/d61/d93/f141 x:0 0 0 2024-09-21T10:40:56.739 INFO:tasks.workunit.client.1.smithi112.stdout:5/988: fdatasync d9/d15/d18/d20/d47/dc6/df5/f10a 0 2024-09-21T10:40:56.739 INFO:tasks.workunit.client.1.smithi112.stdout:5/989: fsync d9/d15/d18/d3a/d61/d62/d6b/faa 0 2024-09-21T10:40:56.742 INFO:tasks.workunit.client.1.smithi112.stdout:9/974: dread d1/d2/d27/d3a/d6b/fac [0,4194304] 0 2024-09-21T10:40:56.744 INFO:tasks.workunit.client.1.smithi112.stdout:9/975: creat d1/d2/d27/d37/d3b/d69/d77/dca/f161 x:0 0 0 2024-09-21T10:40:56.744 INFO:tasks.workunit.client.1.smithi112.stdout:9/976: chown d1/d2/d27/d62/da1 3407988 1 2024-09-21T10:40:56.745 INFO:tasks.workunit.client.1.smithi112.stdout:9/977: creat d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/f162 x:0 0 0 2024-09-21T10:40:56.764 INFO:tasks.workunit.client.1.smithi112.stdout:7/948: dwrite d7/d22/d78/fa0 [0,4194304] 0 2024-09-21T10:40:56.764 INFO:tasks.workunit.client.0.smithi060.stdout:0/275: dwrite d5/f21 [0,4194304] 0 2024-09-21T10:40:56.767 INFO:tasks.workunit.client.1.smithi112.stdout:7/949: unlink d7/d22/d41/d4b/d52/d77/dbd/de4/c13a 0 2024-09-21T10:40:56.769 INFO:tasks.workunit.client.0.smithi060.stdout:0/276: rename d5/d10/da/d20/l2c to d5/d10/d43/l49 0 2024-09-21T10:40:56.771 INFO:tasks.workunit.client.0.smithi060.stdout:0/277: mknod d5/c4a 0 2024-09-21T10:40:56.777 INFO:tasks.workunit.client.0.smithi060.stdout:1/280: link d6/d4a/d5a/f5e d6/d24/da/db/f5f 0 2024-09-21T10:40:56.777 INFO:tasks.workunit.client.0.smithi060.stdout:1/281: truncate d6/f40 522983 0 2024-09-21T10:40:56.777 INFO:tasks.workunit.client.0.smithi060.stdout:1/282: creat d6/d24/da/db/de/d32/f60 x:0 0 0 2024-09-21T10:40:56.779 INFO:tasks.workunit.client.0.smithi060.stdout:8/288: dwrite d2/f1c [0,4194304] 0 2024-09-21T10:40:56.779 INFO:tasks.workunit.client.1.smithi112.stdout:4/962: dwrite de/d33/d2f/ffc [0,4194304] 0 2024-09-21T10:40:56.780 INFO:tasks.workunit.client.1.smithi112.stdout:9/978: dwrite d1/d2/f48 [0,4194304] 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:0/949: getdents d3/d18/d52/d55 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:3/939: dwrite d2/d2f/d3f/ddf/d31/d2a/da1/fd3 [0,4194304] 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:0/950: chown d3/f92 497965 1 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:7/950: dread d7/d22/f38 [0,4194304] 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:0/951: truncate d3/d18/d45/fca 874122 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:8/996: dwrite d8/d9/dd/d2b/f11a [0,4194304] 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:8/997: truncate d8/fe3 218710 0 2024-09-21T10:40:56.782 INFO:tasks.workunit.client.1.smithi112.stdout:0/952: read d3/d18/d52/df9/d130/d46/f58 [3093611,100254] 0 2024-09-21T10:40:56.783 INFO:tasks.workunit.client.0.smithi060.stdout:8/289: mknod d2/d26/c66 0 2024-09-21T10:40:56.784 INFO:tasks.workunit.client.1.smithi112.stdout:4/963: creat de/d2a/dbf/f143 x:0 0 0 2024-09-21T10:40:56.785 INFO:tasks.workunit.client.0.smithi060.stdout:0/278: dread d5/f25 [0,4194304] 0 2024-09-21T10:40:56.785 INFO:tasks.workunit.client.0.smithi060.stdout:0/279: write d5/d10/da/d20/d45/f27 [3704408,108460] 0 2024-09-21T10:40:56.789 INFO:tasks.workunit.client.1.smithi112.stdout:9/979: write d1/d2/d27/d37/d3b/fad [1274872,74364] 0 2024-09-21T10:40:56.797 INFO:tasks.workunit.client.1.smithi112.stdout:2/899: getdents d0/d12/d46/d86/dc0 0 2024-09-21T10:40:56.797 INFO:tasks.workunit.client.1.smithi112.stdout:2/900: chown d0/da4/dc5/ce9 50443 1 2024-09-21T10:40:56.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/998: creat d8/d9/d3c/d90/dfb/d118/f12e x:0 0 0 2024-09-21T10:40:56.800 INFO:tasks.workunit.client.1.smithi112.stdout:8/999: fdatasync d8/d18/f5b 0 2024-09-21T10:40:56.801 INFO:tasks.workunit.client.1.smithi112.stdout:0/953: creat d3/d18/d52/d55/f141 x:0 0 0 2024-09-21T10:40:56.801 INFO:tasks.workunit.client.1.smithi112.stdout:0/954: readlink d3/d18/d52/la4 0 2024-09-21T10:40:56.807 INFO:tasks.workunit.client.1.smithi112.stdout:4/964: link de/d18/f76 de/d2a/d31/f144 0 2024-09-21T10:40:56.807 INFO:tasks.workunit.client.1.smithi112.stdout:4/965: truncate de/d33/d2f/d35/df3/dcc/f13a 49032 0 2024-09-21T10:40:56.809 INFO:tasks.workunit.client.1.smithi112.stdout:9/980: link d1/d2/d27/d37/d3b/d69/d77/dca/dae/f147 d1/d2/d27/dc5/dd0/f163 0 2024-09-21T10:40:56.809 INFO:tasks.workunit.client.1.smithi112.stdout:9/981: chown d1/d2/d27/d37/f100 551 1 2024-09-21T10:40:56.809 INFO:tasks.workunit.client.0.smithi060.stdout:0/280: dwrite d5/d10/da/d20/d45/f27 [0,4194304] 0 2024-09-21T10:40:56.814 INFO:tasks.workunit.client.0.smithi060.stdout:9/291: sync 2024-09-21T10:40:56.814 INFO:tasks.workunit.client.0.smithi060.stdout:3/219: sync 2024-09-21T10:40:56.814 INFO:tasks.workunit.client.0.smithi060.stdout:9/292: readlink d3/d16/l34 0 2024-09-21T10:40:56.814 INFO:tasks.workunit.client.0.smithi060.stdout:9/293: fdatasync d3/d15/f4a 0 2024-09-21T10:40:56.815 INFO:tasks.workunit.client.0.smithi060.stdout:3/220: write d0/d1/d11/d2a/f33 [555364,121605] 0 2024-09-21T10:40:56.815 INFO:tasks.workunit.client.0.smithi060.stdout:0/281: mkdir d5/d10/da/d4b 0 2024-09-21T10:40:56.815 INFO:tasks.workunit.client.0.smithi060.stdout:0/282: truncate d5/f3e 427391 0 2024-09-21T10:40:56.818 INFO:tasks.workunit.client.1.smithi112.stdout:2/901: symlink d0/d12/d46/d86/dc0/dc8/dfa/l125 0 2024-09-21T10:40:56.819 INFO:tasks.workunit.client.0.smithi060.stdout:0/283: getdents d5/d10/da/d2f 0 2024-09-21T10:40:56.819 INFO:tasks.workunit.client.0.smithi060.stdout:0/284: creat d5/d10/da/d15/f4c x:0 0 0 2024-09-21T10:40:56.821 INFO:tasks.workunit.client.0.smithi060.stdout:8/290: getdents d2/d26 0 2024-09-21T10:40:56.821 INFO:tasks.workunit.client.0.smithi060.stdout:8/291: chown d2/d18 513 1 2024-09-21T10:40:56.824 INFO:tasks.workunit.client.1.smithi112.stdout:3/940: rename d2/d2f/d3f/ddf/d31/d2a/d39 to d2/d2f/daf/df4/ddd/d133 0 2024-09-21T10:40:56.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/294: rename d3/d16/d1a/d3b to d3/d5e/d60 0 2024-09-21T10:40:56.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/295: creat d3/d15/f61 x:0 0 0 2024-09-21T10:40:56.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/296: chown d3/d16/d1a/l48 200237 1 2024-09-21T10:40:56.830 INFO:tasks.workunit.client.1.smithi112.stdout:9/982: creat d1/d2/d27/d37/d3b/d69/d77/da0/de4/d12c/f164 x:0 0 0 2024-09-21T10:40:56.832 INFO:tasks.workunit.client.0.smithi060.stdout:8/292: creat d2/d5a/f67 x:0 0 0 2024-09-21T10:40:56.832 INFO:tasks.workunit.client.0.smithi060.stdout:8/293: creat d2/d26/d37/d62/f68 x:0 0 0 2024-09-21T10:40:56.833 INFO:tasks.workunit.client.1.smithi112.stdout:3/941: fdatasync d2/d2f/daf/df4/ddd/d133/d3a/ff6 0 2024-09-21T10:40:56.835 INFO:tasks.workunit.client.1.smithi112.stdout:9/983: symlink d1/d2/d27/d37/d3b/d69/d77/l165 0 2024-09-21T10:40:56.836 INFO:tasks.workunit.client.0.smithi060.stdout:8/294: write d2/d18/f22 [442112,54550] 0 2024-09-21T10:40:56.838 INFO:tasks.workunit.client.0.smithi060.stdout:8/295: creat d2/d18/f69 x:0 0 0 2024-09-21T10:40:56.838 INFO:tasks.workunit.client.0.smithi060.stdout:8/296: write d2/f2d [1638067,5636] 0 2024-09-21T10:40:56.841 INFO:tasks.workunit.client.1.smithi112.stdout:4/966: dwrite de/d33/d2f/d35/df3/fde [0,4194304] 0 2024-09-21T10:40:56.844 INFO:tasks.workunit.client.1.smithi112.stdout:3/942: mknod d2/d2f/d3f/ddf/c134 0 2024-09-21T10:40:56.845 INFO:tasks.workunit.client.1.smithi112.stdout:9/984: symlink d1/d2/d27/d37/d3b/d69/d77/dca/dae/def/l166 0 2024-09-21T10:40:56.848 INFO:tasks.workunit.client.1.smithi112.stdout:7/951: rename d7/d22/d41/d56 to d7/d22/d41/d4b/d52/d77/dbd/d13e 0 2024-09-21T10:40:56.849 INFO:tasks.workunit.client.1.smithi112.stdout:2/902: dwrite d0/da2/f103 [0,4194304] 0 2024-09-21T10:40:56.849 INFO:tasks.workunit.client.0.smithi060.stdout:3/221: dwrite d0/f28 [0,4194304] 0 2024-09-21T10:40:56.849 INFO:tasks.workunit.client.0.smithi060.stdout:0/285: dwrite d5/d10/f9 [0,4194304] 0 2024-09-21T10:40:56.850 INFO:tasks.workunit.client.1.smithi112.stdout:3/943: mknod d2/d2f/daf/df4/ddd/d133/d60/c135 0 2024-09-21T10:40:56.851 INFO:tasks.workunit.client.1.smithi112.stdout:9/985: link d1/d2/d27/c46 d1/d2/d27/d37/d3b/d69/d88/c167 0 2024-09-21T10:40:56.853 INFO:tasks.workunit.client.1.smithi112.stdout:6/977: sync 2024-09-21T10:40:56.853 INFO:tasks.workunit.client.1.smithi112.stdout:5/990: sync 2024-09-21T10:40:56.854 INFO:tasks.workunit.client.0.smithi060.stdout:8/297: dwrite d2/f12 [0,4194304] 0 2024-09-21T10:40:56.854 INFO:tasks.workunit.client.1.smithi112.stdout:4/967: rmdir de/d33/d6f/d9c/d3e/dce 39 2024-09-21T10:40:56.854 INFO:tasks.workunit.client.1.smithi112.stdout:4/968: truncate de/d33/d2f/d35/df3/fde 5048377 0 2024-09-21T10:40:56.854 INFO:tasks.workunit.client.1.smithi112.stdout:4/969: chown de/d2a/fa6 6113151 1 2024-09-21T10:40:56.857 INFO:tasks.workunit.client.1.smithi112.stdout:7/952: link d7/d22/d41/d54/d4d/l6d d7/dbc/l13f 0 2024-09-21T10:40:56.857 INFO:tasks.workunit.client.1.smithi112.stdout:2/903: dread d0/dd/f3b [0,4194304] 0 2024-09-21T10:40:56.860 INFO:tasks.workunit.client.0.smithi060.stdout:3/222: symlink d0/d1/d1e/l41 0 2024-09-21T10:40:56.864 INFO:tasks.workunit.client.0.smithi060.stdout:0/286: mkdir d5/d10/da/d20/d4d 0 2024-09-21T10:40:56.865 INFO:tasks.workunit.client.1.smithi112.stdout:3/944: rmdir d2/d2f/daf/df4/ddd/d133/d60/d86/d98/d120 39 2024-09-21T10:40:56.865 INFO:tasks.workunit.client.1.smithi112.stdout:3/945: stat d2/d2f/daf/df4/ddd/d133/l5a 0 2024-09-21T10:40:56.867 INFO:tasks.workunit.client.0.smithi060.stdout:8/298: symlink d2/d26/d37/l6a 0 2024-09-21T10:40:56.867 INFO:tasks.workunit.client.0.smithi060.stdout:8/299: dread - d2/d5a/f67 zero size 2024-09-21T10:40:56.869 INFO:tasks.workunit.client.1.smithi112.stdout:2/904: read d0/d12/d46/da0/db9/dbd/d62/d63/f4c [3038981,35519] 0 2024-09-21T10:40:56.870 INFO:tasks.workunit.client.0.smithi060.stdout:0/287: mkdir d5/d10/d4e 0 2024-09-21T10:40:56.871 INFO:tasks.workunit.client.1.smithi112.stdout:6/978: unlink d4/d6/da/d14/d49/d73/f151 0 2024-09-21T10:40:56.872 INFO:tasks.workunit.client.0.smithi060.stdout:8/300: symlink d2/d18/d4b/d4d/l6b 0 2024-09-21T10:40:56.873 INFO:tasks.workunit.client.1.smithi112.stdout:5/991: dwrite d9/d15/d18/d20/d47/dc6/f125 [0,4194304] 0 2024-09-21T10:40:56.873 INFO:tasks.workunit.client.1.smithi112.stdout:5/992: write d9/d15/d18/d20/d47/fed [4844861,75343] 0 2024-09-21T10:40:56.873 INFO:tasks.workunit.client.1.smithi112.stdout:5/993: fdatasync d9/d15/d18/d3a/d4b/d71/f80 0 2024-09-21T10:40:56.874 INFO:tasks.workunit.client.1.smithi112.stdout:4/970: getdents de/d33/d6f/d9c/dc8 0 2024-09-21T10:40:56.875 INFO:tasks.workunit.client.0.smithi060.stdout:0/288: creat d5/d10/da/d20/d45/f4f x:0 0 0 2024-09-21T10:40:56.876 INFO:tasks.workunit.client.1.smithi112.stdout:3/946: write d2/d2f/f44 [5542047,108951] 0 2024-09-21T10:40:56.877 INFO:tasks.workunit.client.1.smithi112.stdout:7/953: mknod d7/d22/d41/d4b/d52/d77/dbd/d12b/c140 0 2024-09-21T10:40:56.877 INFO:tasks.workunit.client.1.smithi112.stdout:7/954: chown d7/d22/d41/d54/d4d/fad 227364721 1 2024-09-21T10:40:56.878 INFO:tasks.workunit.client.0.smithi060.stdout:8/301: link d2/d18/d4b/d4d/l4f d2/d26/d37/d64/l6c 0 2024-09-21T10:40:56.878 INFO:tasks.workunit.client.0.smithi060.stdout:3/223: dwrite d0/d1/d11/d2a/f3d [0,4194304] 0 2024-09-21T10:40:56.879 INFO:tasks.workunit.client.0.smithi060.stdout:8/302: dread d2/f5d [0,4194304] 0 2024-09-21T10:40:56.879 INFO:tasks.workunit.client.1.smithi112.stdout:9/986: rename d1/d2/d27/d62/da1/d122 to d1/d2/d27/d168 0 2024-09-21T10:40:56.882 INFO:tasks.workunit.client.1.smithi112.stdout:2/905: link d0/d12/d46/d86/dc0/dc8/dfa/f11c d0/d12/d76/d123/f126 0 2024-09-21T10:40:56.882 INFO:tasks.workunit.client.1.smithi112.stdout:5/994: write d9/d15/d18/d3a/f11f [2666886,85093] 0 2024-09-21T10:40:56.882 INFO:tasks.workunit.client.1.smithi112.stdout:2/906: read - d0/dd/d47/dd0/fe4 zero size 2024-09-21T10:40:56.882 INFO:tasks.workunit.client.1.smithi112.stdout:5/995: dread - d9/d15/d18/d3a/d4b/d71/d113/f116 zero size 2024-09-21T10:40:56.883 INFO:tasks.workunit.client.1.smithi112.stdout:6/979: symlink d4/d6/da/d11/d1f/d22/d100/d12c/d31/l152 0 2024-09-21T10:40:56.888 INFO:tasks.workunit.client.1.smithi112.stdout:9/987: write d1/f6d [188846,2983] 0 2024-09-21T10:40:56.890 INFO:tasks.workunit.client.1.smithi112.stdout:4/971: mknod de/d13d/c145 0 2024-09-21T10:40:56.892 INFO:tasks.workunit.client.1.smithi112.stdout:6/980: read d4/d6/da/d11/d1f/d22/d100/d12c/d31/f71 [1193113,105359] 0 2024-09-21T10:40:56.893 INFO:tasks.workunit.client.0.smithi060.stdout:0/289: symlink d5/d10/da/d20/l50 0 2024-09-21T10:40:56.893 INFO:tasks.workunit.client.0.smithi060.stdout:0/290: readlink d5/d10/d11/l44 0 2024-09-21T10:40:56.894 INFO:tasks.workunit.client.1.smithi112.stdout:3/947: mknod d2/d2f/d3f/ddf/d31/d2a/dff/c136 0 2024-09-21T10:40:56.894 INFO:tasks.workunit.client.1.smithi112.stdout:9/988: fsync d1/d2/d27/dc5/f11d 0 2024-09-21T10:40:56.894 INFO:tasks.workunit.client.1.smithi112.stdout:9/989: creat d1/d2/d27/d3a/d6b/d30/f169 x:0 0 0 2024-09-21T10:40:56.896 INFO:tasks.workunit.client.1.smithi112.stdout:7/955: unlink d7/l8 0 2024-09-21T10:40:56.900 INFO:tasks.workunit.client.1.smithi112.stdout:5/996: symlink d9/d15/d18/d20/l142 0 2024-09-21T10:40:56.902 INFO:tasks.workunit.client.0.smithi060.stdout:3/224: creat d0/d1/d11/f42 x:0 0 0 2024-09-21T10:40:56.903 INFO:tasks.workunit.client.0.smithi060.stdout:3/225: getdents d0/d1/d1e/d34 0 2024-09-21T10:40:56.903 INFO:tasks.workunit.client.0.smithi060.stdout:3/226: chown d0/d1/d1e/f3e 3779 1 2024-09-21T10:40:56.904 INFO:tasks.workunit.client.1.smithi112.stdout:6/981: mknod d4/d6/da/d11/d1f/d22/d86/c153 0 2024-09-21T10:40:56.904 INFO:tasks.workunit.client.1.smithi112.stdout:6/982: stat d4/d6/lf 0 2024-09-21T10:40:56.904 INFO:tasks.workunit.client.1.smithi112.stdout:6/983: truncate d4/dc/d7e/f83 976195 0 2024-09-21T10:40:56.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/984: truncate d4/d6/da/d11/d37/d8b/da0/dfa/fd6 4951451 0 2024-09-21T10:40:56.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/985: write d4/d6/da/d11/d37/d19/df3/f115 [599531,125905] 0 2024-09-21T10:40:56.905 INFO:tasks.workunit.client.1.smithi112.stdout:6/986: write d4/d6/da/d11/d1f/fd9 [161191,4315] 0 2024-09-21T10:40:56.906 INFO:tasks.workunit.client.0.smithi060.stdout:0/291: dread f2 [4194304,4194304] 0 2024-09-21T10:40:56.906 INFO:tasks.workunit.client.0.smithi060.stdout:0/292: readlink d5/d10/d11/l44 0 2024-09-21T10:40:56.906 INFO:tasks.workunit.client.0.smithi060.stdout:8/303: creat d2/d18/d4b/d4d/f6d x:0 0 0 2024-09-21T10:40:56.906 INFO:tasks.workunit.client.1.smithi112.stdout:7/956: dread d7/f26 [0,4194304] 0 2024-09-21T10:40:56.907 INFO:tasks.workunit.client.1.smithi112.stdout:3/948: symlink d2/d2f/d3f/ddf/d31/d2a/da1/l137 0 2024-09-21T10:40:56.908 INFO:tasks.workunit.client.0.smithi060.stdout:0/293: unlink d5/d10/da/d15/f41 0 2024-09-21T10:40:56.910 INFO:tasks.workunit.client.0.smithi060.stdout:8/304: mkdir d2/d18/d4b/d61/d6e 0 2024-09-21T10:40:56.912 INFO:tasks.workunit.client.1.smithi112.stdout:9/990: getdents d1/d2 0 2024-09-21T10:40:56.912 INFO:tasks.workunit.client.1.smithi112.stdout:9/991: write d1/d2/d27/d3a/d6b/d30/f169 [56168,100678] 0 2024-09-21T10:40:56.913 INFO:tasks.workunit.client.1.smithi112.stdout:9/992: chown d1/d2/d27/d62/da1 63264 1 2024-09-21T10:40:56.913 INFO:tasks.workunit.client.0.smithi060.stdout:8/305: mknod d2/d18/d4b/d61/d6e/c6f 0 2024-09-21T10:40:56.913 INFO:tasks.workunit.client.0.smithi060.stdout:8/306: dread - d2/d26/d37/d62/f63 zero size 2024-09-21T10:40:56.913 INFO:tasks.workunit.client.0.smithi060.stdout:8/307: stat d2/d26/d37 0 2024-09-21T10:40:56.914 INFO:tasks.workunit.client.1.smithi112.stdout:2/907: dwrite d0/d12/d46/d86/dc0/dc8/d108/fae [0,4194304] 0 2024-09-21T10:40:56.914 INFO:tasks.workunit.client.1.smithi112.stdout:6/987: creat d4/d6/da/d11/d37/df6/d14c/f154 x:0 0 0 2024-09-21T10:40:56.915 INFO:tasks.workunit.client.1.smithi112.stdout:7/957: truncate d7/d22/f23 411484 0 2024-09-21T10:40:56.916 INFO:tasks.workunit.client.0.smithi060.stdout:8/308: mknod d2/d26/c70 0 2024-09-21T10:40:56.918 INFO:tasks.workunit.client.1.smithi112.stdout:3/949: mkdir d2/d2f/d3f/ddf/d31/d2a/d138 0 2024-09-21T10:40:56.918 INFO:tasks.workunit.client.1.smithi112.stdout:3/950: readlink d2/d2f/daf/df4/ddd/d133/d3a/l116 0 2024-09-21T10:40:56.919 INFO:tasks.workunit.client.1.smithi112.stdout:9/993: getdents d1/d7f/df0/d11c/d13e 0 2024-09-21T10:40:56.921 INFO:tasks.workunit.client.1.smithi112.stdout:4/972: dwrite de/d33/d2f/d35/df3/dc2/f127 [0,4194304] 0 2024-09-21T10:40:56.923 INFO:tasks.workunit.client.1.smithi112.stdout:5/997: getdents d9/d15/d18/d3a/d4b/d74 0 2024-09-21T10:40:56.923 INFO:tasks.workunit.client.0.smithi060.stdout:3/227: dread d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:40:56.923 INFO:tasks.workunit.client.0.smithi060.stdout:3/228: chown d0/d2b/f31 884295 1 2024-09-21T10:40:56.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/309: getdents d2/d26/d37/d62 0 2024-09-21T10:40:56.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/310: dread - d2/d18/d4b/d4d/f6d zero size 2024-09-21T10:40:56.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/311: fdatasync d2/f2d 0 2024-09-21T10:40:56.925 INFO:tasks.workunit.client.0.smithi060.stdout:8/312: write d2/d18/f22 [915948,94606] 0 2024-09-21T10:40:56.929 INFO:tasks.workunit.client.0.smithi060.stdout:3/229: mkdir d0/d1/d11/d2a/d43 0 2024-09-21T10:40:56.929 INFO:tasks.workunit.client.0.smithi060.stdout:3/230: dread - d0/d1/d11/f42 zero size 2024-09-21T10:40:56.932 INFO:tasks.workunit.client.0.smithi060.stdout:8/313: getdents d2/d26/d37/d64/d65 0 2024-09-21T10:40:56.932 INFO:tasks.workunit.client.0.smithi060.stdout:8/314: fsync d2/d26/d37/d62/f63 0 2024-09-21T10:40:56.939 INFO:tasks.workunit.client.0.smithi060.stdout:2/176: sync 2024-09-21T10:40:56.939 INFO:tasks.workunit.client.0.smithi060.stdout:6/347: sync 2024-09-21T10:40:56.939 INFO:tasks.workunit.client.0.smithi060.stdout:3/231: write d0/d1/d1e/f3e [2146055,47454] 0 2024-09-21T10:40:56.941 INFO:tasks.workunit.client.0.smithi060.stdout:0/294: dwrite d5/d10/d11/f28 [0,4194304] 0 2024-09-21T10:40:56.942 INFO:tasks.workunit.client.1.smithi112.stdout:6/988: dwrite d4/d6/da/d11/d37/d19/fb0 [0,4194304] 0 2024-09-21T10:40:56.942 INFO:tasks.workunit.client.1.smithi112.stdout:6/989: chown d4/c2f 32639584 1 2024-09-21T10:40:56.943 INFO:tasks.workunit.client.0.smithi060.stdout:6/348: symlink d3/l69 0 2024-09-21T10:40:56.945 INFO:tasks.workunit.client.1.smithi112.stdout:7/958: dwrite d7/d3d/da7/fe1 [0,4194304] 0 2024-09-21T10:40:56.945 INFO:tasks.workunit.client.1.smithi112.stdout:7/959: chown d7/d22/d73/fa8 3535 1 2024-09-21T10:40:56.946 INFO:tasks.workunit.client.0.smithi060.stdout:3/232: symlink d0/d1/d11/d2a/l44 0 2024-09-21T10:40:56.946 INFO:tasks.workunit.client.0.smithi060.stdout:3/233: fsync d0/d1/d11/f15 0 2024-09-21T10:40:56.947 INFO:tasks.workunit.client.1.smithi112.stdout:3/951: mkdir d2/d2f/d3f/ddf/d31/d2a/dff/d139 0 2024-09-21T10:40:56.947 INFO:tasks.workunit.client.1.smithi112.stdout:3/952: truncate d2/d2f/fd4 1620693 0 2024-09-21T10:40:56.949 INFO:tasks.workunit.client.1.smithi112.stdout:9/994: dwrite d1/d2/d27/d3a/d4c/fbd [4194304,4194304] 0 2024-09-21T10:40:56.949 INFO:tasks.workunit.client.0.smithi060.stdout:6/349: rename d3/dd/l2c to d3/d12/d38/l6a 0 2024-09-21T10:40:56.950 INFO:tasks.workunit.client.0.smithi060.stdout:6/350: write d3/d12/d16/d1a/f3c [3678017,23843] 0 2024-09-21T10:40:56.950 INFO:tasks.workunit.client.0.smithi060.stdout:6/351: chown d3/c11 270907541 1 2024-09-21T10:40:56.952 INFO:tasks.workunit.client.1.smithi112.stdout:4/973: link de/d33/d2f/d71/c37 de/d33/d2f/d35/d111/c146 0 2024-09-21T10:40:56.952 INFO:tasks.workunit.client.1.smithi112.stdout:4/974: chown de/d18/fa8 191 1 2024-09-21T10:40:56.952 INFO:tasks.workunit.client.1.smithi112.stdout:4/975: read de/d33/d6f/f7d [2312935,160] 0 2024-09-21T10:40:56.954 INFO:tasks.workunit.client.0.smithi060.stdout:8/315: dwrite d2/f5d [0,4194304] 0 2024-09-21T10:40:56.954 INFO:tasks.workunit.client.0.smithi060.stdout:8/316: truncate d2/fe 1900977 0 2024-09-21T10:40:56.954 INFO:tasks.workunit.client.0.smithi060.stdout:6/352: stat d3/d12/d16/d22/l35 0 2024-09-21T10:40:56.954 INFO:tasks.workunit.client.0.smithi060.stdout:6/353: stat d3/dd/l39 0 2024-09-21T10:40:56.955 INFO:tasks.workunit.client.1.smithi112.stdout:5/998: truncate d9/d15/d18/d3a/d61/d62/d6b/f105 641071 0 2024-09-21T10:40:56.958 INFO:tasks.workunit.client.1.smithi112.stdout:2/908: dread d0/d12/d76/d123/d7e/d8f/d51/d57/f37 [0,4194304] 0 2024-09-21T10:40:56.960 INFO:tasks.workunit.client.1.smithi112.stdout:6/990: mknod d4/d6/da/d11/d37/d8b/da0/dfa/c155 0 2024-09-21T10:40:56.963 INFO:tasks.workunit.client.1.smithi112.stdout:7/960: truncate d7/d22/d41/d4b/d52/d77/dbd/d13e/d72/dc4/d4a/ff7 445249 0 2024-09-21T10:40:56.964 INFO:tasks.workunit.client.1.smithi112.stdout:4/976: dread de/d33/d2f/d35/df3/fa0 [0,4194304] 0 2024-09-21T10:40:56.964 INFO:tasks.workunit.client.1.smithi112.stdout:4/977: fdatasync de/d2a/dbf/fe4 0 2024-09-21T10:40:56.964 INFO:tasks.workunit.client.1.smithi112.stdout:4/978: read - de/d33/d6f/d9c/d3e/d75/f139 zero size 2024-09-21T10:40:56.964 INFO:tasks.workunit.client.1.smithi112.stdout:3/953: mkdir d2/d2f/daf/df4/ddd/d133/d60/d86/d98/d13a 0 2024-09-21T10:40:56.965 INFO:tasks.workunit.client.1.smithi112.stdout:0/955: sync 2024-09-21T10:40:56.966 INFO:tasks.workunit.client.1.smithi112.stdout:9/995: symlink d1/d2/d27/d37/d3b/d69/d77/da0/de4/l16a 0 2024-09-21T10:40:56.967 INFO:tasks.workunit.client.1.smithi112.stdout:5/999: creat d9/d15/d18/d3a/d4b/d74/f143 x:0 0 0 2024-09-21T10:40:56.967 INFO:tasks.workunit.client.1.smithi112.stdout:6/991: creat d4/d6/da/d11/d1f/d22/d100/f156 x:0 0 0 2024-09-21T10:40:56.968 INFO:tasks.workunit.client.0.smithi060.stdout:3/234: dwrite d0/d1/d11/f32 [0,4194304] 0 2024-09-21T10:40:56.968 INFO:tasks.workunit.client.0.smithi060.stdout:0/295: dwrite d5/f25 [0,4194304] 0 2024-09-21T10:40:56.969 INFO:tasks.workunit.client.1.smithi112.stdout:7/961: mknod d7/d22/d41/d4b/d52/d77/dbd/de4/d101/d121/c141 0 2024-09-21T10:40:56.971 INFO:tasks.workunit.client.1.smithi112.stdout:3/954: mkdir d2/d2f/d3f/ddf/d31/d2a/dff/d13b 0 2024-09-21T10:40:56.972 INFO:tasks.workunit.client.1.smithi112.stdout:2/909: dread d0/d12/d46/da0/db9/dbd/d62/d63/f35 [0,4194304] 0 2024-09-21T10:40:56.973 INFO:tasks.workunit.client.1.smithi112.stdout:4/979: write de/d33/d2f/ffc [579904,106576] 0 2024-09-21T10:40:56.973 INFO:tasks.workunit.client.1.smithi112.stdout:0/956: mknod d3/d18/d52/df9/d130/d4f/dc3/c142 0 2024-09-21T10:40:56.974 INFO:tasks.workunit.client.0.smithi060.stdout:6/354: rmdir d3/dd 39 2024-09-21T10:40:56.975 INFO:tasks.workunit.client.0.smithi060.stdout:6/355: dread - d3/d12/d16/d25/f57 zero size 2024-09-21T10:40:56.975 INFO:tasks.workunit.client.1.smithi112.stdout:9/996: creat d1/d2/f16b x:0 0 0 2024-09-21T10:40:56.975 INFO:tasks.workunit.client.1.smithi112.stdout:9/997: truncate d1/d2/d27/d3a/d6b/d30/d5c/f11b 460345 0 2024-09-21T10:40:56.977 INFO:tasks.workunit.client.0.smithi060.stdout:3/235: mkdir d0/d1/d11/d2a/d45 0 2024-09-21T10:40:56.977 INFO:tasks.workunit.client.0.smithi060.stdout:3/236: chown d0/d1/d24/f40 526099909 1 2024-09-21T10:40:56.979 INFO:tasks.workunit.client.1.smithi112.stdout:7/962: link d7/d22/d41/d4b/d52/d77/dbd/de4/f127 d7/d22/d73/d11d/f142 0 2024-09-21T10:40:56.980 INFO:tasks.workunit.client.0.smithi060.stdout:0/296: creat d5/d10/d4e/f51 x:0 0 0 2024-09-21T10:40:56.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/957: dread d3/d18/d52/df9/d130/d10e/f116 [0,4194304] 0 2024-09-21T10:40:56.983 INFO:tasks.workunit.client.1.smithi112.stdout:0/958: creat d3/d4a/d4e/dc2/d10/dc6/f143 x:0 0 0 2024-09-21T10:40:56.984 INFO:tasks.workunit.client.1.smithi112.stdout:3/955: rename d2/d2f/d3f/ddf/d31/d37/f82 to d2/d2f/d3f/ddf/d31/d2a/dfe/d11e/f13c 0 2024-09-21T10:40:56.986 INFO:tasks.workunit.client.1.smithi112.stdout:2/910: creat d0/da2/dd3/f127 x:0 0 0 2024-09-21T10:40:56.987 INFO:tasks.workunit.client.1.smithi112.stdout:2/911: chown d0/dd/lcb 283745400 1 2024-09-21T10:40:56.987 INFO:tasks.workunit.client.1.smithi112.stdout:2/912: stat d0/dd/d47/dd0/l119 0 2024-09-21T10:40:56.987 INFO:tasks.workunit.client.0.smithi060.stdout:3/237: dread d0/f21 [0,4194304] 0 2024-09-21T10:40:56.989 INFO:tasks.workunit.client.0.smithi060.stdout:0/297: unlink d5/d10/f9 0 2024-09-21T10:40:56.993 INFO:tasks.workunit.client.1.smithi112.stdout:9/998: getdents d1/d2/d27/d3a/d6b/d30/d121 0 2024-09-21T10:40:56.994 INFO:tasks.workunit.client.1.smithi112.stdout:7/963: creat d7/d22/d41/d4b/f143 x:0 0 0 2024-09-21T10:40:56.995 INFO:tasks.workunit.client.0.smithi060.stdout:6/356: dwrite d3/d12/d16/f18 [4194304,4194304] 0 2024-09-21T10:40:56.995 INFO:tasks.workunit.client.0.smithi060.stdout:6/357: write d3/d12/d16/d22/f63 [534723,59308] 0 2024-09-21T10:40:56.996 INFO:tasks.workunit.client.1.smithi112.stdout:4/980: dwrite de/f117 [0,4194304] 0 2024-09-21T10:40:56.997 INFO:tasks.workunit.client.0.smithi060.stdout:6/358: write d3/d12/d16/d25/d27/f29 [1655769,68633] 0 2024-09-21T10:40:56.997 INFO:tasks.workunit.client.0.smithi060.stdout:6/359: write d3/d12/d16/d25/d27/f29 [599850,62326] 0 2024-09-21T10:40:56.997 INFO:tasks.workunit.client.0.smithi060.stdout:6/360: chown d3/d12/d4e 52 1 2024-09-21T10:40:56.998 INFO:tasks.workunit.client.0.smithi060.stdout:3/238: dread d0/f28 [0,4194304] 0 2024-09-21T10:40:56.998 INFO:tasks.workunit.client.0.smithi060.stdout:3/239: fdatasync d0/d1/f18 0 2024-09-21T10:40:56.999 INFO:tasks.workunit.client.1.smithi112.stdout:0/959: symlink d3/d18/d52/df9/d130/d46/d122/l144 0 2024-09-21T10:40:57.000 INFO:tasks.workunit.client.1.smithi112.stdout:3/956: creat d2/d2f/f13d x:0 0 0 2024-09-21T10:40:57.000 INFO:tasks.workunit.client.1.smithi112.stdout:3/957: chown d2/le5 95501675 1 2024-09-21T10:40:57.001 INFO:tasks.workunit.client.0.smithi060.stdout:6/361: mknod d3/d12/d16/d22/d58/c6b 0 2024-09-21T10:40:57.001 INFO:tasks.workunit.client.0.smithi060.stdout:0/298: write d5/d10/d11/f28 [460893,83340] 0 2024-09-21T10:40:57.002 INFO:tasks.workunit.client.1.smithi112.stdout:2/913: symlink d0/d12/d46/d86/dc0/dc8/d111/l128 0 2024-09-21T10:40:57.002 INFO:tasks.workunit.client.0.smithi060.stdout:3/240: dread d0/d1/d24/f25 [0,4194304] 0 2024-09-21T10:40:57.003 INFO:tasks.workunit.client.0.smithi060.stdout:3/241: chown d0/d1/c36 11 1 2024-09-21T10:40:57.003 INFO:tasks.workunit.client.1.smithi112.stdout:9/999: creat d1/d2/d27/d3a/d6b/f16c x:0 0 0 2024-09-21T10:40:57.004 INFO:tasks.workunit.client.0.smithi060.stdout:6/362: fsync d3/d12/d16/d25/d27/f29 0 2024-09-21T10:40:57.006 INFO:tasks.workunit.client.0.smithi060.stdout:0/299: truncate d5/d10/da/fc 2112155 0 2024-09-21T10:40:57.010 INFO:tasks.workunit.client.0.smithi060.stdout:3/242: rename d0/d2b to d0/d1/d11/d46 0 2024-09-21T10:40:57.011 INFO:tasks.workunit.client.1.smithi112.stdout:4/981: unlink de/d33/d2f/d71/fe6 0 2024-09-21T10:40:57.014 INFO:tasks.workunit.client.1.smithi112.stdout:0/960: mkdir d3/d18/d52/d55/dcc/d10b/ddf/de5/d145 0 2024-09-21T10:40:57.014 INFO:tasks.workunit.client.1.smithi112.stdout:0/961: fdatasync d3/d18/d45/fbf 0 2024-09-21T10:40:57.014 INFO:tasks.workunit.client.1.smithi112.stdout:2/914: dread d0/d12/d46/da0/db9/fea [0,4194304] 0 2024-09-21T10:40:57.015 INFO:tasks.workunit.client.1.smithi112.stdout:3/958: chown d2/d2f/d3f/l57 130258 1 2024-09-21T10:40:57.015 INFO:tasks.workunit.client.0.smithi060.stdout:6/363: creat d3/d12/d65/f6c x:0 0 0 2024-09-21T10:40:57.015 INFO:tasks.workunit.client.0.smithi060.stdout:0/300: read d5/f25 [2121840,4648] 0 2024-09-21T10:40:57.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/243: creat d0/d1/d11/f47 x:0 0 0 2024-09-21T10:40:57.017 INFO:tasks.workunit.client.1.smithi112.stdout:4/982: symlink de/d109/d142/l147 0 2024-09-21T10:40:57.021 INFO:tasks.workunit.client.1.smithi112.stdout:0/962: unlink d3/d4a/d4e/dc2/d10/cbb 0 2024-09-21T10:40:57.021 INFO:tasks.workunit.client.1.smithi112.stdout:0/963: chown d3/d4a/d4e/l5a 16 1 2024-09-21T10:40:57.021 INFO:tasks.workunit.client.1.smithi112.stdout:0/964: fdatasync d3/d18/f3b 0 2024-09-21T10:40:57.021 INFO:tasks.workunit.client.1.smithi112.stdout:2/915: mknod d0/d12/d46/dd8/c129 0 2024-09-21T10:40:57.022 INFO:tasks.workunit.client.1.smithi112.stdout:2/916: chown d0/d12/d76/d123/d7e/d8f/d51/d57/f84 1586 1 2024-09-21T10:40:57.022 INFO:tasks.workunit.client.1.smithi112.stdout:7/964: dwrite d7/d22/d41/d4b/d52/d77/dbd/d13e/d5c/f92 [0,4194304] 0 2024-09-21T10:40:57.023 INFO:tasks.workunit.client.1.smithi112.stdout:3/959: unlink d2/d1f/d100/c10e 0 2024-09-21T10:40:57.023 INFO:tasks.workunit.client.1.smithi112.stdout:3/960: readlink d2/d2f/daf/lfa 0 2024-09-21T10:40:57.024 INFO:tasks.workunit.client.1.smithi112.stdout:4/983: mkdir de/d33/d6f/d9c/d148 0 2024-09-21T10:40:57.027 INFO:tasks.workunit.client.1.smithi112.stdout:0/965: creat d3/d4a/d4e/dc2/d10/d8b/f146 x:0 0 0 2024-09-21T10:40:57.028 INFO:tasks.workunit.client.0.smithi060.stdout:3/244: read d0/f28 [1563131,27461] 0 2024-09-21T10:40:57.028 INFO:tasks.workunit.client.0.smithi060.stdout:3/245: chown d0/d1/d11/f47 369 1 2024-09-21T10:40:57.028 INFO:tasks.workunit.client.0.smithi060.stdout:0/301: dwrite d5/d10/d4e/f51 [0,4194304] 0 2024-09-21T10:40:57.034 INFO:tasks.workunit.client.0.smithi060.stdout:6/364: getdents d3/d12/d16/d22/d58 0 2024-09-21T10:40:57.034 INFO:tasks.workunit.client.0.smithi060.stdout:6/365: chown d3/f4b 31940 1 2024-09-21T10:40:57.035 INFO:tasks.workunit.client.1.smithi112.stdout:7/965: rename d7/c2a to d7/d22/d41/d4b/d52/d77/dbd/d13e/d72/c144 0 2024-09-21T10:40:57.035 INFO:tasks.workunit.client.1.smithi112.stdout:7/966: dread - d7/d22/d41/d4b/da2/fdd zero size 2024-09-21T10:40:57.035 INFO:tasks.workunit.client.1.smithi112.stdout:7/967: chown d7/d22/d41/c6b 57 1 2024-09-21T10:40:57.036 INFO:tasks.workunit.client.1.smithi112.stdout:2/917: dwrite d0/d12/f41 [0,4194304] 0 2024-09-21T10:40:57.037 INFO:tasks.workunit.client.1.smithi112.stdout:4/984: mknod de/d33/d6f/d9c/d3e/c149 0 2024-09-21T10:40:57.039 INFO:tasks.workunit.client.1.smithi112.stdout:0/966: truncate d3/d18/d52/d55/dcc/d10b/ddf/de5/f13c 1849724 0 2024-09-21T10:40:57.044 INFO:tasks.workunit.client.1.smithi112.stdout:3/961: rename d2/d1f/f2c to d2/d2f/daf/df4/ddd/d133/d60/d86/d98/d120/f13e 0 2024-09-21T10:40:57.045 INFO:tasks.workunit.client.0.smithi060.stdout:3/246: dread d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:40:57.047 INFO:tasks.workunit.client.1.smithi112.stdout:7/968: read d7/d3d/da7/fe1 [195935,3154] 0 2024-09-21T10:40:57.047 INFO:tasks.workunit.client.1.smithi112.stdout:7/969: write d7/d22/d41/d4b/d52/d77/dbd/d13e/db7/df2/d10c/f12f [1894081,35708] 0 2024-09-21T10:40:57.048 INFO:tasks.workunit.client.1.smithi112.stdout:3/962: dread d2/d2f/daf/df4/fa7 [0,4194304] 0 2024-09-21T10:40:57.049 INFO:tasks.workunit.client.1.smithi112.stdout:2/918: rename d0/l6e to d0/dd/d47/l12a 0 2024-09-21T10:40:57.050 INFO:tasks.workunit.client.1.smithi112.stdout:2/919: write d0/dd/d47/dd0/fe4 [904444,27779] 0 2024-09-21T10:40:57.050 INFO:tasks.workunit.client.1.smithi112.stdout:2/920: write d0/da4/dc5/fd7 [1014379,119475] 0 2024-09-21T10:40:57.055 INFO:tasks.workunit.client.0.smithi060.stdout:6/366: rename d3/c10 to d3/d12/d16/d1a/d60/c6d 0 2024-09-21T10:40:57.055 INFO:tasks.workunit.client.0.smithi060.stdout:6/367: chown d3/d12/d16/d25/f3e 6113 1 2024-09-21T10:40:57.055 INFO:tasks.workunit.client.0.smithi060.stdout:6/368: creat d3/d12/d16/d22/f6e x:0 0 0 2024-09-21T10:40:57.056 INFO:tasks.workunit.client.1.smithi112.stdout:3/963: dread d2/d1f/f35 [0,4194304] 0 2024-09-21T10:40:57.056 INFO:tasks.workunit.client.1.smithi112.stdout:3/964: readlink d2/d2f/lbb 0 2024-09-21T10:40:57.056 INFO:tasks.workunit.client.1.smithi112.stdout:3/965: stat d2/d2f/d3f/ddf/l63 0 2024-09-21T10:40:57.056 INFO:tasks.workunit.client.1.smithi112.stdout:3/966: chown d2/d2f/d3f/ddf/d31/d2a/da1/fd3 377423788 1 2024-09-21T10:40:57.056 INFO:tasks.workunit.client.1.smithi112.stdout:3/967: chown d2/d2f/daf/ff1 587270509 1 2024-09-21T10:40:57.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/970: mkdir d7/d22/d41/d4b/d52/d77/dbd/d13e/dc9/d145 0 2024-09-21T10:40:57.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/971: chown d7/d22/d41/d4b/d52/d77/dbd/d13e/db7/cd7 2494 1 2024-09-21T10:40:57.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/972: fdatasync d7/d22/f63 0 2024-09-21T10:40:57.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/973: creat d7/d22/d41/d4b/d52/d77/dbd/de4/f146 x:0 0 0 2024-09-21T10:40:57.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/974: chown d7/d22/d86/dac/f98 178325 1 2024-09-21T10:40:57.057 INFO:tasks.workunit.client.1.smithi112.stdout:7/975: write d7/d22/d41/d4b/f64 [5506938,9575] 0 2024-09-21T10:40:57.058 INFO:tasks.workunit.client.1.smithi112.stdout:7/976: write d7/d3d/f3e [4947346,109833] 0 2024-09-21T10:40:57.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/247: creat d0/d1/d1e/d34/f48 x:0 0 0 2024-09-21T10:40:57.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/248: write d0/d1/d11/f15 [1019871,108907] 0 2024-09-21T10:40:57.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/249: creat d0/d1/d1e/d34/f49 x:0 0 0 2024-09-21T10:40:57.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/250: stat d0/d1/d11/f32 0 2024-09-21T10:40:57.059 INFO:tasks.workunit.client.0.smithi060.stdout:3/251: stat d0/d1/d11/d46/l3b 0 2024-09-21T10:40:57.060 INFO:tasks.workunit.client.0.smithi060.stdout:3/252: read - d0/d1/d24/f40 zero size 2024-09-21T10:40:57.060 INFO:tasks.workunit.client.1.smithi112.stdout:3/968: chown d2/d2f/d3f/ced 768563104 1 2024-09-21T10:40:57.060 INFO:tasks.workunit.client.1.smithi112.stdout:3/969: chown d2/d2f/daf/df4/ddd/d133/d3a/c122 3 1 2024-09-21T10:40:57.061 INFO:tasks.workunit.client.1.smithi112.stdout:3/970: read d2/dd5/d107/f118 [320020,98690] 0 2024-09-21T10:40:57.063 INFO:tasks.workunit.client.0.smithi060.stdout:0/302: mknod d5/d10/da/c52 0 2024-09-21T10:40:57.064 INFO:tasks.workunit.client.1.smithi112.stdout:3/971: dread d2/d2f/d3f/ddf/d31/d2a/f3b [0,4194304] 0 2024-09-21T10:40:57.064 INFO:tasks.workunit.client.1.smithi112.stdout:3/972: write d2/f93 [1835864,90430] 0 2024-09-21T10:40:57.067 INFO:tasks.workunit.client.1.smithi112.stdout:0/967: dwrite d3/d18/d52/d55/dcc/d10b/f12f [4194304,4194304] 0 2024-09-21T10:40:57.068 INFO:tasks.workunit.client.1.smithi112.stdout:0/968: chown d3/d4a/d4e/dc2/d10/d8b/fd2 599 1 2024-09-21T10:40:57.068 INFO:tasks.workunit.client.1.smithi112.stdout:4/985: dwrite de/d33/d2f/d71/f4a [0,4194304] 0 2024-09-21T10:40:57.069 INFO:tasks.workunit.client.1.smithi112.stdout:7/977: rmdir d7/d22/d41/d4b/d52/d77/dbd/d13e/dc9/d145 0 2024-09-21T10:40:57.070 INFO:tasks.workunit.client.0.smithi060.stdout:6/369: symlink d3/d12/d16/d22/d58/l6f 0 2024-09-21T10:40:57.071 INFO:tasks.workunit.client.1.smithi112.stdout:3/973: creat d2/d2f/daf/df4/ddd/f13f x:0 0 0 2024-09-21T10:40:57.071 INFO:tasks.workunit.client.1.smithi112.stdout:3/974: fsync d2/d2f/d3f/ddf/f5e 0 2024-09-21T10:40:57.072 INFO:tasks.workunit.client.1.smithi112.stdout:3/975: creat d2/dd5/f140 x:0 0 0 2024-09-21T10:40:57.076 INFO:tasks.workunit.client.1.smithi112.stdout:0/969: symlink d3/d4a/d4e/l147 0 2024-09-21T10:40:57.079 INFO:tasks.workunit.client.0.smithi060.stdout:3/253: mknod d0/d1/d11/d2a/d45/c4a 0 2024-09-21T10:40:57.079 INFO:tasks.workunit.client.0.smithi060.stdout:3/254: dread - d0/d1/d24/f40 zero size 2024-09-21T10:40:57.079 INFO:tasks.workunit.client.1.smithi112.stdout:4/986: creat de/d18/d6d/f14a x:0 0 0 2024-09-21T10:40:57.080 INFO:tasks.workunit.client.0.smithi060.stdout:6/370: getdents d3/d12/d16/d1a 0 2024-09-21T10:40:57.081 INFO:tasks.workunit.client.0.smithi060.stdout:4/339: sync 2024-09-21T10:40:57.081 INFO:tasks.workunit.client.0.smithi060.stdout:4/340: fsync d0/d5/d3a/f5d 0 2024-09-21T10:40:57.081 INFO:tasks.workunit.client.0.smithi060.stdout:4/341: write d0/d5/d3a/f5d [133047,40743] 0 2024-09-21T10:40:57.081 INFO:tasks.workunit.client.0.smithi060.stdout:4/342: readlink d0/d5/d12/d16/l58 0 2024-09-21T10:40:57.082 INFO:tasks.workunit.client.1.smithi112.stdout:7/978: mkdir d7/d22/d41/d4b/d52/d77/dbd/d13e/dc9/dd3/d147 0 2024-09-21T10:40:57.084 INFO:tasks.workunit.client.1.smithi112.stdout:3/976: mkdir d2/d2f/d3f/ddf/d31/d2a/dff/d13b/d141 0 2024-09-21T10:40:57.087 INFO:tasks.workunit.client.1.smithi112.stdout:7/979: mknod d7/d22/d86/dac/c148 0 2024-09-21T10:40:57.088 INFO:tasks.workunit.client.1.smithi112.stdout:3/977: creat d2/d2f/daf/df4/ddd/d133/d60/d86/dd8/f142 x:0 0 0 2024-09-21T10:40:57.088 INFO:tasks.workunit.client.1.smithi112.stdout:3/978: stat d2/d2f/d3f/ddf/d31/l7f 0 2024-09-21T10:40:57.090 INFO:tasks.workunit.client.1.smithi112.stdout:3/979: symlink d2/d2f/d3f/ddf/d31/l143 0 2024-09-21T10:40:57.090 INFO:tasks.workunit.client.1.smithi112.stdout:3/980: chown d2/d2f/d3f/ddf/d31 27 1 2024-09-21T10:40:57.090 INFO:tasks.workunit.client.1.smithi112.stdout:3/981: truncate d2/d2f/daf/df4/ddd/d133/d60/d86/d98/d120/fdb 896151 0 2024-09-21T10:40:57.091 INFO:tasks.workunit.client.1.smithi112.stdout:3/982: chown d2/d2f/d3f/ddf/dad/fe9 175 1 2024-09-21T10:40:57.091 INFO:tasks.workunit.client.1.smithi112.stdout:3/983: readlink d2/d2f/d3f/ddf/d31/l129 0 2024-09-21T10:40:57.091 INFO:tasks.workunit.client.1.smithi112.stdout:4/987: dread de/d18/f26 [0,4194304] 0 2024-09-21T10:40:57.092 INFO:tasks.workunit.client.1.smithi112.stdout:4/988: chown de/d33/db5/f13f 1509401062 1 2024-09-21T10:40:57.097 INFO:tasks.workunit.client.0.smithi060.stdout:4/343: dread d0/f60 [0,4194304] 0 2024-09-21T10:40:57.098 INFO:tasks.workunit.client.0.smithi060.stdout:4/344: chown d0/d5/f66 4697 1 2024-09-21T10:40:57.098 INFO:tasks.workunit.client.0.smithi060.stdout:4/345: chown d0/d59 442 1 2024-09-21T10:40:57.098 INFO:tasks.workunit.client.0.smithi060.stdout:4/346: chown d0/d5/d12/c4f 18277429 1 2024-09-21T10:40:57.098 INFO:tasks.workunit.client.0.smithi060.stdout:4/347: creat d0/d5/d3a/f6d x:0 0 0 2024-09-21T10:40:57.101 INFO:tasks.workunit.client.0.smithi060.stdout:4/348: getdents d0/d5/d12/d3d 0 2024-09-21T10:40:57.101 INFO:tasks.workunit.client.1.smithi112.stdout:2/921: dwrite d0/d12/d76/d123/f100 [0,4194304] 0 2024-09-21T10:40:57.102 INFO:tasks.workunit.client.1.smithi112.stdout:2/922: stat d0/da4/dbe/c8c 0 2024-09-21T10:40:57.102 INFO:tasks.workunit.client.0.smithi060.stdout:4/349: mknod d0/d5/d12/d16/c6e 0 2024-09-21T10:40:57.105 INFO:tasks.workunit.client.0.smithi060.stdout:4/350: rename d0/d5/d12/d15/l49 to d0/d3c/d69/d6a/d6b/l6f 0 2024-09-21T10:40:57.105 INFO:tasks.workunit.client.1.smithi112.stdout:4/989: dread de/d18/f21 [4194304,4194304] 0 2024-09-21T10:40:57.111 INFO:tasks.workunit.client.0.smithi060.stdout:0/303: dwrite d5/f3e [0,4194304] 0 2024-09-21T10:40:57.113 INFO:tasks.workunit.client.1.smithi112.stdout:2/923: creat d0/d12/d46/da0/db9/dbd/d62/f12b x:0 0 0 2024-09-21T10:40:57.116 INFO:tasks.workunit.client.0.smithi060.stdout:3/255: dwrite d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:40:57.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/371: dwrite d3/d12/d16/d1a/f1e [0,4194304] 0 2024-09-21T10:40:57.116 INFO:tasks.workunit.client.0.smithi060.stdout:6/372: read d3/dd/f14 [566566,73846] 0 2024-09-21T10:40:57.117 INFO:tasks.workunit.client.1.smithi112.stdout:3/984: dwrite d2/d2f/daf/df4/ddd/d133/d3a/ff6 [8388608,4194304] 0 2024-09-21T10:40:57.119 INFO:tasks.workunit.client.0.smithi060.stdout:0/304: fdatasync d5/d10/da/f39 0 2024-09-21T10:40:57.119 INFO:tasks.workunit.client.0.smithi060.stdout:0/305: rename d5 to d5/d10/d4e/d53 22 2024-09-21T10:40:57.126 INFO:tasks.workunit.client.0.smithi060.stdout:6/373: mkdir d3/d12/d16/d22/d5d/d70 0 2024-09-21T10:40:57.127 INFO:tasks.workunit.client.1.smithi112.stdout:4/990: rmdir de/d33/d2f/d71 39 2024-09-21T10:40:57.128 INFO:tasks.workunit.client.1.smithi112.stdout:3/985: write d2/d2f/d3f/ddf/d31/d2a/da1/fd3 [1065619,4776] 0 2024-09-21T10:40:57.129 INFO:tasks.workunit.client.0.smithi060.stdout:6/374: creat d3/d54/f71 x:0 0 0 2024-09-21T10:40:57.130 INFO:tasks.workunit.client.0.smithi060.stdout:6/375: symlink d3/d12/d65/l72 0 2024-09-21T10:40:57.130 INFO:tasks.workunit.client.0.smithi060.stdout:6/376: getdents d3/d12/d16/d5b 0 2024-09-21T10:40:57.131 INFO:tasks.workunit.client.1.smithi112.stdout:3/986: symlink d2/d2f/d3f/ddf/d31/d37/l144 0 2024-09-21T10:40:57.131 INFO:tasks.workunit.client.1.smithi112.stdout:3/987: truncate d2/d2f/daf/df4/ddd/d133/d60/d86/dd8/f142 907772 0 2024-09-21T10:40:57.133 INFO:tasks.workunit.client.0.smithi060.stdout:6/377: creat d3/d12/d16/d1a/d60/f73 x:0 0 0 2024-09-21T10:40:57.133 INFO:tasks.workunit.client.0.smithi060.stdout:6/378: write d3/d12/d38/d41/f62 [582647,74532] 0 2024-09-21T10:40:57.134 INFO:tasks.workunit.client.1.smithi112.stdout:3/988: rename d2/d2f/d3f/ddf/d31/d37/c6b to d2/d2f/daf/df4/ddd/d133/d60/d86/d98/c145 0 2024-09-21T10:40:57.135 INFO:tasks.workunit.client.1.smithi112.stdout:4/991: getdents de/d18/d6d 0 2024-09-21T10:40:57.135 INFO:tasks.workunit.client.1.smithi112.stdout:4/992: read - de/d2e/df4/f105 zero size 2024-09-21T10:40:57.136 INFO:tasks.workunit.client.1.smithi112.stdout:7/980: rmdir d7/d22/d41/d4b/d52/d77/dbd 39 2024-09-21T10:40:57.137 INFO:tasks.workunit.client.1.smithi112.stdout:4/993: rename de/d2e/df4/l138 to de/d2a/dbf/d82/l14b 0 2024-09-21T10:40:57.137 INFO:tasks.workunit.client.1.smithi112.stdout:4/994: chown de/d2a/d31/lc0 223934015 1 2024-09-21T10:40:57.139 INFO:tasks.workunit.client.1.smithi112.stdout:7/981: dread d7/d22/d41/f7b [0,4194304] 0 2024-09-21T10:40:57.139 INFO:tasks.workunit.client.1.smithi112.stdout:7/982: chown d7/d22/d41/d4b/da2/dea/fa6 78 1 2024-09-21T10:40:57.140 INFO:tasks.workunit.client.1.smithi112.stdout:7/983: unlink d7/f14 0 2024-09-21T10:40:57.146 INFO:tasks.workunit.client.1.smithi112.stdout:6/992: sync 2024-09-21T10:40:57.147 INFO:tasks.workunit.client.0.smithi060.stdout:4/351: dwrite d0/d5/f10 [0,4194304] 0 2024-09-21T10:40:57.147 INFO:tasks.workunit.client.0.smithi060.stdout:4/352: read - d0/d5/d12/f5f zero size 2024-09-21T10:40:57.149 INFO:tasks.workunit.client.0.smithi060.stdout:4/353: mknod d0/d5/d12/d15/d4d/c70 0 2024-09-21T10:40:57.149 INFO:tasks.workunit.client.0.smithi060.stdout:4/354: fsync d0/f4 0 2024-09-21T10:40:57.150 INFO:tasks.workunit.client.0.smithi060.stdout:4/355: creat d0/d5/f71 x:0 0 0 2024-09-21T10:40:57.153 INFO:tasks.workunit.client.1.smithi112.stdout:7/984: dread f5 [0,4194304] 0 2024-09-21T10:40:57.155 INFO:tasks.workunit.client.0.smithi060.stdout:3/256: dwrite d0/d1/d24/f25 [0,4194304] 0 2024-09-21T10:40:57.155 INFO:tasks.workunit.client.0.smithi060.stdout:3/257: creat d0/d1/d1e/f4b x:0 0 0 2024-09-21T10:40:57.155 INFO:tasks.workunit.client.0.smithi060.stdout:3/258: readlink d0/d1/d11/d46/l3b 0 2024-09-21T10:40:57.155 INFO:tasks.workunit.client.1.smithi112.stdout:7/985: rename d7/d22/d86/dac/c124 to d7/d22/d41/d4b/d52/d77/dbd/de4/d101/c149 0 2024-09-21T10:40:57.158 INFO:tasks.workunit.client.1.smithi112.stdout:2/924: dwrite d0/d12/d76/d123/d7e/f10c [0,4194304] 0 2024-09-21T10:40:57.159 INFO:tasks.workunit.client.0.smithi060.stdout:0/306: dwrite d5/d10/d11/f3b [0,4194304] 0 2024-09-21T10:40:57.159 INFO:tasks.workunit.client.1.smithi112.stdout:4/995: dwrite de/d2a/dbf/d82/fa2 [0,4194304] 0 2024-09-21T10:40:57.159 INFO:tasks.workunit.client.0.smithi060.stdout:3/259: symlink d0/d1/d11/d2a/d45/l4c 0 2024-09-21T10:40:57.159 INFO:tasks.workunit.client.0.smithi060.stdout:3/260: creat d0/d1/d11/d2a/f4d x:0 0 0 2024-09-21T10:40:57.159 INFO:tasks.workunit.client.0.smithi060.stdout:3/261: readlink d0/l3c 0 2024-09-21T10:40:57.164 INFO:tasks.workunit.client.1.smithi112.stdout:3/989: dread d2/d2f/d3f/ddf/d31/d2a/da1/fd3 [0,4194304] 0 2024-09-21T10:40:57.170 INFO:tasks.workunit.client.1.smithi112.stdout:4/996: dread de/d18/d6d/f8c [0,4194304] 0 2024-09-21T10:40:57.170 INFO:tasks.workunit.client.1.smithi112.stdout:4/997: write de/d33/d2f/d71/f4a [5075339,109338] 0 2024-09-21T10:40:57.170 INFO:tasks.workunit.client.1.smithi112.stdout:4/998: write de/d2a/d31/fdf [151871,65355] 0 2024-09-21T10:40:57.171 INFO:tasks.workunit.client.1.smithi112.stdout:4/999: write de/d33/d2f/d71/fb1 [591780,41843] 0 2024-09-21T10:40:57.176 INFO:tasks.workunit.client.0.smithi060.stdout:3/262: write d0/d1/d11/d2a/f2e [154005,49214] 0 2024-09-21T10:40:57.178 INFO:tasks.workunit.client.0.smithi060.stdout:3/263: mkdir d0/d1/d11/d2a/d43/d4e 0 2024-09-21T10:40:57.178 INFO:tasks.workunit.client.0.smithi060.stdout:3/264: write d0/d1/d1e/d34/f48 [711812,79255] 0 2024-09-21T10:40:57.178 INFO:tasks.workunit.client.0.smithi060.stdout:3/265: stat d0/d1/d11/d2a/f33 0 2024-09-21T10:40:57.181 INFO:tasks.workunit.client.1.smithi112.stdout:6/993: dwrite d4/d4f/fea [0,4194304] 0 2024-09-21T10:40:57.181 INFO:tasks.workunit.client.1.smithi112.stdout:6/994: write d4/d6/da/d14/f149 [714747,89309] 0 2024-09-21T10:40:57.182 INFO:tasks.workunit.client.0.smithi060.stdout:4/356: dwrite d0/d5/f5a [0,4194304] 0 2024-09-21T10:40:57.182 INFO:tasks.workunit.client.0.smithi060.stdout:0/307: dwrite d5/d10/da/f39 [0,4194304] 0 2024-09-21T10:40:57.183 INFO:tasks.workunit.client.1.smithi112.stdout:6/995: mknod d4/d6/da/d11/d1f/d22/dde/c157 0 2024-09-21T10:40:57.183 INFO:tasks.workunit.client.1.smithi112.stdout:6/996: fdatasync d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/fc5 0 2024-09-21T10:40:57.184 INFO:tasks.workunit.client.1.smithi112.stdout:6/997: chown d4/d6/da/d11/d1f/d22/d100/d12c/ccb 0 1 2024-09-21T10:40:57.187 INFO:tasks.workunit.client.1.smithi112.stdout:6/998: symlink d4/d6/da/d14/d49/d73/l158 0 2024-09-21T10:40:57.188 INFO:tasks.workunit.client.0.smithi060.stdout:4/357: mkdir d0/d5/d12/d15/d72 0 2024-09-21T10:40:57.191 INFO:tasks.workunit.client.1.smithi112.stdout:6/999: mkdir d4/d6/da/d11/d1f/d22/d100/d12c/d31/d56/d11b/d159 0 2024-09-21T10:40:57.195 INFO:tasks.workunit.client.0.smithi060.stdout:3/266: dwrite d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:40:57.197 INFO:tasks.workunit.client.0.smithi060.stdout:4/358: dread d0/d5/f5a [0,4194304] 0 2024-09-21T10:40:57.197 INFO:tasks.workunit.client.0.smithi060.stdout:4/359: fdatasync d0/d5/d3a/f6d 0 2024-09-21T10:40:57.198 INFO:tasks.workunit.client.0.smithi060.stdout:0/308: write d5/d10/da/d20/d45/f4f [396987,17351] 0 2024-09-21T10:40:57.200 INFO:tasks.workunit.client.0.smithi060.stdout:4/360: creat d0/d5/d12/f73 x:0 0 0 2024-09-21T10:40:57.202 INFO:tasks.workunit.client.0.smithi060.stdout:4/361: mknod d0/d5/d12/d15/d4d/c74 0 2024-09-21T10:40:57.202 INFO:tasks.workunit.client.0.smithi060.stdout:4/362: truncate d0/d3c/d67/f68 744310 0 2024-09-21T10:40:57.203 INFO:tasks.workunit.client.0.smithi060.stdout:4/363: link d0/d5/d12/f73 d0/d3c/d69/d6a/d6b/d32/f75 0 2024-09-21T10:40:57.204 INFO:tasks.workunit.client.0.smithi060.stdout:4/364: chown d0/d5/d12/d15/d4d/c74 14555 1 2024-09-21T10:40:57.204 INFO:tasks.workunit.client.0.smithi060.stdout:4/365: write d0/d3c/d67/f68 [1628779,68094] 0 2024-09-21T10:40:57.205 INFO:tasks.workunit.client.0.smithi060.stdout:4/366: unlink d0/f4 0 2024-09-21T10:40:57.205 INFO:tasks.workunit.client.0.smithi060.stdout:4/367: readlink d0/d5/d12/d16/d28/l31 0 2024-09-21T10:40:57.208 INFO:tasks.workunit.client.0.smithi060.stdout:4/368: symlink d0/d3c/d69/d6a/d6b/d65/d51/l76 0 2024-09-21T10:40:57.209 INFO:tasks.workunit.client.0.smithi060.stdout:4/369: creat d0/d3c/d69/d6a/d6b/d32/d57/f77 x:0 0 0 2024-09-21T10:40:57.212 INFO:tasks.workunit.client.0.smithi060.stdout:1/283: sync 2024-09-21T10:40:57.212 INFO:tasks.workunit.client.0.smithi060.stdout:7/301: sync 2024-09-21T10:40:57.212 INFO:tasks.workunit.client.0.smithi060.stdout:5/286: sync 2024-09-21T10:40:57.216 INFO:tasks.workunit.client.0.smithi060.stdout:5/287: mknod d5/c66 0 2024-09-21T10:40:57.219 INFO:tasks.workunit.client.0.smithi060.stdout:1/284: symlink d6/d24/da/db/d1c/l61 0 2024-09-21T10:40:57.219 INFO:tasks.workunit.client.0.smithi060.stdout:1/285: chown d6/d24/da/db/d1c/f26 10250 1 2024-09-21T10:40:57.220 INFO:tasks.workunit.client.0.smithi060.stdout:3/267: dwrite d0/d1/d24/f40 [0,4194304] 0 2024-09-21T10:40:57.222 INFO:tasks.workunit.client.0.smithi060.stdout:1/286: rename d6/d24/da/db/l51 to d6/d24/da/db/de/d32/l62 0 2024-09-21T10:40:57.222 INFO:tasks.workunit.client.0.smithi060.stdout:1/287: read - d6/d24/da/db/de/d32/f60 zero size 2024-09-21T10:40:57.225 INFO:tasks.workunit.client.0.smithi060.stdout:0/309: dwrite d5/d10/da/d15/f1b [0,4194304] 0 2024-09-21T10:40:57.230 INFO:tasks.workunit.client.0.smithi060.stdout:1/288: mknod d6/d24/da/db/dd/c63 0 2024-09-21T10:40:57.230 INFO:tasks.workunit.client.0.smithi060.stdout:5/288: read d5/d45/d5a/f17 [3947150,12497] 0 2024-09-21T10:40:57.232 INFO:tasks.workunit.client.0.smithi060.stdout:0/310: stat d5/d10/da/l2e 0 2024-09-21T10:40:57.232 INFO:tasks.workunit.client.0.smithi060.stdout:0/311: readlink d5/d10/da/d20/d45/l26 0 2024-09-21T10:40:57.233 INFO:tasks.workunit.client.0.smithi060.stdout:1/289: symlink d6/d24/da/d45/l64 0 2024-09-21T10:40:57.233 INFO:tasks.workunit.client.0.smithi060.stdout:1/290: creat d6/f65 x:0 0 0 2024-09-21T10:40:57.234 INFO:tasks.workunit.client.0.smithi060.stdout:5/289: symlink d5/d9/d10/d19/l67 0 2024-09-21T10:40:57.234 INFO:tasks.workunit.client.0.smithi060.stdout:5/290: chown d5/d9/d10/d19/f4e 4 1 2024-09-21T10:40:57.235 INFO:tasks.workunit.client.0.smithi060.stdout:0/312: symlink d5/d10/da/d20/d4d/l54 0 2024-09-21T10:40:57.235 INFO:tasks.workunit.client.0.smithi060.stdout:4/370: dwrite d0/f41 [4194304,4194304] 0 2024-09-21T10:40:57.236 INFO:tasks.workunit.client.0.smithi060.stdout:7/302: dwrite da/d14/d35/f36 [0,4194304] 0 2024-09-21T10:40:57.236 INFO:tasks.workunit.client.0.smithi060.stdout:7/303: fsync da/d14/d2a/d49/f5f 0 2024-09-21T10:40:57.238 INFO:tasks.workunit.client.0.smithi060.stdout:1/291: mknod d6/d24/da/db/dd/c66 0 2024-09-21T10:40:57.238 INFO:tasks.workunit.client.0.smithi060.stdout:5/291: symlink d5/d45/l68 0 2024-09-21T10:40:57.238 INFO:tasks.workunit.client.0.smithi060.stdout:5/292: fsync d5/d9/d10/d19/f34 0 2024-09-21T10:40:57.239 INFO:tasks.workunit.client.0.smithi060.stdout:3/268: dwrite d0/d1/d1e/f37 [0,4194304] 0 2024-09-21T10:40:57.242 INFO:tasks.workunit.client.0.smithi060.stdout:1/292: symlink d6/d24/l67 0 2024-09-21T10:40:57.242 INFO:tasks.workunit.client.0.smithi060.stdout:1/293: write d6/d24/da/db/f57 [157788,13616] 0 2024-09-21T10:40:57.243 INFO:tasks.workunit.client.0.smithi060.stdout:5/293: mknod d5/d9/d10/d19/d21/d30/c69 0 2024-09-21T10:40:57.244 INFO:tasks.workunit.client.0.smithi060.stdout:3/269: symlink d0/d1/d11/d2a/l4f 0 2024-09-21T10:40:57.245 INFO:tasks.workunit.client.0.smithi060.stdout:0/313: dread d5/f21 [0,4194304] 0 2024-09-21T10:40:57.245 INFO:tasks.workunit.client.0.smithi060.stdout:7/304: getdents da/d14 0 2024-09-21T10:40:57.245 INFO:tasks.workunit.client.0.smithi060.stdout:7/305: chown da/d14/l20 7704 1 2024-09-21T10:40:57.246 INFO:tasks.workunit.client.0.smithi060.stdout:1/294: mknod d6/d24/da/db/dd/c68 0 2024-09-21T10:40:57.246 INFO:tasks.workunit.client.0.smithi060.stdout:1/295: write d6/d24/da/f1f [944301,24500] 0 2024-09-21T10:40:57.247 INFO:tasks.workunit.client.1.smithi112.stdout:0/970: sync 2024-09-21T10:40:57.247 INFO:tasks.workunit.client.0.smithi060.stdout:5/294: symlink d5/l6a 0 2024-09-21T10:40:57.247 INFO:tasks.workunit.client.0.smithi060.stdout:5/295: creat d5/d45/d5a/d3a/f6b x:0 0 0 2024-09-21T10:40:57.248 INFO:tasks.workunit.client.0.smithi060.stdout:3/270: mknod d0/c50 0 2024-09-21T10:40:57.248 INFO:tasks.workunit.client.1.smithi112.stdout:0/971: dread d3/d4a/f64 [0,4194304] 0 2024-09-21T10:40:57.249 INFO:tasks.workunit.client.0.smithi060.stdout:0/314: creat d5/d10/da/d20/f55 x:0 0 0 2024-09-21T10:40:57.249 INFO:tasks.workunit.client.0.smithi060.stdout:7/306: mknod da/d14/d15/c70 0 2024-09-21T10:40:57.251 INFO:tasks.workunit.client.1.smithi112.stdout:0/972: creat d3/d18/d52/df9/d130/d4f/dc3/dde/f148 x:0 0 0 2024-09-21T10:40:57.251 INFO:tasks.workunit.client.1.smithi112.stdout:0/973: chown d3/d18 2082701 1 2024-09-21T10:40:57.255 INFO:tasks.workunit.client.1.smithi112.stdout:0/974: symlink d3/d4a/d4e/dc2/d1a/dba/deb/d133/l149 0 2024-09-21T10:40:57.255 INFO:tasks.workunit.client.0.smithi060.stdout:5/296: symlink d5/d9/d3e/l6c 0 2024-09-21T10:40:57.255 INFO:tasks.workunit.client.0.smithi060.stdout:5/297: read - d5/d45/d5a/f5d zero size 2024-09-21T10:40:57.256 INFO:tasks.workunit.client.0.smithi060.stdout:5/298: stat d5/d9/d3b/c65 0 2024-09-21T10:40:57.256 INFO:tasks.workunit.client.0.smithi060.stdout:3/271: creat d0/d1/d11/f51 x:0 0 0 2024-09-21T10:40:57.257 INFO:tasks.workunit.client.0.smithi060.stdout:3/272: chown d0/d1/d1e/l41 4457 1 2024-09-21T10:40:57.258 INFO:tasks.workunit.client.1.smithi112.stdout:0/975: link d3/d18/d52/d55/f93 d3/d18/d52/df9/d130/d4f/d83/dd5/f14a 0 2024-09-21T10:40:57.259 INFO:tasks.workunit.client.0.smithi060.stdout:0/315: creat d5/f56 x:0 0 0 2024-09-21T10:40:57.261 INFO:tasks.workunit.client.1.smithi112.stdout:0/976: symlink d3/d18/d52/l14b 0 2024-09-21T10:40:57.261 INFO:tasks.workunit.client.1.smithi112.stdout:0/977: chown d3/d4a/fcb 246 1 2024-09-21T10:40:57.263 INFO:tasks.workunit.client.1.smithi112.stdout:0/978: creat d3/d18/f14c x:0 0 0 2024-09-21T10:40:57.263 INFO:tasks.workunit.client.1.smithi112.stdout:0/979: dread - d3/f120 zero size 2024-09-21T10:40:57.263 INFO:tasks.workunit.client.1.smithi112.stdout:0/980: write d3/d18/dc0/fda [1247555,14127] 0 2024-09-21T10:40:57.263 INFO:tasks.workunit.client.1.smithi112.stdout:0/981: chown d3/d18/d52/df9/d130/d46/d122 57 1 2024-09-21T10:40:57.263 INFO:tasks.workunit.client.1.smithi112.stdout:0/982: fdatasync d3/d4a/d4e/d72/fa9 0 2024-09-21T10:40:57.264 INFO:tasks.workunit.client.0.smithi060.stdout:1/296: rmdir d6/d24/da 39 2024-09-21T10:40:57.265 INFO:tasks.workunit.client.0.smithi060.stdout:5/299: getdents d5/d9/d10 0 2024-09-21T10:40:57.266 INFO:tasks.workunit.client.1.smithi112.stdout:0/983: truncate d3/d4a/d4e/dc2/d10/f35 2701027 0 2024-09-21T10:40:57.267 INFO:tasks.workunit.client.1.smithi112.stdout:0/984: fdatasync d3/f2b 0 2024-09-21T10:40:57.268 INFO:tasks.workunit.client.0.smithi060.stdout:3/273: mkdir d0/d1/d52 0 2024-09-21T10:40:57.268 INFO:tasks.workunit.client.0.smithi060.stdout:3/274: write d0/d1/d1e/d34/f49 [378563,28610] 0 2024-09-21T10:40:57.268 INFO:tasks.workunit.client.0.smithi060.stdout:3/275: truncate d0/d1/d11/f42 1013647 0 2024-09-21T10:40:57.268 INFO:tasks.workunit.client.0.smithi060.stdout:7/307: dwrite da/d14/d2a/d49/f6d [0,4194304] 0 2024-09-21T10:40:57.268 INFO:tasks.workunit.client.0.smithi060.stdout:7/308: fsync da/d14/d35/f1b 0 2024-09-21T10:40:57.269 INFO:tasks.workunit.client.0.smithi060.stdout:7/309: chown da/d14/d25/l26 0 1 2024-09-21T10:40:57.269 INFO:tasks.workunit.client.0.smithi060.stdout:1/297: creat d6/d4a/f69 x:0 0 0 2024-09-21T10:40:57.269 INFO:tasks.workunit.client.0.smithi060.stdout:5/300: unlink d5/d9/fe 0 2024-09-21T10:40:57.270 INFO:tasks.workunit.client.0.smithi060.stdout:5/301: chown d5/d9/d10/d19/f4e 21622 1 2024-09-21T10:40:57.271 INFO:tasks.workunit.client.0.smithi060.stdout:3/276: getdents d0/d1/d11/d2a/d45 0 2024-09-21T10:40:57.271 INFO:tasks.workunit.client.0.smithi060.stdout:1/298: dread d6/f44 [0,4194304] 0 2024-09-21T10:40:57.273 INFO:tasks.workunit.client.0.smithi060.stdout:0/316: write d5/d10/da/d20/d45/f27 [3069871,5566] 0 2024-09-21T10:40:57.276 INFO:tasks.workunit.client.0.smithi060.stdout:3/277: mkdir d0/d1/d11/d53 0 2024-09-21T10:40:57.279 INFO:tasks.workunit.client.0.smithi060.stdout:1/299: creat d6/d24/da/d45/f6a x:0 0 0 2024-09-21T10:40:57.279 INFO:tasks.workunit.client.0.smithi060.stdout:1/300: stat d6/c2f 0 2024-09-21T10:40:57.279 INFO:tasks.workunit.client.0.smithi060.stdout:1/301: dread - d6/f58 zero size 2024-09-21T10:40:57.280 INFO:tasks.workunit.client.0.smithi060.stdout:5/302: getdents d5/d45/d5a/d3a 0 2024-09-21T10:40:57.282 INFO:tasks.workunit.client.0.smithi060.stdout:3/278: mknod d0/d1/d11/d2a/d43/d4e/c54 0 2024-09-21T10:40:57.282 INFO:tasks.workunit.client.0.smithi060.stdout:0/317: dread f0 [4194304,4194304] 0 2024-09-21T10:40:57.284 INFO:tasks.workunit.client.0.smithi060.stdout:1/302: unlink d6/d24/da/db/de/d32/l62 0 2024-09-21T10:40:57.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/986: sync 2024-09-21T10:40:57.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/987: chown d7/d22/d41/d4b/d52/d77/dbd/d13e/dc9/f109 776018 1 2024-09-21T10:40:57.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/988: fdatasync d7/d22/d78/f108 0 2024-09-21T10:40:57.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/989: write d7/f13 [654528,39543] 0 2024-09-21T10:40:57.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/990: chown d7/dbc/d10d/l128 1 1 2024-09-21T10:40:57.285 INFO:tasks.workunit.client.1.smithi112.stdout:7/991: chown d7/d22/d41/d4b/da2/fdd 297972241 1 2024-09-21T10:40:57.286 INFO:tasks.workunit.client.0.smithi060.stdout:5/303: dread d5/d9/d10/f1b [0,4194304] 0 2024-09-21T10:40:57.287 INFO:tasks.workunit.client.0.smithi060.stdout:7/310: dwrite da/d14/d15/f18 [0,4194304] 0 2024-09-21T10:40:57.287 INFO:tasks.workunit.client.0.smithi060.stdout:7/311: write da/d14/d2a/d49/d2e/f3d [663497,14684] 0 2024-09-21T10:40:57.287 INFO:tasks.workunit.client.1.smithi112.stdout:7/992: dread - d7/d3d/f12a zero size 2024-09-21T10:40:57.289 INFO:tasks.workunit.client.1.smithi112.stdout:7/993: unlink d7/d22/d86/dac/d8a/ffc 0 2024-09-21T10:40:57.289 INFO:tasks.workunit.client.1.smithi112.stdout:7/994: read - d7/dbc/f120 zero size 2024-09-21T10:40:57.290 INFO:tasks.workunit.client.0.smithi060.stdout:3/279: mknod d0/d1/d11/c55 0 2024-09-21T10:40:57.291 INFO:tasks.workunit.client.0.smithi060.stdout:0/318: rename d5/d10/da/f39 to d5/d10/d11/f57 0 2024-09-21T10:40:57.291 INFO:tasks.workunit.client.0.smithi060.stdout:0/319: fsync d5/d10/da/d20/d45/d2a/d40/f46 0 2024-09-21T10:40:57.291 INFO:tasks.workunit.client.0.smithi060.stdout:1/303: mknod d6/d24/da/db/dd/c6b 0 2024-09-21T10:40:57.293 INFO:tasks.workunit.client.0.smithi060.stdout:1/304: read d6/d24/da/f12 [583518,123256] 0 2024-09-21T10:40:57.293 INFO:tasks.workunit.client.0.smithi060.stdout:3/280: rename d0/d1/d1e/l30 to d0/d1/l56 0 2024-09-21T10:40:57.295 INFO:tasks.workunit.client.0.smithi060.stdout:3/281: rename d0/c1d to d0/d1/d11/d2a/d43/c57 0 2024-09-21T10:40:57.297 INFO:tasks.workunit.client.0.smithi060.stdout:3/282: symlink d0/d1/d52/l58 0 2024-09-21T10:40:57.300 INFO:tasks.workunit.client.0.smithi060.stdout:3/283: creat d0/d1/d11/d46/f59 x:0 0 0 2024-09-21T10:40:57.300 INFO:tasks.workunit.client.0.smithi060.stdout:3/284: chown d0/f28 62712 1 2024-09-21T10:40:57.301 INFO:tasks.workunit.client.0.smithi060.stdout:0/320: write d5/d10/d11/f28 [4384831,64216] 0 2024-09-21T10:40:57.307 INFO:tasks.workunit.client.0.smithi060.stdout:7/312: dread da/d14/d2a/f2d [0,4194304] 0 2024-09-21T10:40:57.307 INFO:tasks.workunit.client.0.smithi060.stdout:7/313: fdatasync da/f24 0 2024-09-21T10:40:57.316 INFO:tasks.workunit.client.1.smithi112.stdout:7/995: dwrite d7/d22/d41/d4b/d5e/f95 [0,4194304] 0 2024-09-21T10:40:57.316 INFO:tasks.workunit.client.1.smithi112.stdout:7/996: creat d7/d22/d41/d4b/da2/dea/f14a x:0 0 0 2024-09-21T10:40:57.316 INFO:tasks.workunit.client.0.smithi060.stdout:7/314: dread da/f24 [0,4194304] 0 2024-09-21T10:40:57.318 INFO:tasks.workunit.client.0.smithi060.stdout:7/315: symlink da/d60/d6e/l71 0 2024-09-21T10:40:57.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/316: creat da/d14/f72 x:0 0 0 2024-09-21T10:40:57.320 INFO:tasks.workunit.client.0.smithi060.stdout:7/317: creat da/f73 x:0 0 0 2024-09-21T10:40:57.321 INFO:tasks.workunit.client.0.smithi060.stdout:3/285: dwrite d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:40:57.330 INFO:tasks.workunit.client.1.smithi112.stdout:7/997: write d7/d22/d41/d4b/d52/d77/dbd/d13e/dc9/dd3/dd8/f10f [411181,124803] 0 2024-09-21T10:40:57.331 INFO:tasks.workunit.client.1.smithi112.stdout:7/998: creat d7/d22/d41/d54/d4d/d10b/f14b x:0 0 0 2024-09-21T10:40:57.333 INFO:tasks.workunit.client.1.smithi112.stdout:7/999: link d7/d22/d41/d4b/da2/ff1 d7/d22/d41/d4b/d52/dfd/f14c 0 2024-09-21T10:40:57.347 INFO:tasks.workunit.client.0.smithi060.stdout:0/321: dread d5/d10/da/d20/d45/f27 [0,4194304] 0 2024-09-21T10:40:57.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/322: rename d5/c4a to d5/c58 0 2024-09-21T10:40:57.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/323: mknod d5/d10/da/d20/d45/d2a/d40/c59 0 2024-09-21T10:40:57.349 INFO:tasks.workunit.client.0.smithi060.stdout:0/324: fsync d5/d10/da/f13 0 2024-09-21T10:40:57.349 INFO:tasks.workunit.client.0.smithi060.stdout:0/325: creat d5/d10/f5a x:0 0 0 2024-09-21T10:40:57.350 INFO:tasks.workunit.client.0.smithi060.stdout:5/304: dwrite d5/d9/d10/d19/f32 [0,4194304] 0 2024-09-21T10:40:57.350 INFO:tasks.workunit.client.0.smithi060.stdout:5/305: read d5/d45/d5a/f17 [936285,83033] 0 2024-09-21T10:40:57.351 INFO:tasks.workunit.client.0.smithi060.stdout:0/326: rename d5/d10/d11/f3b to d5/d10/da/d2d/f5b 0 2024-09-21T10:40:57.354 INFO:tasks.workunit.client.0.smithi060.stdout:5/306: truncate d5/f7 2793838 0 2024-09-21T10:40:57.356 INFO:tasks.workunit.client.0.smithi060.stdout:0/327: dread d5/d10/da/d20/d45/f27 [0,4194304] 0 2024-09-21T10:40:57.357 INFO:tasks.workunit.client.0.smithi060.stdout:0/328: creat d5/d10/da/d20/d45/d2a/f5c x:0 0 0 2024-09-21T10:40:57.358 INFO:tasks.workunit.client.0.smithi060.stdout:0/329: write f2 [4209308,92713] 0 2024-09-21T10:40:57.358 INFO:tasks.workunit.client.0.smithi060.stdout:0/330: chown d5/d10/f8 534855 1 2024-09-21T10:40:57.358 INFO:tasks.workunit.client.0.smithi060.stdout:7/318: dwrite da/d14/d25/f2c [0,4194304] 0 2024-09-21T10:40:57.358 INFO:tasks.workunit.client.0.smithi060.stdout:3/286: dwrite d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:57.358 INFO:tasks.workunit.client.0.smithi060.stdout:3/287: chown d0/c2f 93 1 2024-09-21T10:40:57.359 INFO:tasks.workunit.client.0.smithi060.stdout:1/305: dwrite d6/d24/da/db/dd/f1d [0,4194304] 0 2024-09-21T10:40:57.361 INFO:tasks.workunit.client.0.smithi060.stdout:0/331: creat d5/d10/d43/f5d x:0 0 0 2024-09-21T10:40:57.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/307: read d5/d9/d10/d19/f34 [3223255,122259] 0 2024-09-21T10:40:57.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/308: chown d5/d45/d5a/d3a/f5e 138 1 2024-09-21T10:40:57.364 INFO:tasks.workunit.client.0.smithi060.stdout:3/288: mknod d0/d1/d11/d46/c5a 0 2024-09-21T10:40:57.369 INFO:tasks.workunit.client.0.smithi060.stdout:1/306: dread d6/d24/da/db/d1c/f26 [0,4194304] 0 2024-09-21T10:40:57.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/332: rename d5/d10/ld to d5/d10/d4e/l5e 0 2024-09-21T10:40:57.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/333: dread - d5/d10/f3d zero size 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/990: sync 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:2/925: sync 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:2/926: truncate d0/da4/dc5/fec 4554660 0 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:2/927: stat d0/dd/f29 0 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/991: write d2/d2f/d3f/ddf/d31/d2a/dff/f12a [218281,90829] 0 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/992: write d2/f18 [1405855,59981] 0 2024-09-21T10:40:57.372 INFO:tasks.workunit.client.1.smithi112.stdout:3/993: write d2/d2f/f44 [11921193,84994] 0 2024-09-21T10:40:57.373 INFO:tasks.workunit.client.0.smithi060.stdout:1/307: symlink d6/d24/da/d45/l6c 0 2024-09-21T10:40:57.373 INFO:tasks.workunit.client.0.smithi060.stdout:1/308: fdatasync d6/f40 0 2024-09-21T10:40:57.373 INFO:tasks.workunit.client.0.smithi060.stdout:0/334: mknod d5/d10/da/d20/d45/d2a/d40/d48/c5f 0 2024-09-21T10:40:57.375 INFO:tasks.workunit.client.1.smithi112.stdout:2/928: truncate d0/d12/d77/f101 2620163 0 2024-09-21T10:40:57.378 INFO:tasks.workunit.client.1.smithi112.stdout:3/994: rename d2/d2f/d3f/ddf/l63 to d2/d2f/daf/df4/ddd/d133/d60/d86/dfb/l146 0 2024-09-21T10:40:57.379 INFO:tasks.workunit.client.0.smithi060.stdout:1/309: mknod d6/d24/da/db/c6d 0 2024-09-21T10:40:57.380 INFO:tasks.workunit.client.0.smithi060.stdout:1/310: fdatasync d6/f44 0 2024-09-21T10:40:57.380 INFO:tasks.workunit.client.0.smithi060.stdout:7/319: dwrite da/f12 [0,4194304] 0 2024-09-21T10:40:57.381 INFO:tasks.workunit.client.0.smithi060.stdout:1/311: symlink d6/d24/da/d45/l6e 0 2024-09-21T10:40:57.382 INFO:tasks.workunit.client.0.smithi060.stdout:1/312: fdatasync d6/d24/da/db/de/f18 0 2024-09-21T10:40:57.383 INFO:tasks.workunit.client.0.smithi060.stdout:7/320: rename da/d14/d35/c17 to da/d14/c74 0 2024-09-21T10:40:57.384 INFO:tasks.workunit.client.0.smithi060.stdout:7/321: creat da/d14/d25/d56/f75 x:0 0 0 2024-09-21T10:40:57.384 INFO:tasks.workunit.client.0.smithi060.stdout:5/309: dwrite d5/d9/d3e/f43 [0,4194304] 0 2024-09-21T10:40:57.385 INFO:tasks.workunit.client.0.smithi060.stdout:1/313: mknod d6/d24/c6f 0 2024-09-21T10:40:57.387 INFO:tasks.workunit.client.0.smithi060.stdout:3/289: rmdir d0/d1/d11/d46 39 2024-09-21T10:40:57.387 INFO:tasks.workunit.client.0.smithi060.stdout:3/290: write d0/d1/d11/d2a/f2e [3798582,1488] 0 2024-09-21T10:40:57.390 INFO:tasks.workunit.client.0.smithi060.stdout:7/322: rename da/d14/d2a/d49/f23 to da/d14/d15/f76 0 2024-09-21T10:40:57.392 INFO:tasks.workunit.client.0.smithi060.stdout:1/314: dread d6/d24/da/db/d1c/f26 [0,4194304] 0 2024-09-21T10:40:57.392 INFO:tasks.workunit.client.1.smithi112.stdout:2/929: rename d0/dd/f6a to d0/dd/da5/f12c 0 2024-09-21T10:40:57.393 INFO:tasks.workunit.client.0.smithi060.stdout:1/315: dread d6/d24/f3f [0,4194304] 0 2024-09-21T10:40:57.393 INFO:tasks.workunit.client.0.smithi060.stdout:1/316: readlink d6/d24/da/db/d1c/l2b 0 2024-09-21T10:40:57.394 INFO:tasks.workunit.client.1.smithi112.stdout:3/995: mknod d2/d2f/daf/df4/ddd/d133/d60/d86/dd8/d126/c147 0 2024-09-21T10:40:57.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/310: rmdir d5/d45/d5a/d3a 39 2024-09-21T10:40:57.400 INFO:tasks.workunit.client.1.smithi112.stdout:2/930: mknod d0/d12/d76/d123/d7e/d8f/c12d 0 2024-09-21T10:40:57.403 INFO:tasks.workunit.client.0.smithi060.stdout:3/291: mknod d0/d1/d11/d2a/d43/c5b 0 2024-09-21T10:40:57.403 INFO:tasks.workunit.client.0.smithi060.stdout:3/292: stat d0/d1/d1e/d34/f48 0 2024-09-21T10:40:57.404 INFO:tasks.workunit.client.1.smithi112.stdout:2/931: mkdir d0/d12/d46/d86/dc0/dc8/dfa/d12e 0 2024-09-21T10:40:57.405 INFO:tasks.workunit.client.0.smithi060.stdout:7/323: mkdir da/d60/d6e/d77 0 2024-09-21T10:40:57.408 INFO:tasks.workunit.client.1.smithi112.stdout:2/932: creat d0/d12/d46/d10f/f12f x:0 0 0 2024-09-21T10:40:57.409 INFO:tasks.workunit.client.0.smithi060.stdout:0/335: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:57.409 INFO:tasks.workunit.client.0.smithi060.stdout:0/336: creat d5/d10/f60 x:0 0 0 2024-09-21T10:40:57.409 INFO:tasks.workunit.client.0.smithi060.stdout:0/337: creat d5/d10/f61 x:0 0 0 2024-09-21T10:40:57.410 INFO:tasks.workunit.client.1.smithi112.stdout:2/933: rmdir d0/d12/d46/da0/db9/dbd/de1 39 2024-09-21T10:40:57.411 INFO:tasks.workunit.client.1.smithi112.stdout:0/985: sync 2024-09-21T10:40:57.412 INFO:tasks.workunit.client.0.smithi060.stdout:1/317: dwrite d6/f44 [0,4194304] 0 2024-09-21T10:40:57.413 INFO:tasks.workunit.client.1.smithi112.stdout:3/996: dwrite d2/d2f/d3f/ddf/d31/d2a/dfe/fe8 [4194304,4194304] 0 2024-09-21T10:40:57.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/338: link d5/d10/da/d20/d45/f27 d5/d10/da/d20/f62 0 2024-09-21T10:40:57.417 INFO:tasks.workunit.client.0.smithi060.stdout:3/293: dread d0/d1/d1e/f3e [0,4194304] 0 2024-09-21T10:40:57.420 INFO:tasks.workunit.client.0.smithi060.stdout:5/311: rename d5/d9 to d5/d45/d6d 0 2024-09-21T10:40:57.420 INFO:tasks.workunit.client.0.smithi060.stdout:5/312: write d5/d45/d6d/d3e/f43 [4198120,101483] 0 2024-09-21T10:40:57.420 INFO:tasks.workunit.client.1.smithi112.stdout:2/934: write d0/d12/d46/da0/db9/dbd/f5a [3102083,109943] 0 2024-09-21T10:40:57.420 INFO:tasks.workunit.client.1.smithi112.stdout:2/935: dread - d0/d12/d46/f93 zero size 2024-09-21T10:40:57.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/997: symlink d2/d2f/daf/df4/ddd/d133/d60/l148 0 2024-09-21T10:40:57.423 INFO:tasks.workunit.client.1.smithi112.stdout:3/998: fdatasync f0 0 2024-09-21T10:40:57.426 INFO:tasks.workunit.client.1.smithi112.stdout:2/936: write d0/d12/d76/d123/d7e/d8f/d51/d57/fb2 [486639,43428] 0 2024-09-21T10:40:57.428 INFO:tasks.workunit.client.1.smithi112.stdout:3/999: creat d2/f149 x:0 0 0 2024-09-21T10:40:57.429 INFO:tasks.workunit.client.0.smithi060.stdout:1/318: rename d6/d4a/d5a/f5b to d6/d4a/d5a/f70 0 2024-09-21T10:40:57.431 INFO:tasks.workunit.client.0.smithi060.stdout:7/324: dwrite f0 [0,4194304] 0 2024-09-21T10:40:57.431 INFO:tasks.workunit.client.0.smithi060.stdout:0/339: mkdir d5/d10/da/d20/d45/d2a/d40/d48/d63 0 2024-09-21T10:40:57.431 INFO:tasks.workunit.client.0.smithi060.stdout:0/340: read - d5/d10/da/d20/f55 zero size 2024-09-21T10:40:57.432 INFO:tasks.workunit.client.0.smithi060.stdout:3/294: mkdir d0/d1/d5c 0 2024-09-21T10:40:57.436 INFO:tasks.workunit.client.0.smithi060.stdout:0/341: creat d5/d10/da/d2f/f64 x:0 0 0 2024-09-21T10:40:57.437 INFO:tasks.workunit.client.1.smithi112.stdout:0/986: dwrite d3/d18/d52/df9/d130/d4f/dc3/fac [0,4194304] 0 2024-09-21T10:40:57.437 INFO:tasks.workunit.client.1.smithi112.stdout:0/987: readlink d3/d4a/d4e/l5a 0 2024-09-21T10:40:57.437 INFO:tasks.workunit.client.1.smithi112.stdout:0/988: fsync d3/d18/d52/df9/d130/d4f/d83/fb8 0 2024-09-21T10:40:57.437 INFO:tasks.workunit.client.1.smithi112.stdout:0/989: chown d3/d18/d52/d55/dcc/d10b/ddf/l126 10 1 2024-09-21T10:40:57.438 INFO:tasks.workunit.client.0.smithi060.stdout:3/295: getdents d0/d1/d11/d2a 0 2024-09-21T10:40:57.443 INFO:tasks.workunit.client.0.smithi060.stdout:7/325: write da/d14/d35/f1d [2273989,5240] 0 2024-09-21T10:40:57.443 INFO:tasks.workunit.client.0.smithi060.stdout:7/326: creat da/d14/d35/f78 x:0 0 0 2024-09-21T10:40:57.443 INFO:tasks.workunit.client.0.smithi060.stdout:1/319: dread d6/d24/da/db/de/d32/f37 [4194304,4194304] 0 2024-09-21T10:40:57.445 INFO:tasks.workunit.client.0.smithi060.stdout:1/320: symlink d6/d24/d50/l71 0 2024-09-21T10:40:57.445 INFO:tasks.workunit.client.0.smithi060.stdout:1/321: stat d6/f40 0 2024-09-21T10:40:57.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/322: fdatasync d6/f65 0 2024-09-21T10:40:57.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/323: write d6/d24/da/db/f5f [5752560,97224] 0 2024-09-21T10:40:57.446 INFO:tasks.workunit.client.0.smithi060.stdout:5/313: dwrite d5/d45/d6d/d10/d19/d21/f44 [0,4194304] 0 2024-09-21T10:40:57.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/324: getdents d6/d24/da 0 2024-09-21T10:40:57.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/325: write d6/d24/da/db/de/d32/f60 [257974,116751] 0 2024-09-21T10:40:57.447 INFO:tasks.workunit.client.0.smithi060.stdout:1/326: fdatasync d6/d24/da/db/de/d32/f37 0 2024-09-21T10:40:57.447 INFO:tasks.workunit.client.1.smithi112.stdout:2/937: dwrite d0/f19 [0,4194304] 0 2024-09-21T10:40:57.448 INFO:tasks.workunit.client.0.smithi060.stdout:5/314: getdents d5/d45/d6d 0 2024-09-21T10:40:57.451 INFO:tasks.workunit.client.0.smithi060.stdout:1/327: creat d6/d24/da/db/d1c/d4b/f72 x:0 0 0 2024-09-21T10:40:57.453 INFO:tasks.workunit.client.0.smithi060.stdout:5/315: getdents d5/d45 0 2024-09-21T10:40:57.453 INFO:tasks.workunit.client.0.smithi060.stdout:5/316: write d5/f24 [554366,20236] 0 2024-09-21T10:40:57.454 INFO:tasks.workunit.client.0.smithi060.stdout:7/327: dread da/f12 [0,4194304] 0 2024-09-21T10:40:57.455 INFO:tasks.workunit.client.0.smithi060.stdout:1/328: symlink d6/d24/d50/l73 0 2024-09-21T10:40:57.457 INFO:tasks.workunit.client.0.smithi060.stdout:5/317: symlink d5/d45/d6d/d10/d19/d21/d30/l6e 0 2024-09-21T10:40:57.458 INFO:tasks.workunit.client.0.smithi060.stdout:1/329: symlink d6/d4a/d5a/l74 0 2024-09-21T10:40:57.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/318: mknod d5/d45/d5a/d3a/c6f 0 2024-09-21T10:40:57.459 INFO:tasks.workunit.client.0.smithi060.stdout:5/319: fsync d5/d45/d6d/d3e/d50/f59 0 2024-09-21T10:40:57.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/330: symlink d6/d24/da/d45/l75 0 2024-09-21T10:40:57.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/331: chown d6/d24/da/db/d1c/f55 3624397 1 2024-09-21T10:40:57.461 INFO:tasks.workunit.client.0.smithi060.stdout:5/320: unlink d5/d45/d6d/f64 0 2024-09-21T10:40:57.462 INFO:tasks.workunit.client.0.smithi060.stdout:1/332: unlink d6/d24/c46 0 2024-09-21T10:40:57.462 INFO:tasks.workunit.client.0.smithi060.stdout:5/321: mknod d5/d45/d5a/c70 0 2024-09-21T10:40:57.462 INFO:tasks.workunit.client.0.smithi060.stdout:5/322: truncate d5/d45/d5a/d3a/f6b 463261 0 2024-09-21T10:40:57.463 INFO:tasks.workunit.client.0.smithi060.stdout:1/333: mkdir d6/d24/da/d45/d76 0 2024-09-21T10:40:57.464 INFO:tasks.workunit.client.0.smithi060.stdout:1/334: creat d6/d24/da/db/de/f77 x:0 0 0 2024-09-21T10:40:57.465 INFO:tasks.workunit.client.0.smithi060.stdout:2/177: sync 2024-09-21T10:40:57.465 INFO:tasks.workunit.client.0.smithi060.stdout:8/317: sync 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:9/297: sync 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:8/318: read d2/f15 [1838874,101464] 0 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:6/379: sync 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:8/319: write d2/d18/f69 [447958,10870] 0 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:8/320: chown d2/d18/d4b/c56 228840 1 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:6/380: chown d3/d12/d16/d1a/d60/f73 366784870 1 2024-09-21T10:40:57.466 INFO:tasks.workunit.client.0.smithi060.stdout:4/371: sync 2024-09-21T10:40:57.468 INFO:tasks.workunit.client.0.smithi060.stdout:1/335: dread d6/d24/da/f1f [0,4194304] 0 2024-09-21T10:40:57.469 INFO:tasks.workunit.client.0.smithi060.stdout:9/298: creat d3/d5e/d60/d2f/f62 x:0 0 0 2024-09-21T10:40:57.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/328: fdatasync da/d14/d2a/d49/d2e/f3d 0 2024-09-21T10:40:57.472 INFO:tasks.workunit.client.0.smithi060.stdout:8/321: link d2/d18/d4b/d4d/l4f d2/l71 0 2024-09-21T10:40:57.473 INFO:tasks.workunit.client.0.smithi060.stdout:1/336: creat d6/d24/d50/f78 x:0 0 0 2024-09-21T10:40:57.473 INFO:tasks.workunit.client.1.smithi112.stdout:0/990: dwrite d3/d4a/d4e/d72/da0/f112 [0,4194304] 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/342: dwrite d5/f25 [0,4194304] 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/343: readlink d5/d10/d43/l49 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/344: stat d5/f25 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/345: creat d5/d10/da/d20/f65 x:0 0 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/296: dwrite d0/d1/d11/d46/f59 [0,4194304] 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:1/337: read d6/d24/f3f [27908,52527] 0 2024-09-21T10:40:57.474 INFO:tasks.workunit.client.0.smithi060.stdout:9/299: mknod d3/d16/c63 0 2024-09-21T10:40:57.475 INFO:tasks.workunit.client.0.smithi060.stdout:7/329: dread da/d14/d25/f4a [0,4194304] 0 2024-09-21T10:40:57.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/330: dread da/d14/f48 [0,4194304] 0 2024-09-21T10:40:57.477 INFO:tasks.workunit.client.0.smithi060.stdout:8/322: mknod d2/c72 0 2024-09-21T10:40:57.479 INFO:tasks.workunit.client.0.smithi060.stdout:6/381: dread d3/d12/f51 [0,4194304] 0 2024-09-21T10:40:57.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/338: dread d6/d24/da/f1f [0,4194304] 0 2024-09-21T10:40:57.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/339: chown d6/d24/da/db/c28 3850 1 2024-09-21T10:40:57.482 INFO:tasks.workunit.client.0.smithi060.stdout:5/323: getdents d5/d45/d6d/d10/d19/d21/d30 0 2024-09-21T10:40:57.482 INFO:tasks.workunit.client.0.smithi060.stdout:5/324: truncate d5/d45/d5a/f5d 874566 0 2024-09-21T10:40:57.485 INFO:tasks.workunit.client.1.smithi112.stdout:0/991: read d3/d18/fdd [203160,7936] 0 2024-09-21T10:40:57.485 INFO:tasks.workunit.client.1.smithi112.stdout:0/992: creat d3/d18/d45/f14d x:0 0 0 2024-09-21T10:40:57.485 INFO:tasks.workunit.client.1.smithi112.stdout:0/993: fsync d3/d18/d52/df9/d130/d4f/dc3/fb7 0 2024-09-21T10:40:57.485 INFO:tasks.workunit.client.1.smithi112.stdout:0/994: write d3/d18/d52/df9/d130/d4f/d83/dd5/f14a [4735778,9292] 0 2024-09-21T10:40:57.490 INFO:tasks.workunit.client.0.smithi060.stdout:9/300: mkdir d3/d15/d5a/d64 0 2024-09-21T10:40:57.491 INFO:tasks.workunit.client.0.smithi060.stdout:3/297: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:57.491 INFO:tasks.workunit.client.0.smithi060.stdout:2/178: dwrite d3/d7/d24/f2a [0,4194304] 0 2024-09-21T10:40:57.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/331: mkdir da/d14/d35/d79 0 2024-09-21T10:40:57.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/332: chown da/d60/d6e/l50 11580545 1 2024-09-21T10:40:57.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/333: dread - da/d14/d2a/d49/d2e/f65 zero size 2024-09-21T10:40:57.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/334: dread - da/f59 zero size 2024-09-21T10:40:57.493 INFO:tasks.workunit.client.0.smithi060.stdout:8/323: symlink d2/d5a/l73 0 2024-09-21T10:40:57.495 INFO:tasks.workunit.client.0.smithi060.stdout:6/382: mknod d3/d12/d16/d22/c74 0 2024-09-21T10:40:57.496 INFO:tasks.workunit.client.0.smithi060.stdout:1/340: mkdir d6/d24/da/db/d79 0 2024-09-21T10:40:57.498 INFO:tasks.workunit.client.0.smithi060.stdout:5/325: rmdir d5/d45/d5a/d3a 39 2024-09-21T10:40:57.500 INFO:tasks.workunit.client.0.smithi060.stdout:9/301: rename d3/d5e/d60/d2f/f46 to d3/d16/d5f/f65 0 2024-09-21T10:40:57.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/302: fsync d3/d5e/d60/f23 0 2024-09-21T10:40:57.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/303: write d3/d16/f4b [1425133,43363] 0 2024-09-21T10:40:57.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/304: write d3/d5e/d60/d2f/f62 [342628,22902] 0 2024-09-21T10:40:57.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/305: stat d3/d15/f17 0 2024-09-21T10:40:57.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/306: write d3/ff [1704147,6776] 0 2024-09-21T10:40:57.504 INFO:tasks.workunit.client.0.smithi060.stdout:7/335: dread da/fc [0,4194304] 0 2024-09-21T10:40:57.505 INFO:tasks.workunit.client.0.smithi060.stdout:6/383: mkdir d3/d12/d16/d22/d58/d75 0 2024-09-21T10:40:57.506 INFO:tasks.workunit.client.0.smithi060.stdout:0/346: dwrite d5/d10/f8 [0,4194304] 0 2024-09-21T10:40:57.506 INFO:tasks.workunit.client.0.smithi060.stdout:1/341: symlink d6/d24/da/db/de/d32/l7a 0 2024-09-21T10:40:57.508 INFO:tasks.workunit.client.0.smithi060.stdout:3/298: dwrite d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:40:57.508 INFO:tasks.workunit.client.0.smithi060.stdout:5/326: unlink d5/l42 0 2024-09-21T10:40:57.509 INFO:tasks.workunit.client.0.smithi060.stdout:5/327: fdatasync d5/f16 0 2024-09-21T10:40:57.509 INFO:tasks.workunit.client.0.smithi060.stdout:9/307: creat d3/d5e/f66 x:0 0 0 2024-09-21T10:40:57.510 INFO:tasks.workunit.client.1.smithi112.stdout:0/995: dwrite d3/d23/f29 [4194304,4194304] 0 2024-09-21T10:40:57.511 INFO:tasks.workunit.client.0.smithi060.stdout:6/384: mkdir d3/d12/d16/d25/d76 0 2024-09-21T10:40:57.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/347: mkdir d5/d10/da/d2f/d66 0 2024-09-21T10:40:57.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/348: fdatasync d5/d10/da/f13 0 2024-09-21T10:40:57.519 INFO:tasks.workunit.client.0.smithi060.stdout:1/342: mknod d6/d24/da/db/d1c/c7b 0 2024-09-21T10:40:57.520 INFO:tasks.workunit.client.1.smithi112.stdout:0/996: truncate d3/d18/d45/fbf 940713 0 2024-09-21T10:40:57.520 INFO:tasks.workunit.client.1.smithi112.stdout:0/997: chown d3/d4a/d4e/dc2/d1a/c131 213313 1 2024-09-21T10:40:57.520 INFO:tasks.workunit.client.1.smithi112.stdout:0/998: write d3/d4a/fbd [1924767,106055] 0 2024-09-21T10:40:57.523 INFO:tasks.workunit.client.0.smithi060.stdout:9/308: rename d3/f14 to d3/d15/d5a/f67 0 2024-09-21T10:40:57.523 INFO:tasks.workunit.client.0.smithi060.stdout:9/309: dread - d3/f47 zero size 2024-09-21T10:40:57.523 INFO:tasks.workunit.client.0.smithi060.stdout:9/310: creat d3/d5e/d60/d2f/f68 x:0 0 0 2024-09-21T10:40:57.523 INFO:tasks.workunit.client.0.smithi060.stdout:9/311: fsync d3/fa 0 2024-09-21T10:40:57.523 INFO:tasks.workunit.client.0.smithi060.stdout:9/312: stat d3/d15/d5a 0 2024-09-21T10:40:57.529 INFO:tasks.workunit.client.0.smithi060.stdout:0/349: symlink d5/d10/da/d2f/l67 0 2024-09-21T10:40:57.530 INFO:tasks.workunit.client.1.smithi112.stdout:0/999: mknod d3/d18/d45/c14e 0 2024-09-21T10:40:57.532 INFO:tasks.workunit.client.0.smithi060.stdout:0/350: dread d5/d10/da/d20/d45/f4f [0,4194304] 0 2024-09-21T10:40:57.533 INFO:tasks.workunit.client.0.smithi060.stdout:0/351: chown d5/d10/d11/c18 29528820 1 2024-09-21T10:40:57.533 INFO:tasks.workunit.client.0.smithi060.stdout:1/343: mkdir d6/d24/da/db/de/d7c 0 2024-09-21T10:40:57.535 INFO:tasks.workunit.client.0.smithi060.stdout:8/324: dwrite d2/d18/d4b/d4d/f53 [0,4194304] 0 2024-09-21T10:40:57.535 INFO:tasks.workunit.client.0.smithi060.stdout:9/313: unlink d3/d16/d1f/f2c 0 2024-09-21T10:40:57.536 INFO:tasks.workunit.client.1.smithi112.stdout:2/938: sync 2024-09-21T10:40:57.537 INFO:tasks.workunit.client.0.smithi060.stdout:8/325: mkdir d2/d26/d37/d62/d74 0 2024-09-21T10:40:57.539 INFO:tasks.workunit.client.1.smithi112.stdout:2/939: creat d0/d12/d46/d86/f130 x:0 0 0 2024-09-21T10:40:57.539 INFO:tasks.workunit.client.0.smithi060.stdout:3/299: dwrite d0/d1/d1e/f3e [0,4194304] 0 2024-09-21T10:40:57.539 INFO:tasks.workunit.client.0.smithi060.stdout:3/300: readlink d0/d1/d11/l1b 0 2024-09-21T10:40:57.540 INFO:tasks.workunit.client.0.smithi060.stdout:6/385: dwrite d3/d12/d16/d1a/f4c [0,4194304] 0 2024-09-21T10:40:57.540 INFO:tasks.workunit.client.0.smithi060.stdout:7/336: dwrite da/d14/d25/f2c [0,4194304] 0 2024-09-21T10:40:57.540 INFO:tasks.workunit.client.0.smithi060.stdout:9/314: link d3/fa d3/f69 0 2024-09-21T10:40:57.541 INFO:tasks.workunit.client.0.smithi060.stdout:1/344: getdents d6/d24/da/db/de/d32 0 2024-09-21T10:40:57.543 INFO:tasks.workunit.client.1.smithi112.stdout:2/940: truncate d0/d12/d46/da0/db9/dbd/d62/d63/fcd 1813216 0 2024-09-21T10:40:57.544 INFO:tasks.workunit.client.0.smithi060.stdout:8/326: unlink d2/d18/d4b/d4d/f53 0 2024-09-21T10:40:57.547 INFO:tasks.workunit.client.1.smithi112.stdout:2/941: symlink d0/d12/d46/d86/dc0/dc8/d108/l131 0 2024-09-21T10:40:57.548 INFO:tasks.workunit.client.0.smithi060.stdout:9/315: dread d3/d16/d1a/f28 [0,4194304] 0 2024-09-21T10:40:57.548 INFO:tasks.workunit.client.0.smithi060.stdout:9/316: creat d3/d5e/f6a x:0 0 0 2024-09-21T10:40:57.550 INFO:tasks.workunit.client.0.smithi060.stdout:6/386: getdents d3/d12/d16/d22/d5d 0 2024-09-21T10:40:57.550 INFO:tasks.workunit.client.0.smithi060.stdout:6/387: creat d3/d54/f77 x:0 0 0 2024-09-21T10:40:57.552 INFO:tasks.workunit.client.1.smithi112.stdout:2/942: creat d0/d12/d46/d86/dc0/dc8/dfa/d12e/f132 x:0 0 0 2024-09-21T10:40:57.552 INFO:tasks.workunit.client.1.smithi112.stdout:2/943: truncate d0/d12/d46/dd8/fe8 832891 0 2024-09-21T10:40:57.553 INFO:tasks.workunit.client.0.smithi060.stdout:1/345: symlink d6/d24/da/d45/l7d 0 2024-09-21T10:40:57.553 INFO:tasks.workunit.client.0.smithi060.stdout:1/346: write d6/d24/da/db/de/f38 [215506,43753] 0 2024-09-21T10:40:57.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/352: dwrite d5/d10/da/d20/d45/f27 [4194304,4194304] 0 2024-09-21T10:40:57.554 INFO:tasks.workunit.client.0.smithi060.stdout:8/327: mkdir d2/d18/d4b/d4d/d75 0 2024-09-21T10:40:57.554 INFO:tasks.workunit.client.0.smithi060.stdout:8/328: chown d2/d26/f38 21651 1 2024-09-21T10:40:57.555 INFO:tasks.workunit.client.1.smithi112.stdout:2/944: symlink d0/da4/dbe/l133 0 2024-09-21T10:40:57.558 INFO:tasks.workunit.client.0.smithi060.stdout:6/388: dread d3/d12/d16/d22/f63 [0,4194304] 0 2024-09-21T10:40:57.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/353: dread d5/d10/da/f13 [0,4194304] 0 2024-09-21T10:40:57.560 INFO:tasks.workunit.client.0.smithi060.stdout:0/354: write d5/d10/f61 [704732,41937] 0 2024-09-21T10:40:57.561 INFO:tasks.workunit.client.1.smithi112.stdout:2/945: rmdir d0/d12/d97 39 2024-09-21T10:40:57.562 INFO:tasks.workunit.client.0.smithi060.stdout:7/337: getdents da/d14/d25/d56 0 2024-09-21T10:40:57.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/338: symlink da/l7a 0 2024-09-21T10:40:57.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/339: truncate da/d14/d25/d56/f58 1292580 0 2024-09-21T10:40:57.566 INFO:tasks.workunit.client.1.smithi112.stdout:2/946: creat d0/dd/da5/df0/f134 x:0 0 0 2024-09-21T10:40:57.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/347: dread d6/d24/da/db/de/d32/f37 [0,4194304] 0 2024-09-21T10:40:57.568 INFO:tasks.workunit.client.0.smithi060.stdout:7/340: rename da/d14/f6b to da/d14/d2a/d49/f7b 0 2024-09-21T10:40:57.569 INFO:tasks.workunit.client.0.smithi060.stdout:7/341: write da/d14/d35/f78 [1027910,43321] 0 2024-09-21T10:40:57.569 INFO:tasks.workunit.client.0.smithi060.stdout:7/342: readlink da/d14/d25/l3e 0 2024-09-21T10:40:57.570 INFO:tasks.workunit.client.1.smithi112.stdout:2/947: mkdir d0/d12/d46/d86/dc0/dc8/dfa/d12e/d135 0 2024-09-21T10:40:57.570 INFO:tasks.workunit.client.1.smithi112.stdout:2/948: creat d0/d12/d77/f136 x:0 0 0 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:3/301: dwrite d0/d1/d1e/f35 [0,4194304] 0 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:9/317: dwrite d3/fc [0,4194304] 0 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:6/389: dread d3/d12/d16/d1a/f1e [0,4194304] 0 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:9/318: truncate d3/d15/f3c 4691043 0 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:6/390: truncate d3/d12/f3b 300116 0 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:6/391: dread - d3/f4b zero size 2024-09-21T10:40:57.571 INFO:tasks.workunit.client.0.smithi060.stdout:6/392: write d3/d12/d16/d25/d27/f29 [2250730,129352] 0 2024-09-21T10:40:57.573 INFO:tasks.workunit.client.1.smithi112.stdout:2/949: creat d0/d12/f137 x:0 0 0 2024-09-21T10:40:57.573 INFO:tasks.workunit.client.1.smithi112.stdout:2/950: fdatasync d0/d12/d46/da0/db9/dbd/f3f 0 2024-09-21T10:40:57.579 INFO:tasks.workunit.client.1.smithi112.stdout:2/951: mknod d0/d12/d46/d86/dc0/dc8/dfa/d12e/c138 0 2024-09-21T10:40:57.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/319: truncate d3/d5e/d60/d2f/f62 290242 0 2024-09-21T10:40:57.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/320: fdatasync d3/d5e/d60/d2f/f50 0 2024-09-21T10:40:57.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/321: chown d3/d5e/d60/c33 385893 1 2024-09-21T10:40:57.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/322: chown d3/f4f 2641 1 2024-09-21T10:40:57.582 INFO:tasks.workunit.client.0.smithi060.stdout:7/343: read da/d14/d2a/d49/f6d [1973143,57220] 0 2024-09-21T10:40:57.583 INFO:tasks.workunit.client.0.smithi060.stdout:7/344: stat da/d14/d15/c53 0 2024-09-21T10:40:57.583 INFO:tasks.workunit.client.0.smithi060.stdout:6/393: symlink d3/d12/d16/d5b/l78 0 2024-09-21T10:40:57.583 INFO:tasks.workunit.client.0.smithi060.stdout:6/394: chown d3/d12/d16/d22 182840813 1 2024-09-21T10:40:57.583 INFO:tasks.workunit.client.0.smithi060.stdout:6/395: chown d3/d12 30338788 1 2024-09-21T10:40:57.585 INFO:tasks.workunit.client.0.smithi060.stdout:7/345: mknod da/d14/d15/c7c 0 2024-09-21T10:40:57.590 INFO:tasks.workunit.client.0.smithi060.stdout:0/355: dwrite d5/d10/da/d20/f55 [0,4194304] 0 2024-09-21T10:40:57.590 INFO:tasks.workunit.client.0.smithi060.stdout:0/356: chown d5/d10/da/d20/d45/d2a/d40/d48/c5f 981 1 2024-09-21T10:40:57.604 INFO:tasks.workunit.client.0.smithi060.stdout:8/329: dwrite d2/f17 [0,4194304] 0 2024-09-21T10:40:57.604 INFO:tasks.workunit.client.0.smithi060.stdout:1/348: dwrite d6/d4a/d5a/f70 [0,4194304] 0 2024-09-21T10:40:57.604 INFO:tasks.workunit.client.0.smithi060.stdout:9/323: dwrite d3/f69 [4194304,4194304] 0 2024-09-21T10:40:57.605 INFO:tasks.workunit.client.0.smithi060.stdout:3/302: dwrite d0/d1/f26 [0,4194304] 0 2024-09-21T10:40:57.606 INFO:tasks.workunit.client.0.smithi060.stdout:8/330: symlink d2/d26/d37/d64/d65/l76 0 2024-09-21T10:40:57.606 INFO:tasks.workunit.client.0.smithi060.stdout:8/331: write d2/d26/d37/d62/f63 [264142,12175] 0 2024-09-21T10:40:57.612 INFO:tasks.workunit.client.0.smithi060.stdout:1/349: mkdir d6/d24/da/db/d7e 0 2024-09-21T10:40:57.612 INFO:tasks.workunit.client.0.smithi060.stdout:9/324: creat d3/d16/d5f/f6b x:0 0 0 2024-09-21T10:40:57.613 INFO:tasks.workunit.client.0.smithi060.stdout:3/303: getdents d0/d1/d11/d46 0 2024-09-21T10:40:57.614 INFO:tasks.workunit.client.0.smithi060.stdout:3/304: write d0/d1/f18 [1365830,72253] 0 2024-09-21T10:40:57.623 INFO:tasks.workunit.client.0.smithi060.stdout:8/332: mkdir d2/d26/d37/d62/d77 0 2024-09-21T10:40:57.623 INFO:tasks.workunit.client.0.smithi060.stdout:8/333: write d2/d26/d37/f58 [183237,100789] 0 2024-09-21T10:40:57.623 INFO:tasks.workunit.client.0.smithi060.stdout:8/334: write d2/f47 [328496,57168] 0 2024-09-21T10:40:57.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/350: mknod d6/d24/da/db/c7f 0 2024-09-21T10:40:57.625 INFO:tasks.workunit.client.0.smithi060.stdout:9/325: rename d3/d16/d1f/f2a to d3/d5e/f6c 0 2024-09-21T10:40:57.625 INFO:tasks.workunit.client.0.smithi060.stdout:9/326: dread - d3/d5e/d60/d2f/f50 zero size 2024-09-21T10:40:57.626 INFO:tasks.workunit.client.0.smithi060.stdout:3/305: creat d0/d1/d11/d2a/f5d x:0 0 0 2024-09-21T10:40:57.626 INFO:tasks.workunit.client.0.smithi060.stdout:8/335: creat d2/d18/d4b/d61/f78 x:0 0 0 2024-09-21T10:40:57.628 INFO:tasks.workunit.client.0.smithi060.stdout:9/327: link d3/d16/d42/l54 d3/d5e/d60/l6d 0 2024-09-21T10:40:57.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/306: mknod d0/d1/d11/d2a/d43/d4e/c5e 0 2024-09-21T10:40:57.631 INFO:tasks.workunit.client.0.smithi060.stdout:1/351: write d6/d24/da/db/f56 [4016754,29306] 0 2024-09-21T10:40:57.637 INFO:tasks.workunit.client.0.smithi060.stdout:9/328: dread d3/d15/f22 [4194304,4194304] 0 2024-09-21T10:40:57.638 INFO:tasks.workunit.client.0.smithi060.stdout:9/329: mknod d3/d15/d5a/c6e 0 2024-09-21T10:40:57.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/330: dread d3/d16/d1f/f49 [0,4194304] 0 2024-09-21T10:40:57.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/331: truncate d3/d5e/d60/d2f/f62 1073592 0 2024-09-21T10:40:57.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/332: dread - d3/d5e/d60/d2f/f50 zero size 2024-09-21T10:40:57.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/333: write d3/d15/f17 [5630742,47999] 0 2024-09-21T10:40:57.644 INFO:tasks.workunit.client.0.smithi060.stdout:9/334: write d3/d16/d42/f5d [777895,116896] 0 2024-09-21T10:40:57.646 INFO:tasks.workunit.client.0.smithi060.stdout:9/335: mknod d3/d15/c6f 0 2024-09-21T10:40:57.646 INFO:tasks.workunit.client.0.smithi060.stdout:8/336: write d2/d18/f36 [1116947,64023] 0 2024-09-21T10:40:57.646 INFO:tasks.workunit.client.0.smithi060.stdout:9/336: mknod d3/d16/d1a/c70 0 2024-09-21T10:40:57.647 INFO:tasks.workunit.client.0.smithi060.stdout:9/337: truncate d3/f9 2155403 0 2024-09-21T10:40:57.648 INFO:tasks.workunit.client.0.smithi060.stdout:8/337: getdents d2/d18 0 2024-09-21T10:40:57.648 INFO:tasks.workunit.client.0.smithi060.stdout:8/338: write d2/d26/d37/f55 [136078,66082] 0 2024-09-21T10:40:57.648 INFO:tasks.workunit.client.0.smithi060.stdout:8/339: write d2/d26/f29 [568663,97858] 0 2024-09-21T10:40:57.648 INFO:tasks.workunit.client.0.smithi060.stdout:9/338: mkdir d3/d16/d1a/d71 0 2024-09-21T10:40:57.648 INFO:tasks.workunit.client.0.smithi060.stdout:9/339: creat d3/d16/d1a/f72 x:0 0 0 2024-09-21T10:40:57.650 INFO:tasks.workunit.client.1.smithi112.stdout:2/952: sync 2024-09-21T10:40:57.652 INFO:tasks.workunit.client.0.smithi060.stdout:1/352: dwrite d6/d24/da/db/f56 [0,4194304] 0 2024-09-21T10:40:57.652 INFO:tasks.workunit.client.1.smithi112.stdout:2/953: link d0/d12/d46/da0/db9/dbd/d62/d63/ff6 d0/dd/da5/df0/f139 0 2024-09-21T10:40:57.653 INFO:tasks.workunit.client.0.smithi060.stdout:3/307: dwrite d0/f28 [4194304,4194304] 0 2024-09-21T10:40:57.654 INFO:tasks.workunit.client.0.smithi060.stdout:1/353: stat d6/d24/da/db/dd/l25 0 2024-09-21T10:40:57.658 INFO:tasks.workunit.client.0.smithi060.stdout:1/354: symlink d6/d24/da/db/d7e/l80 0 2024-09-21T10:40:57.658 INFO:tasks.workunit.client.0.smithi060.stdout:1/355: chown d6/d24/da/db/dd/l25 3425 1 2024-09-21T10:40:57.658 INFO:tasks.workunit.client.0.smithi060.stdout:1/356: readlink d6/d24/d50/l73 0 2024-09-21T10:40:57.658 INFO:tasks.workunit.client.0.smithi060.stdout:8/340: dread d2/ff [0,4194304] 0 2024-09-21T10:40:57.658 INFO:tasks.workunit.client.0.smithi060.stdout:8/341: truncate d2/f14 936730 0 2024-09-21T10:40:57.659 INFO:tasks.workunit.client.0.smithi060.stdout:1/357: mknod d6/d24/da/d45/d76/c81 0 2024-09-21T10:40:57.660 INFO:tasks.workunit.client.0.smithi060.stdout:1/358: read d6/f40 [503383,21063] 0 2024-09-21T10:40:57.660 INFO:tasks.workunit.client.0.smithi060.stdout:1/359: chown d6/d24/da/l34 82 1 2024-09-21T10:40:57.660 INFO:tasks.workunit.client.1.smithi112.stdout:2/954: write d0/d12/d46/da0/db9/dbd/d62/fa8 [1349575,2395] 0 2024-09-21T10:40:57.661 INFO:tasks.workunit.client.0.smithi060.stdout:8/342: rename d2/d26/f32 to d2/d26/d37/d62/d77/f79 0 2024-09-21T10:40:57.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/955: symlink d0/dd/da5/df0/l13a 0 2024-09-21T10:40:57.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/956: write d0/d12/d46/da0/db9/dbd/d62/d63/f4f [4821189,6897] 0 2024-09-21T10:40:57.662 INFO:tasks.workunit.client.1.smithi112.stdout:2/957: read - d0/d12/d76/d123/d7e/d8f/ff5 zero size 2024-09-21T10:40:57.663 INFO:tasks.workunit.client.0.smithi060.stdout:3/308: dread d0/d1/d1e/f37 [0,4194304] 0 2024-09-21T10:40:57.663 INFO:tasks.workunit.client.0.smithi060.stdout:3/309: creat d0/d1/d24/f5f x:0 0 0 2024-09-21T10:40:57.663 INFO:tasks.workunit.client.0.smithi060.stdout:1/360: rename d6/d24/da/db/f10 to d6/d24/da/db/d1c/d4b/f82 0 2024-09-21T10:40:57.665 INFO:tasks.workunit.client.0.smithi060.stdout:8/343: link d2/d18/d4b/d61/d6e/c6f d2/d26/d37/d64/c7a 0 2024-09-21T10:40:57.667 INFO:tasks.workunit.client.0.smithi060.stdout:1/361: rename d6/d24/da/db/de/d32/l39 to d6/d24/da/db/dd/l83 0 2024-09-21T10:40:57.669 INFO:tasks.workunit.client.0.smithi060.stdout:8/344: rename d2/c7 to d2/d26/d37/d62/d77/c7b 0 2024-09-21T10:40:57.670 INFO:tasks.workunit.client.0.smithi060.stdout:1/362: creat d6/d24/da/d45/d76/f84 x:0 0 0 2024-09-21T10:40:57.672 INFO:tasks.workunit.client.0.smithi060.stdout:1/363: creat d6/d24/da/db/f85 x:0 0 0 2024-09-21T10:40:57.673 INFO:tasks.workunit.client.0.smithi060.stdout:9/340: dwrite d3/d15/d5a/f67 [0,4194304] 0 2024-09-21T10:40:57.678 INFO:tasks.workunit.client.0.smithi060.stdout:3/310: dread d0/f21 [0,4194304] 0 2024-09-21T10:40:57.680 INFO:tasks.workunit.client.0.smithi060.stdout:3/311: symlink d0/l60 0 2024-09-21T10:40:57.680 INFO:tasks.workunit.client.0.smithi060.stdout:3/312: write d0/d1/d11/d46/f31 [132616,17159] 0 2024-09-21T10:40:57.680 INFO:tasks.workunit.client.0.smithi060.stdout:8/345: dread d2/d26/f29 [0,4194304] 0 2024-09-21T10:40:57.682 INFO:tasks.workunit.client.0.smithi060.stdout:1/364: rmdir d6/d24/da/db/d1c/d4b 39 2024-09-21T10:40:57.702 INFO:tasks.workunit.client.0.smithi060.stdout:8/346: dwrite d2/d26/d37/d62/f63 [0,4194304] 0 2024-09-21T10:40:57.702 INFO:tasks.workunit.client.0.smithi060.stdout:8/347: chown d2/d26 7363042 1 2024-09-21T10:40:57.705 INFO:tasks.workunit.client.0.smithi060.stdout:8/348: mkdir d2/d26/d37/d62/d77/d7c 0 2024-09-21T10:40:57.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/313: dwrite d0/d1/d11/d2a/f3d [0,4194304] 0 2024-09-21T10:40:57.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/314: chown d0/d1/d1e/f35 214 1 2024-09-21T10:40:57.706 INFO:tasks.workunit.client.0.smithi060.stdout:1/365: dwrite d6/d24/da/db/f85 [0,4194304] 0 2024-09-21T10:40:57.708 INFO:tasks.workunit.client.0.smithi060.stdout:3/315: rename d0/d1/l2c to d0/d1/d52/l61 0 2024-09-21T10:40:57.710 INFO:tasks.workunit.client.0.smithi060.stdout:1/366: mkdir d6/d24/da/db/d79/d86 0 2024-09-21T10:40:57.711 INFO:tasks.workunit.client.0.smithi060.stdout:3/316: mknod d0/d1/d52/c62 0 2024-09-21T10:40:57.711 INFO:tasks.workunit.client.0.smithi060.stdout:3/317: write d0/d1/d11/d2a/f2e [4820521,43449] 0 2024-09-21T10:40:57.711 INFO:tasks.workunit.client.0.smithi060.stdout:3/318: chown d0/l60 15700983 1 2024-09-21T10:40:57.715 INFO:tasks.workunit.client.0.smithi060.stdout:8/349: write d2/f1c [913361,31817] 0 2024-09-21T10:40:57.715 INFO:tasks.workunit.client.0.smithi060.stdout:8/350: chown d2/f47 7687 1 2024-09-21T10:40:57.715 INFO:tasks.workunit.client.0.smithi060.stdout:8/351: write d2/d18/f5e [744352,14431] 0 2024-09-21T10:40:57.719 INFO:tasks.workunit.client.0.smithi060.stdout:1/367: dread d6/d24/da/db/f56 [0,4194304] 0 2024-09-21T10:40:57.720 INFO:tasks.workunit.client.0.smithi060.stdout:3/319: dread d0/f28 [0,4194304] 0 2024-09-21T10:40:57.720 INFO:tasks.workunit.client.0.smithi060.stdout:3/320: creat d0/d1/d11/d2a/f63 x:0 0 0 2024-09-21T10:40:57.722 INFO:tasks.workunit.client.0.smithi060.stdout:3/321: truncate d0/d1/d1e/f35 2102188 0 2024-09-21T10:40:57.723 INFO:tasks.workunit.client.0.smithi060.stdout:3/322: mkdir d0/d1/d11/d2a/d64 0 2024-09-21T10:40:57.724 INFO:tasks.workunit.client.0.smithi060.stdout:3/323: mknod d0/d1/d24/c65 0 2024-09-21T10:40:57.725 INFO:tasks.workunit.client.0.smithi060.stdout:3/324: link d0/d1/d11/c55 d0/d1/d11/d2a/d64/c66 0 2024-09-21T10:40:57.727 INFO:tasks.workunit.client.0.smithi060.stdout:3/325: unlink d0/d1/d11/d2a/f3d 0 2024-09-21T10:40:57.729 INFO:tasks.workunit.client.0.smithi060.stdout:3/326: mknod d0/d1/d11/d2a/d43/c67 0 2024-09-21T10:40:57.729 INFO:tasks.workunit.client.0.smithi060.stdout:3/327: stat d0/d1/d11/d46/f31 0 2024-09-21T10:40:57.729 INFO:tasks.workunit.client.0.smithi060.stdout:3/328: stat d0/f28 0 2024-09-21T10:40:57.730 INFO:tasks.workunit.client.0.smithi060.stdout:3/329: symlink d0/d1/d1e/l68 0 2024-09-21T10:40:57.733 INFO:tasks.workunit.client.0.smithi060.stdout:8/352: dwrite d2/f3 [0,4194304] 0 2024-09-21T10:40:57.733 INFO:tasks.workunit.client.0.smithi060.stdout:8/353: write d2/f1c [3288012,126687] 0 2024-09-21T10:40:57.735 INFO:tasks.workunit.client.0.smithi060.stdout:8/354: rename d2/d26/d37/c3e to d2/d26/d37/d64/c7d 0 2024-09-21T10:40:57.735 INFO:tasks.workunit.client.0.smithi060.stdout:8/355: creat d2/d18/d4b/d4d/f7e x:0 0 0 2024-09-21T10:40:57.735 INFO:tasks.workunit.client.0.smithi060.stdout:8/356: chown d2/d26/d37 59319649 1 2024-09-21T10:40:57.738 INFO:tasks.workunit.client.0.smithi060.stdout:3/330: getdents d0/d1/d11/d2a/d43 0 2024-09-21T10:40:57.743 INFO:tasks.workunit.client.0.smithi060.stdout:8/357: dread d2/f15 [0,4194304] 0 2024-09-21T10:40:57.743 INFO:tasks.workunit.client.0.smithi060.stdout:8/358: read d2/ff [2836189,34475] 0 2024-09-21T10:40:57.743 INFO:tasks.workunit.client.0.smithi060.stdout:8/359: chown d2/f8 5741315 1 2024-09-21T10:40:57.745 INFO:tasks.workunit.client.0.smithi060.stdout:8/360: dread d2/d18/f22 [0,4194304] 0 2024-09-21T10:40:57.746 INFO:tasks.workunit.client.0.smithi060.stdout:3/331: dread d0/d1/d11/f32 [0,4194304] 0 2024-09-21T10:40:57.747 INFO:tasks.workunit.client.0.smithi060.stdout:8/361: unlink d2/f8 0 2024-09-21T10:40:57.747 INFO:tasks.workunit.client.0.smithi060.stdout:8/362: read d2/fe [293435,79785] 0 2024-09-21T10:40:57.748 INFO:tasks.workunit.client.1.smithi112.stdout:2/958: sync 2024-09-21T10:40:57.748 INFO:tasks.workunit.client.1.smithi112.stdout:2/959: creat d0/dd/da5/df0/f13b x:0 0 0 2024-09-21T10:40:57.749 INFO:tasks.workunit.client.0.smithi060.stdout:8/363: link d2/l48 d2/d26/d37/d62/d77/l7f 0 2024-09-21T10:40:57.751 INFO:tasks.workunit.client.0.smithi060.stdout:3/332: dread d0/d1/d11/f32 [0,4194304] 0 2024-09-21T10:40:57.751 INFO:tasks.workunit.client.0.smithi060.stdout:3/333: write d0/d1/d11/d2a/f63 [448163,111743] 0 2024-09-21T10:40:57.754 INFO:tasks.workunit.client.0.smithi060.stdout:3/334: mknod d0/d1/d1e/c69 0 2024-09-21T10:40:57.755 INFO:tasks.workunit.client.0.smithi060.stdout:3/335: mknod d0/d1/d1e/c6a 0 2024-09-21T10:40:57.762 INFO:tasks.workunit.client.0.smithi060.stdout:3/336: read d0/d1/f26 [3935,39149] 0 2024-09-21T10:40:57.769 INFO:tasks.workunit.client.1.smithi112.stdout:2/960: dwrite d0/d12/d46/da0/db9/dbd/d62/d63/f35 [0,4194304] 0 2024-09-21T10:40:57.769 INFO:tasks.workunit.client.0.smithi060.stdout:8/364: dwrite d2/d18/f5e [0,4194304] 0 2024-09-21T10:40:57.787 INFO:tasks.workunit.client.0.smithi060.stdout:3/337: dwrite d0/d1/d1e/f35 [0,4194304] 0 2024-09-21T10:40:57.787 INFO:tasks.workunit.client.0.smithi060.stdout:3/338: stat d0/d1/d11/d46/f59 0 2024-09-21T10:40:57.792 INFO:tasks.workunit.client.1.smithi112.stdout:2/961: dwrite d0/d12/d46/f65 [0,4194304] 0 2024-09-21T10:40:57.792 INFO:tasks.workunit.client.1.smithi112.stdout:2/962: write d0/da2/dd3/f127 [275649,5472] 0 2024-09-21T10:40:57.794 INFO:tasks.workunit.client.0.smithi060.stdout:8/365: dwrite d2/d18/d4b/d4d/f6d [0,4194304] 0 2024-09-21T10:40:57.798 INFO:tasks.workunit.client.0.smithi060.stdout:8/366: unlink d2/d18/f34 0 2024-09-21T10:40:57.798 INFO:tasks.workunit.client.0.smithi060.stdout:8/367: fsync d2/d26/d37/d62/f63 0 2024-09-21T10:40:57.798 INFO:tasks.workunit.client.0.smithi060.stdout:8/368: readlink d2/l3a 0 2024-09-21T10:40:57.798 INFO:tasks.workunit.client.0.smithi060.stdout:8/369: getdents d2/d26/d37/d64 0 2024-09-21T10:40:57.803 INFO:tasks.workunit.client.0.smithi060.stdout:3/339: dwrite d0/d1/d1e/f37 [0,4194304] 0 2024-09-21T10:40:57.803 INFO:tasks.workunit.client.0.smithi060.stdout:3/340: read d0/f1c [161990,28387] 0 2024-09-21T10:40:57.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/341: write d0/d1/d11/d2a/f4d [211133,12402] 0 2024-09-21T10:40:57.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/342: fdatasync d0/f16 0 2024-09-21T10:40:57.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/343: read - d0/d1/f3f zero size 2024-09-21T10:40:57.804 INFO:tasks.workunit.client.0.smithi060.stdout:3/344: read - d0/d1/d11/f51 zero size 2024-09-21T10:40:57.807 INFO:tasks.workunit.client.0.smithi060.stdout:8/370: write d2/d26/d37/f45 [1466889,124768] 0 2024-09-21T10:40:57.807 INFO:tasks.workunit.client.1.smithi112.stdout:2/963: dwrite d0/d12/d76/d123/d7e/d8f/f3c [0,4194304] 0 2024-09-21T10:40:57.808 INFO:tasks.workunit.client.1.smithi112.stdout:2/964: creat d0/d12/d46/d10f/f13c x:0 0 0 2024-09-21T10:40:57.809 INFO:tasks.workunit.client.0.smithi060.stdout:8/371: dread d2/d26/d37/f3d [0,4194304] 0 2024-09-21T10:40:57.810 INFO:tasks.workunit.client.1.smithi112.stdout:2/965: rmdir d0/d12/d76/d123/d7e 39 2024-09-21T10:40:57.810 INFO:tasks.workunit.client.1.smithi112.stdout:2/966: dread - d0/d12/d46/da0/db9/f109 zero size 2024-09-21T10:40:57.811 INFO:tasks.workunit.client.0.smithi060.stdout:3/345: dread d0/d1/d24/f25 [0,4194304] 0 2024-09-21T10:40:57.811 INFO:tasks.workunit.client.0.smithi060.stdout:3/346: dread - d0/d1/d1e/f4b zero size 2024-09-21T10:40:57.812 INFO:tasks.workunit.client.0.smithi060.stdout:8/372: mknod d2/d26/d37/d64/c80 0 2024-09-21T10:40:57.812 INFO:tasks.workunit.client.0.smithi060.stdout:8/373: read - d2/d5a/f67 zero size 2024-09-21T10:40:57.812 INFO:tasks.workunit.client.0.smithi060.stdout:8/374: chown d2/d18/d4b/d61/d6e 4 1 2024-09-21T10:40:57.812 INFO:tasks.workunit.client.0.smithi060.stdout:8/375: chown d2/d26/d37/f58 2842201 1 2024-09-21T10:40:57.812 INFO:tasks.workunit.client.0.smithi060.stdout:8/376: fsync d2/d18/f36 0 2024-09-21T10:40:57.813 INFO:tasks.workunit.client.1.smithi112.stdout:2/967: rename d0/dd/da5/df0/f13b to d0/d12/d46/d10f/f13d 0 2024-09-21T10:40:57.815 INFO:tasks.workunit.client.0.smithi060.stdout:3/347: unlink d0/d1/f18 0 2024-09-21T10:40:57.816 INFO:tasks.workunit.client.0.smithi060.stdout:8/377: creat d2/d26/d37/d64/d65/f81 x:0 0 0 2024-09-21T10:40:57.818 INFO:tasks.workunit.client.0.smithi060.stdout:3/348: rename d0/d1/d11/d46/l3b to d0/d1/d52/l6b 0 2024-09-21T10:40:57.818 INFO:tasks.workunit.client.0.smithi060.stdout:3/349: chown d0/d1/d11/d2a 18 1 2024-09-21T10:40:57.818 INFO:tasks.workunit.client.0.smithi060.stdout:3/350: chown d0/d1/d1e/f3e 21815851 1 2024-09-21T10:40:57.818 INFO:tasks.workunit.client.0.smithi060.stdout:3/351: read d0/d1/d11/d2a/f2e [1046842,102033] 0 2024-09-21T10:40:57.818 INFO:tasks.workunit.client.0.smithi060.stdout:3/352: stat d0/d1/d1e/f4b 0 2024-09-21T10:40:57.820 INFO:tasks.workunit.client.0.smithi060.stdout:3/353: mknod d0/d1/d52/c6c 0 2024-09-21T10:40:57.820 INFO:tasks.workunit.client.0.smithi060.stdout:3/354: chown d0/d1/l3 59 1 2024-09-21T10:40:57.821 INFO:tasks.workunit.client.0.smithi060.stdout:3/355: truncate d0/d1/d11/d2a/f63 1150069 0 2024-09-21T10:40:57.821 INFO:tasks.workunit.client.0.smithi060.stdout:3/356: symlink d0/d1/d1e/d34/l6d 0 2024-09-21T10:40:57.824 INFO:tasks.workunit.client.0.smithi060.stdout:8/378: read d2/d26/f35 [485222,59336] 0 2024-09-21T10:40:57.825 INFO:tasks.workunit.client.0.smithi060.stdout:8/379: chown d2/d26/d37/d64/d65 0 1 2024-09-21T10:40:57.829 INFO:tasks.workunit.client.0.smithi060.stdout:3/357: getdents d0/d1 0 2024-09-21T10:40:57.829 INFO:tasks.workunit.client.0.smithi060.stdout:3/358: chown d0/d1/d24/f25 311310 1 2024-09-21T10:40:57.831 INFO:tasks.workunit.client.0.smithi060.stdout:8/380: link d2/c25 d2/c82 0 2024-09-21T10:40:57.832 INFO:tasks.workunit.client.0.smithi060.stdout:8/381: mkdir d2/d26/d37/d62/d74/d83 0 2024-09-21T10:40:57.835 INFO:tasks.workunit.client.0.smithi060.stdout:3/359: dread d0/d1/d1e/f3e [0,4194304] 0 2024-09-21T10:40:57.842 INFO:tasks.workunit.client.0.smithi060.stdout:8/382: read d2/f5d [2700367,109051] 0 2024-09-21T10:40:57.843 INFO:tasks.workunit.client.0.smithi060.stdout:8/383: mknod d2/d26/d37/d62/d74/c84 0 2024-09-21T10:40:57.843 INFO:tasks.workunit.client.0.smithi060.stdout:8/384: chown d2/d18/f22 88 1 2024-09-21T10:40:57.844 INFO:tasks.workunit.client.0.smithi060.stdout:8/385: getdents d2/d26/d37/d64 0 2024-09-21T10:40:57.844 INFO:tasks.workunit.client.0.smithi060.stdout:8/386: write d2/d26/d37/d62/f68 [922795,53697] 0 2024-09-21T10:40:57.864 INFO:tasks.workunit.client.0.smithi060.stdout:3/360: dwrite d0/f1c [0,4194304] 0 2024-09-21T10:40:57.870 INFO:tasks.workunit.client.0.smithi060.stdout:2/179: sync 2024-09-21T10:40:57.870 INFO:tasks.workunit.client.0.smithi060.stdout:4/372: sync 2024-09-21T10:40:57.871 INFO:tasks.workunit.client.0.smithi060.stdout:2/180: creat d3/d7/f34 x:0 0 0 2024-09-21T10:40:57.871 INFO:tasks.workunit.client.0.smithi060.stdout:2/181: truncate d3/d7/f34 468141 0 2024-09-21T10:40:57.872 INFO:tasks.workunit.client.0.smithi060.stdout:2/182: rename d3/d20/d15/l22 to d3/d7/d24/d33/l35 0 2024-09-21T10:40:57.872 INFO:tasks.workunit.client.0.smithi060.stdout:2/183: write d3/f5 [1609045,100067] 0 2024-09-21T10:40:57.873 INFO:tasks.workunit.client.0.smithi060.stdout:3/361: dread d0/d1/f20 [0,4194304] 0 2024-09-21T10:40:57.873 INFO:tasks.workunit.client.0.smithi060.stdout:4/373: write d0/d3c/d69/d6a/d6b/d32/d57/f5b [1138673,22522] 0 2024-09-21T10:40:57.873 INFO:tasks.workunit.client.0.smithi060.stdout:2/184: rename d3/d20/f11 to d3/d7/d23/f36 0 2024-09-21T10:40:57.874 INFO:tasks.workunit.client.1.smithi112.stdout:2/968: sync 2024-09-21T10:40:57.874 INFO:tasks.workunit.client.0.smithi060.stdout:3/362: symlink d0/d1/d1e/l6e 0 2024-09-21T10:40:57.874 INFO:tasks.workunit.client.0.smithi060.stdout:3/363: readlink d0/le 0 2024-09-21T10:40:57.875 INFO:tasks.workunit.client.1.smithi112.stdout:2/969: creat d0/d12/d76/d123/d7e/d8f/d51/f13e x:0 0 0 2024-09-21T10:40:57.876 INFO:tasks.workunit.client.0.smithi060.stdout:2/185: rename d3/d20/d17/c2e to d3/d7/d24/d33/c37 0 2024-09-21T10:40:57.876 INFO:tasks.workunit.client.1.smithi112.stdout:2/970: dread d0/d12/d76/d123/d7e/d8f/d51/f54 [0,4194304] 0 2024-09-21T10:40:57.877 INFO:tasks.workunit.client.0.smithi060.stdout:3/364: symlink d0/d1/d1e/d34/l6f 0 2024-09-21T10:40:57.877 INFO:tasks.workunit.client.0.smithi060.stdout:2/186: creat d3/f38 x:0 0 0 2024-09-21T10:40:57.879 INFO:tasks.workunit.client.0.smithi060.stdout:4/374: dread d0/d5/f1a [0,4194304] 0 2024-09-21T10:40:57.881 INFO:tasks.workunit.client.0.smithi060.stdout:4/375: link d0/c3e d0/df/d46/c78 0 2024-09-21T10:40:57.886 INFO:tasks.workunit.client.0.smithi060.stdout:2/187: rmdir d3/d20/d15/d1f 0 2024-09-21T10:40:57.887 INFO:tasks.workunit.client.1.smithi112.stdout:2/971: dread d0/d12/d97/faa [0,4194304] 0 2024-09-21T10:40:57.889 INFO:tasks.workunit.client.1.smithi112.stdout:2/972: link d0/d12/d77/f101 d0/d12/d46/da0/f13f 0 2024-09-21T10:40:57.890 INFO:tasks.workunit.client.1.smithi112.stdout:2/973: symlink d0/l140 0 2024-09-21T10:40:57.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/974: write d0/da4/dbe/fa7 [697901,545] 0 2024-09-21T10:40:57.899 INFO:tasks.workunit.client.1.smithi112.stdout:2/975: readlink d0/d12/d76/d123/d7e/d8f/l43 0 2024-09-21T10:40:57.900 INFO:tasks.workunit.client.1.smithi112.stdout:2/976: write d0/f2a [1329466,17830] 0 2024-09-21T10:40:57.900 INFO:tasks.workunit.client.1.smithi112.stdout:2/977: creat d0/d12/f141 x:0 0 0 2024-09-21T10:40:57.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/978: mknod d0/d12/d46/d86/dc0/c142 0 2024-09-21T10:40:57.902 INFO:tasks.workunit.client.1.smithi112.stdout:2/979: write d0/d12/d76/d123/d7e/d8f/d51/d57/f67 [1994195,61971] 0 2024-09-21T10:40:57.904 INFO:tasks.workunit.client.0.smithi060.stdout:4/376: dwrite d0/f60 [0,4194304] 0 2024-09-21T10:40:57.904 INFO:tasks.workunit.client.0.smithi060.stdout:2/188: dread f2 [0,4194304] 0 2024-09-21T10:40:57.906 INFO:tasks.workunit.client.0.smithi060.stdout:4/377: link d0/d5/d12/d15/d4d/c70 d0/d3c/d69/d6a/d6b/c79 0 2024-09-21T10:40:57.907 INFO:tasks.workunit.client.0.smithi060.stdout:2/189: mknod d3/d7/d24/d33/c39 0 2024-09-21T10:40:57.919 INFO:tasks.workunit.client.1.smithi112.stdout:2/980: dwrite d0/d12/d46/da0/db9/dbd/f3f [0,4194304] 0 2024-09-21T10:40:57.919 INFO:tasks.workunit.client.1.smithi112.stdout:2/981: stat d0/d12/d76/d123/d7e/d8f/l74 0 2024-09-21T10:40:57.920 INFO:tasks.workunit.client.1.smithi112.stdout:2/982: truncate d0/d12/d46/da0/db9/dbd/d62/d63/f4f 3659455 0 2024-09-21T10:40:57.921 INFO:tasks.workunit.client.1.smithi112.stdout:2/983: write d0/d12/d76/f91 [4845892,4185] 0 2024-09-21T10:40:57.921 INFO:tasks.workunit.client.0.smithi060.stdout:4/378: dwrite d0/d3c/d69/d6a/d6b/d32/f5e [0,4194304] 0 2024-09-21T10:40:57.921 INFO:tasks.workunit.client.1.smithi112.stdout:2/984: mknod d0/d12/d46/c143 0 2024-09-21T10:40:57.927 INFO:tasks.workunit.client.0.smithi060.stdout:4/379: dread d0/fc [4194304,4194304] 0 2024-09-21T10:40:57.929 INFO:tasks.workunit.client.0.smithi060.stdout:4/380: read d0/d5/d12/d16/d28/f2d [5793654,51155] 0 2024-09-21T10:40:57.930 INFO:tasks.workunit.client.1.smithi112.stdout:2/985: write d0/f1d [3519884,113731] 0 2024-09-21T10:40:57.932 INFO:tasks.workunit.client.1.smithi112.stdout:2/986: symlink d0/d12/d46/d86/dc0/dc8/dfa/l144 0 2024-09-21T10:40:57.932 INFO:tasks.workunit.client.1.smithi112.stdout:2/987: stat d0/dd/d47/c4b 0 2024-09-21T10:40:57.932 INFO:tasks.workunit.client.1.smithi112.stdout:2/988: chown d0/d12/d46/da0/db9/fca 68 1 2024-09-21T10:40:57.932 INFO:tasks.workunit.client.1.smithi112.stdout:2/989: stat d0/da2/cdf 0 2024-09-21T10:40:57.932 INFO:tasks.workunit.client.1.smithi112.stdout:2/990: mkdir d0/d12/d46/d86/d145 0 2024-09-21T10:40:57.933 INFO:tasks.workunit.client.1.smithi112.stdout:2/991: link d0/d12/d46/da0/db9/dbd/de1/fe5 d0/d12/d46/d86/dc0/dc8/f146 0 2024-09-21T10:40:57.934 INFO:tasks.workunit.client.1.smithi112.stdout:2/992: creat d0/dd/f147 x:0 0 0 2024-09-21T10:40:57.935 INFO:tasks.workunit.client.1.smithi112.stdout:2/993: creat d0/d12/d46/da0/db9/dbd/de1/f148 x:0 0 0 2024-09-21T10:40:57.935 INFO:tasks.workunit.client.1.smithi112.stdout:2/994: readlink d0/d12/d46/da0/db9/dbd/d62/d63/lb4 0 2024-09-21T10:40:57.935 INFO:tasks.workunit.client.1.smithi112.stdout:2/995: creat d0/da2/f149 x:0 0 0 2024-09-21T10:40:57.936 INFO:tasks.workunit.client.1.smithi112.stdout:2/996: symlink d0/d12/d97/l14a 0 2024-09-21T10:40:57.937 INFO:tasks.workunit.client.1.smithi112.stdout:2/997: symlink d0/d12/d46/l14b 0 2024-09-21T10:40:57.938 INFO:tasks.workunit.client.1.smithi112.stdout:2/998: unlink d0/d12/d46/da0/f13f 0 2024-09-21T10:40:57.938 INFO:tasks.workunit.client.1.smithi112.stdout:2/999: write d0/d12/d46/f107 [935835,62392] 0 2024-09-21T10:40:57.941 INFO:tasks.workunit.client.1.smithi112.stderr:+ rm -rf -- ./tmp.20FFPXnV11 2024-09-21T10:40:57.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:57 smithi060 ceph-mon[28215]: pgmap v15: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 229 MiB/s rd, 262 MiB/s wr, 373 op/s 2024-09-21T10:40:57.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:57 smithi112 ceph-mon[35117]: pgmap v15: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 229 MiB/s rd, 262 MiB/s wr, 373 op/s 2024-09-21T10:40:57.955 INFO:tasks.workunit.client.0.smithi060.stdout:5/328: sync 2024-09-21T10:40:57.956 INFO:tasks.workunit.client.0.smithi060.stdout:5/329: mkdir d5/d71 0 2024-09-21T10:40:57.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/330: dwrite d5/f16 [0,4194304] 0 2024-09-21T10:40:57.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/331: chown d5/d45/d5a/d3a/f53 526859706 1 2024-09-21T10:40:57.971 INFO:tasks.workunit.client.0.smithi060.stdout:5/332: creat d5/d45/d6d/d10/d19/f72 x:0 0 0 2024-09-21T10:40:57.979 INFO:tasks.workunit.client.0.smithi060.stdout:5/333: write d5/d45/d6d/d10/d19/f37 [3608978,79962] 0 2024-09-21T10:40:57.981 INFO:tasks.workunit.client.0.smithi060.stdout:5/334: mknod d5/d45/d6d/d10/d19/c73 0 2024-09-21T10:40:58.003 INFO:tasks.workunit.client.0.smithi060.stdout:5/335: dwrite d5/d45/d5a/d3a/f5e [0,4194304] 0 2024-09-21T10:40:58.005 INFO:tasks.workunit.client.0.smithi060.stdout:5/336: rmdir d5/d45/d6d/d3b 39 2024-09-21T10:40:58.007 INFO:tasks.workunit.client.0.smithi060.stdout:5/337: rename d5/d45/d6d/f1d to d5/d45/d6d/d3b/f74 0 2024-09-21T10:40:58.008 INFO:tasks.workunit.client.0.smithi060.stdout:5/338: creat d5/d45/d6d/d10/d19/d21/d30/d49/f75 x:0 0 0 2024-09-21T10:40:58.008 INFO:tasks.workunit.client.0.smithi060.stdout:5/339: creat d5/f76 x:0 0 0 2024-09-21T10:40:58.024 INFO:tasks.workunit.client.0.smithi060.stdout:5/340: dwrite d5/d45/d5a/d3a/f53 [0,4194304] 0 2024-09-21T10:40:58.026 INFO:tasks.workunit.client.0.smithi060.stdout:5/341: mkdir d5/d45/d77 0 2024-09-21T10:40:58.034 INFO:tasks.workunit.client.0.smithi060.stdout:5/342: write d5/d45/d6d/d10/d19/d21/d30/f47 [2375841,104459] 0 2024-09-21T10:40:58.091 INFO:tasks.workunit.client.0.smithi060.stdout:6/396: sync 2024-09-21T10:40:58.104 INFO:tasks.workunit.client.0.smithi060.stdout:6/397: dwrite d3/d12/d16/d22/f6e [0,4194304] 0 2024-09-21T10:40:58.120 INFO:tasks.workunit.client.0.smithi060.stdout:6/398: dwrite d3/d12/d16/d22/f2f [0,4194304] 0 2024-09-21T10:40:58.128 INFO:tasks.workunit.client.0.smithi060.stdout:6/399: write d3/d12/d16/d22/f6e [2566629,73240] 0 2024-09-21T10:40:58.128 INFO:tasks.workunit.client.0.smithi060.stdout:6/400: chown d3/d12/d16/d22/c74 71518 1 2024-09-21T10:40:58.142 INFO:tasks.workunit.client.0.smithi060.stdout:6/401: dwrite d3/d12/d38/d41/f68 [0,4194304] 0 2024-09-21T10:40:58.145 INFO:tasks.workunit.client.0.smithi060.stdout:6/402: symlink d3/d12/d38/l79 0 2024-09-21T10:40:58.145 INFO:tasks.workunit.client.0.smithi060.stdout:6/403: fdatasync d3/d12/d38/d41/f4d 0 2024-09-21T10:40:58.146 INFO:tasks.workunit.client.0.smithi060.stdout:6/404: read d3/d12/d16/f40 [2473749,86718] 0 2024-09-21T10:40:58.283 INFO:tasks.workunit.client.0.smithi060.stdout:0/357: sync 2024-09-21T10:40:58.313 INFO:tasks.workunit.client.0.smithi060.stdout:0/358: symlink d5/d10/da/d2d/l68 0 2024-09-21T10:40:58.314 INFO:tasks.workunit.client.0.smithi060.stdout:0/359: getdents d5/d10/da 0 2024-09-21T10:40:58.316 INFO:tasks.workunit.client.0.smithi060.stdout:0/360: link d5/d10/d43/l49 d5/d10/da/d2d/l69 0 2024-09-21T10:40:58.317 INFO:tasks.workunit.client.0.smithi060.stdout:0/361: link d5/d10/d4e/l5e d5/d10/d4e/l6a 0 2024-09-21T10:40:58.320 INFO:tasks.workunit.client.0.smithi060.stdout:0/362: dread d5/d10/f61 [0,4194304] 0 2024-09-21T10:40:58.340 INFO:tasks.workunit.client.0.smithi060.stdout:0/363: dwrite d5/d10/da/d2f/f64 [0,4194304] 0 2024-09-21T10:40:58.340 INFO:tasks.workunit.client.0.smithi060.stdout:0/364: chown d5/d10/da 60136 1 2024-09-21T10:40:58.340 INFO:tasks.workunit.client.0.smithi060.stdout:0/365: creat d5/d10/da/d2f/f6b x:0 0 0 2024-09-21T10:40:58.340 INFO:tasks.workunit.client.0.smithi060.stdout:0/366: fdatasync d5/d10/f8 0 2024-09-21T10:40:58.340 INFO:tasks.workunit.client.0.smithi060.stdout:0/367: read d5/d10/da/f13 [451399,56084] 0 2024-09-21T10:40:58.341 INFO:tasks.workunit.client.0.smithi060.stdout:0/368: creat d5/d10/da/d20/d45/d2a/f6c x:0 0 0 2024-09-21T10:40:58.387 INFO:tasks.workunit.client.0.smithi060.stdout:0/369: truncate f2 5478682 0 2024-09-21T10:40:58.389 INFO:tasks.workunit.client.0.smithi060.stdout:0/370: link d5/d10/d4e/l5e d5/d10/da/d20/l6d 0 2024-09-21T10:40:58.390 INFO:tasks.workunit.client.0.smithi060.stdout:0/371: creat d5/d10/da/d20/d4d/f6e x:0 0 0 2024-09-21T10:40:58.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/372: creat d5/d10/d4e/f6f x:0 0 0 2024-09-21T10:40:58.393 INFO:tasks.workunit.client.0.smithi060.stdout:0/373: creat d5/d10/da/d20/d45/d2a/d40/f70 x:0 0 0 2024-09-21T10:40:58.407 INFO:tasks.workunit.client.0.smithi060.stdout:0/374: dwrite d5/d10/da/d20/d45/f30 [0,4194304] 0 2024-09-21T10:40:58.410 INFO:tasks.workunit.client.0.smithi060.stdout:0/375: creat d5/d10/da/d4b/f71 x:0 0 0 2024-09-21T10:40:58.410 INFO:tasks.workunit.client.0.smithi060.stdout:0/376: write d5/d10/da/d4b/f71 [81156,55578] 0 2024-09-21T10:40:58.423 INFO:tasks.workunit.client.0.smithi060.stdout:0/377: dwrite d5/d10/da/d20/d45/f30 [0,4194304] 0 2024-09-21T10:40:58.423 INFO:tasks.workunit.client.0.smithi060.stdout:0/378: write d5/d10/da/fc [2882569,29564] 0 2024-09-21T10:40:58.423 INFO:tasks.workunit.client.0.smithi060.stdout:0/379: creat d5/d10/da/d15/f72 x:0 0 0 2024-09-21T10:40:58.425 INFO:tasks.workunit.client.0.smithi060.stdout:0/380: symlink d5/d10/da/d2f/d66/l73 0 2024-09-21T10:40:58.429 INFO:tasks.workunit.client.0.smithi060.stdout:0/381: write f2 [5268525,35839] 0 2024-09-21T10:40:58.432 INFO:tasks.workunit.client.0.smithi060.stdout:1/368: sync 2024-09-21T10:40:58.432 INFO:tasks.workunit.client.0.smithi060.stdout:7/346: sync 2024-09-21T10:40:58.432 INFO:tasks.workunit.client.0.smithi060.stdout:9/341: sync 2024-09-21T10:40:58.432 INFO:tasks.workunit.client.0.smithi060.stdout:7/347: creat da/d14/d35/f7d x:0 0 0 2024-09-21T10:40:58.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/348: dread - da/d14/d2a/d49/d27/f44 zero size 2024-09-21T10:40:58.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/349: creat da/d14/d15/f7e x:0 0 0 2024-09-21T10:40:58.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/350: fsync da/f24 0 2024-09-21T10:40:58.435 INFO:tasks.workunit.client.0.smithi060.stdout:1/369: unlink d6/d4a/d5a/f70 0 2024-09-21T10:40:58.436 INFO:tasks.workunit.client.0.smithi060.stdout:9/342: symlink d3/d16/d1a/l73 0 2024-09-21T10:40:58.436 INFO:tasks.workunit.client.0.smithi060.stdout:1/370: dread d6/d24/da/db/de/f38 [0,4194304] 0 2024-09-21T10:40:58.444 INFO:tasks.workunit.client.0.smithi060.stdout:7/351: unlink da/d14/d35/f1a 0 2024-09-21T10:40:58.446 INFO:tasks.workunit.client.0.smithi060.stdout:0/382: truncate f2 1649073 0 2024-09-21T10:40:58.447 INFO:tasks.workunit.client.0.smithi060.stdout:1/371: mknod d6/c87 0 2024-09-21T10:40:58.448 INFO:tasks.workunit.client.0.smithi060.stdout:0/383: mknod d5/d10/da/d4b/c74 0 2024-09-21T10:40:58.448 INFO:tasks.workunit.client.0.smithi060.stdout:0/384: fdatasync d5/d10/da/d20/f55 0 2024-09-21T10:40:58.449 INFO:tasks.workunit.client.0.smithi060.stdout:9/343: dwrite d3/d15/f2b [0,4194304] 0 2024-09-21T10:40:58.449 INFO:tasks.workunit.client.0.smithi060.stdout:9/344: write d3/d16/d1a/f26 [1024536,74226] 0 2024-09-21T10:40:58.450 INFO:tasks.workunit.client.0.smithi060.stdout:0/385: dread d5/d10/da/d20/d45/f4f [0,4194304] 0 2024-09-21T10:40:58.451 INFO:tasks.workunit.client.0.smithi060.stdout:1/372: creat d6/d24/d50/f88 x:0 0 0 2024-09-21T10:40:58.452 INFO:tasks.workunit.client.0.smithi060.stdout:7/352: read da/f12 [2024647,40631] 0 2024-09-21T10:40:58.458 INFO:tasks.workunit.client.0.smithi060.stdout:9/345: creat d3/d15/d53/f74 x:0 0 0 2024-09-21T10:40:58.459 INFO:tasks.workunit.client.0.smithi060.stdout:0/386: mkdir d5/d10/da/d20/d45/d2a/d40/d75 0 2024-09-21T10:40:58.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/353: symlink da/d60/d6e/l7f 0 2024-09-21T10:40:58.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/354: creat da/d14/d2a/d49/f80 x:0 0 0 2024-09-21T10:40:58.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/355: chown da/d14/d2a/d49/d2e/f3d 429616 1 2024-09-21T10:40:58.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/356: write da/d14/d15/f7e [497009,30984] 0 2024-09-21T10:40:58.465 INFO:tasks.workunit.client.0.smithi060.stdout:9/346: mknod d3/d15/d58/c75 0 2024-09-21T10:40:58.466 INFO:tasks.workunit.client.0.smithi060.stdout:1/373: dwrite d6/d24/da/db/dd/f3d [0,4194304] 0 2024-09-21T10:40:58.468 INFO:tasks.workunit.client.0.smithi060.stdout:0/387: rename d5/d10/da/d20/d33 to d5/d10/da/d20/d45/d2a/d76 0 2024-09-21T10:40:58.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/357: creat da/d14/d2a/f81 x:0 0 0 2024-09-21T10:40:58.472 INFO:tasks.workunit.client.0.smithi060.stdout:7/358: chown da/d14/d2a/c4b 10 1 2024-09-21T10:40:58.472 INFO:tasks.workunit.client.0.smithi060.stdout:9/347: truncate d3/d15/d5a/f67 1537476 0 2024-09-21T10:40:58.472 INFO:tasks.workunit.client.0.smithi060.stdout:9/348: chown d3/l6 210967 1 2024-09-21T10:40:58.485 INFO:tasks.workunit.client.0.smithi060.stdout:1/374: unlink d6/d24/da/db/dd/f4d 0 2024-09-21T10:40:58.485 INFO:tasks.workunit.client.0.smithi060.stdout:1/375: creat d6/f89 x:0 0 0 2024-09-21T10:40:58.485 INFO:tasks.workunit.client.0.smithi060.stdout:7/359: write f0 [2107585,32831] 0 2024-09-21T10:40:58.485 INFO:tasks.workunit.client.0.smithi060.stdout:7/360: creat da/d14/d15/f82 x:0 0 0 2024-09-21T10:40:58.486 INFO:tasks.workunit.client.0.smithi060.stdout:7/361: write f6 [3674891,80391] 0 2024-09-21T10:40:58.489 INFO:tasks.workunit.client.0.smithi060.stdout:7/362: rmdir da/d60/d6e/d77 0 2024-09-21T10:40:58.491 INFO:tasks.workunit.client.0.smithi060.stdout:7/363: getdents da/d14/d2a/d49/d2e 0 2024-09-21T10:40:58.493 INFO:tasks.workunit.client.0.smithi060.stdout:0/388: dwrite d5/f3e [0,4194304] 0 2024-09-21T10:40:58.493 INFO:tasks.workunit.client.0.smithi060.stdout:0/389: truncate f2 2678126 0 2024-09-21T10:40:58.493 INFO:tasks.workunit.client.0.smithi060.stdout:9/349: dwrite d3/d16/d5f/f65 [0,4194304] 0 2024-09-21T10:40:58.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/387: sync 2024-09-21T10:40:58.496 INFO:tasks.workunit.client.0.smithi060.stdout:0/390: symlink d5/d10/d4e/l77 0 2024-09-21T10:40:58.496 INFO:tasks.workunit.client.0.smithi060.stdout:0/391: truncate d5/d10/f5a 632458 0 2024-09-21T10:40:58.503 INFO:tasks.workunit.client.0.smithi060.stdout:8/388: dread d2/d18/f36 [0,4194304] 0 2024-09-21T10:40:58.503 INFO:tasks.workunit.client.0.smithi060.stdout:8/389: truncate d2/d26/d37/d62/f68 1859674 0 2024-09-21T10:40:58.503 INFO:tasks.workunit.client.0.smithi060.stdout:8/390: write d2/d26/f38 [999198,113487] 0 2024-09-21T10:40:58.506 INFO:tasks.workunit.client.0.smithi060.stdout:7/364: dwrite da/d14/d35/f1d [0,4194304] 0 2024-09-21T10:40:58.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/350: creat d3/f76 x:0 0 0 2024-09-21T10:40:58.507 INFO:tasks.workunit.client.0.smithi060.stdout:7/365: dread da/d14/f48 [0,4194304] 0 2024-09-21T10:40:58.508 INFO:tasks.workunit.client.0.smithi060.stdout:0/392: creat d5/d10/da/d2d/f78 x:0 0 0 2024-09-21T10:40:58.513 INFO:tasks.workunit.client.0.smithi060.stdout:9/351: rename l1 to d3/d5e/d60/d2f/d5b/l77 0 2024-09-21T10:40:58.518 INFO:tasks.workunit.client.0.smithi060.stdout:8/391: link d2/f14 d2/d18/d4b/d61/d6e/f85 0 2024-09-21T10:40:58.518 INFO:tasks.workunit.client.0.smithi060.stdout:2/190: sync 2024-09-21T10:40:58.519 INFO:tasks.workunit.client.0.smithi060.stdout:4/381: sync 2024-09-21T10:40:58.519 INFO:tasks.workunit.client.0.smithi060.stdout:6/405: sync 2024-09-21T10:40:58.519 INFO:tasks.workunit.client.0.smithi060.stdout:6/406: write d3/f4b [142182,52680] 0 2024-09-21T10:40:58.519 INFO:tasks.workunit.client.0.smithi060.stdout:6/407: creat d3/d12/d16/d22/f7a x:0 0 0 2024-09-21T10:40:58.519 INFO:tasks.workunit.client.0.smithi060.stdout:5/343: sync 2024-09-21T10:40:58.519 INFO:tasks.workunit.client.0.smithi060.stdout:3/365: sync 2024-09-21T10:40:58.520 INFO:tasks.workunit.client.0.smithi060.stdout:9/352: mkdir d3/d15/d78 0 2024-09-21T10:40:58.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/393: getdents d5/d10/d11 0 2024-09-21T10:40:58.524 INFO:tasks.workunit.client.0.smithi060.stdout:8/392: creat d2/d18/d4b/f86 x:0 0 0 2024-09-21T10:40:58.525 INFO:tasks.workunit.client.0.smithi060.stdout:7/366: dwrite f6 [8388608,4194304] 0 2024-09-21T10:40:58.525 INFO:tasks.workunit.client.0.smithi060.stdout:7/367: readlink da/d14/d35/l4f 0 2024-09-21T10:40:58.526 INFO:tasks.workunit.client.0.smithi060.stdout:2/191: creat d3/d7/d18/f3a x:0 0 0 2024-09-21T10:40:58.529 INFO:tasks.workunit.client.0.smithi060.stdout:4/382: creat d0/df/d46/f7a x:0 0 0 2024-09-21T10:40:58.529 INFO:tasks.workunit.client.0.smithi060.stdout:4/383: stat d0/d5/d12/d16/d28/f3b 0 2024-09-21T10:40:58.530 INFO:tasks.workunit.client.0.smithi060.stdout:0/394: dread d5/d10/d4e/f51 [0,4194304] 0 2024-09-21T10:40:58.532 INFO:tasks.workunit.client.0.smithi060.stdout:5/344: truncate d5/ff 2895006 0 2024-09-21T10:40:58.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/408: write d3/d12/d38/d41/f44 [3693307,55920] 0 2024-09-21T10:40:58.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/409: fdatasync d3/d54/f77 0 2024-09-21T10:40:58.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/410: write d3/d12/d16/d22/f7a [863358,16532] 0 2024-09-21T10:40:58.533 INFO:tasks.workunit.client.0.smithi060.stdout:3/366: creat d0/d1/f70 x:0 0 0 2024-09-21T10:40:58.537 INFO:tasks.workunit.client.0.smithi060.stdout:9/353: mkdir d3/d16/d1f/d79 0 2024-09-21T10:40:58.538 INFO:tasks.workunit.client.0.smithi060.stdout:7/368: symlink da/d60/d6e/l83 0 2024-09-21T10:40:58.538 INFO:tasks.workunit.client.0.smithi060.stdout:7/369: read da/d14/d25/d56/f58 [1177534,37644] 0 2024-09-21T10:40:58.550 INFO:tasks.workunit.client.0.smithi060.stdout:4/384: dwrite d0/f60 [4194304,4194304] 0 2024-09-21T10:40:58.555 INFO:tasks.workunit.client.0.smithi060.stdout:9/354: dwrite d3/d15/f2b [0,4194304] 0 2024-09-21T10:40:58.561 INFO:tasks.workunit.client.0.smithi060.stdout:2/192: mkdir d3/d20/d15/d3b 0 2024-09-21T10:40:58.565 INFO:tasks.workunit.client.0.smithi060.stdout:5/345: link d5/f8 d5/d45/d6d/d10/d19/d21/d30/d49/f78 0 2024-09-21T10:40:58.565 INFO:tasks.workunit.client.0.smithi060.stdout:5/346: stat d5/d45/l68 0 2024-09-21T10:40:58.565 INFO:tasks.workunit.client.0.smithi060.stdout:5/347: chown d5/c66 4 1 2024-09-21T10:40:58.565 INFO:tasks.workunit.client.0.smithi060.stdout:5/348: write d5/d45/d6d/d10/f1b [1605590,111340] 0 2024-09-21T10:40:58.565 INFO:tasks.workunit.client.0.smithi060.stdout:5/349: write d5/d45/d6d/d10/d19/f4e [963956,123059] 0 2024-09-21T10:40:58.567 INFO:tasks.workunit.client.0.smithi060.stdout:6/411: mknod d3/d12/d38/c7b 0 2024-09-21T10:40:58.569 INFO:tasks.workunit.client.0.smithi060.stdout:3/367: mknod d0/d1/d11/d2a/d64/c71 0 2024-09-21T10:40:58.569 INFO:tasks.workunit.client.0.smithi060.stdout:3/368: getdents d0/d1/d11/d53 0 2024-09-21T10:40:58.569 INFO:tasks.workunit.client.0.smithi060.stdout:8/393: truncate d2/f15 836419 0 2024-09-21T10:40:58.570 INFO:tasks.workunit.client.0.smithi060.stdout:8/394: chown d2/d18/d4b 393 1 2024-09-21T10:40:58.575 INFO:tasks.workunit.client.0.smithi060.stdout:4/385: creat d0/d5/d12/d15/f7b x:0 0 0 2024-09-21T10:40:58.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/355: symlink d3/l7a 0 2024-09-21T10:40:58.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/356: fdatasync d3/d15/f17 0 2024-09-21T10:40:58.580 INFO:tasks.workunit.client.0.smithi060.stdout:2/193: link d3/d20/d15/l19 d3/d20/d15/l3c 0 2024-09-21T10:40:58.581 INFO:tasks.workunit.client.0.smithi060.stdout:0/395: rmdir d5/d10/d4e 39 2024-09-21T10:40:58.581 INFO:tasks.workunit.client.0.smithi060.stdout:3/369: dwrite d0/f28 [0,4194304] 0 2024-09-21T10:40:58.585 INFO:tasks.workunit.client.0.smithi060.stdout:5/350: symlink d5/d45/d6d/d3b/l79 0 2024-09-21T10:40:58.588 INFO:tasks.workunit.client.0.smithi060.stdout:6/412: symlink d3/d12/d16/d25/d76/l7c 0 2024-09-21T10:40:58.591 INFO:tasks.workunit.client.0.smithi060.stdout:8/395: write d2/f46 [4756268,60528] 0 2024-09-21T10:40:58.592 INFO:tasks.workunit.client.0.smithi060.stdout:4/386: unlink d0/d5/d12/l63 0 2024-09-21T10:40:58.593 INFO:tasks.workunit.client.0.smithi060.stdout:4/387: dread - d0/d5/d12/f5f zero size 2024-09-21T10:40:58.595 INFO:tasks.workunit.client.0.smithi060.stdout:2/194: creat d3/d20/d15/f3d x:0 0 0 2024-09-21T10:40:58.595 INFO:tasks.workunit.client.0.smithi060.stdout:5/351: mkdir d5/d7a 0 2024-09-21T10:40:58.595 INFO:tasks.workunit.client.0.smithi060.stdout:5/352: chown d5/d7a 166133 1 2024-09-21T10:40:58.595 INFO:tasks.workunit.client.0.smithi060.stdout:5/353: creat d5/d45/d6d/d10/d19/f7b x:0 0 0 2024-09-21T10:40:58.597 INFO:tasks.workunit.client.0.smithi060.stdout:6/413: creat d3/d12/d16/d22/d58/d75/f7d x:0 0 0 2024-09-21T10:40:58.598 INFO:tasks.workunit.client.0.smithi060.stdout:9/357: dwrite d3/d16/d42/f5d [0,4194304] 0 2024-09-21T10:40:58.600 INFO:tasks.workunit.client.0.smithi060.stdout:8/396: unlink d2/d18/d4b/d4d/l6b 0 2024-09-21T10:40:58.602 INFO:tasks.workunit.client.0.smithi060.stdout:2/195: mknod d3/d20/d15/c3e 0 2024-09-21T10:40:58.603 INFO:tasks.workunit.client.0.smithi060.stdout:6/414: dread d3/d12/d16/d25/f28 [0,4194304] 0 2024-09-21T10:40:58.607 INFO:tasks.workunit.client.0.smithi060.stdout:5/354: symlink d5/d71/l7c 0 2024-09-21T10:40:58.607 INFO:tasks.workunit.client.0.smithi060.stdout:5/355: write d5/d45/d6d/d10/d19/f72 [440068,60256] 0 2024-09-21T10:40:58.607 INFO:tasks.workunit.client.0.smithi060.stdout:5/356: readlink d5/d45/d6d/d10/d19/d21/d30/d49/l4d 0 2024-09-21T10:40:58.612 INFO:tasks.workunit.client.0.smithi060.stdout:0/396: dwrite d5/d10/da/fc [0,4194304] 0 2024-09-21T10:40:58.614 INFO:tasks.workunit.client.0.smithi060.stdout:8/397: creat d2/d26/d37/d64/f87 x:0 0 0 2024-09-21T10:40:58.615 INFO:tasks.workunit.client.0.smithi060.stdout:6/415: mknod d3/c7e 0 2024-09-21T10:40:58.615 INFO:tasks.workunit.client.0.smithi060.stdout:6/416: fdatasync d3/d12/d16/d1a/d60/f73 0 2024-09-21T10:40:58.616 INFO:tasks.workunit.client.0.smithi060.stdout:2/196: link d3/d7/d24/f2a d3/d20/d15/d30/f3f 0 2024-09-21T10:40:58.617 INFO:tasks.workunit.client.0.smithi060.stdout:8/398: dread d2/d26/d37/f55 [0,4194304] 0 2024-09-21T10:40:58.617 INFO:tasks.workunit.client.0.smithi060.stdout:8/399: truncate d2/d26/d37/f55 436871 0 2024-09-21T10:40:58.617 INFO:tasks.workunit.client.0.smithi060.stdout:5/357: symlink d5/l7d 0 2024-09-21T10:40:58.617 INFO:tasks.workunit.client.0.smithi060.stdout:3/370: dwrite d0/d1/d1e/f4b [0,4194304] 0 2024-09-21T10:40:58.619 INFO:tasks.workunit.client.0.smithi060.stdout:8/400: unlink d2/d18/f69 0 2024-09-21T10:40:58.620 INFO:tasks.workunit.client.0.smithi060.stdout:9/358: dwrite d3/f10 [0,4194304] 0 2024-09-21T10:40:58.621 INFO:tasks.workunit.client.0.smithi060.stdout:5/358: unlink d5/d45/d6d/d10/d19/f32 0 2024-09-21T10:40:58.624 INFO:tasks.workunit.client.0.smithi060.stdout:6/417: write d3/d12/d16/d22/f48 [223047,23060] 0 2024-09-21T10:40:58.624 INFO:tasks.workunit.client.0.smithi060.stdout:6/418: truncate d3/d12/d16/d1a/f1e 4997057 0 2024-09-21T10:40:58.626 INFO:tasks.workunit.client.0.smithi060.stdout:3/371: rename d0/d1/d1e/f37 to d0/d1/d11/d2a/d64/f72 0 2024-09-21T10:40:58.626 INFO:tasks.workunit.client.0.smithi060.stdout:0/397: getdents d5/d10 0 2024-09-21T10:40:58.634 INFO:tasks.workunit.client.0.smithi060.stdout:9/359: dread d3/f4f [0,4194304] 0 2024-09-21T10:40:58.634 INFO:tasks.workunit.client.0.smithi060.stdout:2/197: dwrite d3/d7/d18/f3a [0,4194304] 0 2024-09-21T10:40:58.637 INFO:tasks.workunit.client.0.smithi060.stdout:8/401: creat d2/d26/d37/d62/f88 x:0 0 0 2024-09-21T10:40:58.639 INFO:tasks.workunit.client.0.smithi060.stdout:0/398: mkdir d5/d10/da/d20/d79 0 2024-09-21T10:40:58.642 INFO:tasks.workunit.client.0.smithi060.stdout:8/402: write d2/f1c [4406392,40656] 0 2024-09-21T10:40:58.642 INFO:tasks.workunit.client.0.smithi060.stdout:5/359: dwrite d5/d45/d6d/d10/d19/f33 [4194304,4194304] 0 2024-09-21T10:40:58.643 INFO:tasks.workunit.client.0.smithi060.stdout:3/372: dwrite d0/d1/d24/f25 [4194304,4194304] 0 2024-09-21T10:40:58.643 INFO:tasks.workunit.client.0.smithi060.stdout:3/373: getdents d0/d1/d11/d2a/d43 0 2024-09-21T10:40:58.645 INFO:tasks.workunit.client.0.smithi060.stdout:0/399: link d5/d10/da/d20/d4d/l54 d5/d10/d11/l7a 0 2024-09-21T10:40:58.645 INFO:tasks.workunit.client.0.smithi060.stdout:0/400: write d5/d10/da/d20/d45/d2a/d40/f70 [898123,17219] 0 2024-09-21T10:40:58.647 INFO:tasks.workunit.client.0.smithi060.stdout:8/403: unlink d2/d26/d37/d62/d77/c7b 0 2024-09-21T10:40:58.652 INFO:tasks.workunit.client.0.smithi060.stdout:5/360: read d5/d45/d5a/d3a/f5e [1054810,35611] 0 2024-09-21T10:40:58.656 INFO:tasks.workunit.client.0.smithi060.stdout:3/374: rename d0/d1/c36 to d0/d1/d11/d2a/d64/c73 0 2024-09-21T10:40:58.657 INFO:tasks.workunit.client.0.smithi060.stdout:8/404: mkdir d2/d26/d37/d62/d74/d83/d89 0 2024-09-21T10:40:58.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/198: dwrite f2 [4194304,4194304] 0 2024-09-21T10:40:58.661 INFO:tasks.workunit.client.0.smithi060.stdout:5/361: write d5/d45/d6d/d3e/d50/f59 [3082919,29907] 0 2024-09-21T10:40:58.663 INFO:tasks.workunit.client.0.smithi060.stdout:3/375: link d0/d1/d52/c6c d0/d1/d11/c74 0 2024-09-21T10:40:58.665 INFO:tasks.workunit.client.0.smithi060.stdout:8/405: creat d2/d26/d37/d62/d74/d83/d89/f8a x:0 0 0 2024-09-21T10:40:58.666 INFO:tasks.workunit.client.0.smithi060.stdout:2/199: write d3/d20/d15/d30/f3f [175325,33633] 0 2024-09-21T10:40:58.670 INFO:tasks.workunit.client.0.smithi060.stdout:3/376: rename d0/d1/d11/c55 to d0/d1/c75 0 2024-09-21T10:40:58.670 INFO:tasks.workunit.client.0.smithi060.stdout:3/377: truncate d0/d1/d1e/f4b 4712176 0 2024-09-21T10:40:58.671 INFO:tasks.workunit.client.0.smithi060.stdout:8/406: creat d2/d5a/f8b x:0 0 0 2024-09-21T10:40:58.675 INFO:tasks.workunit.client.0.smithi060.stdout:3/378: rmdir d0/d1/d11/d2a/d64 39 2024-09-21T10:40:58.675 INFO:tasks.workunit.client.0.smithi060.stdout:3/379: write d0/d1/d11/d46/f59 [5067660,8945] 0 2024-09-21T10:40:58.676 INFO:tasks.workunit.client.0.smithi060.stdout:5/362: dwrite d5/d45/d6d/d10/f1b [0,4194304] 0 2024-09-21T10:40:58.676 INFO:tasks.workunit.client.0.smithi060.stdout:5/363: creat d5/d45/d5a/f7e x:0 0 0 2024-09-21T10:40:58.686 INFO:tasks.workunit.client.0.smithi060.stdout:3/380: write d0/f28 [4506254,85101] 0 2024-09-21T10:40:58.688 INFO:tasks.workunit.client.0.smithi060.stdout:5/364: write d5/f7 [109713,69709] 0 2024-09-21T10:40:58.688 INFO:tasks.workunit.client.0.smithi060.stdout:8/407: rmdir d2/d26/d37/d62/d77 39 2024-09-21T10:40:58.688 INFO:tasks.workunit.client.0.smithi060.stdout:8/408: fdatasync d2/f1c 0 2024-09-21T10:40:58.690 INFO:tasks.workunit.client.0.smithi060.stdout:2/200: truncate f2 7635591 0 2024-09-21T10:40:58.695 INFO:tasks.workunit.client.0.smithi060.stdout:5/365: mkdir d5/d45/d6d/d10/d19/d21/d7f 0 2024-09-21T10:40:58.698 INFO:tasks.workunit.client.0.smithi060.stdout:8/409: mknod d2/d18/d4b/d4d/c8c 0 2024-09-21T10:40:58.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/201: truncate d3/d20/d15/d30/f3f 938419 0 2024-09-21T10:40:58.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/202: readlink d3/lf 0 2024-09-21T10:40:58.747 INFO:tasks.workunit.client.0.smithi060.stdout:5/366: dwrite d5/d45/d6d/f2b [4194304,4194304] 0 2024-09-21T10:40:58.763 INFO:tasks.workunit.client.0.smithi060.stdout:5/367: dwrite d5/d45/d6d/d3b/f74 [0,4194304] 0 2024-09-21T10:40:58.763 INFO:tasks.workunit.client.0.smithi060.stdout:5/368: rename d5 to d5/d45/d6d/d10/d19/d21/d30/d49/d80 22 2024-09-21T10:40:58.765 INFO:tasks.workunit.client.0.smithi060.stdout:5/369: mknod d5/d45/c81 0 2024-09-21T10:40:58.766 INFO:tasks.workunit.client.0.smithi060.stdout:5/370: symlink d5/d45/d6d/d3e/l82 0 2024-09-21T10:40:58.767 INFO:tasks.workunit.client.0.smithi060.stdout:5/371: creat d5/d45/d6d/d10/d19/d21/f83 x:0 0 0 2024-09-21T10:40:58.767 INFO:tasks.workunit.client.0.smithi060.stdout:5/372: readlink d5/d45/d6d/d3b/l5b 0 2024-09-21T10:40:58.768 INFO:tasks.workunit.client.0.smithi060.stdout:5/373: mkdir d5/d7a/d84 0 2024-09-21T10:40:58.771 INFO:tasks.workunit.client.0.smithi060.stdout:5/374: rmdir d5/d45/d5a 39 2024-09-21T10:40:58.771 INFO:tasks.workunit.client.0.smithi060.stdout:5/375: read d5/d45/d5a/f17 [1770339,45361] 0 2024-09-21T10:40:58.771 INFO:tasks.workunit.client.0.smithi060.stdout:5/376: readlink d5/d45/d6d/d3e/l6c 0 2024-09-21T10:40:58.771 INFO:tasks.workunit.client.0.smithi060.stdout:5/377: truncate d5/d45/f4b 926071 0 2024-09-21T10:40:58.788 INFO:tasks.workunit.client.0.smithi060.stdout:5/378: dwrite d5/d45/d6d/d10/d19/f4e [0,4194304] 0 2024-09-21T10:40:58.792 INFO:tasks.workunit.client.0.smithi060.stdout:5/379: creat d5/d45/f85 x:0 0 0 2024-09-21T10:40:58.794 INFO:tasks.workunit.client.0.smithi060.stdout:5/380: dread d5/d45/d5a/f20 [0,4194304] 0 2024-09-21T10:40:58.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/381: dread d5/d45/d5a/f62 [0,4194304] 0 2024-09-21T10:40:58.809 INFO:tasks.workunit.client.0.smithi060.stdout:5/382: dread d5/ff [0,4194304] 0 2024-09-21T10:40:58.818 INFO:tasks.workunit.client.0.smithi060.stdout:5/383: dread d5/d45/d6d/d3e/d50/f58 [0,4194304] 0 2024-09-21T10:40:58.819 INFO:tasks.workunit.client.0.smithi060.stdout:5/384: rename d5/f16 to d5/f86 0 2024-09-21T10:40:58.820 INFO:tasks.workunit.client.0.smithi060.stdout:5/385: mknod d5/d45/d6d/d10/d19/d21/d30/d49/c87 0 2024-09-21T10:40:58.822 INFO:tasks.workunit.client.0.smithi060.stdout:5/386: truncate d5/f7 1493950 0 2024-09-21T10:40:58.822 INFO:tasks.workunit.client.0.smithi060.stdout:5/387: chown d5/d45/d6d/l52 619567 1 2024-09-21T10:40:58.822 INFO:tasks.workunit.client.0.smithi060.stdout:5/388: fsync d5/d45/d6d/d10/f1b 0 2024-09-21T10:40:58.822 INFO:tasks.workunit.client.0.smithi060.stdout:5/389: dread d5/d45/d5a/f5d [0,4194304] 0 2024-09-21T10:40:58.824 INFO:tasks.workunit.client.0.smithi060.stdout:5/390: mkdir d5/d7a/d84/d88 0 2024-09-21T10:40:58.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/391: rmdir d5/d7a 39 2024-09-21T10:40:58.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/392: fdatasync d5/d45/d6d/d10/d19/d21/f44 0 2024-09-21T10:40:58.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/393: chown d5/f76 80098685 1 2024-09-21T10:40:58.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/394: fsync d5/d45/d5a/f62 0 2024-09-21T10:40:58.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/395: fsync d5/d45/d6d/d10/d19/f33 0 2024-09-21T10:40:58.829 INFO:tasks.workunit.client.0.smithi060.stdout:5/396: rename d5/d45/d6d/d3b to d5/d45/d6d/d10/d19/d21/d7f/d89 0 2024-09-21T10:40:58.848 INFO:tasks.workunit.client.0.smithi060.stdout:5/397: dwrite d5/d45/d6d/d3e/f57 [0,4194304] 0 2024-09-21T10:40:58.851 INFO:tasks.workunit.client.0.smithi060.stdout:1/376: sync 2024-09-21T10:40:58.851 INFO:tasks.workunit.client.0.smithi060.stdout:7/370: sync 2024-09-21T10:40:58.852 INFO:tasks.workunit.client.0.smithi060.stdout:5/398: dread d5/ff [0,4194304] 0 2024-09-21T10:40:58.853 INFO:tasks.workunit.client.0.smithi060.stdout:7/371: rename da/d14/d35/f36 to da/d60/f84 0 2024-09-21T10:40:58.854 INFO:tasks.workunit.client.0.smithi060.stdout:1/377: symlink d6/d24/da/d45/d47/l8a 0 2024-09-21T10:40:58.856 INFO:tasks.workunit.client.0.smithi060.stdout:7/372: link da/d14/d25/c42 da/d14/d35/d79/c85 0 2024-09-21T10:40:58.856 INFO:tasks.workunit.client.0.smithi060.stdout:7/373: read - da/d14/d25/d56/f75 zero size 2024-09-21T10:40:58.856 INFO:tasks.workunit.client.0.smithi060.stdout:7/374: creat da/d14/d2a/f86 x:0 0 0 2024-09-21T10:40:58.856 INFO:tasks.workunit.client.0.smithi060.stdout:7/375: creat da/d14/d2a/d49/d27/f87 x:0 0 0 2024-09-21T10:40:58.857 INFO:tasks.workunit.client.0.smithi060.stdout:1/378: mknod d6/d24/da/db/d1c/d4b/c8b 0 2024-09-21T10:40:58.859 INFO:tasks.workunit.client.0.smithi060.stdout:5/399: dread d5/d45/d5a/f17 [0,4194304] 0 2024-09-21T10:40:58.859 INFO:tasks.workunit.client.0.smithi060.stdout:5/400: write d5/d45/f4b [1122447,61523] 0 2024-09-21T10:40:58.860 INFO:tasks.workunit.client.0.smithi060.stdout:7/376: rename f0 to da/d14/d2a/d49/f88 0 2024-09-21T10:40:58.860 INFO:tasks.workunit.client.0.smithi060.stdout:7/377: readlink da/d14/d2a/l5c 0 2024-09-21T10:40:58.861 INFO:tasks.workunit.client.0.smithi060.stdout:1/379: link d6/d24/da/db/dd/l83 d6/d4a/l8c 0 2024-09-21T10:40:58.862 INFO:tasks.workunit.client.0.smithi060.stdout:7/378: truncate da/d14/d35/f1d 524228 0 2024-09-21T10:40:58.862 INFO:tasks.workunit.client.0.smithi060.stdout:7/379: creat da/f89 x:0 0 0 2024-09-21T10:40:58.862 INFO:tasks.workunit.client.0.smithi060.stdout:7/380: creat da/d14/d2a/d49/d27/f8a x:0 0 0 2024-09-21T10:40:58.862 INFO:tasks.workunit.client.0.smithi060.stdout:7/381: dread - da/d14/d15/f82 zero size 2024-09-21T10:40:58.867 INFO:tasks.workunit.client.0.smithi060.stdout:7/382: truncate da/d14/d2a/d49/f67 1099746 0 2024-09-21T10:40:58.868 INFO:tasks.workunit.client.0.smithi060.stdout:5/401: dread d5/d45/d6d/d10/d19/d21/d7f/d89/f74 [0,4194304] 0 2024-09-21T10:40:58.872 INFO:tasks.workunit.client.0.smithi060.stdout:5/402: mkdir d5/d45/d6d/d3e/d60/d61/d8a 0 2024-09-21T10:40:58.872 INFO:tasks.workunit.client.0.smithi060.stdout:5/403: write d5/d45/d6d/d10/d19/f7b [719437,73359] 0 2024-09-21T10:40:58.872 INFO:tasks.workunit.client.0.smithi060.stdout:5/404: getdents d5/d45/d6d/d10/d19/d21/d30 0 2024-09-21T10:40:58.877 INFO:tasks.workunit.client.0.smithi060.stdout:5/405: mknod d5/d45/d6d/d10/d19/d21/c8b 0 2024-09-21T10:40:58.877 INFO:tasks.workunit.client.0.smithi060.stdout:5/406: readlink d5/d71/l7c 0 2024-09-21T10:40:58.880 INFO:tasks.workunit.client.0.smithi060.stdout:5/407: creat d5/d45/d6d/d10/d19/d21/d7f/d89/f8c x:0 0 0 2024-09-21T10:40:58.880 INFO:tasks.workunit.client.0.smithi060.stdout:5/408: truncate d5/d45/d6d/d10/d19/d21/d7f/d89/f8c 110172 0 2024-09-21T10:40:58.880 INFO:tasks.workunit.client.0.smithi060.stdout:5/409: write d5/d45/f85 [607575,47487] 0 2024-09-21T10:40:58.884 INFO:tasks.workunit.client.0.smithi060.stdout:1/380: rmdir d6/d24/da/db/dd 39 2024-09-21T10:40:58.884 INFO:tasks.workunit.client.0.smithi060.stdout:1/381: read d6/f40 [172933,73452] 0 2024-09-21T10:40:58.884 INFO:tasks.workunit.client.0.smithi060.stdout:1/382: chown d6/d24/da/d45/d76/c81 394206 1 2024-09-21T10:40:58.889 INFO:tasks.workunit.client.0.smithi060.stdout:5/410: read d5/d45/d6d/d10/d19/f31 [282490,88953] 0 2024-09-21T10:40:58.893 INFO:tasks.workunit.client.0.smithi060.stdout:1/383: read d6/d24/fc [8913443,65601] 0 2024-09-21T10:40:58.897 INFO:tasks.workunit.client.0.smithi060.stdout:1/384: link d6/f89 d6/d24/da/db/de/f8d 0 2024-09-21T10:40:58.899 INFO:tasks.workunit.client.0.smithi060.stdout:1/385: mknod d6/d24/da/db/de/d7c/c8e 0 2024-09-21T10:40:58.899 INFO:tasks.workunit.client.0.smithi060.stdout:1/386: dread - d6/d24/d50/f78 zero size 2024-09-21T10:40:58.907 INFO:tasks.workunit.client.0.smithi060.stdout:1/387: dread d6/d24/da/db/f56 [0,4194304] 0 2024-09-21T10:40:58.908 INFO:tasks.workunit.client.0.smithi060.stdout:5/411: dwrite d5/f76 [0,4194304] 0 2024-09-21T10:40:58.912 INFO:tasks.workunit.client.0.smithi060.stdout:5/412: rename d5/d45/d6d/d3e to d5/d45/d6d/d10/d19/d8d 0 2024-09-21T10:40:58.912 INFO:tasks.workunit.client.0.smithi060.stdout:5/413: truncate d5/d45/d5a/f7e 386816 0 2024-09-21T10:40:58.912 INFO:tasks.workunit.client.0.smithi060.stdout:5/414: write d5/f8 [3501716,95418] 0 2024-09-21T10:40:58.914 INFO:tasks.workunit.client.0.smithi060.stdout:1/388: read d6/d24/da/db/d1c/f36 [3496912,90085] 0 2024-09-21T10:40:58.915 INFO:tasks.workunit.client.0.smithi060.stdout:1/389: rename d6/d24/d50/f88 to d6/d24/d50/f8f 0 2024-09-21T10:40:58.918 INFO:tasks.workunit.client.0.smithi060.stdout:1/390: mkdir d6/d24/da/db/d7e/d90 0 2024-09-21T10:40:58.918 INFO:tasks.workunit.client.0.smithi060.stdout:1/391: stat d6/d24/da/db/c7f 0 2024-09-21T10:40:58.926 INFO:tasks.workunit.client.0.smithi060.stdout:5/415: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/f8c [0,4194304] 0 2024-09-21T10:40:58.926 INFO:tasks.workunit.client.0.smithi060.stdout:5/416: stat d5/d45/d6d/d10/d19/d21/d30/d49/l4d 0 2024-09-21T10:40:58.926 INFO:tasks.workunit.client.0.smithi060.stdout:5/417: chown d5/d45/d6d/d10/d19/d21/d30/d49/l4d 16564728 1 2024-09-21T10:40:58.945 INFO:tasks.workunit.client.0.smithi060.stdout:1/392: dwrite d6/d24/f59 [0,4194304] 0 2024-09-21T10:40:58.945 INFO:tasks.workunit.client.0.smithi060.stdout:5/418: dwrite d5/d45/d5a/f62 [0,4194304] 0 2024-09-21T10:40:58.952 INFO:tasks.workunit.client.0.smithi060.stdout:1/393: truncate d6/d24/da/db/de/f1a 1322792 0 2024-09-21T10:40:58.971 INFO:tasks.workunit.client.0.smithi060.stdout:5/419: dwrite d5/d45/d6d/d10/d19/f7b [0,4194304] 0 2024-09-21T10:40:58.971 INFO:tasks.workunit.client.0.smithi060.stdout:1/394: dwrite d6/d24/da/db/de/f38 [0,4194304] 0 2024-09-21T10:40:58.972 INFO:tasks.workunit.client.0.smithi060.stdout:5/420: truncate d5/d45/d6d/d10/d19/d21/d7f/d89/f74 417962 0 2024-09-21T10:40:58.975 INFO:tasks.workunit.client.0.smithi060.stdout:5/421: symlink d5/d45/d77/l8e 0 2024-09-21T10:40:58.976 INFO:tasks.workunit.client.0.smithi060.stdout:1/395: rmdir d6/d24/da/d45/d76 39 2024-09-21T10:40:58.979 INFO:tasks.workunit.client.0.smithi060.stdout:1/396: truncate d6/d24/da/db/de/f21 1416997 0 2024-09-21T10:40:58.983 INFO:tasks.workunit.client.0.smithi060.stdout:5/422: dread d5/f76 [0,4194304] 0 2024-09-21T10:40:58.985 INFO:tasks.workunit.client.0.smithi060.stdout:1/397: write d6/d24/da/db/d1c/f4c [2221451,66420] 0 2024-09-21T10:40:58.985 INFO:tasks.workunit.client.0.smithi060.stdout:5/423: mkdir d5/d45/d77/d8f 0 2024-09-21T10:40:58.988 INFO:tasks.workunit.client.0.smithi060.stdout:1/398: mknod d6/d24/d50/c91 0 2024-09-21T10:40:58.989 INFO:tasks.workunit.client.0.smithi060.stdout:5/424: creat d5/d45/d6d/d10/f90 x:0 0 0 2024-09-21T10:40:58.992 INFO:tasks.workunit.client.0.smithi060.stdout:1/399: write d6/d24/da/db/de/f1a [631795,37595] 0 2024-09-21T10:40:58.992 INFO:tasks.workunit.client.0.smithi060.stdout:1/400: fdatasync d6/d24/da/db/de/d32/f60 0 2024-09-21T10:40:58.993 INFO:tasks.workunit.client.0.smithi060.stdout:5/425: truncate d5/d45/d6d/d10/d19/d21/f2d 329324 0 2024-09-21T10:40:58.996 INFO:tasks.workunit.client.0.smithi060.stdout:1/401: rmdir d6/d24/da/db/de/d32 39 2024-09-21T10:40:59.002 INFO:tasks.workunit.client.0.smithi060.stdout:1/402: creat d6/d24/da/db/dd/f92 x:0 0 0 2024-09-21T10:40:59.015 INFO:tasks.workunit.client.0.smithi060.stdout:1/403: dwrite d6/d4a/d5a/f5e [4194304,4194304] 0 2024-09-21T10:40:59.016 INFO:tasks.workunit.client.0.smithi060.stdout:1/404: symlink d6/d24/da/db/d79/d86/l93 0 2024-09-21T10:40:59.018 INFO:tasks.workunit.client.0.smithi060.stdout:1/405: unlink d6/d24/da/db/d1c/c7b 0 2024-09-21T10:40:59.019 INFO:tasks.workunit.client.0.smithi060.stdout:1/406: stat d6/d24/da 0 2024-09-21T10:40:59.019 INFO:tasks.workunit.client.0.smithi060.stdout:1/407: read - d6/d24/da/db/f29 zero size 2024-09-21T10:40:59.027 INFO:tasks.workunit.client.0.smithi060.stdout:4/388: sync 2024-09-21T10:40:59.027 INFO:tasks.workunit.client.0.smithi060.stdout:6/419: sync 2024-09-21T10:40:59.027 INFO:tasks.workunit.client.0.smithi060.stdout:6/420: write d3/dd/f14 [1143813,126954] 0 2024-09-21T10:40:59.027 INFO:tasks.workunit.client.0.smithi060.stdout:6/421: fdatasync d3/dd/f64 0 2024-09-21T10:40:59.029 INFO:tasks.workunit.client.0.smithi060.stdout:6/422: mkdir d3/d12/d65/d7f 0 2024-09-21T10:40:59.029 INFO:tasks.workunit.client.0.smithi060.stdout:6/423: dread - d3/d12/d16/d25/d27/f61 zero size 2024-09-21T10:40:59.031 INFO:tasks.workunit.client.0.smithi060.stdout:6/424: unlink d3/d12/d38/l79 0 2024-09-21T10:40:59.032 INFO:tasks.workunit.client.0.smithi060.stdout:6/425: unlink d3/d12/d16/d1a/f3c 0 2024-09-21T10:40:59.032 INFO:tasks.workunit.client.0.smithi060.stdout:6/426: stat d3/d12/d16/d1a/d21/f23 0 2024-09-21T10:40:59.033 INFO:tasks.workunit.client.0.smithi060.stdout:1/408: dwrite d6/d24/da/db/de/f18 [0,4194304] 0 2024-09-21T10:40:59.033 INFO:tasks.workunit.client.0.smithi060.stdout:6/427: symlink d3/d12/d16/d5b/l80 0 2024-09-21T10:40:59.038 INFO:tasks.workunit.client.0.smithi060.stdout:4/389: write d0/d3c/d69/d6a/d6b/f22 [4147902,18897] 0 2024-09-21T10:40:59.043 INFO:tasks.workunit.client.0.smithi060.stdout:1/409: symlink d6/d24/da/db/de/d32/l94 0 2024-09-21T10:40:59.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/428: link d3/d54/l67 d3/d12/d16/d1a/d21/l81 0 2024-09-21T10:40:59.044 INFO:tasks.workunit.client.0.smithi060.stdout:6/429: creat d3/d12/d65/f82 x:0 0 0 2024-09-21T10:40:59.047 INFO:tasks.workunit.client.0.smithi060.stdout:4/390: symlink d0/d3c/d69/d6a/d6b/d32/l7c 0 2024-09-21T10:40:59.060 INFO:tasks.workunit.client.0.smithi060.stdout:6/430: dwrite d3/d12/d16/d1a/d60/f73 [0,4194304] 0 2024-09-21T10:40:59.060 INFO:tasks.workunit.client.0.smithi060.stdout:6/431: readlink d3/d12/d16/l2e 0 2024-09-21T10:40:59.104 INFO:tasks.workunit.client.0.smithi060.stdout:1/410: mkdir d6/d24/da/db/d79/d86/d95 0 2024-09-21T10:40:59.106 INFO:tasks.workunit.client.0.smithi060.stdout:4/391: truncate d0/d5/d12/d16/f47 913780 0 2024-09-21T10:40:59.110 INFO:tasks.workunit.client.0.smithi060.stdout:6/432: mkdir d3/d12/d16/d1a/d83 0 2024-09-21T10:40:59.112 INFO:tasks.workunit.client.0.smithi060.stdout:1/411: rmdir d6/d24/da/db/d7e 39 2024-09-21T10:40:59.117 INFO:tasks.workunit.client.0.smithi060.stdout:4/392: mkdir d0/d3c/d67/d7d 0 2024-09-21T10:40:59.117 INFO:tasks.workunit.client.0.smithi060.stdout:4/393: fsync d0/d3c/d69/d6a/d6b/f45 0 2024-09-21T10:40:59.118 INFO:tasks.workunit.client.0.smithi060.stdout:6/433: mknod d3/d12/d65/d66/c84 0 2024-09-21T10:40:59.119 INFO:tasks.workunit.client.0.smithi060.stdout:1/412: symlink d6/d24/da/db/de/d7c/l96 0 2024-09-21T10:40:59.124 INFO:tasks.workunit.client.0.smithi060.stdout:6/434: creat d3/d12/d16/d25/d76/f85 x:0 0 0 2024-09-21T10:40:59.124 INFO:tasks.workunit.client.0.smithi060.stdout:4/394: rmdir d0/d3c/d69/d6a/d6b/d32/d57 39 2024-09-21T10:40:59.128 INFO:tasks.workunit.client.0.smithi060.stdout:1/413: write d6/f44 [3204789,69432] 0 2024-09-21T10:40:59.129 INFO:tasks.workunit.client.0.smithi060.stdout:6/435: mknod d3/d12/d16/d5b/c86 0 2024-09-21T10:40:59.129 INFO:tasks.workunit.client.0.smithi060.stdout:6/436: write d3/d12/d16/d22/d58/d75/f7d [656282,94673] 0 2024-09-21T10:40:59.129 INFO:tasks.workunit.client.0.smithi060.stdout:6/437: stat d3/d12/d16/f40 0 2024-09-21T10:40:59.132 INFO:tasks.workunit.client.0.smithi060.stdout:6/438: mknod d3/d12/c87 0 2024-09-21T10:40:59.133 INFO:tasks.workunit.client.0.smithi060.stdout:4/395: dread d0/d5/f66 [0,4194304] 0 2024-09-21T10:40:59.138 INFO:tasks.workunit.client.0.smithi060.stdout:6/439: rmdir d3/d12/d38/d41 39 2024-09-21T10:40:59.143 INFO:tasks.workunit.client.0.smithi060.stdout:4/396: dread d0/d5/d12/d16/d28/f3b [0,4194304] 0 2024-09-21T10:40:59.149 INFO:tasks.workunit.client.0.smithi060.stdout:1/414: dwrite d6/d24/da/db/d1c/f36 [4194304,4194304] 0 2024-09-21T10:40:59.174 INFO:tasks.workunit.client.0.smithi060.stdout:6/440: rename d3/d12/d16/d22/f4a to d3/d12/d16/d1a/d21/f88 0 2024-09-21T10:40:59.179 INFO:tasks.workunit.client.0.smithi060.stdout:4/397: truncate d0/d5/d3a/f5d 987408 0 2024-09-21T10:40:59.181 INFO:tasks.workunit.client.0.smithi060.stdout:6/441: mkdir d3/d12/d16/d22/d5d/d70/d89 0 2024-09-21T10:40:59.182 INFO:tasks.workunit.client.0.smithi060.stdout:4/398: creat d0/d3c/d69/d6a/d6b/d32/f7e x:0 0 0 2024-09-21T10:40:59.184 INFO:tasks.workunit.client.0.smithi060.stdout:6/442: truncate d3/d12/f51 1849689 0 2024-09-21T10:40:59.184 INFO:tasks.workunit.client.0.smithi060.stdout:6/443: dread - d3/d12/d38/d41/f4d zero size 2024-09-21T10:40:59.185 INFO:tasks.workunit.client.0.smithi060.stdout:4/399: symlink d0/d3c/d69/d6a/d6b/d65/d51/l7f 0 2024-09-21T10:40:59.186 INFO:tasks.workunit.client.0.smithi060.stdout:6/444: truncate d3/d12/d16/d22/f48 57258 0 2024-09-21T10:40:59.187 INFO:tasks.workunit.client.0.smithi060.stdout:4/400: creat d0/d5/d12/d15/d72/f80 x:0 0 0 2024-09-21T10:40:59.187 INFO:tasks.workunit.client.0.smithi060.stdout:4/401: write d0/d5/d12/f73 [441242,90410] 0 2024-09-21T10:40:59.188 INFO:tasks.workunit.client.0.smithi060.stdout:6/445: mknod d3/d12/d65/d66/c8a 0 2024-09-21T10:40:59.189 INFO:tasks.workunit.client.0.smithi060.stdout:4/402: creat d0/d3c/f81 x:0 0 0 2024-09-21T10:40:59.190 INFO:tasks.workunit.client.0.smithi060.stdout:6/446: truncate d3/d12/d38/f3a 950744 0 2024-09-21T10:40:59.191 INFO:tasks.workunit.client.0.smithi060.stdout:4/403: chown d0/d3c/d69/d6a/d6b/d32/d57/l4c 384564 1 2024-09-21T10:40:59.196 INFO:tasks.workunit.client.0.smithi060.stdout:4/404: truncate d0/d5/d12/d16/f47 144977 0 2024-09-21T10:40:59.197 INFO:tasks.workunit.client.0.smithi060.stdout:6/447: rmdir d3/d12/d16/d25/d76 39 2024-09-21T10:40:59.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/448: write d3/d12/d16/d25/f28 [890459,21297] 0 2024-09-21T10:40:59.212 INFO:tasks.workunit.client.0.smithi060.stdout:6/449: mknod d3/d12/d65/d66/c8b 0 2024-09-21T10:40:59.212 INFO:tasks.workunit.client.0.smithi060.stdout:4/405: dwrite d0/f60 [4194304,4194304] 0 2024-09-21T10:40:59.212 INFO:tasks.workunit.client.0.smithi060.stdout:4/406: chown d0/d5/d12/d15/d72/f80 4 1 2024-09-21T10:40:59.214 INFO:tasks.workunit.client.0.smithi060.stdout:4/407: symlink d0/d3c/d69/d6a/d6b/d65/d51/l82 0 2024-09-21T10:40:59.224 INFO:tasks.workunit.client.0.smithi060.stdout:4/408: rename d0/d3c/d69 to d0/d83 0 2024-09-21T10:40:59.225 INFO:tasks.workunit.client.0.smithi060.stdout:4/409: read d0/d5/d12/f73 [269461,117036] 0 2024-09-21T10:40:59.226 INFO:tasks.workunit.client.0.smithi060.stdout:4/410: truncate d0/fc 3978256 0 2024-09-21T10:40:59.227 INFO:tasks.workunit.client.0.smithi060.stdout:6/450: dwrite d3/d12/d65/f6c [0,4194304] 0 2024-09-21T10:40:59.227 INFO:tasks.workunit.client.0.smithi060.stdout:6/451: write d3/d12/d16/d25/f28 [3712569,41164] 0 2024-09-21T10:40:59.228 INFO:tasks.workunit.client.0.smithi060.stdout:4/411: mkdir d0/df/d84 0 2024-09-21T10:40:59.233 INFO:tasks.workunit.client.0.smithi060.stdout:6/452: symlink d3/d12/d16/d1a/l8c 0 2024-09-21T10:40:59.233 INFO:tasks.workunit.client.0.smithi060.stdout:6/453: dread - d3/f52 zero size 2024-09-21T10:40:59.237 INFO:tasks.workunit.client.0.smithi060.stdout:6/454: dread d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:40:59.239 INFO:tasks.workunit.client.0.smithi060.stdout:6/455: creat d3/d12/d38/f8d x:0 0 0 2024-09-21T10:40:59.240 INFO:tasks.workunit.client.0.smithi060.stdout:6/456: creat d3/dd/f8e x:0 0 0 2024-09-21T10:40:59.240 INFO:tasks.workunit.client.0.smithi060.stdout:6/457: fdatasync d3/dd/f14 0 2024-09-21T10:40:59.242 INFO:tasks.workunit.client.0.smithi060.stdout:6/458: symlink d3/d12/d65/l8f 0 2024-09-21T10:40:59.242 INFO:tasks.workunit.client.0.smithi060.stdout:6/459: chown d3/d12/d16/d1a/d21/l81 203765222 1 2024-09-21T10:40:59.242 INFO:tasks.workunit.client.0.smithi060.stdout:6/460: write d3/d12/d38/d41/f4d [151145,26033] 0 2024-09-21T10:40:59.263 INFO:tasks.workunit.client.0.smithi060.stdout:6/461: dwrite d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:40:59.263 INFO:tasks.workunit.client.0.smithi060.stdout:6/462: readlink d3/d12/d65/l72 0 2024-09-21T10:40:59.263 INFO:tasks.workunit.client.0.smithi060.stdout:6/463: fsync d3/d12/d16/d25/f45 0 2024-09-21T10:40:59.263 INFO:tasks.workunit.client.0.smithi060.stdout:6/464: readlink d3/d54/l67 0 2024-09-21T10:40:59.318 INFO:tasks.workunit.client.0.smithi060.stdout:6/465: truncate d3/d12/d38/f3a 326746 0 2024-09-21T10:40:59.320 INFO:tasks.workunit.client.0.smithi060.stdout:6/466: unlink d3/d12/d65/l72 0 2024-09-21T10:40:59.320 INFO:tasks.workunit.client.0.smithi060.stdout:6/467: stat d3/d12/d38/d41/f46 0 2024-09-21T10:40:59.320 INFO:tasks.workunit.client.0.smithi060.stdout:6/468: chown d3/d12/d16/d25/f3e 12 1 2024-09-21T10:40:59.323 INFO:tasks.workunit.client.0.smithi060.stdout:9/360: sync 2024-09-21T10:40:59.337 INFO:tasks.workunit.client.0.smithi060.stdout:6/469: dwrite d3/d12/d38/f8d [0,4194304] 0 2024-09-21T10:40:59.345 INFO:tasks.workunit.client.0.smithi060.stdout:6/470: read d3/d12/d38/f8d [3908891,73780] 0 2024-09-21T10:40:59.346 INFO:tasks.workunit.client.0.smithi060.stdout:6/471: mkdir d3/d12/d16/d1a/d21/d90 0 2024-09-21T10:40:59.349 INFO:tasks.workunit.client.0.smithi060.stdout:6/472: mknod d3/d12/d16/d22/c91 0 2024-09-21T10:40:59.381 INFO:tasks.workunit.client.0.smithi060.stdout:0/401: sync 2024-09-21T10:40:59.381 INFO:tasks.workunit.client.0.smithi060.stdout:0/402: fdatasync d5/d10/da/fc 0 2024-09-21T10:40:59.389 INFO:tasks.workunit.client.0.smithi060.stdout:0/403: rename d5/d10/da/d15/f72 to d5/d10/f7b 0 2024-09-21T10:40:59.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/404: rename d5/d10/d11/f57 to d5/d10/da/d20/d45/d2a/d40/d75/f7c 0 2024-09-21T10:40:59.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/405: chown d5/d10/da/d20/d45/f27 20987031 1 2024-09-21T10:40:59.391 INFO:tasks.workunit.client.0.smithi060.stdout:0/406: fdatasync d5/d10/d11/f28 0 2024-09-21T10:40:59.392 INFO:tasks.workunit.client.0.smithi060.stdout:0/407: stat d5/d10/d11/c18 0 2024-09-21T10:40:59.392 INFO:tasks.workunit.client.0.smithi060.stdout:0/408: creat d5/d10/da/d15/f7d x:0 0 0 2024-09-21T10:40:59.394 INFO:tasks.workunit.client.0.smithi060.stdout:0/409: unlink d5/d10/da/d2d/l36 0 2024-09-21T10:40:59.394 INFO:tasks.workunit.client.0.smithi060.stdout:0/410: stat d5/d10/da/d20/d45/l37 0 2024-09-21T10:40:59.395 INFO:tasks.workunit.client.0.smithi060.stdout:0/411: readlink d5/d10/da/d2f/l67 0 2024-09-21T10:40:59.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/412: write d5/f3e [808617,66497] 0 2024-09-21T10:40:59.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/413: chown d5/d10/da/d20/d45/d2a/l38 13 1 2024-09-21T10:40:59.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/414: chown d5/d10/da/d20/d45/d2a/d40 106 1 2024-09-21T10:40:59.419 INFO:tasks.workunit.client.0.smithi060.stdout:0/415: dwrite d5/d10/da/d20/d45/f30 [0,4194304] 0 2024-09-21T10:40:59.419 INFO:tasks.workunit.client.0.smithi060.stdout:0/416: chown d5/d10/d11/l7a 442536 1 2024-09-21T10:40:59.421 INFO:tasks.workunit.client.0.smithi060.stdout:0/417: symlink d5/d10/da/d20/d79/l7e 0 2024-09-21T10:40:59.433 INFO:tasks.workunit.client.0.smithi060.stdout:0/418: dwrite d5/d10/d4e/f51 [0,4194304] 0 2024-09-21T10:40:59.436 INFO:tasks.workunit.client.0.smithi060.stdout:0/419: getdents d5/d10/d43 0 2024-09-21T10:40:59.436 INFO:tasks.workunit.client.0.smithi060.stdout:0/420: truncate d5/d10/f60 297996 0 2024-09-21T10:40:59.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/421: dwrite d5/d10/da/d4b/f71 [0,4194304] 0 2024-09-21T10:40:59.452 INFO:tasks.workunit.client.0.smithi060.stdout:0/422: write d5/d10/da/d20/d4d/f6e [131249,66771] 0 2024-09-21T10:40:59.452 INFO:tasks.workunit.client.0.smithi060.stdout:0/423: creat d5/d10/da/d20/d45/d2a/f7f x:0 0 0 2024-09-21T10:40:59.455 INFO:tasks.workunit.client.0.smithi060.stdout:0/424: creat d5/d10/da/d20/d45/d2a/d40/d48/d63/f80 x:0 0 0 2024-09-21T10:40:59.457 INFO:tasks.workunit.client.0.smithi060.stdout:0/425: creat d5/d10/da/f81 x:0 0 0 2024-09-21T10:40:59.457 INFO:tasks.workunit.client.0.smithi060.stdout:0/426: write d5/d10/da/d20/d45/d2a/f6c [928866,102631] 0 2024-09-21T10:40:59.458 INFO:tasks.workunit.client.0.smithi060.stdout:0/427: chown d5/d10/d4e/l77 1672174 1 2024-09-21T10:40:59.458 INFO:tasks.workunit.client.0.smithi060.stdout:0/428: fdatasync d5/f56 0 2024-09-21T10:40:59.458 INFO:tasks.workunit.client.0.smithi060.stdout:0/429: chown d5/d10/da/d2f 1379 1 2024-09-21T10:40:59.458 INFO:tasks.workunit.client.0.smithi060.stdout:0/430: truncate d5/d10/f7b 478743 0 2024-09-21T10:40:59.459 INFO:tasks.workunit.client.0.smithi060.stdout:0/431: mknod d5/d10/da/d20/d45/d2a/d40/c82 0 2024-09-21T10:40:59.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/432: dwrite d5/d10/d11/f28 [4194304,4194304] 0 2024-09-21T10:40:59.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/433: truncate d5/d10/da/d20/d45/d2a/f5c 827269 0 2024-09-21T10:40:59.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/434: truncate d5/f25 1217283 0 2024-09-21T10:40:59.475 INFO:tasks.workunit.client.0.smithi060.stdout:0/435: rmdir d5/d10/da/d20/d45/d2a/d40/d48 39 2024-09-21T10:40:59.475 INFO:tasks.workunit.client.0.smithi060.stdout:0/436: readlink d5/d10/da/d20/d79/l7e 0 2024-09-21T10:40:59.475 INFO:tasks.workunit.client.0.smithi060.stdout:0/437: stat d5/d10/da/d20/d45/d2a/f5c 0 2024-09-21T10:40:59.476 INFO:tasks.workunit.client.0.smithi060.stdout:0/438: symlink d5/d10/d11/l83 0 2024-09-21T10:40:59.476 INFO:tasks.workunit.client.0.smithi060.stdout:0/439: dread - d5/d10/da/d2f/f6b zero size 2024-09-21T10:40:59.495 INFO:tasks.workunit.client.0.smithi060.stdout:0/440: dwrite d5/d10/da/d2f/f64 [0,4194304] 0 2024-09-21T10:40:59.497 INFO:tasks.workunit.client.0.smithi060.stdout:0/441: rmdir d5/d10/da/d20/d79 39 2024-09-21T10:40:59.500 INFO:tasks.workunit.client.0.smithi060.stdout:0/442: link d5/f21 d5/d10/da/f84 0 2024-09-21T10:40:59.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/443: rmdir d5/d10/da 39 2024-09-21T10:40:59.531 INFO:tasks.workunit.client.0.smithi060.stdout:0/444: dwrite d5/d10/da/d20/d45/d2a/d40/d75/f7c [0,4194304] 0 2024-09-21T10:40:59.531 INFO:tasks.workunit.client.0.smithi060.stdout:0/445: fdatasync d5/d10/da/d20/d45/f4f 0 2024-09-21T10:40:59.531 INFO:tasks.workunit.client.0.smithi060.stdout:0/446: write d5/f56 [635872,32015] 0 2024-09-21T10:40:59.534 INFO:tasks.workunit.client.0.smithi060.stdout:0/447: rename d5/d10/da/d20/d45/d2a/l38 to d5/d10/da/d20/d4d/l85 0 2024-09-21T10:40:59.536 INFO:tasks.workunit.client.0.smithi060.stdout:0/448: creat d5/d10/da/f86 x:0 0 0 2024-09-21T10:40:59.544 INFO:tasks.workunit.client.0.smithi060.stdout:0/449: write d5/d10/da/fc [1317592,7402] 0 2024-09-21T10:40:59.547 INFO:tasks.workunit.client.0.smithi060.stdout:0/450: creat d5/d10/da/d20/d4d/f87 x:0 0 0 2024-09-21T10:40:59.548 INFO:tasks.workunit.client.0.smithi060.stdout:0/451: symlink d5/d10/da/l88 0 2024-09-21T10:40:59.549 INFO:tasks.workunit.client.0.smithi060.stdout:0/452: rmdir d5/d10/d11 39 2024-09-21T10:40:59.550 INFO:tasks.workunit.client.0.smithi060.stdout:0/453: symlink d5/d10/da/d20/d45/d2a/d40/l89 0 2024-09-21T10:40:59.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/454: dread d5/d10/f60 [0,4194304] 0 2024-09-21T10:40:59.552 INFO:tasks.workunit.client.0.smithi060.stdout:0/455: dread - d5/d10/d43/f5d zero size 2024-09-21T10:40:59.552 INFO:tasks.workunit.client.0.smithi060.stdout:0/456: readlink d5/d10/d11/l83 0 2024-09-21T10:40:59.552 INFO:tasks.workunit.client.0.smithi060.stdout:0/457: symlink d5/d10/da/d20/d79/l8a 0 2024-09-21T10:40:59.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/458: creat d5/d10/da/d4b/f8b x:0 0 0 2024-09-21T10:40:59.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/459: write d5/f56 [560294,47200] 0 2024-09-21T10:40:59.554 INFO:tasks.workunit.client.0.smithi060.stdout:0/460: write d5/f56 [1100134,99015] 0 2024-09-21T10:40:59.566 INFO:tasks.workunit.client.0.smithi060.stdout:0/461: dwrite d5/d10/da/f12 [0,4194304] 0 2024-09-21T10:40:59.567 INFO:tasks.workunit.client.0.smithi060.stdout:0/462: write f2 [2568455,18359] 0 2024-09-21T10:40:59.568 INFO:tasks.workunit.client.0.smithi060.stdout:0/463: unlink d5/d10/da/d20/c23 0 2024-09-21T10:40:59.571 INFO:tasks.workunit.client.0.smithi060.stdout:3/381: sync 2024-09-21T10:40:59.573 INFO:tasks.workunit.client.0.smithi060.stdout:3/382: link d0/d1/d52/l61 d0/l76 0 2024-09-21T10:40:59.573 INFO:tasks.workunit.client.0.smithi060.stdout:3/383: getdents d0/d1/d11/d2a/d43 0 2024-09-21T10:40:59.574 INFO:tasks.workunit.client.0.smithi060.stdout:3/384: creat d0/d1/d11/f77 x:0 0 0 2024-09-21T10:40:59.575 INFO:tasks.workunit.client.0.smithi060.stdout:3/385: mknod d0/d1/d11/d46/c78 0 2024-09-21T10:40:59.575 INFO:tasks.workunit.client.0.smithi060.stdout:3/386: write d0/f21 [3674483,9179] 0 2024-09-21T10:40:59.576 INFO:tasks.workunit.client.0.smithi060.stdout:3/387: unlink d0/d1/d11/c74 0 2024-09-21T10:40:59.578 INFO:tasks.workunit.client.0.smithi060.stdout:3/388: symlink d0/d1/d11/d2a/d43/l79 0 2024-09-21T10:40:59.579 INFO:tasks.workunit.client.0.smithi060.stdout:3/389: symlink d0/d1/d52/l7a 0 2024-09-21T10:40:59.583 INFO:tasks.workunit.client.0.smithi060.stdout:0/464: dwrite d5/d10/da/d2f/f6b [0,4194304] 0 2024-09-21T10:40:59.588 INFO:tasks.workunit.client.0.smithi060.stdout:3/390: dread d0/d1/f20 [0,4194304] 0 2024-09-21T10:40:59.589 INFO:tasks.workunit.client.0.smithi060.stdout:3/391: symlink d0/d1/d52/l7b 0 2024-09-21T10:40:59.592 INFO:tasks.workunit.client.0.smithi060.stdout:3/392: unlink d0/d1/d11/d2a/d43/d4e/c54 0 2024-09-21T10:40:59.595 INFO:tasks.workunit.client.0.smithi060.stdout:3/393: creat d0/d1/d52/f7c x:0 0 0 2024-09-21T10:40:59.606 INFO:tasks.workunit.client.0.smithi060.stdout:0/465: dwrite d5/d10/da/d20/d45/d2a/f5c [0,4194304] 0 2024-09-21T10:40:59.610 INFO:tasks.workunit.client.0.smithi060.stdout:3/394: dwrite d0/d1/d24/f25 [4194304,4194304] 0 2024-09-21T10:40:59.632 INFO:tasks.workunit.client.0.smithi060.stdout:0/466: symlink d5/d10/da/d2f/d66/l8c 0 2024-09-21T10:40:59.632 INFO:tasks.workunit.client.0.smithi060.stdout:0/467: fsync d5/d10/da/d20/d45/f4f 0 2024-09-21T10:40:59.633 INFO:tasks.workunit.client.0.smithi060.stdout:0/468: dread d5/d10/f5a [0,4194304] 0 2024-09-21T10:40:59.634 INFO:tasks.workunit.client.0.smithi060.stdout:0/469: dread d5/d10/f7b [0,4194304] 0 2024-09-21T10:40:59.645 INFO:tasks.workunit.client.0.smithi060.stdout:3/395: getdents d0/d1/d11/d46 0 2024-09-21T10:40:59.646 INFO:tasks.workunit.client.0.smithi060.stdout:8/410: sync 2024-09-21T10:40:59.646 INFO:tasks.workunit.client.0.smithi060.stdout:8/411: creat d2/d26/d37/d62/f8d x:0 0 0 2024-09-21T10:40:59.646 INFO:tasks.workunit.client.0.smithi060.stdout:0/470: mknod d5/d10/d4e/c8d 0 2024-09-21T10:40:59.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/396: rename d0/d1/f26 to d0/f7d 0 2024-09-21T10:40:59.649 INFO:tasks.workunit.client.0.smithi060.stdout:8/412: truncate d2/f46 4062383 0 2024-09-21T10:40:59.653 INFO:tasks.workunit.client.0.smithi060.stdout:0/471: symlink d5/d10/d4e/l8e 0 2024-09-21T10:40:59.654 INFO:tasks.workunit.client.0.smithi060.stdout:3/397: link d0/d1/d11/f32 d0/d1/d11/d2a/f7e 0 2024-09-21T10:40:59.657 INFO:tasks.workunit.client.0.smithi060.stdout:0/472: rename d5/d10/da/d20/d45/d2a/d40/d48/d63/f80 to d5/d10/d4e/f8f 0 2024-09-21T10:40:59.658 INFO:tasks.workunit.client.0.smithi060.stdout:0/473: dread d5/d10/f5a [0,4194304] 0 2024-09-21T10:40:59.660 INFO:tasks.workunit.client.0.smithi060.stdout:0/474: symlink d5/d10/da/d20/d45/d2a/d40/d75/l90 0 2024-09-21T10:40:59.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/361: sync 2024-09-21T10:40:59.660 INFO:tasks.workunit.client.0.smithi060.stdout:2/203: sync 2024-09-21T10:40:59.661 INFO:tasks.workunit.client.0.smithi060.stdout:4/412: sync 2024-09-21T10:40:59.661 INFO:tasks.workunit.client.0.smithi060.stdout:5/426: sync 2024-09-21T10:40:59.661 INFO:tasks.workunit.client.0.smithi060.stdout:1/415: sync 2024-09-21T10:40:59.661 INFO:tasks.workunit.client.0.smithi060.stdout:0/475: mknod d5/d10/da/d20/d45/d2a/d40/c91 0 2024-09-21T10:40:59.661 INFO:tasks.workunit.client.0.smithi060.stdout:0/476: truncate d5/f56 2021718 0 2024-09-21T10:40:59.663 INFO:tasks.workunit.client.0.smithi060.stdout:9/362: symlink d3/d5e/d60/d2f/l7b 0 2024-09-21T10:40:59.665 INFO:tasks.workunit.client.0.smithi060.stdout:0/477: mknod d5/d10/da/d20/d79/c92 0 2024-09-21T10:40:59.667 INFO:tasks.workunit.client.0.smithi060.stdout:5/427: getdents d5/d45/d6d 0 2024-09-21T10:40:59.667 INFO:tasks.workunit.client.0.smithi060.stdout:3/398: write d0/d1/d11/f32 [989765,8735] 0 2024-09-21T10:40:59.671 INFO:tasks.workunit.client.0.smithi060.stdout:0/478: creat d5/d10/da/d20/f93 x:0 0 0 2024-09-21T10:40:59.671 INFO:tasks.workunit.client.0.smithi060.stdout:0/479: chown d5/d10/da 971430 1 2024-09-21T10:40:59.671 INFO:tasks.workunit.client.0.smithi060.stdout:0/480: dread - d5/d10/da/f81 zero size 2024-09-21T10:40:59.672 INFO:tasks.workunit.client.0.smithi060.stdout:9/363: dread d3/f4f [0,4194304] 0 2024-09-21T10:40:59.674 INFO:tasks.workunit.client.0.smithi060.stdout:0/481: creat d5/d10/da/d20/d45/d2a/d76/f94 x:0 0 0 2024-09-21T10:40:59.674 INFO:tasks.workunit.client.0.smithi060.stdout:0/482: dread - d5/d10/da/d15/f7d zero size 2024-09-21T10:40:59.676 INFO:tasks.workunit.client.0.smithi060.stdout:3/399: rmdir d0/d1/d1e 39 2024-09-21T10:40:59.677 INFO:tasks.workunit.client.0.smithi060.stdout:2/204: dread d3/f5 [0,4194304] 0 2024-09-21T10:40:59.679 INFO:tasks.workunit.client.0.smithi060.stdout:9/364: truncate d3/d16/d1a/f28 625361 0 2024-09-21T10:40:59.681 INFO:tasks.workunit.client.0.smithi060.stdout:2/205: symlink d3/d20/l40 0 2024-09-21T10:40:59.685 INFO:tasks.workunit.client.0.smithi060.stdout:2/206: mknod d3/d7/c41 0 2024-09-21T10:40:59.685 INFO:tasks.workunit.client.0.smithi060.stdout:7/383: sync 2024-09-21T10:40:59.685 INFO:tasks.workunit.client.0.smithi060.stdout:7/384: truncate da/d14/d2a/d49/d27/f8a 952152 0 2024-09-21T10:40:59.685 INFO:tasks.workunit.client.0.smithi060.stdout:6/473: sync 2024-09-21T10:40:59.688 INFO:tasks.workunit.client.0.smithi060.stdout:2/207: rename d3/d7/la to d3/d7/l42 0 2024-09-21T10:40:59.688 INFO:tasks.workunit.client.0.smithi060.stdout:3/400: dread d0/d1/d24/f25 [0,4194304] 0 2024-09-21T10:40:59.688 INFO:tasks.workunit.client.0.smithi060.stdout:3/401: readlink d0/d1/d11/d2a/l4f 0 2024-09-21T10:40:59.688 INFO:tasks.workunit.client.0.smithi060.stdout:1/416: dwrite d6/d24/da/db/de/f77 [0,4194304] 0 2024-09-21T10:40:59.688 INFO:tasks.workunit.client.0.smithi060.stdout:1/417: truncate d6/d24/f3f 1120517 0 2024-09-21T10:40:59.689 INFO:tasks.workunit.client.0.smithi060.stdout:7/385: unlink da/d14/l34 0 2024-09-21T10:40:59.692 INFO:tasks.workunit.client.0.smithi060.stdout:6/474: rmdir d3/d12/d16/d1a/d21 39 2024-09-21T10:40:59.692 INFO:tasks.workunit.client.0.smithi060.stdout:6/475: chown d3/c56 258161 1 2024-09-21T10:40:59.692 INFO:tasks.workunit.client.0.smithi060.stdout:6/476: readlink d3/l8 0 2024-09-21T10:40:59.696 INFO:tasks.workunit.client.0.smithi060.stdout:2/208: read d3/d7/d23/f36 [2016234,86374] 0 2024-09-21T10:40:59.697 INFO:tasks.workunit.client.0.smithi060.stdout:7/386: mkdir da/d14/d15/d8b 0 2024-09-21T10:40:59.697 INFO:tasks.workunit.client.0.smithi060.stdout:7/387: chown da/d14/d15/ff 28791172 1 2024-09-21T10:40:59.698 INFO:tasks.workunit.client.0.smithi060.stdout:6/477: creat d3/d12/d16/d5b/f92 x:0 0 0 2024-09-21T10:40:59.701 INFO:tasks.workunit.client.0.smithi060.stdout:2/209: mkdir d3/d20/d15/d30/d43 0 2024-09-21T10:40:59.704 INFO:tasks.workunit.client.0.smithi060.stdout:7/388: mknod da/d14/d2a/d49/c8c 0 2024-09-21T10:40:59.704 INFO:tasks.workunit.client.0.smithi060.stdout:7/389: write da/d14/d2a/d49/d27/f44 [512941,120430] 0 2024-09-21T10:40:59.706 INFO:tasks.workunit.client.0.smithi060.stdout:2/210: mknod d3/d7/d24/c44 0 2024-09-21T10:40:59.707 INFO:tasks.workunit.client.0.smithi060.stdout:7/390: mknod da/d14/d35/d32/c8d 0 2024-09-21T10:40:59.709 INFO:tasks.workunit.client.0.smithi060.stdout:2/211: dread d3/d7/d24/f2a [0,4194304] 0 2024-09-21T10:40:59.709 INFO:tasks.workunit.client.0.smithi060.stdout:2/212: dread - d3/d20/d15/f3d zero size 2024-09-21T10:40:59.709 INFO:tasks.workunit.client.0.smithi060.stdout:7/391: symlink da/d14/d35/l8e 0 2024-09-21T10:40:59.711 INFO:tasks.workunit.client.0.smithi060.stdout:3/402: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:40:59.731 INFO:tasks.workunit.client.0.smithi060.stdout:2/213: dread d3/d7/d18/f3a [0,4194304] 0 2024-09-21T10:40:59.732 INFO:tasks.workunit.client.0.smithi060.stdout:2/214: getdents d3/d7/d23 0 2024-09-21T10:40:59.732 INFO:tasks.workunit.client.0.smithi060.stdout:2/215: stat d3/d7/d18 0 2024-09-21T10:40:59.733 INFO:tasks.workunit.client.0.smithi060.stdout:2/216: symlink d3/d20/d15/d3b/l45 0 2024-09-21T10:40:59.734 INFO:tasks.workunit.client.0.smithi060.stdout:2/217: getdents d3/d20/d17 0 2024-09-21T10:40:59.745 INFO:tasks.workunit.client.0.smithi060.stdout:0/483: dwrite d5/f3e [4194304,4194304] 0 2024-09-21T10:40:59.745 INFO:tasks.workunit.client.0.smithi060.stdout:0/484: creat d5/d10/da/d20/d45/d2a/d76/f95 x:0 0 0 2024-09-21T10:40:59.746 INFO:tasks.workunit.client.0.smithi060.stdout:5/428: dwrite d5/d45/d6d/f40 [4194304,4194304] 0 2024-09-21T10:40:59.746 INFO:tasks.workunit.client.0.smithi060.stdout:9/365: dwrite d3/d5e/f66 [0,4194304] 0 2024-09-21T10:40:59.746 INFO:tasks.workunit.client.0.smithi060.stdout:9/366: fdatasync d3/d15/f3c 0 2024-09-21T10:40:59.746 INFO:tasks.workunit.client.0.smithi060.stdout:9/367: fsync d3/d16/d1a/f4c 0 2024-09-21T10:40:59.746 INFO:tasks.workunit.client.0.smithi060.stdout:1/418: dwrite d6/d4a/f69 [0,4194304] 0 2024-09-21T10:40:59.747 INFO:tasks.workunit.client.0.smithi060.stdout:7/392: dwrite da/d14/d2a/d49/f67 [0,4194304] 0 2024-09-21T10:40:59.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/403: dwrite d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:40:59.747 INFO:tasks.workunit.client.0.smithi060.stdout:6/478: dwrite d3/d12/d16/d1a/d60/f73 [0,4194304] 0 2024-09-21T10:40:59.747 INFO:tasks.workunit.client.0.smithi060.stdout:7/393: creat da/d14/d2a/d49/d27/f8f x:0 0 0 2024-09-21T10:40:59.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/404: write d0/d1/d1e/d34/f48 [798719,28866] 0 2024-09-21T10:40:59.749 INFO:tasks.workunit.client.0.smithi060.stdout:7/394: read da/d14/d2a/d49/d27/f44 [50131,83203] 0 2024-09-21T10:40:59.751 INFO:tasks.workunit.client.0.smithi060.stdout:8/413: dread d2/f46 [0,4194304] 0 2024-09-21T10:40:59.753 INFO:tasks.workunit.client.0.smithi060.stdout:0/485: truncate f0 5917769 0 2024-09-21T10:40:59.753 INFO:tasks.workunit.client.0.smithi060.stdout:0/486: truncate d5/d10/da/f81 992900 0 2024-09-21T10:40:59.754 INFO:tasks.workunit.client.0.smithi060.stdout:1/419: dread d6/d24/da/db/d1c/f4c [0,4194304] 0 2024-09-21T10:40:59.755 INFO:tasks.workunit.client.0.smithi060.stdout:5/429: mkdir d5/d45/d77/d8f/d91 0 2024-09-21T10:40:59.756 INFO:tasks.workunit.client.0.smithi060.stdout:5/430: dread d5/d45/d5a/f5d [0,4194304] 0 2024-09-21T10:40:59.759 INFO:tasks.workunit.client.0.smithi060.stdout:9/368: creat d3/d15/d58/f7c x:0 0 0 2024-09-21T10:40:59.767 INFO:tasks.workunit.client.0.smithi060.stdout:6/479: symlink d3/d12/d16/d1a/d21/d90/l93 0 2024-09-21T10:40:59.769 INFO:tasks.workunit.client.0.smithi060.stdout:3/405: rename d0/l27 to d0/d1/d11/d2a/l7f 0 2024-09-21T10:40:59.770 INFO:tasks.workunit.client.0.smithi060.stdout:3/406: dread - d0/d1/d11/f51 zero size 2024-09-21T10:40:59.773 INFO:tasks.workunit.client.0.smithi060.stdout:8/414: symlink d2/d18/d4b/d4d/l8e 0 2024-09-21T10:40:59.775 INFO:tasks.workunit.client.0.smithi060.stdout:7/395: dwrite da/d14/f19 [0,4194304] 0 2024-09-21T10:40:59.775 INFO:tasks.workunit.client.0.smithi060.stdout:7/396: truncate da/d14/d35/f7d 628664 0 2024-09-21T10:40:59.775 INFO:tasks.workunit.client.0.smithi060.stdout:7/397: write da/d14/d2a/d49/d2e/f65 [205497,27808] 0 2024-09-21T10:40:59.778 INFO:tasks.workunit.client.0.smithi060.stdout:0/487: mkdir d5/d10/da/d20/d45/d2a/d40/d48/d63/d96 0 2024-09-21T10:40:59.781 INFO:tasks.workunit.client.0.smithi060.stdout:1/420: mkdir d6/d24/d50/d97 0 2024-09-21T10:40:59.782 INFO:tasks.workunit.client.0.smithi060.stdout:6/480: mknod d3/dd/c94 0 2024-09-21T10:40:59.782 INFO:tasks.workunit.client.0.smithi060.stdout:6/481: write d3/d12/d16/d22/f6e [3791610,2325] 0 2024-09-21T10:40:59.784 INFO:tasks.workunit.client.0.smithi060.stdout:6/482: dread d3/d12/d16/d25/f45 [0,4194304] 0 2024-09-21T10:40:59.784 INFO:tasks.workunit.client.0.smithi060.stdout:6/483: write d3/d12/d38/d41/f4d [934069,115606] 0 2024-09-21T10:40:59.784 INFO:tasks.workunit.client.0.smithi060.stdout:6/484: read - d3/f52 zero size 2024-09-21T10:40:59.784 INFO:tasks.workunit.client.0.smithi060.stdout:3/407: rmdir d0 39 2024-09-21T10:40:59.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/431: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/f8c [0,4194304] 0 2024-09-21T10:40:59.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/432: fdatasync d5/d45/d6d/d10/d19/f4e 0 2024-09-21T10:40:59.787 INFO:tasks.workunit.client.0.smithi060.stdout:5/433: write d5/ff [3441693,20906] 0 2024-09-21T10:40:59.787 INFO:tasks.workunit.client.0.smithi060.stdout:5/434: chown d5/d45 1 1 2024-09-21T10:40:59.787 INFO:tasks.workunit.client.0.smithi060.stdout:5/435: write d5/d45/d6d/d10/d19/d21/f83 [609023,33296] 0 2024-09-21T10:40:59.790 INFO:tasks.workunit.client.0.smithi060.stdout:9/369: dwrite d3/d15/f22 [4194304,4194304] 0 2024-09-21T10:40:59.799 INFO:tasks.workunit.client.0.smithi060.stdout:7/398: rename f6 to da/f90 0 2024-09-21T10:40:59.802 INFO:tasks.workunit.client.0.smithi060.stdout:7/399: read da/d14/d35/f30 [19534,48184] 0 2024-09-21T10:40:59.803 INFO:tasks.workunit.client.0.smithi060.stdout:7/400: dread da/d14/d25/d56/f58 [0,4194304] 0 2024-09-21T10:40:59.803 INFO:tasks.workunit.client.0.smithi060.stdout:7/401: fsync da/fc 0 2024-09-21T10:40:59.813 INFO:tasks.workunit.client.0.smithi060.stdout:3/408: dwrite d0/f1c [0,4194304] 0 2024-09-21T10:40:59.813 INFO:tasks.workunit.client.0.smithi060.stdout:3/409: readlink d0/d1/d11/d2a/l44 0 2024-09-21T10:40:59.813 INFO:tasks.workunit.client.0.smithi060.stdout:9/370: dwrite d3/d16/d1a/f1d [0,4194304] 0 2024-09-21T10:40:59.817 INFO:tasks.workunit.client.0.smithi060.stdout:1/421: truncate d6/d24/da/db/f5f 2544008 0 2024-09-21T10:40:59.820 INFO:tasks.workunit.client.0.smithi060.stdout:8/415: getdents d2/d18 0 2024-09-21T10:40:59.822 INFO:tasks.workunit.client.0.smithi060.stdout:8/416: write d2/d26/d37/d62/f68 [840459,73837] 0 2024-09-21T10:40:59.823 INFO:tasks.workunit.client.0.smithi060.stdout:5/436: rename d5/d45/d6d/l25 to d5/d45/l92 0 2024-09-21T10:40:59.825 INFO:tasks.workunit.client.0.smithi060.stdout:7/402: creat da/d14/d25/f91 x:0 0 0 2024-09-21T10:40:59.825 INFO:tasks.workunit.client.0.smithi060.stdout:7/403: fdatasync da/d14/d2a/d49/d2e/f65 0 2024-09-21T10:40:59.825 INFO:tasks.workunit.client.0.smithi060.stdout:7/404: fsync da/d14/d2a/d49/f6d 0 2024-09-21T10:40:59.825 INFO:tasks.workunit.client.0.smithi060.stdout:7/405: chown da/d14/d25/l26 0 1 2024-09-21T10:40:59.827 INFO:tasks.workunit.client.0.smithi060.stdout:6/485: rmdir d3/d12/d16/d1a/d60 39 2024-09-21T10:40:59.827 INFO:tasks.workunit.client.0.smithi060.stdout:6/486: fsync d3/d12/d16/d25/d27/f29 0 2024-09-21T10:40:59.829 INFO:tasks.workunit.client.0.smithi060.stdout:8/417: symlink d2/d26/l8f 0 2024-09-21T10:40:59.830 INFO:tasks.workunit.client.0.smithi060.stdout:8/418: dread - d2/d18/f5c zero size 2024-09-21T10:40:59.830 INFO:tasks.workunit.client.0.smithi060.stdout:3/410: dwrite d0/f7d [4194304,4194304] 0 2024-09-21T10:40:59.831 INFO:tasks.workunit.client.0.smithi060.stdout:5/437: creat d5/d45/d6d/d10/d19/d8d/d60/f93 x:0 0 0 2024-09-21T10:40:59.831 INFO:tasks.workunit.client.0.smithi060.stdout:5/438: chown d5/d45/f4b 10626208 1 2024-09-21T10:40:59.831 INFO:tasks.workunit.client.0.smithi060.stdout:5/439: write d5/d45/f85 [1594837,68581] 0 2024-09-21T10:40:59.833 INFO:tasks.workunit.client.0.smithi060.stdout:7/406: rename da/d14/d35/f1b to da/d14/d25/d56/f92 0 2024-09-21T10:40:59.838 INFO:tasks.workunit.client.0.smithi060.stdout:8/419: creat d2/d26/d37/d62/d77/f90 x:0 0 0 2024-09-21T10:40:59.840 INFO:tasks.workunit.client.0.smithi060.stdout:3/411: mknod d0/d1/d11/d53/c80 0 2024-09-21T10:40:59.841 INFO:tasks.workunit.client.0.smithi060.stdout:5/440: dread d5/d45/d6d/d10/d19/d21/d30/f35 [0,4194304] 0 2024-09-21T10:40:59.842 INFO:tasks.workunit.client.0.smithi060.stdout:5/441: read d5/d45/d5a/f7e [103033,23734] 0 2024-09-21T10:40:59.844 INFO:tasks.workunit.client.0.smithi060.stdout:8/420: dread d2/d18/d4b/d61/d6e/f85 [0,4194304] 0 2024-09-21T10:40:59.844 INFO:tasks.workunit.client.0.smithi060.stdout:7/407: link da/d14/d2a/d49/f5f da/d60/d6e/f93 0 2024-09-21T10:40:59.844 INFO:tasks.workunit.client.0.smithi060.stdout:7/408: truncate da/d14/d2a/d49/d27/f4c 2060920 0 2024-09-21T10:40:59.847 INFO:tasks.workunit.client.0.smithi060.stdout:5/442: unlink d5/l18 0 2024-09-21T10:40:59.853 INFO:tasks.workunit.client.0.smithi060.stdout:8/421: mknod d2/d18/d4b/d4d/c91 0 2024-09-21T10:40:59.854 INFO:tasks.workunit.client.0.smithi060.stdout:2/218: rmdir d3/d20/d15 39 2024-09-21T10:40:59.856 INFO:tasks.workunit.client.0.smithi060.stdout:5/443: rename d5/c51 to d5/d45/d6d/d10/d19/c94 0 2024-09-21T10:40:59.858 INFO:tasks.workunit.client.0.smithi060.stdout:8/422: readlink d2/l3a 0 2024-09-21T10:40:59.858 INFO:tasks.workunit.client.0.smithi060.stdout:8/423: write d2/f14 [1662859,74291] 0 2024-09-21T10:40:59.859 INFO:tasks.workunit.client.0.smithi060.stdout:5/444: read d5/d45/d6d/d10/d19/d21/f83 [150796,65734] 0 2024-09-21T10:40:59.860 INFO:tasks.workunit.client.0.smithi060.stdout:2/219: dread d3/d20/d15/d30/f3f [0,4194304] 0 2024-09-21T10:40:59.860 INFO:tasks.workunit.client.0.smithi060.stdout:2/220: write d3/f5 [6008200,32057] 0 2024-09-21T10:40:59.861 INFO:tasks.workunit.client.0.smithi060.stdout:8/424: rename d2/d18/d4b/d4d/f6d to d2/d26/d37/d62/d74/d83/d89/f92 0 2024-09-21T10:40:59.864 INFO:tasks.workunit.client.0.smithi060.stdout:2/221: read d3/d7/f34 [348108,25798] 0 2024-09-21T10:40:59.864 INFO:tasks.workunit.client.0.smithi060.stdout:7/409: dwrite da/f90 [0,4194304] 0 2024-09-21T10:40:59.865 INFO:tasks.workunit.client.0.smithi060.stdout:8/425: creat d2/d26/d37/f93 x:0 0 0 2024-09-21T10:40:59.867 INFO:tasks.workunit.client.0.smithi060.stdout:3/412: dwrite d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:40:59.871 INFO:tasks.workunit.client.0.smithi060.stdout:5/445: rename d5/d45/d6d/d10/c27 to d5/d45/d6d/d10/d19/d8d/c95 0 2024-09-21T10:40:59.873 INFO:tasks.workunit.client.0.smithi060.stdout:2/222: mkdir d3/d7/d24/d25/d46 0 2024-09-21T10:40:59.873 INFO:tasks.workunit.client.0.smithi060.stdout:6/487: getdents d3/d12/d16/d1a/d21/d90 0 2024-09-21T10:40:59.877 INFO:tasks.workunit.client.0.smithi060.stdout:7/410: creat da/d14/d2a/d49/d2e/f94 x:0 0 0 2024-09-21T10:40:59.877 INFO:tasks.workunit.client.0.smithi060.stdout:7/411: fdatasync da/f12 0 2024-09-21T10:40:59.877 INFO:tasks.workunit.client.0.smithi060.stdout:7/412: creat da/d14/d35/d32/f95 x:0 0 0 2024-09-21T10:40:59.881 INFO:tasks.workunit.client.0.smithi060.stdout:8/426: chown d2/c4e 2279 1 2024-09-21T10:40:59.881 INFO:tasks.workunit.client.0.smithi060.stdout:8/427: write d2/d26/d37/d62/d77/f90 [246210,90167] 0 2024-09-21T10:40:59.883 INFO:tasks.workunit.client.0.smithi060.stdout:2/223: unlink d3/d20/d15/l19 0 2024-09-21T10:40:59.891 INFO:tasks.workunit.client.0.smithi060.stdout:2/224: mknod d3/d20/d15/c47 0 2024-09-21T10:40:59.895 INFO:tasks.workunit.client.0.smithi060.stdout:2/225: rename d3/d7/d23/f36 to d3/d7/d23/f48 0 2024-09-21T10:40:59.898 INFO:tasks.workunit.client.0.smithi060.stdout:2/226: getdents d3 0 2024-09-21T10:40:59.898 INFO:tasks.workunit.client.0.smithi060.stdout:2/227: creat d3/d7/d24/f49 x:0 0 0 2024-09-21T10:40:59.898 INFO:tasks.workunit.client.0.smithi060.stdout:2/228: chown d3/d7 660041 1 2024-09-21T10:40:59.899 INFO:tasks.workunit.client.0.smithi060.stdout:5/446: dwrite d5/d45/d5a/f17 [0,4194304] 0 2024-09-21T10:40:59.899 INFO:tasks.workunit.client.0.smithi060.stdout:6/488: dread d3/d12/d16/d1a/f1e [0,4194304] 0 2024-09-21T10:40:59.902 INFO:tasks.workunit.client.0.smithi060.stdout:6/489: rename d3/d12/d16/d22/d58/l6f to d3/d12/d65/d66/l95 0 2024-09-21T10:40:59.902 INFO:tasks.workunit.client.0.smithi060.stdout:6/490: readlink d3/l15 0 2024-09-21T10:40:59.906 INFO:tasks.workunit.client.0.smithi060.stdout:3/413: dwrite d0/d1/d11/d2a/f4d [0,4194304] 0 2024-09-21T10:40:59.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/491: truncate d3/d12/f3b 286469 0 2024-09-21T10:40:59.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/492: readlink d3/d12/d16/d22/l35 0 2024-09-21T10:40:59.911 INFO:tasks.workunit.client.0.smithi060.stdout:5/447: dread d5/d45/d5a/f62 [0,4194304] 0 2024-09-21T10:40:59.911 INFO:tasks.workunit.client.0.smithi060.stdout:5/448: chown d5/d45/d6d/d10/d19/d8d/f57 7898958 1 2024-09-21T10:40:59.917 INFO:tasks.workunit.client.0.smithi060.stdout:7/413: dwrite da/d60/d6e/f69 [0,4194304] 0 2024-09-21T10:40:59.918 INFO:tasks.workunit.client.0.smithi060.stdout:8/428: dwrite d2/f3 [0,4194304] 0 2024-09-21T10:40:59.918 INFO:tasks.workunit.client.0.smithi060.stdout:3/414: dread d0/f28 [4194304,4194304] 0 2024-09-21T10:40:59.918 INFO:tasks.workunit.client.0.smithi060.stdout:3/415: readlink d0/l22 0 2024-09-21T10:40:59.918 INFO:tasks.workunit.client.0.smithi060.stdout:8/429: creat d2/d18/d4b/d61/f94 x:0 0 0 2024-09-21T10:40:59.918 INFO:tasks.workunit.client.0.smithi060.stdout:8/430: truncate d2/d5a/f8b 894601 0 2024-09-21T10:40:59.932 INFO:tasks.workunit.client.0.smithi060.stdout:6/493: truncate d3/d12/d16/d1a/f1e 3015077 0 2024-09-21T10:40:59.935 INFO:tasks.workunit.client.0.smithi060.stdout:5/449: creat d5/d45/d77/d8f/f96 x:0 0 0 2024-09-21T10:40:59.936 INFO:tasks.workunit.client.0.smithi060.stdout:5/450: rename d5 to d5/d45/d6d/d97 22 2024-09-21T10:40:59.939 INFO:tasks.workunit.client.0.smithi060.stdout:6/494: dread d3/d12/d38/d41/f44 [0,4194304] 0 2024-09-21T10:40:59.939 INFO:tasks.workunit.client.0.smithi060.stdout:6/495: creat d3/d12/d38/f96 x:0 0 0 2024-09-21T10:40:59.943 INFO:tasks.workunit.client.0.smithi060.stdout:7/414: read da/fc [1886512,17539] 0 2024-09-21T10:40:59.945 INFO:tasks.workunit.client.0.smithi060.stdout:3/416: truncate d0/d1/f20 2681875 0 2024-09-21T10:40:59.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:40:59 smithi060 ceph-mon[28215]: pgmap v16: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 229 MiB/s rd, 262 MiB/s wr, 373 op/s 2024-09-21T10:40:59.950 INFO:tasks.workunit.client.0.smithi060.stdout:8/431: symlink d2/d26/d37/l95 0 2024-09-21T10:40:59.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:40:59 smithi112 ceph-mon[35117]: pgmap v16: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 229 MiB/s rd, 262 MiB/s wr, 373 op/s 2024-09-21T10:40:59.951 INFO:tasks.workunit.client.0.smithi060.stdout:5/451: truncate d5/f86 1552760 0 2024-09-21T10:40:59.955 INFO:tasks.workunit.client.0.smithi060.stdout:6/496: mkdir d3/d12/d16/d1a/d83/d97 0 2024-09-21T10:40:59.957 INFO:tasks.workunit.client.0.smithi060.stdout:7/415: rename da/d14/d15/c7c to da/d14/d35/d79/c96 0 2024-09-21T10:40:59.959 INFO:tasks.workunit.client.0.smithi060.stdout:8/432: readlink d2/l48 0 2024-09-21T10:40:59.959 INFO:tasks.workunit.client.0.smithi060.stdout:8/433: fdatasync d2/d26/d37/d62/f68 0 2024-09-21T10:40:59.963 INFO:tasks.workunit.client.0.smithi060.stdout:7/416: creat da/d60/f97 x:0 0 0 2024-09-21T10:40:59.963 INFO:tasks.workunit.client.0.smithi060.stdout:7/417: creat da/d14/d2a/d49/d2e/f98 x:0 0 0 2024-09-21T10:40:59.963 INFO:tasks.workunit.client.0.smithi060.stdout:7/418: write da/d14/d2a/d49/f5f [2644914,37800] 0 2024-09-21T10:40:59.963 INFO:tasks.workunit.client.0.smithi060.stdout:7/419: fdatasync da/f73 0 2024-09-21T10:40:59.963 INFO:tasks.workunit.client.0.smithi060.stdout:7/420: truncate da/d14/d25/f4a 684258 0 2024-09-21T10:40:59.967 INFO:tasks.workunit.client.0.smithi060.stdout:3/417: dwrite d0/d1/d1e/d34/f49 [0,4194304] 0 2024-09-21T10:40:59.969 INFO:tasks.workunit.client.0.smithi060.stdout:8/434: unlink d2/f2d 0 2024-09-21T10:40:59.969 INFO:tasks.workunit.client.0.smithi060.stdout:8/435: chown d2/d18/f36 1533869 1 2024-09-21T10:40:59.971 INFO:tasks.workunit.client.0.smithi060.stdout:5/452: truncate d5/d45/d5a/f17 2016171 0 2024-09-21T10:40:59.972 INFO:tasks.workunit.client.0.smithi060.stdout:3/418: mkdir d0/d1/d24/d81 0 2024-09-21T10:40:59.973 INFO:tasks.workunit.client.0.smithi060.stdout:6/497: dwrite d3/d12/d16/d25/d27/f61 [0,4194304] 0 2024-09-21T10:40:59.974 INFO:tasks.workunit.client.0.smithi060.stdout:8/436: rename d2/d26/d37/d62/f63 to d2/d26/d37/d62/d77/f96 0 2024-09-21T10:40:59.977 INFO:tasks.workunit.client.0.smithi060.stdout:3/419: dread d0/d1/d11/d2a/f33 [0,4194304] 0 2024-09-21T10:40:59.977 INFO:tasks.workunit.client.0.smithi060.stdout:6/498: symlink d3/d12/d65/d7f/l98 0 2024-09-21T10:40:59.978 INFO:tasks.workunit.client.0.smithi060.stdout:6/499: chown d3/d12/d38/d41/f44 7618 1 2024-09-21T10:40:59.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/453: dread d5/d45/d6d/f2b [4194304,4194304] 0 2024-09-21T10:40:59.978 INFO:tasks.workunit.client.0.smithi060.stdout:8/437: creat d2/f97 x:0 0 0 2024-09-21T10:40:59.979 INFO:tasks.workunit.client.0.smithi060.stdout:3/420: rmdir d0/d1/d11/d2a/d45 39 2024-09-21T10:40:59.980 INFO:tasks.workunit.client.0.smithi060.stdout:6/500: dread d3/d12/d16/d22/d58/d75/f7d [0,4194304] 0 2024-09-21T10:40:59.981 INFO:tasks.workunit.client.0.smithi060.stdout:5/454: link d5/d45/d6d/cd d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/c98 0 2024-09-21T10:40:59.985 INFO:tasks.workunit.client.0.smithi060.stdout:3/421: truncate d0/d1/d11/f32 741803 0 2024-09-21T10:40:59.985 INFO:tasks.workunit.client.0.smithi060.stdout:3/422: write d0/f21 [4160800,116942] 0 2024-09-21T10:40:59.988 INFO:tasks.workunit.client.0.smithi060.stdout:3/423: creat d0/d1/d24/d81/f82 x:0 0 0 2024-09-21T10:40:59.990 INFO:tasks.workunit.client.0.smithi060.stdout:8/438: fsync d2/d18/d4b/d61/f94 0 2024-09-21T10:40:59.991 INFO:tasks.workunit.client.0.smithi060.stdout:8/439: stat d2/d18/f30 0 2024-09-21T10:40:59.993 INFO:tasks.workunit.client.0.smithi060.stdout:8/440: mknod d2/d26/d37/c98 0 2024-09-21T10:40:59.993 INFO:tasks.workunit.client.0.smithi060.stdout:8/441: chown d2/d18/f36 289446 1 2024-09-21T10:40:59.997 INFO:tasks.workunit.client.0.smithi060.stdout:8/442: truncate d2/f12 3565738 0 2024-09-21T10:41:00.000 INFO:tasks.workunit.client.0.smithi060.stdout:7/421: getdents da/d14/d15 0 2024-09-21T10:41:00.000 INFO:tasks.workunit.client.0.smithi060.stdout:7/422: readlink da/ld 0 2024-09-21T10:41:00.004 INFO:tasks.workunit.client.0.smithi060.stdout:7/423: dread da/d14/d25/f4a [0,4194304] 0 2024-09-21T10:41:00.004 INFO:tasks.workunit.client.0.smithi060.stdout:6/501: dwrite d3/d12/d16/d1a/f4f [0,4194304] 0 2024-09-21T10:41:00.005 INFO:tasks.workunit.client.0.smithi060.stdout:6/502: chown d3/d12/d16/d25/d76/f85 3 1 2024-09-21T10:41:00.005 INFO:tasks.workunit.client.0.smithi060.stdout:6/503: stat d3/d12/d16/d22/f7a 0 2024-09-21T10:41:00.010 INFO:tasks.workunit.client.0.smithi060.stdout:7/424: dread da/d14/d35/f1d [0,4194304] 0 2024-09-21T10:41:00.011 INFO:tasks.workunit.client.0.smithi060.stdout:7/425: chown da/d14/d15/ff 174 1 2024-09-21T10:41:00.013 INFO:tasks.workunit.client.0.smithi060.stdout:5/455: dwrite d5/d45/d5a/d3a/f53 [0,4194304] 0 2024-09-21T10:41:00.014 INFO:tasks.workunit.client.0.smithi060.stdout:6/504: link d3/d54/l67 d3/d12/d16/d22/d58/d75/l99 0 2024-09-21T10:41:00.014 INFO:tasks.workunit.client.0.smithi060.stdout:7/426: symlink da/d14/d25/l99 0 2024-09-21T10:41:00.017 INFO:tasks.workunit.client.0.smithi060.stdout:8/443: dwrite d2/f17 [0,4194304] 0 2024-09-21T10:41:00.018 INFO:tasks.workunit.client.0.smithi060.stdout:3/424: dwrite d0/d1/d1e/d34/f49 [0,4194304] 0 2024-09-21T10:41:00.021 INFO:tasks.workunit.client.0.smithi060.stdout:6/505: mkdir d3/d12/d16/d1a/d9a 0 2024-09-21T10:41:00.024 INFO:tasks.workunit.client.0.smithi060.stdout:7/427: unlink da/d14/d15/l61 0 2024-09-21T10:41:00.024 INFO:tasks.workunit.client.0.smithi060.stdout:7/428: write da/d60/d6e/f38 [296411,34762] 0 2024-09-21T10:41:00.025 INFO:tasks.workunit.client.0.smithi060.stdout:7/429: dread - da/d14/d2a/d49/d27/f8f zero size 2024-09-21T10:41:00.026 INFO:tasks.workunit.client.0.smithi060.stdout:8/444: write d2/f47 [1084805,28287] 0 2024-09-21T10:41:00.029 INFO:tasks.workunit.client.0.smithi060.stdout:5/456: getdents d5/d45/d6d/d10/d19/d21 0 2024-09-21T10:41:00.029 INFO:tasks.workunit.client.0.smithi060.stdout:5/457: truncate d5/d45/d6d/d10/d19/d21/f83 941739 0 2024-09-21T10:41:00.032 INFO:tasks.workunit.client.0.smithi060.stdout:6/506: mknod d3/d12/d16/d22/d5d/d70/d89/c9b 0 2024-09-21T10:41:00.037 INFO:tasks.workunit.client.0.smithi060.stdout:5/458: link d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/c98 d5/d45/d6d/d10/d19/d21/d30/d49/c99 0 2024-09-21T10:41:00.038 INFO:tasks.workunit.client.0.smithi060.stdout:6/507: mkdir d3/d12/d16/d1a/d21/d90/d9c 0 2024-09-21T10:41:00.041 INFO:tasks.workunit.client.0.smithi060.stdout:3/425: dwrite d0/d1/d11/d2a/f5d [0,4194304] 0 2024-09-21T10:41:00.042 INFO:tasks.workunit.client.0.smithi060.stdout:8/445: truncate d2/f23 2268519 0 2024-09-21T10:41:00.043 INFO:tasks.workunit.client.0.smithi060.stdout:7/430: dwrite da/d14/d2a/f2b [0,4194304] 0 2024-09-21T10:41:00.045 INFO:tasks.workunit.client.0.smithi060.stdout:5/459: rmdir d5/d7a 39 2024-09-21T10:41:00.049 INFO:tasks.workunit.client.0.smithi060.stdout:3/426: write d0/d1/d1e/f3e [3590133,74584] 0 2024-09-21T10:41:00.056 INFO:tasks.workunit.client.0.smithi060.stdout:7/431: rename da/d14/d35/c5d to da/d14/d2a/d49/d27/c9a 0 2024-09-21T10:41:00.056 INFO:tasks.workunit.client.0.smithi060.stdout:7/432: dread - da/d14/d2a/d49/d27/f87 zero size 2024-09-21T10:41:00.060 INFO:tasks.workunit.client.0.smithi060.stdout:5/460: symlink d5/d45/d5a/l9a 0 2024-09-21T10:41:00.062 INFO:tasks.workunit.client.0.smithi060.stdout:3/427: mknod d0/d1/d11/d53/c83 0 2024-09-21T10:41:00.071 INFO:tasks.workunit.client.0.smithi060.stdout:8/446: rmdir d2 39 2024-09-21T10:41:00.071 INFO:tasks.workunit.client.0.smithi060.stdout:8/447: read - d2/f97 zero size 2024-09-21T10:41:00.072 INFO:tasks.workunit.client.0.smithi060.stdout:7/433: mknod da/d14/d35/d79/c9b 0 2024-09-21T10:41:00.075 INFO:tasks.workunit.client.0.smithi060.stdout:8/448: rmdir d2/d18/d4b/d61 39 2024-09-21T10:41:00.076 INFO:tasks.workunit.client.0.smithi060.stdout:7/434: mknod da/d14/d2a/c9c 0 2024-09-21T10:41:00.076 INFO:tasks.workunit.client.0.smithi060.stdout:7/435: chown da/d14/d35/d32/c43 3083555 1 2024-09-21T10:41:00.077 INFO:tasks.workunit.client.0.smithi060.stdout:3/428: truncate d0/d1/d11/d2a/f5d 767197 0 2024-09-21T10:41:00.077 INFO:tasks.workunit.client.0.smithi060.stdout:3/429: stat d0/d1/d11/d2a/f5d 0 2024-09-21T10:41:00.077 INFO:tasks.workunit.client.0.smithi060.stdout:3/430: truncate d0/d1/d11/f51 425690 0 2024-09-21T10:41:00.078 INFO:tasks.workunit.client.0.smithi060.stdout:5/461: dwrite d5/d45/d6d/d10/d19/d8d/f43 [0,4194304] 0 2024-09-21T10:41:00.079 INFO:tasks.workunit.client.0.smithi060.stdout:7/436: mknod da/d14/d15/c9d 0 2024-09-21T10:41:00.080 INFO:tasks.workunit.client.0.smithi060.stdout:3/431: mknod d0/d1/d1e/c84 0 2024-09-21T10:41:00.080 INFO:tasks.workunit.client.0.smithi060.stdout:3/432: chown d0/d1/d1e/f35 1514750723 1 2024-09-21T10:41:00.083 INFO:tasks.workunit.client.0.smithi060.stdout:8/449: rename d2/c1d to d2/d26/d37/d64/d65/c99 0 2024-09-21T10:41:00.083 INFO:tasks.workunit.client.0.smithi060.stdout:8/450: fdatasync d2/d26/d37/d64/d65/f57 0 2024-09-21T10:41:00.094 INFO:tasks.workunit.client.0.smithi060.stdout:5/462: getdents d5/d7a 0 2024-09-21T10:41:00.094 INFO:tasks.workunit.client.0.smithi060.stdout:5/463: fsync d5/d45/d6d/d10/d19/d21/f44 0 2024-09-21T10:41:00.096 INFO:tasks.workunit.client.0.smithi060.stdout:7/437: unlink da/d14/d2a/c3c 0 2024-09-21T10:41:00.096 INFO:tasks.workunit.client.0.smithi060.stdout:7/438: write da/f73 [286154,19777] 0 2024-09-21T10:41:00.100 INFO:tasks.workunit.client.0.smithi060.stdout:3/433: mkdir d0/d1/d11/d2a/d85 0 2024-09-21T10:41:00.102 INFO:tasks.workunit.client.0.smithi060.stdout:8/451: dwrite d2/d26/d37/f58 [0,4194304] 0 2024-09-21T10:41:00.104 INFO:tasks.workunit.client.0.smithi060.stdout:5/464: creat d5/d45/d6d/d10/d19/d21/d7f/f9b x:0 0 0 2024-09-21T10:41:00.105 INFO:tasks.workunit.client.0.smithi060.stdout:7/439: symlink da/d14/d2a/l9e 0 2024-09-21T10:41:00.105 INFO:tasks.workunit.client.0.smithi060.stdout:7/440: fdatasync da/d14/d2a/d49/f6c 0 2024-09-21T10:41:00.106 INFO:tasks.workunit.client.0.smithi060.stdout:7/441: fsync da/d14/d35/f7d 0 2024-09-21T10:41:00.106 INFO:tasks.workunit.client.0.smithi060.stdout:7/442: stat da/d14 0 2024-09-21T10:41:00.108 INFO:tasks.workunit.client.0.smithi060.stdout:3/434: creat d0/d1/d11/d2a/d45/f86 x:0 0 0 2024-09-21T10:41:00.109 INFO:tasks.workunit.client.0.smithi060.stdout:5/465: dread d5/f7 [0,4194304] 0 2024-09-21T10:41:00.113 INFO:tasks.workunit.client.0.smithi060.stdout:7/443: link da/d14/d25/d56/f58 da/d14/d15/f9f 0 2024-09-21T10:41:00.113 INFO:tasks.workunit.client.0.smithi060.stdout:3/435: mkdir d0/d1/d11/d2a/d87 0 2024-09-21T10:41:00.115 INFO:tasks.workunit.client.0.smithi060.stdout:5/466: symlink d5/d45/d5a/d3a/l9c 0 2024-09-21T10:41:00.116 INFO:tasks.workunit.client.0.smithi060.stdout:4/413: sync 2024-09-21T10:41:00.117 INFO:tasks.workunit.client.0.smithi060.stdout:8/452: dwrite d2/d18/d4b/d4d/f7e [0,4194304] 0 2024-09-21T10:41:00.117 INFO:tasks.workunit.client.0.smithi060.stdout:7/444: rename da/d14/d15/c53 to da/d60/ca0 0 2024-09-21T10:41:00.121 INFO:tasks.workunit.client.0.smithi060.stdout:4/414: write d0/d3c/f48 [461080,52035] 0 2024-09-21T10:41:00.128 INFO:tasks.workunit.client.0.smithi060.stdout:7/445: dread da/d14/d2a/d49/d27/f44 [0,4194304] 0 2024-09-21T10:41:00.130 INFO:tasks.workunit.client.0.smithi060.stdout:7/446: truncate da/d14/d35/f30 1072265 0 2024-09-21T10:41:00.130 INFO:tasks.workunit.client.0.smithi060.stdout:7/447: readlink da/d14/l29 0 2024-09-21T10:41:00.135 INFO:tasks.workunit.client.0.smithi060.stdout:4/415: read d0/d5/d12/d16/d28/f2d [475621,85119] 0 2024-09-21T10:41:00.135 INFO:tasks.workunit.client.0.smithi060.stdout:4/416: readlink d0/d5/d12/d15/l40 0 2024-09-21T10:41:00.135 INFO:tasks.workunit.client.0.smithi060.stdout:4/417: chown d0/d83/d6a/d6b/l24 119 1 2024-09-21T10:41:00.136 INFO:tasks.workunit.client.0.smithi060.stdout:4/418: mknod d0/c85 0 2024-09-21T10:41:00.136 INFO:tasks.workunit.client.0.smithi060.stdout:4/419: readlink d0/d83/d6a/d6b/l24 0 2024-09-21T10:41:00.136 INFO:tasks.workunit.client.0.smithi060.stdout:4/420: fdatasync d0/d5/d12/d15/d72/f80 0 2024-09-21T10:41:00.141 INFO:tasks.workunit.client.0.smithi060.stdout:3/436: dwrite d0/d1/f3f [0,4194304] 0 2024-09-21T10:41:00.142 INFO:tasks.workunit.client.0.smithi060.stdout:3/437: readlink d0/lc 0 2024-09-21T10:41:00.142 INFO:tasks.workunit.client.0.smithi060.stdout:8/453: dwrite d2/ff [4194304,4194304] 0 2024-09-21T10:41:00.142 INFO:tasks.workunit.client.0.smithi060.stdout:5/467: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/f74 [0,4194304] 0 2024-09-21T10:41:00.144 INFO:tasks.workunit.client.0.smithi060.stdout:4/421: write d0/d5/f4b [3947737,110375] 0 2024-09-21T10:41:00.148 INFO:tasks.workunit.client.0.smithi060.stdout:7/448: unlink da/d60/ca0 0 2024-09-21T10:41:00.149 INFO:tasks.workunit.client.0.smithi060.stdout:3/438: creat d0/d1/d11/d2a/d43/f88 x:0 0 0 2024-09-21T10:41:00.150 INFO:tasks.workunit.client.0.smithi060.stdout:3/439: read d0/d1/d11/d2a/f2e [3327880,2578] 0 2024-09-21T10:41:00.151 INFO:tasks.workunit.client.0.smithi060.stdout:8/454: write d2/d26/d37/f58 [3147515,116770] 0 2024-09-21T10:41:00.151 INFO:tasks.workunit.client.0.smithi060.stdout:8/455: readlink d2/d26/d37/l6a 0 2024-09-21T10:41:00.153 INFO:tasks.workunit.client.0.smithi060.stdout:8/456: mkdir d2/d26/d37/d62/d74/d83/d89/d9a 0 2024-09-21T10:41:00.153 INFO:tasks.workunit.client.0.smithi060.stdout:8/457: stat d2/d26/d37 0 2024-09-21T10:41:00.155 INFO:tasks.workunit.client.0.smithi060.stdout:8/458: creat d2/d26/d37/d62/d74/f9b x:0 0 0 2024-09-21T10:41:00.155 INFO:tasks.workunit.client.0.smithi060.stdout:8/459: readlink d2/l3a 0 2024-09-21T10:41:00.155 INFO:tasks.workunit.client.0.smithi060.stdout:8/460: truncate d2/d26/d37/d62/d77/f90 787132 0 2024-09-21T10:41:00.157 INFO:tasks.workunit.client.0.smithi060.stdout:8/461: truncate d2/f1e 2935545 0 2024-09-21T10:41:00.160 INFO:tasks.workunit.client.0.smithi060.stdout:8/462: rmdir d2/d26/d37/d62/d77/d7c 0 2024-09-21T10:41:00.161 INFO:tasks.workunit.client.0.smithi060.stdout:8/463: creat d2/d26/d37/d64/d65/f9c x:0 0 0 2024-09-21T10:41:00.163 INFO:tasks.workunit.client.0.smithi060.stdout:8/464: link d2/d18/c4c d2/d26/d37/d62/d74/c9d 0 2024-09-21T10:41:00.163 INFO:tasks.workunit.client.0.smithi060.stdout:3/440: write d0/d1/d24/f40 [1680626,120813] 0 2024-09-21T10:41:00.163 INFO:tasks.workunit.client.0.smithi060.stdout:3/441: stat d0/d1/d11/d2a/d64 0 2024-09-21T10:41:00.164 INFO:tasks.workunit.client.0.smithi060.stdout:8/465: truncate d2/d26/d37/d62/f68 1041167 0 2024-09-21T10:41:00.167 INFO:tasks.workunit.client.0.smithi060.stdout:3/442: mkdir d0/d1/d1e/d89 0 2024-09-21T10:41:00.169 INFO:tasks.workunit.client.0.smithi060.stdout:3/443: mknod d0/d1/d5c/c8a 0 2024-09-21T10:41:00.171 INFO:tasks.workunit.client.0.smithi060.stdout:5/468: dwrite d5/d45/d6d/d10/d19/f34 [0,4194304] 0 2024-09-21T10:41:00.171 INFO:tasks.workunit.client.0.smithi060.stdout:5/469: chown d5/f86 283192 1 2024-09-21T10:41:00.174 INFO:tasks.workunit.client.0.smithi060.stdout:5/470: unlink d5/d45/d6d/l28 0 2024-09-21T10:41:00.174 INFO:tasks.workunit.client.0.smithi060.stdout:5/471: dread - d5/d45/d77/d8f/f96 zero size 2024-09-21T10:41:00.174 INFO:tasks.workunit.client.0.smithi060.stdout:4/422: dwrite d0/d5/d3a/f5d [0,4194304] 0 2024-09-21T10:41:00.174 INFO:tasks.workunit.client.0.smithi060.stdout:7/449: getdents da/d60 0 2024-09-21T10:41:00.176 INFO:tasks.workunit.client.0.smithi060.stdout:4/423: symlink d0/d5/d12/d3d/l86 0 2024-09-21T10:41:00.176 INFO:tasks.workunit.client.0.smithi060.stdout:4/424: dread - d0/d5/d12/d15/d4d/f54 zero size 2024-09-21T10:41:00.176 INFO:tasks.workunit.client.0.smithi060.stdout:4/425: chown d0/d5/d12/d15/c2a 658 1 2024-09-21T10:41:00.177 INFO:tasks.workunit.client.0.smithi060.stdout:3/444: dread d0/d1/d11/d2a/f4d [0,4194304] 0 2024-09-21T10:41:00.177 INFO:tasks.workunit.client.0.smithi060.stdout:3/445: dread - d0/d1/d24/f5f zero size 2024-09-21T10:41:00.178 INFO:tasks.workunit.client.0.smithi060.stdout:7/450: rename da/d14/d35/f7d to da/d60/fa1 0 2024-09-21T10:41:00.179 INFO:tasks.workunit.client.0.smithi060.stdout:8/466: dread d2/d18/f5e [0,4194304] 0 2024-09-21T10:41:00.180 INFO:tasks.workunit.client.0.smithi060.stdout:7/451: fsync da/d60/f84 0 2024-09-21T10:41:00.180 INFO:tasks.workunit.client.0.smithi060.stdout:7/452: fsync da/d14/d25/d56/f92 0 2024-09-21T10:41:00.180 INFO:tasks.workunit.client.0.smithi060.stdout:7/453: fsync da/d14/d25/d56/f58 0 2024-09-21T10:41:00.183 INFO:tasks.workunit.client.0.smithi060.stdout:5/472: write d5/f76 [1298609,9241] 0 2024-09-21T10:41:00.183 INFO:tasks.workunit.client.0.smithi060.stdout:5/473: read d5/d45/d5a/d3a/f5e [1560211,85550] 0 2024-09-21T10:41:00.184 INFO:tasks.workunit.client.0.smithi060.stdout:3/446: dread d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:41:00.184 INFO:tasks.workunit.client.0.smithi060.stdout:3/447: truncate d0/d1/d11/f77 763703 0 2024-09-21T10:41:00.184 INFO:tasks.workunit.client.0.smithi060.stdout:3/448: fsync d0/d1/d11/d2a/f2d 0 2024-09-21T10:41:00.184 INFO:tasks.workunit.client.0.smithi060.stdout:3/449: creat d0/d1/f8b x:0 0 0 2024-09-21T10:41:00.186 INFO:tasks.workunit.client.0.smithi060.stdout:7/454: truncate da/d14/d15/f76 10089829 0 2024-09-21T10:41:00.187 INFO:tasks.workunit.client.0.smithi060.stdout:7/455: write da/d14/d2a/d49/d27/f8a [508290,107364] 0 2024-09-21T10:41:00.187 INFO:tasks.workunit.client.0.smithi060.stdout:8/467: truncate d2/f1f 453064 0 2024-09-21T10:41:00.190 INFO:tasks.workunit.client.0.smithi060.stdout:5/474: dread d5/d45/d6d/d10/d19/f37 [0,4194304] 0 2024-09-21T10:41:00.190 INFO:tasks.workunit.client.0.smithi060.stdout:3/450: symlink d0/d1/d24/d81/l8c 0 2024-09-21T10:41:00.191 INFO:tasks.workunit.client.0.smithi060.stdout:3/451: read d0/d1/d11/f42 [574031,109680] 0 2024-09-21T10:41:00.193 INFO:tasks.workunit.client.0.smithi060.stdout:4/426: rename d0/df/d46 to d0/d3c/d67/d7d/d87 0 2024-09-21T10:41:00.195 INFO:tasks.workunit.client.0.smithi060.stdout:7/456: truncate da/d14/f48 243654 0 2024-09-21T10:41:00.195 INFO:tasks.workunit.client.0.smithi060.stdout:7/457: read - da/d14/d15/f82 zero size 2024-09-21T10:41:00.198 INFO:tasks.workunit.client.0.smithi060.stdout:8/468: getdents d2/d18/d4b/d61/d6e 0 2024-09-21T10:41:00.202 INFO:tasks.workunit.client.0.smithi060.stdout:3/452: dread d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:41:00.204 INFO:tasks.workunit.client.0.smithi060.stdout:7/458: read da/d14/d15/f13 [334500,119251] 0 2024-09-21T10:41:00.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/475: dwrite d5/d45/d5a/d3a/f6b [0,4194304] 0 2024-09-21T10:41:00.206 INFO:tasks.workunit.client.0.smithi060.stdout:5/476: truncate d5/d45/d6d/d10/d19/f34 4847026 0 2024-09-21T10:41:00.206 INFO:tasks.workunit.client.0.smithi060.stdout:8/469: getdents d2/d18/d4b 0 2024-09-21T10:41:00.206 INFO:tasks.workunit.client.0.smithi060.stdout:3/453: dread d0/d1/d11/f32 [0,4194304] 0 2024-09-21T10:41:00.214 INFO:tasks.workunit.client.0.smithi060.stdout:8/470: mknod d2/d26/d37/d62/d77/c9e 0 2024-09-21T10:41:00.215 INFO:tasks.workunit.client.0.smithi060.stdout:3/454: read d0/d1/d24/f25 [4271016,44052] 0 2024-09-21T10:41:00.216 INFO:tasks.workunit.client.0.smithi060.stdout:4/427: rename d0/d5/d12/d16 to d0/df/d88 0 2024-09-21T10:41:00.216 INFO:tasks.workunit.client.0.smithi060.stdout:4/428: write d0/d83/d6a/d6b/d32/f7e [670869,55209] 0 2024-09-21T10:41:00.218 INFO:tasks.workunit.client.0.smithi060.stdout:8/471: symlink d2/d18/l9f 0 2024-09-21T10:41:00.218 INFO:tasks.workunit.client.0.smithi060.stdout:8/472: read - d2/d26/d37/d64/d65/f57 zero size 2024-09-21T10:41:00.218 INFO:tasks.workunit.client.0.smithi060.stdout:8/473: truncate d2/d5a/f67 189040 0 2024-09-21T10:41:00.219 INFO:tasks.workunit.client.0.smithi060.stdout:3/455: link d0/c2f d0/d1/d52/c8d 0 2024-09-21T10:41:00.219 INFO:tasks.workunit.client.0.smithi060.stdout:3/456: read - d0/d1/d52/f7c zero size 2024-09-21T10:41:00.220 INFO:tasks.workunit.client.0.smithi060.stdout:5/477: rename d5/d71/l7c to d5/l9d 0 2024-09-21T10:41:00.222 INFO:tasks.workunit.client.0.smithi060.stdout:7/459: dwrite da/d14/d15/f18 [0,4194304] 0 2024-09-21T10:41:00.222 INFO:tasks.workunit.client.0.smithi060.stdout:3/457: mkdir d0/d1/d11/d2a/d8e 0 2024-09-21T10:41:00.223 INFO:tasks.workunit.client.0.smithi060.stdout:5/478: mkdir d5/d45/d6d/d10/d19/d8d/d60/d9e 0 2024-09-21T10:41:00.223 INFO:tasks.workunit.client.0.smithi060.stdout:5/479: chown d5/d45/d6d/d10/d19/d8d/d50/f59 16246 1 2024-09-21T10:41:00.223 INFO:tasks.workunit.client.0.smithi060.stdout:7/460: truncate da/d60/d6e/f69 4980898 0 2024-09-21T10:41:00.226 INFO:tasks.workunit.client.0.smithi060.stdout:4/429: dread d0/df/d88/d28/f3b [0,4194304] 0 2024-09-21T10:41:00.227 INFO:tasks.workunit.client.0.smithi060.stdout:3/458: symlink d0/d1/d11/d2a/d43/d4e/l8f 0 2024-09-21T10:41:00.227 INFO:tasks.workunit.client.0.smithi060.stdout:3/459: write d0/d1/f70 [330770,67130] 0 2024-09-21T10:41:00.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/480: rename d5/d45/d5a/d3a/c6f to d5/d45/d77/d8f/c9f 0 2024-09-21T10:41:00.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/481: write d5/d45/d6d/d10/d19/d21/f83 [476506,106568] 0 2024-09-21T10:41:00.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/482: creat d5/fa0 x:0 0 0 2024-09-21T10:41:00.232 INFO:tasks.workunit.client.0.smithi060.stdout:7/461: symlink da/d14/d2a/d49/la2 0 2024-09-21T10:41:00.232 INFO:tasks.workunit.client.0.smithi060.stdout:5/483: dread d5/f86 [0,4194304] 0 2024-09-21T10:41:00.234 INFO:tasks.workunit.client.0.smithi060.stdout:4/430: symlink d0/d5/d12/l89 0 2024-09-21T10:41:00.234 INFO:tasks.workunit.client.0.smithi060.stdout:8/474: dwrite d2/d18/f36 [0,4194304] 0 2024-09-21T10:41:00.235 INFO:tasks.workunit.client.0.smithi060.stdout:3/460: link d0/d1/d52/l7a d0/d1/d1e/d89/l90 0 2024-09-21T10:41:00.237 INFO:tasks.workunit.client.0.smithi060.stdout:5/484: mknod d5/d7a/d84/ca1 0 2024-09-21T10:41:00.237 INFO:tasks.workunit.client.0.smithi060.stdout:5/485: fdatasync d5/d45/d6d/d10/d19/d8d/d50/f59 0 2024-09-21T10:41:00.239 INFO:tasks.workunit.client.0.smithi060.stdout:8/475: truncate d2/f1c 2350648 0 2024-09-21T10:41:00.242 INFO:tasks.workunit.client.0.smithi060.stdout:8/476: symlink d2/d26/d37/d64/d65/la0 0 2024-09-21T10:41:00.242 INFO:tasks.workunit.client.0.smithi060.stdout:8/477: readlink d2/l3a 0 2024-09-21T10:41:00.243 INFO:tasks.workunit.client.0.smithi060.stdout:8/478: getdents d2/d26/d37/d62/d77 0 2024-09-21T10:41:00.244 INFO:tasks.workunit.client.0.smithi060.stdout:8/479: stat d2/d26/c70 0 2024-09-21T10:41:00.246 INFO:tasks.workunit.client.0.smithi060.stdout:8/480: link d2/f14 d2/d26/d37/d62/d74/d83/d89/fa1 0 2024-09-21T10:41:00.250 INFO:tasks.workunit.client.0.smithi060.stdout:5/486: write d5/d45/d6d/d10/d19/f34 [423851,78056] 0 2024-09-21T10:41:00.261 INFO:tasks.workunit.client.0.smithi060.stdout:7/462: dwrite da/d60/f84 [0,4194304] 0 2024-09-21T10:41:00.266 INFO:tasks.workunit.client.0.smithi060.stdout:7/463: link da/d14/d15/c9d da/d14/d2a/d49/ca3 0 2024-09-21T10:41:00.268 INFO:tasks.workunit.client.0.smithi060.stdout:4/431: dwrite d0/d59/f5c [0,4194304] 0 2024-09-21T10:41:00.270 INFO:tasks.workunit.client.0.smithi060.stdout:8/481: dwrite d2/d26/d37/d64/d65/f57 [0,4194304] 0 2024-09-21T10:41:00.274 INFO:tasks.workunit.client.0.smithi060.stdout:3/461: dwrite d0/d1/d1e/f3e [0,4194304] 0 2024-09-21T10:41:00.274 INFO:tasks.workunit.client.0.smithi060.stdout:3/462: truncate d0/d1/f8b 571398 0 2024-09-21T10:41:00.275 INFO:tasks.workunit.client.0.smithi060.stdout:3/463: creat d0/d1/d11/d2a/d45/f91 x:0 0 0 2024-09-21T10:41:00.280 INFO:tasks.workunit.client.0.smithi060.stdout:4/432: symlink d0/df/d88/d28/l8a 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/464: dwrite da/d14/d25/f4a [0,4194304] 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/465: creat da/d14/d25/fa4 x:0 0 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/466: truncate da/d14/d2a/d49/f6c 833664 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/467: fsync da/d60/d6e/f38 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/468: creat da/d14/fa5 x:0 0 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:3/464: dread d0/f16 [0,4194304] 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:3/465: fsync d0/d1/d11/d2a/d64/f72 0 2024-09-21T10:41:00.284 INFO:tasks.workunit.client.0.smithi060.stdout:3/466: chown d0/f1c 1034443 1 2024-09-21T10:41:00.285 INFO:tasks.workunit.client.0.smithi060.stdout:8/482: dwrite d2/d18/f30 [0,4194304] 0 2024-09-21T10:41:00.300 INFO:tasks.workunit.client.0.smithi060.stdout:4/433: mkdir d0/d8b 0 2024-09-21T10:41:00.306 INFO:tasks.workunit.client.0.smithi060.stdout:7/469: unlink da/d14/d2a/d49/f80 0 2024-09-21T10:41:00.307 INFO:tasks.workunit.client.0.smithi060.stdout:3/467: symlink d0/d1/d5c/l92 0 2024-09-21T10:41:00.307 INFO:tasks.workunit.client.0.smithi060.stdout:3/468: chown d0/d1/c19 87 1 2024-09-21T10:41:00.311 INFO:tasks.workunit.client.0.smithi060.stdout:8/483: rename d2/d18/d4b/d4d to d2/d26/d37/d62/d74/d83/da2 0 2024-09-21T10:41:00.312 INFO:tasks.workunit.client.0.smithi060.stdout:3/469: mkdir d0/d1/d11/d2a/d93 0 2024-09-21T10:41:00.315 INFO:tasks.workunit.client.0.smithi060.stdout:8/484: mknod d2/d18/ca3 0 2024-09-21T10:41:00.315 INFO:tasks.workunit.client.0.smithi060.stdout:4/434: dwrite d0/f60 [4194304,4194304] 0 2024-09-21T10:41:00.317 INFO:tasks.workunit.client.0.smithi060.stdout:3/470: unlink d0/d1/d1e/d34/f48 0 2024-09-21T10:41:00.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/470: dwrite da/fc [0,4194304] 0 2024-09-21T10:41:00.319 INFO:tasks.workunit.client.0.smithi060.stdout:8/485: mkdir d2/d26/da4 0 2024-09-21T10:41:00.319 INFO:tasks.workunit.client.0.smithi060.stdout:8/486: creat d2/d26/d37/d64/d65/fa5 x:0 0 0 2024-09-21T10:41:00.320 INFO:tasks.workunit.client.0.smithi060.stdout:4/435: symlink d0/df/d88/l8c 0 2024-09-21T10:41:00.322 INFO:tasks.workunit.client.0.smithi060.stdout:7/471: creat da/d14/d25/d56/fa6 x:0 0 0 2024-09-21T10:41:00.323 INFO:tasks.workunit.client.0.smithi060.stdout:8/487: rename d2/d26/l8f to d2/d26/la6 0 2024-09-21T10:41:00.323 INFO:tasks.workunit.client.0.smithi060.stdout:8/488: chown d2/d18/l54 24803 1 2024-09-21T10:41:00.324 INFO:tasks.workunit.client.0.smithi060.stdout:4/436: getdents d0/d83/d6a/d6b/d65/d51 0 2024-09-21T10:41:00.324 INFO:tasks.workunit.client.0.smithi060.stdout:4/437: truncate d0/d5/f71 865852 0 2024-09-21T10:41:00.325 INFO:tasks.workunit.client.0.smithi060.stdout:7/472: readlink l2 0 2024-09-21T10:41:00.327 INFO:tasks.workunit.client.0.smithi060.stdout:4/438: creat d0/d3c/d67/d7d/d87/f8d x:0 0 0 2024-09-21T10:41:00.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/439: stat d0/d83/d6a/d6b/c79 0 2024-09-21T10:41:00.331 INFO:tasks.workunit.client.0.smithi060.stdout:7/473: getdents da 0 2024-09-21T10:41:00.334 INFO:tasks.workunit.client.0.smithi060.stdout:7/474: getdents da/d14/d25 0 2024-09-21T10:41:00.336 INFO:tasks.workunit.client.0.smithi060.stdout:7/475: truncate da/d14/d2a/d49/f67 1737099 0 2024-09-21T10:41:00.336 INFO:tasks.workunit.client.0.smithi060.stdout:7/476: dread - da/d14/d25/fa4 zero size 2024-09-21T10:41:00.345 INFO:tasks.workunit.client.0.smithi060.stdout:8/489: dwrite d2/d18/f22 [0,4194304] 0 2024-09-21T10:41:00.346 INFO:tasks.workunit.client.0.smithi060.stdout:8/490: truncate d2/d26/f35 1445276 0 2024-09-21T10:41:00.346 INFO:tasks.workunit.client.0.smithi060.stdout:8/491: dread - d2/d26/d37/d64/d65/fa5 zero size 2024-09-21T10:41:00.349 INFO:tasks.workunit.client.0.smithi060.stdout:8/492: mkdir d2/da7 0 2024-09-21T10:41:00.349 INFO:tasks.workunit.client.0.smithi060.stdout:7/477: read da/d60/d6e/f69 [1093072,73397] 0 2024-09-21T10:41:00.351 INFO:tasks.workunit.client.0.smithi060.stdout:7/478: truncate da/d14/d25/d56/f92 65906 0 2024-09-21T10:41:00.352 INFO:tasks.workunit.client.0.smithi060.stdout:7/479: mkdir da/d14/d15/d8b/da7 0 2024-09-21T10:41:00.353 INFO:tasks.workunit.client.0.smithi060.stdout:0/488: sync 2024-09-21T10:41:00.353 INFO:tasks.workunit.client.0.smithi060.stdout:0/489: truncate d5/d10/da/d20/f65 141385 0 2024-09-21T10:41:00.360 INFO:tasks.workunit.client.0.smithi060.stdout:8/493: read d2/d26/d37/d62/d74/d83/d89/f92 [1649913,91089] 0 2024-09-21T10:41:00.361 INFO:tasks.workunit.client.0.smithi060.stdout:0/490: creat d5/d10/da/d15/f97 x:0 0 0 2024-09-21T10:41:00.363 INFO:tasks.workunit.client.0.smithi060.stdout:8/494: mkdir d2/d26/d37/d62/d77/da8 0 2024-09-21T10:41:00.366 INFO:tasks.workunit.client.0.smithi060.stdout:8/495: symlink d2/d26/d37/d62/d74/d83/da2/la9 0 2024-09-21T10:41:00.366 INFO:tasks.workunit.client.0.smithi060.stdout:8/496: chown d2/d18/f36 113 1 2024-09-21T10:41:00.369 INFO:tasks.workunit.client.0.smithi060.stdout:8/497: mkdir d2/d26/da4/daa 0 2024-09-21T10:41:00.370 INFO:tasks.workunit.client.0.smithi060.stdout:8/498: creat d2/d26/d37/d62/d74/d83/d89/d9a/fab x:0 0 0 2024-09-21T10:41:00.372 INFO:tasks.workunit.client.0.smithi060.stdout:8/499: mkdir d2/d26/d37/d62/d74/d83/dac 0 2024-09-21T10:41:00.372 INFO:tasks.workunit.client.0.smithi060.stdout:7/480: dwrite da/d14/fa5 [0,4194304] 0 2024-09-21T10:41:00.373 INFO:tasks.workunit.client.0.smithi060.stdout:7/481: chown da/d14/d15/ff 578 1 2024-09-21T10:41:00.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/482: unlink da/f89 0 2024-09-21T10:41:00.378 INFO:tasks.workunit.client.0.smithi060.stdout:7/483: symlink da/d14/d15/d8b/da7/la8 0 2024-09-21T10:41:00.378 INFO:tasks.workunit.client.0.smithi060.stdout:0/491: dwrite d5/d10/f5a [0,4194304] 0 2024-09-21T10:41:00.383 INFO:tasks.workunit.client.0.smithi060.stdout:0/492: symlink d5/d10/da/d20/d45/d2a/d40/l98 0 2024-09-21T10:41:00.383 INFO:tasks.workunit.client.0.smithi060.stdout:0/493: link d5/d10/da/d20/d45/d2a/d40/d48/c5f d5/d10/da/d20/d45/d2a/d40/c99 0 2024-09-21T10:41:00.388 INFO:tasks.workunit.client.0.smithi060.stdout:8/500: dwrite d2/f15 [0,4194304] 0 2024-09-21T10:41:00.390 INFO:tasks.workunit.client.0.smithi060.stdout:8/501: symlink d2/d18/lad 0 2024-09-21T10:41:00.402 INFO:tasks.workunit.client.0.smithi060.stdout:8/502: write d2/d18/f36 [1006301,90433] 0 2024-09-21T10:41:00.407 INFO:tasks.workunit.client.0.smithi060.stdout:7/484: dwrite da/d60/f84 [0,4194304] 0 2024-09-21T10:41:00.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/494: dwrite f2 [0,4194304] 0 2024-09-21T10:41:00.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/495: creat d5/d10/da/d20/f9a x:0 0 0 2024-09-21T10:41:00.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/496: write d5/d10/da/d20/f9a [654933,121805] 0 2024-09-21T10:41:00.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/497: dread - d5/d10/da/f86 zero size 2024-09-21T10:41:00.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/498: fdatasync d5/d10/da/d2d/f5b 0 2024-09-21T10:41:00.409 INFO:tasks.workunit.client.0.smithi060.stdout:7/485: rename da/d14/d2a/l9e to da/d14/d2a/d49/d2e/la9 0 2024-09-21T10:41:00.409 INFO:tasks.workunit.client.0.smithi060.stdout:7/486: readlink da/ld 0 2024-09-21T10:41:00.411 INFO:tasks.workunit.client.0.smithi060.stdout:7/487: creat da/d14/d15/faa x:0 0 0 2024-09-21T10:41:00.411 INFO:tasks.workunit.client.0.smithi060.stdout:7/488: truncate da/d14/d15/f18 5256765 0 2024-09-21T10:41:00.413 INFO:tasks.workunit.client.0.smithi060.stdout:0/499: dread d5/d10/da/d20/d45/f4f [0,4194304] 0 2024-09-21T10:41:00.413 INFO:tasks.workunit.client.0.smithi060.stdout:8/503: write d2/f1e [2762126,3810] 0 2024-09-21T10:41:00.413 INFO:tasks.workunit.client.0.smithi060.stdout:0/500: readlink d5/d10/da/d20/d79/l8a 0 2024-09-21T10:41:00.413 INFO:tasks.workunit.client.0.smithi060.stdout:0/501: write d5/d10/da/d20/d45/d2a/d40/f70 [903365,5849] 0 2024-09-21T10:41:00.414 INFO:tasks.workunit.client.0.smithi060.stdout:7/489: stat da/d14/d35/d32/l57 0 2024-09-21T10:41:00.414 INFO:tasks.workunit.client.0.smithi060.stdout:7/490: write da/d14/d35/d32/f95 [823919,75860] 0 2024-09-21T10:41:00.414 INFO:tasks.workunit.client.0.smithi060.stdout:7/491: truncate da/d14/d2a/d49/d2e/f98 860199 0 2024-09-21T10:41:00.414 INFO:tasks.workunit.client.0.smithi060.stdout:7/492: fsync da/d60/d6e/f38 0 2024-09-21T10:41:00.415 INFO:tasks.workunit.client.0.smithi060.stdout:8/504: creat d2/d26/d37/d62/d77/fae x:0 0 0 2024-09-21T10:41:00.415 INFO:tasks.workunit.client.0.smithi060.stdout:8/505: truncate d2/d26/d37/d64/d65/f9c 474744 0 2024-09-21T10:41:00.415 INFO:tasks.workunit.client.0.smithi060.stdout:8/506: truncate d2/d18/d4b/d61/f94 865139 0 2024-09-21T10:41:00.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/502: dread f0 [4194304,4194304] 0 2024-09-21T10:41:00.416 INFO:tasks.workunit.client.0.smithi060.stdout:7/493: symlink da/d60/d6e/lab 0 2024-09-21T10:41:00.417 INFO:tasks.workunit.client.0.smithi060.stdout:0/503: mknod d5/d10/da/d20/d79/c9b 0 2024-09-21T10:41:00.425 INFO:tasks.workunit.client.0.smithi060.stdout:8/507: read d2/d18/f22 [3969242,2724] 0 2024-09-21T10:41:00.426 INFO:tasks.workunit.client.0.smithi060.stdout:0/504: dread d5/d10/d11/f28 [4194304,4194304] 0 2024-09-21T10:41:00.426 INFO:tasks.workunit.client.0.smithi060.stdout:8/508: write d2/d18/d4b/d61/d6e/f85 [171674,79667] 0 2024-09-21T10:41:00.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/509: creat d2/d26/d37/d62/faf x:0 0 0 2024-09-21T10:41:00.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/510: readlink d2/d26/l2e 0 2024-09-21T10:41:00.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/511: fdatasync d2/d26/d37/d64/d65/f9c 0 2024-09-21T10:41:00.431 INFO:tasks.workunit.client.0.smithi060.stdout:8/512: creat d2/d26/fb0 x:0 0 0 2024-09-21T10:41:00.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/494: dwrite da/d14/d2a/f81 [0,4194304] 0 2024-09-21T10:41:00.433 INFO:tasks.workunit.client.0.smithi060.stdout:7/495: stat da/d14/d25/d56/f92 0 2024-09-21T10:41:00.433 INFO:tasks.workunit.client.0.smithi060.stdout:8/513: link d2/d26/d37/d62/d77/fae d2/d26/d37/d62/d74/d83/fb1 0 2024-09-21T10:41:00.438 INFO:tasks.workunit.client.0.smithi060.stdout:7/496: symlink da/d14/d35/d32/lac 0 2024-09-21T10:41:00.438 INFO:tasks.workunit.client.0.smithi060.stdout:7/497: write da/d14/d25/d56/f92 [641480,4675] 0 2024-09-21T10:41:00.438 INFO:tasks.workunit.client.0.smithi060.stdout:7/498: creat da/d14/d2a/fad x:0 0 0 2024-09-21T10:41:00.441 INFO:tasks.workunit.client.0.smithi060.stdout:0/505: dwrite d5/d10/da/d20/d45/f30 [0,4194304] 0 2024-09-21T10:41:00.441 INFO:tasks.workunit.client.0.smithi060.stdout:0/506: chown d5/d10/da/d20/d45/d2a/d40/d75/f7c 122417 1 2024-09-21T10:41:00.446 INFO:tasks.workunit.client.0.smithi060.stdout:0/507: dread d5/d10/da/d20/d45/f4f [0,4194304] 0 2024-09-21T10:41:00.447 INFO:tasks.workunit.client.0.smithi060.stdout:0/508: getdents d5/d10/da/d20/d79 0 2024-09-21T10:41:00.449 INFO:tasks.workunit.client.0.smithi060.stdout:8/514: dwrite d2/d26/d37/d64/d65/f9c [0,4194304] 0 2024-09-21T10:41:00.450 INFO:tasks.workunit.client.0.smithi060.stdout:0/509: getdents d5 0 2024-09-21T10:41:00.452 INFO:tasks.workunit.client.0.smithi060.stdout:8/515: creat d2/d26/d37/d62/d74/d83/d89/fb2 x:0 0 0 2024-09-21T10:41:00.452 INFO:tasks.workunit.client.0.smithi060.stdout:8/516: chown d2/f23 2060104 1 2024-09-21T10:41:00.453 INFO:tasks.workunit.client.0.smithi060.stdout:0/510: link d5/d10/da/d20/d45/d2a/d40/f46 d5/d10/d4e/f9c 0 2024-09-21T10:41:00.453 INFO:tasks.workunit.client.0.smithi060.stdout:8/517: mknod d2/d26/d37/cb3 0 2024-09-21T10:41:00.461 INFO:tasks.workunit.client.0.smithi060.stdout:7/499: dwrite da/d14/d25/d56/f62 [0,4194304] 0 2024-09-21T10:41:00.461 INFO:tasks.workunit.client.0.smithi060.stdout:7/500: fsync da/d14/d15/f5e 0 2024-09-21T10:41:00.465 INFO:tasks.workunit.client.0.smithi060.stdout:8/518: dread d2/d26/d37/d64/d65/f9c [0,4194304] 0 2024-09-21T10:41:00.467 INFO:tasks.workunit.client.0.smithi060.stdout:0/511: dwrite d5/d10/f60 [0,4194304] 0 2024-09-21T10:41:00.468 INFO:tasks.workunit.client.0.smithi060.stdout:0/512: getdents d5 0 2024-09-21T10:41:00.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/501: dwrite da/d14/d35/f1d [0,4194304] 0 2024-09-21T10:41:00.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/502: write da/d14/d35/d32/f52 [1574918,10785] 0 2024-09-21T10:41:00.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/503: stat da/d60/d6e/l83 0 2024-09-21T10:41:00.476 INFO:tasks.workunit.client.0.smithi060.stdout:7/504: truncate da/d60/fa1 1109244 0 2024-09-21T10:41:00.477 INFO:tasks.workunit.client.0.smithi060.stdout:8/519: mknod d2/d18/d4b/cb4 0 2024-09-21T10:41:00.478 INFO:tasks.workunit.client.0.smithi060.stdout:8/520: chown d2/d26/d37/l95 21821744 1 2024-09-21T10:41:00.481 INFO:tasks.workunit.client.0.smithi060.stdout:0/513: truncate f0 288884 0 2024-09-21T10:41:00.483 INFO:tasks.workunit.client.0.smithi060.stdout:7/505: truncate da/d14/fa5 1400607 0 2024-09-21T10:41:00.483 INFO:tasks.workunit.client.0.smithi060.stdout:7/506: creat da/d14/d2a/d49/d27/fae x:0 0 0 2024-09-21T10:41:00.483 INFO:tasks.workunit.client.0.smithi060.stdout:7/507: fsync da/d14/f54 0 2024-09-21T10:41:00.484 INFO:tasks.workunit.client.0.smithi060.stdout:8/521: symlink d2/d26/d37/d62/d74/d83/dac/lb5 0 2024-09-21T10:41:00.484 INFO:tasks.workunit.client.0.smithi060.stdout:8/522: creat d2/d26/d37/d64/d65/fb6 x:0 0 0 2024-09-21T10:41:00.484 INFO:tasks.workunit.client.0.smithi060.stdout:8/523: chown d2/d26/d37/d64/d65/c99 184401 1 2024-09-21T10:41:00.484 INFO:tasks.workunit.client.0.smithi060.stdout:8/524: stat d2/d26/d37/d62/d74/c84 0 2024-09-21T10:41:00.487 INFO:tasks.workunit.client.0.smithi060.stdout:0/514: rename d5/d10/d4e/f6f to d5/d10/da/d20/d45/d2a/d40/d75/f9d 0 2024-09-21T10:41:00.487 INFO:tasks.workunit.client.0.smithi060.stdout:0/515: write d5/d10/f3d [942074,116616] 0 2024-09-21T10:41:00.492 INFO:tasks.workunit.client.0.smithi060.stdout:8/525: creat d2/d5a/fb7 x:0 0 0 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/526: link d2/d26/d37/d64/d65/la0 d2/d26/d37/d62/d74/lb8 0 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/527: write d2/d26/d37/d62/f8d [215641,89437] 0 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/528: write d2/d18/f5c [158347,90099] 0 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/529: stat d2/d26/d37/d62/d77/f79 0 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/530: chown d2/d18/d4b/d61/f94 1 1 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/531: chown d2/d26/d37/d62/d77/f79 704853457 1 2024-09-21T10:41:00.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/532: chown d2/d26/l2e 5264 1 2024-09-21T10:41:00.497 INFO:tasks.workunit.client.0.smithi060.stdout:8/533: chown d2/c42 714 1 2024-09-21T10:41:00.511 INFO:tasks.workunit.client.0.smithi060.stdout:7/508: dwrite da/f73 [0,4194304] 0 2024-09-21T10:41:00.511 INFO:tasks.workunit.client.0.smithi060.stdout:7/509: write da/d14/d25/f91 [79459,108276] 0 2024-09-21T10:41:00.513 INFO:tasks.workunit.client.0.smithi060.stdout:9/371: sync 2024-09-21T10:41:00.513 INFO:tasks.workunit.client.0.smithi060.stdout:9/372: read - d3/d15/d53/f74 zero size 2024-09-21T10:41:00.514 INFO:tasks.workunit.client.0.smithi060.stdout:0/516: truncate d5/d10/f3d 880997 0 2024-09-21T10:41:00.514 INFO:tasks.workunit.client.0.smithi060.stdout:0/517: fdatasync d5/d10/da/d2d/f5b 0 2024-09-21T10:41:00.518 INFO:tasks.workunit.client.0.smithi060.stdout:9/373: creat d3/d15/d78/f7d x:0 0 0 2024-09-21T10:41:00.519 INFO:tasks.workunit.client.0.smithi060.stdout:8/534: dwrite d2/d26/d37/d64/d65/fa5 [0,4194304] 0 2024-09-21T10:41:00.520 INFO:tasks.workunit.client.0.smithi060.stdout:0/518: mknod d5/d10/d4e/c9e 0 2024-09-21T10:41:00.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/519: creat d5/d10/da/d20/d4d/f9f x:0 0 0 2024-09-21T10:41:00.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/520: dread - d5/d10/da/d4b/f8b zero size 2024-09-21T10:41:00.524 INFO:tasks.workunit.client.0.smithi060.stdout:9/374: mkdir d3/d16/d42/d7e 0 2024-09-21T10:41:00.526 INFO:tasks.workunit.client.0.smithi060.stdout:9/375: mkdir d3/d16/d7f 0 2024-09-21T10:41:00.526 INFO:tasks.workunit.client.0.smithi060.stdout:9/376: chown d3/d16/d42/d7e 0 1 2024-09-21T10:41:00.529 INFO:tasks.workunit.client.0.smithi060.stdout:7/510: dwrite da/d14/d25/d56/f92 [0,4194304] 0 2024-09-21T10:41:00.536 INFO:tasks.workunit.client.0.smithi060.stdout:7/511: creat da/d14/d15/d8b/da7/faf x:0 0 0 2024-09-21T10:41:00.536 INFO:tasks.workunit.client.0.smithi060.stdout:9/377: dread d3/f4f [0,4194304] 0 2024-09-21T10:41:00.538 INFO:tasks.workunit.client.0.smithi060.stdout:7/512: stat da/d14/d25/c42 0 2024-09-21T10:41:00.538 INFO:tasks.workunit.client.0.smithi060.stdout:7/513: truncate da/d14/d15/f82 969390 0 2024-09-21T10:41:00.541 INFO:tasks.workunit.client.0.smithi060.stdout:9/378: unlink d3/d16/d42/f5d 0 2024-09-21T10:41:00.541 INFO:tasks.workunit.client.0.smithi060.stdout:9/379: getdents d3/d16/d7f 0 2024-09-21T10:41:00.542 INFO:tasks.workunit.client.0.smithi060.stdout:9/380: symlink d3/d16/d42/l80 0 2024-09-21T10:41:00.544 INFO:tasks.workunit.client.0.smithi060.stdout:9/381: truncate d3/d5e/d60/d2f/f31 3661784 0 2024-09-21T10:41:00.545 INFO:tasks.workunit.client.0.smithi060.stdout:8/535: dwrite d2/f5d [0,4194304] 0 2024-09-21T10:41:00.545 INFO:tasks.workunit.client.0.smithi060.stdout:8/536: chown d2/f23 2631 1 2024-09-21T10:41:00.546 INFO:tasks.workunit.client.0.smithi060.stdout:0/521: dwrite d5/d10/da/d20/f62 [0,4194304] 0 2024-09-21T10:41:00.546 INFO:tasks.workunit.client.0.smithi060.stdout:0/522: write d5/d10/da/d20/f93 [489994,26004] 0 2024-09-21T10:41:00.547 INFO:tasks.workunit.client.0.smithi060.stdout:7/514: write da/fc [1496805,102364] 0 2024-09-21T10:41:00.549 INFO:tasks.workunit.client.0.smithi060.stdout:8/537: truncate d2/f15 1220755 0 2024-09-21T10:41:00.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/523: mknod d5/d10/da/d4b/ca0 0 2024-09-21T10:41:00.553 INFO:tasks.workunit.client.0.smithi060.stdout:9/382: dread d3/f4f [0,4194304] 0 2024-09-21T10:41:00.553 INFO:tasks.workunit.client.0.smithi060.stdout:7/515: mkdir da/d14/d35/d79/db0 0 2024-09-21T10:41:00.557 INFO:tasks.workunit.client.0.smithi060.stdout:7/516: dread da/d14/d15/f7e [0,4194304] 0 2024-09-21T10:41:00.557 INFO:tasks.workunit.client.0.smithi060.stdout:7/517: stat da/d14/d2a/d49/f5f 0 2024-09-21T10:41:00.557 INFO:tasks.workunit.client.0.smithi060.stdout:7/518: stat da/d14/d2a/d49/d27/f87 0 2024-09-21T10:41:00.560 INFO:tasks.workunit.client.0.smithi060.stdout:9/383: dread d3/f35 [0,4194304] 0 2024-09-21T10:41:00.560 INFO:tasks.workunit.client.0.smithi060.stdout:9/384: chown d3/d15/d5a/d64 855196477 1 2024-09-21T10:41:00.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/519: mkdir da/d60/d6e/db1 0 2024-09-21T10:41:00.567 INFO:tasks.workunit.client.0.smithi060.stdout:9/385: creat d3/d16/d42/d7e/f81 x:0 0 0 2024-09-21T10:41:00.567 INFO:tasks.workunit.client.0.smithi060.stdout:9/386: getdents d3/d15/d5a/d64 0 2024-09-21T10:41:00.567 INFO:tasks.workunit.client.0.smithi060.stdout:9/387: fdatasync d3/d15/f22 0 2024-09-21T10:41:00.567 INFO:tasks.workunit.client.0.smithi060.stdout:9/388: getdents d3/d16/d1a/d71 0 2024-09-21T10:41:00.569 INFO:tasks.workunit.client.0.smithi060.stdout:9/389: write d3/d15/f3c [5160397,105704] 0 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:8/538: link d2/d26/f35 d2/fb9 0 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:8/539: chown d2/fb9 454844 1 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:0/524: dwrite d5/d10/f61 [0,4194304] 0 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:7/520: symlink da/lb2 0 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:7/521: fdatasync da/d14/f48 0 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:7/522: stat da/d14/d25/fa4 0 2024-09-21T10:41:00.570 INFO:tasks.workunit.client.0.smithi060.stdout:7/523: chown da/d14/d25/d56/f75 247 1 2024-09-21T10:41:00.571 INFO:tasks.workunit.client.0.smithi060.stdout:7/524: read da/d14/d2a/d49/f6c [402160,129241] 0 2024-09-21T10:41:00.571 INFO:tasks.workunit.client.0.smithi060.stdout:7/525: readlink da/d14/d35/l37 0 2024-09-21T10:41:00.572 INFO:tasks.workunit.client.0.smithi060.stdout:9/390: rmdir d3/d15/d5a 39 2024-09-21T10:41:00.573 INFO:tasks.workunit.client.0.smithi060.stdout:8/540: mknod d2/d26/d37/d62/d74/d83/dac/cba 0 2024-09-21T10:41:00.573 INFO:tasks.workunit.client.0.smithi060.stdout:8/541: chown d2/d26/d37/d62/d74/d83/dac/lb5 3 1 2024-09-21T10:41:00.576 INFO:tasks.workunit.client.0.smithi060.stdout:0/525: symlink d5/d10/da/d20/d45/d2a/d40/d48/d63/la1 0 2024-09-21T10:41:00.578 INFO:tasks.workunit.client.0.smithi060.stdout:7/526: link da/d14/d15/f82 da/d14/d15/d8b/fb3 0 2024-09-21T10:41:00.579 INFO:tasks.workunit.client.0.smithi060.stdout:7/527: write da/d14/d15/d8b/fb3 [552248,39108] 0 2024-09-21T10:41:00.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/391: unlink d3/d16/d1a/f28 0 2024-09-21T10:41:00.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/392: chown d3/d15/f2b 192467 1 2024-09-21T10:41:00.580 INFO:tasks.workunit.client.0.smithi060.stdout:9/393: creat d3/d5e/f82 x:0 0 0 2024-09-21T10:41:00.582 INFO:tasks.workunit.client.0.smithi060.stdout:8/542: symlink d2/d18/d4b/lbb 0 2024-09-21T10:41:00.582 INFO:tasks.workunit.client.0.smithi060.stdout:8/543: chown d2/d18/d4b/lbb 35 1 2024-09-21T10:41:00.584 INFO:tasks.workunit.client.0.smithi060.stdout:0/526: link d5/d10/d11/f28 d5/d10/da/d2d/fa2 0 2024-09-21T10:41:00.587 INFO:tasks.workunit.client.0.smithi060.stdout:8/544: mknod d2/d5a/cbc 0 2024-09-21T10:41:00.589 INFO:tasks.workunit.client.0.smithi060.stdout:0/527: mknod d5/d10/d43/ca3 0 2024-09-21T10:41:00.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/528: dread da/d14/d2a/f81 [0,4194304] 0 2024-09-21T10:41:00.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/529: stat da/d60/d6e/l51 0 2024-09-21T10:41:00.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/530: fsync da/d14/d15/faa 0 2024-09-21T10:41:00.592 INFO:tasks.workunit.client.0.smithi060.stdout:7/531: creat da/d14/fb4 x:0 0 0 2024-09-21T10:41:00.593 INFO:tasks.workunit.client.0.smithi060.stdout:8/545: read d2/f23 [1242599,126885] 0 2024-09-21T10:41:00.593 INFO:tasks.workunit.client.0.smithi060.stdout:8/546: stat d2/d26/d37/d62/f88 0 2024-09-21T10:41:00.598 INFO:tasks.workunit.client.0.smithi060.stdout:7/532: write da/d14/d15/ff [326252,35195] 0 2024-09-21T10:41:00.598 INFO:tasks.workunit.client.0.smithi060.stdout:7/533: truncate da/fc 4262716 0 2024-09-21T10:41:00.602 INFO:tasks.workunit.client.0.smithi060.stdout:9/394: dwrite d3/d5e/d60/d2f/f57 [0,4194304] 0 2024-09-21T10:41:00.611 INFO:tasks.workunit.client.0.smithi060.stdout:0/528: dwrite f2 [0,4194304] 0 2024-09-21T10:41:00.611 INFO:tasks.workunit.client.0.smithi060.stdout:0/529: fdatasync d5/d10/f61 0 2024-09-21T10:41:00.614 INFO:tasks.workunit.client.0.smithi060.stdout:0/530: rename d5/d10/da/d20/d45/d2a to d5/d10/da/d4b/da4 0 2024-09-21T10:41:00.617 INFO:tasks.workunit.client.0.smithi060.stdout:0/531: link d5/d10/da/d4b/da4/d40/d75/f9d d5/d10/da/fa5 0 2024-09-21T10:41:00.624 INFO:tasks.workunit.client.0.smithi060.stdout:8/547: dwrite d2/d5a/f8b [0,4194304] 0 2024-09-21T10:41:00.624 INFO:tasks.workunit.client.0.smithi060.stdout:7/534: dwrite da/d14/d25/f2c [0,4194304] 0 2024-09-21T10:41:00.629 INFO:tasks.workunit.client.0.smithi060.stdout:9/395: dwrite d3/d5e/d60/f39 [0,4194304] 0 2024-09-21T10:41:00.631 INFO:tasks.workunit.client.0.smithi060.stdout:7/535: mknod da/d14/d25/d56/cb5 0 2024-09-21T10:41:00.633 INFO:tasks.workunit.client.0.smithi060.stdout:7/536: mkdir da/d14/d2a/db6 0 2024-09-21T10:41:00.634 INFO:tasks.workunit.client.0.smithi060.stdout:7/537: read - da/d60/f97 zero size 2024-09-21T10:41:00.634 INFO:tasks.workunit.client.0.smithi060.stdout:7/538: chown da/d60 1202 1 2024-09-21T10:41:00.640 INFO:tasks.workunit.client.0.smithi060.stdout:9/396: dread d3/d5e/f66 [0,4194304] 0 2024-09-21T10:41:00.644 INFO:tasks.workunit.client.0.smithi060.stdout:7/539: dread da/d14/d25/d56/f62 [0,4194304] 0 2024-09-21T10:41:00.647 INFO:tasks.workunit.client.0.smithi060.stdout:7/540: truncate da/d14/d35/d32/f52 24764 0 2024-09-21T10:41:00.650 INFO:tasks.workunit.client.0.smithi060.stdout:7/541: creat da/d14/d15/d8b/fb7 x:0 0 0 2024-09-21T10:41:00.650 INFO:tasks.workunit.client.0.smithi060.stdout:7/542: chown da/d14/l5a 737236 1 2024-09-21T10:41:00.652 INFO:tasks.workunit.client.0.smithi060.stdout:7/543: rename da/d14/d35/l4f to da/d14/lb8 0 2024-09-21T10:41:00.652 INFO:tasks.workunit.client.0.smithi060.stdout:7/544: dread - da/d14/d2a/d49/d27/f87 zero size 2024-09-21T10:41:00.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/397: dwrite d3/d15/d5a/f67 [0,4194304] 0 2024-09-21T10:41:00.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/398: chown d3/d16/d42/d7e 110356 1 2024-09-21T10:41:00.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/399: fdatasync d3/d16/d5f/f65 0 2024-09-21T10:41:00.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/400: readlink d3/d16/d1a/l48 0 2024-09-21T10:41:00.664 INFO:tasks.workunit.client.0.smithi060.stdout:9/401: dread d3/ff [0,4194304] 0 2024-09-21T10:41:00.664 INFO:tasks.workunit.client.0.smithi060.stdout:9/402: readlink d3/d15/l40 0 2024-09-21T10:41:00.665 INFO:tasks.workunit.client.0.smithi060.stdout:1/422: sync 2024-09-21T10:41:00.665 INFO:tasks.workunit.client.0.smithi060.stdout:1/423: chown d6/c7 1 1 2024-09-21T10:41:00.666 INFO:tasks.workunit.client.0.smithi060.stdout:7/545: dwrite da/d14/d35/d32/f68 [0,4194304] 0 2024-09-21T10:41:00.669 INFO:tasks.workunit.client.0.smithi060.stdout:9/403: mknod d3/d5e/d60/d2f/d5b/c83 0 2024-09-21T10:41:00.669 INFO:tasks.workunit.client.0.smithi060.stdout:1/424: symlink d6/l98 0 2024-09-21T10:41:00.673 INFO:tasks.workunit.client.0.smithi060.stdout:7/546: symlink da/d14/d15/lb9 0 2024-09-21T10:41:00.676 INFO:tasks.workunit.client.0.smithi060.stdout:9/404: rename d3/d5e/d60/f23 to d3/d16/d5f/f84 0 2024-09-21T10:41:00.678 INFO:tasks.workunit.client.0.smithi060.stdout:1/425: mkdir d6/d24/da/db/d7e/d90/d99 0 2024-09-21T10:41:00.682 INFO:tasks.workunit.client.0.smithi060.stdout:7/547: unlink da/d14/d25/fa4 0 2024-09-21T10:41:00.683 INFO:tasks.workunit.client.0.smithi060.stdout:9/405: mkdir d3/d16/d42/d7e/d85 0 2024-09-21T10:41:00.685 INFO:tasks.workunit.client.0.smithi060.stdout:1/426: rmdir d6/d24/da/db/d7e/d90 39 2024-09-21T10:41:00.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/406: link d3/d5e/f66 d3/d5e/d60/f86 0 2024-09-21T10:41:00.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/407: write d3/d5e/d60/f25 [3089736,57931] 0 2024-09-21T10:41:00.697 INFO:tasks.workunit.client.0.smithi060.stdout:1/427: creat d6/d24/da/db/d7e/f9a x:0 0 0 2024-09-21T10:41:00.697 INFO:tasks.workunit.client.0.smithi060.stdout:1/428: fdatasync d6/d24/da/db/de/d32/f3b 0 2024-09-21T10:41:00.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/408: rename d3/l5 to d3/d5e/d60/d2f/l87 0 2024-09-21T10:41:00.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/409: creat d3/d16/d5f/f88 x:0 0 0 2024-09-21T10:41:00.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/410: write d3/d16/d1a/f72 [376637,75678] 0 2024-09-21T10:41:00.701 INFO:tasks.workunit.client.0.smithi060.stdout:7/548: dwrite da/d14/d2a/f81 [0,4194304] 0 2024-09-21T10:41:00.702 INFO:tasks.workunit.client.0.smithi060.stdout:1/429: mkdir d6/d24/d50/d9b 0 2024-09-21T10:41:00.705 INFO:tasks.workunit.client.0.smithi060.stdout:9/411: truncate d3/fa 6726868 0 2024-09-21T10:41:00.705 INFO:tasks.workunit.client.0.smithi060.stdout:9/412: dread - d3/d15/d78/f7d zero size 2024-09-21T10:41:00.705 INFO:tasks.workunit.client.0.smithi060.stdout:9/413: creat d3/f89 x:0 0 0 2024-09-21T10:41:00.706 INFO:tasks.workunit.client.0.smithi060.stdout:9/414: truncate d3/d16/f44 809223 0 2024-09-21T10:41:00.707 INFO:tasks.workunit.client.0.smithi060.stdout:7/549: creat da/d14/d2a/db6/fba x:0 0 0 2024-09-21T10:41:00.709 INFO:tasks.workunit.client.0.smithi060.stdout:1/430: symlink d6/d24/da/l9c 0 2024-09-21T10:41:00.709 INFO:tasks.workunit.client.0.smithi060.stdout:1/431: read d6/d24/da/f12 [606524,54676] 0 2024-09-21T10:41:00.709 INFO:tasks.workunit.client.0.smithi060.stdout:1/432: write d6/d24/d50/f8f [998120,26818] 0 2024-09-21T10:41:00.713 INFO:tasks.workunit.client.0.smithi060.stdout:9/415: mknod d3/c8a 0 2024-09-21T10:41:00.714 INFO:tasks.workunit.client.0.smithi060.stdout:9/416: mknod d3/d16/d1f/c8b 0 2024-09-21T10:41:00.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/417: rmdir d3/d16/d1f/d79 0 2024-09-21T10:41:00.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/418: chown d3/f35 4659 1 2024-09-21T10:41:00.717 INFO:tasks.workunit.client.0.smithi060.stdout:1/433: dread d6/f44 [0,4194304] 0 2024-09-21T10:41:00.718 INFO:tasks.workunit.client.0.smithi060.stdout:1/434: mknod d6/d24/da/db/de/d7c/c9d 0 2024-09-21T10:41:00.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/419: dread d3/fc [0,4194304] 0 2024-09-21T10:41:00.732 INFO:tasks.workunit.client.0.smithi060.stdout:7/550: dwrite da/d14/d15/faa [0,4194304] 0 2024-09-21T10:41:00.732 INFO:tasks.workunit.client.0.smithi060.stdout:1/435: dwrite d6/d24/da/db/de/d32/f37 [4194304,4194304] 0 2024-09-21T10:41:00.732 INFO:tasks.workunit.client.0.smithi060.stdout:1/436: fdatasync d6/d24/da/db/f5f 0 2024-09-21T10:41:00.738 INFO:tasks.workunit.client.0.smithi060.stdout:7/551: rmdir da/d14/d2a/d49 39 2024-09-21T10:41:00.738 INFO:tasks.workunit.client.0.smithi060.stdout:7/552: chown da/d14/f72 0 1 2024-09-21T10:41:00.739 INFO:tasks.workunit.client.0.smithi060.stdout:1/437: dread d6/d24/da/db/de/f1a [0,4194304] 0 2024-09-21T10:41:00.739 INFO:tasks.workunit.client.0.smithi060.stdout:1/438: fdatasync d6/d24/fc 0 2024-09-21T10:41:00.740 INFO:tasks.workunit.client.0.smithi060.stdout:1/439: unlink d6/d24/c54 0 2024-09-21T10:41:00.742 INFO:tasks.workunit.client.0.smithi060.stdout:7/553: dread da/d14/d15/f76 [8388608,4194304] 0 2024-09-21T10:41:00.744 INFO:tasks.workunit.client.0.smithi060.stdout:7/554: mknod da/d14/d25/cbb 0 2024-09-21T10:41:00.747 INFO:tasks.workunit.client.0.smithi060.stdout:1/440: read d6/d24/da/db/dd/f3d [3492805,103509] 0 2024-09-21T10:41:00.747 INFO:tasks.workunit.client.0.smithi060.stdout:7/555: mknod da/d14/d2a/d49/cbc 0 2024-09-21T10:41:00.747 INFO:tasks.workunit.client.0.smithi060.stdout:7/556: write da/d14/d2a/f2d [3196178,75479] 0 2024-09-21T10:41:00.749 INFO:tasks.workunit.client.0.smithi060.stdout:9/420: dwrite d3/fa [0,4194304] 0 2024-09-21T10:41:00.750 INFO:tasks.workunit.client.0.smithi060.stdout:7/557: rename da/d14/d2a/d49/f6d to da/d14/d25/fbd 0 2024-09-21T10:41:00.760 INFO:tasks.workunit.client.0.smithi060.stdout:7/558: symlink da/d60/lbe 0 2024-09-21T10:41:00.760 INFO:tasks.workunit.client.0.smithi060.stdout:9/421: dread d3/d16/d5f/f65 [0,4194304] 0 2024-09-21T10:41:00.760 INFO:tasks.workunit.client.0.smithi060.stdout:9/422: creat d3/d15/d78/f8c x:0 0 0 2024-09-21T10:41:00.761 INFO:tasks.workunit.client.0.smithi060.stdout:9/423: write d3/d16/d1a/f4c [804431,59512] 0 2024-09-21T10:41:00.761 INFO:tasks.workunit.client.0.smithi060.stdout:1/441: dwrite d6/d24/da/db/f56 [0,4194304] 0 2024-09-21T10:41:00.761 INFO:tasks.workunit.client.0.smithi060.stdout:7/559: symlink da/d14/d2a/d49/d27/lbf 0 2024-09-21T10:41:00.762 INFO:tasks.workunit.client.0.smithi060.stdout:7/560: write da/f12 [2110513,62755] 0 2024-09-21T10:41:00.762 INFO:tasks.workunit.client.0.smithi060.stdout:7/561: read - da/d14/d2a/f86 zero size 2024-09-21T10:41:00.762 INFO:tasks.workunit.client.0.smithi060.stdout:7/562: write da/d14/d15/d8b/da7/faf [664875,34349] 0 2024-09-21T10:41:00.809 INFO:tasks.workunit.client.0.smithi060.stdout:1/442: symlink d6/d24/da/d45/d76/l9e 0 2024-09-21T10:41:00.809 INFO:tasks.workunit.client.0.smithi060.stdout:1/443: chown d6/d24/da/d45/l7d 27649 1 2024-09-21T10:41:00.810 INFO:tasks.workunit.client.0.smithi060.stdout:7/563: rename da/d14/d2a/d49/d27/f44 to da/d14/d2a/d49/d2e/fc0 0 2024-09-21T10:41:00.811 INFO:tasks.workunit.client.0.smithi060.stdout:7/564: write da/d14/d2a/d49/d27/fae [43405,10256] 0 2024-09-21T10:41:00.811 INFO:tasks.workunit.client.0.smithi060.stdout:7/565: write da/d14/f72 [239175,73059] 0 2024-09-21T10:41:00.811 INFO:tasks.workunit.client.0.smithi060.stdout:7/566: stat da/d14/d15/d8b/fb3 0 2024-09-21T10:41:00.811 INFO:tasks.workunit.client.0.smithi060.stdout:7/567: chown da/d14/d15/f7e 7068 1 2024-09-21T10:41:00.816 INFO:tasks.workunit.client.0.smithi060.stdout:2/229: sync 2024-09-21T10:41:00.816 INFO:tasks.workunit.client.0.smithi060.stdout:6/508: sync 2024-09-21T10:41:00.816 INFO:tasks.workunit.client.0.smithi060.stdout:2/230: fsync d3/d20/d15/f3d 0 2024-09-21T10:41:00.905 INFO:tasks.workunit.client.0.smithi060.stdout:1/444: mkdir d6/d24/da/db/d79/d86/d9f 0 2024-09-21T10:41:00.914 INFO:tasks.workunit.client.0.smithi060.stdout:2/231: creat d3/d20/d17/f4a x:0 0 0 2024-09-21T10:41:00.914 INFO:tasks.workunit.client.0.smithi060.stdout:2/232: readlink d3/lf 0 2024-09-21T10:41:00.914 INFO:tasks.workunit.client.0.smithi060.stdout:2/233: chown d3/d20/d15/c3e 127812625 1 2024-09-21T10:41:00.914 INFO:tasks.workunit.client.0.smithi060.stdout:2/234: fsync d3/d20/d15/f3d 0 2024-09-21T10:41:00.925 INFO:tasks.workunit.client.0.smithi060.stdout:2/235: mkdir d3/d20/d15/d30/d43/d4b 0 2024-09-21T10:41:00.943 INFO:tasks.workunit.client.0.smithi060.stdout:2/236: dwrite d3/d7/d24/f49 [0,4194304] 0 2024-09-21T10:41:00.945 INFO:tasks.workunit.client.0.smithi060.stdout:2/237: dread d3/d20/d15/d30/f3f [0,4194304] 0 2024-09-21T10:41:00.950 INFO:tasks.workunit.client.0.smithi060.stdout:2/238: truncate d3/f5 1941470 0 2024-09-21T10:41:00.953 INFO:tasks.workunit.client.0.smithi060.stdout:2/239: mkdir d3/d20/d15/d4c 0 2024-09-21T10:41:00.953 INFO:tasks.workunit.client.0.smithi060.stdout:2/240: chown d3/d20/d15/l1d 59 1 2024-09-21T10:41:00.981 INFO:tasks.workunit.client.0.smithi060.stdout:1/445: rename d6/d24/da/db/de/f1a to d6/d24/da/db/d79/d86/fa0 0 2024-09-21T10:41:00.982 INFO:tasks.workunit.client.0.smithi060.stdout:1/446: readlink d6/d24/da/db/d1c/l61 0 2024-09-21T10:41:00.982 INFO:tasks.workunit.client.0.smithi060.stdout:1/447: symlink d6/d24/da/db/d79/d86/d95/la1 0 2024-09-21T10:41:00.984 INFO:tasks.workunit.client.0.smithi060.stdout:1/448: creat d6/d24/da/db/d79/d86/fa2 x:0 0 0 2024-09-21T10:41:00.991 INFO:tasks.workunit.client.0.smithi060.stdout:1/449: dread d6/d24/da/db/d1c/d4b/f82 [0,4194304] 0 2024-09-21T10:41:00.992 INFO:tasks.workunit.client.0.smithi060.stdout:1/450: truncate d6/d24/da/db/f5f 530830 0 2024-09-21T10:41:01.000 INFO:tasks.workunit.client.0.smithi060.stdout:9/424: rmdir d3/d16/d42 39 2024-09-21T10:41:01.000 INFO:tasks.workunit.client.0.smithi060.stdout:9/425: write d3/d16/d1f/f49 [573597,92432] 0 2024-09-21T10:41:01.000 INFO:tasks.workunit.client.0.smithi060.stdout:9/426: stat d3/d16/d42/l80 0 2024-09-21T10:41:01.000 INFO:tasks.workunit.client.0.smithi060.stdout:9/427: fdatasync d3/d5e/f66 0 2024-09-21T10:41:01.000 INFO:tasks.workunit.client.0.smithi060.stdout:9/428: write d3/d16/d1f/f49 [1042166,11741] 0 2024-09-21T10:41:01.001 INFO:tasks.workunit.client.0.smithi060.stdout:9/429: creat d3/d16/d7f/f8d x:0 0 0 2024-09-21T10:41:01.001 INFO:tasks.workunit.client.0.smithi060.stdout:9/430: creat d3/d5e/d60/f8e x:0 0 0 2024-09-21T10:41:01.001 INFO:tasks.workunit.client.0.smithi060.stdout:9/431: read - d3/d16/d5f/f6b zero size 2024-09-21T10:41:01.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/432: fsync d3/d16/d1a/f72 0 2024-09-21T10:41:01.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/433: write d3/d5e/d60/d2f/f50 [35766,29473] 0 2024-09-21T10:41:01.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/434: mkdir d3/d16/d42/d7e/d85/d8f 0 2024-09-21T10:41:01.002 INFO:tasks.workunit.client.0.smithi060.stdout:9/435: rmdir d3/d16/d42 39 2024-09-21T10:41:01.004 INFO:tasks.workunit.client.0.smithi060.stdout:3/471: sync 2024-09-21T10:41:01.004 INFO:tasks.workunit.client.0.smithi060.stdout:4/440: sync 2024-09-21T10:41:01.004 INFO:tasks.workunit.client.0.smithi060.stdout:5/487: sync 2024-09-21T10:41:01.005 INFO:tasks.workunit.client.0.smithi060.stdout:9/436: truncate d3/f9 2680439 0 2024-09-21T10:41:01.008 INFO:tasks.workunit.client.0.smithi060.stdout:5/488: symlink d5/la2 0 2024-09-21T10:41:01.011 INFO:tasks.workunit.client.0.smithi060.stdout:9/437: symlink d3/l90 0 2024-09-21T10:41:01.011 INFO:tasks.workunit.client.0.smithi060.stdout:9/438: creat d3/d5e/d60/f91 x:0 0 0 2024-09-21T10:41:01.011 INFO:tasks.workunit.client.0.smithi060.stdout:9/439: chown d3/d5e/d60/d2f/f50 0 1 2024-09-21T10:41:01.012 INFO:tasks.workunit.client.0.smithi060.stdout:5/489: truncate d5/f86 149475 0 2024-09-21T10:41:01.022 INFO:tasks.workunit.client.0.smithi060.stdout:3/472: dwrite d0/d1/d1e/f4b [0,4194304] 0 2024-09-21T10:41:01.022 INFO:tasks.workunit.client.0.smithi060.stdout:3/473: write d0/d1/d24/f5f [1014999,130656] 0 2024-09-21T10:41:01.022 INFO:tasks.workunit.client.0.smithi060.stdout:1/451: creat d6/d24/fa3 x:0 0 0 2024-09-21T10:41:01.022 INFO:tasks.workunit.client.0.smithi060.stdout:1/452: dread - d6/d24/d50/f78 zero size 2024-09-21T10:41:01.022 INFO:tasks.workunit.client.0.smithi060.stdout:1/453: creat d6/d4a/d5a/fa4 x:0 0 0 2024-09-21T10:41:01.022 INFO:tasks.workunit.client.0.smithi060.stdout:1/454: write d6/d24/fa3 [275482,93458] 0 2024-09-21T10:41:01.023 INFO:tasks.workunit.client.0.smithi060.stdout:3/474: rename d0/d1/d1e/f3e to d0/d1/d11/d2a/d93/f94 0 2024-09-21T10:41:01.023 INFO:tasks.workunit.client.0.smithi060.stdout:3/475: creat d0/d1/d24/d81/f95 x:0 0 0 2024-09-21T10:41:01.024 INFO:tasks.workunit.client.0.smithi060.stdout:1/455: creat d6/d24/da/fa5 x:0 0 0 2024-09-21T10:41:01.025 INFO:tasks.workunit.client.0.smithi060.stdout:1/456: fdatasync d6/d24/da/db/dd/f92 0 2024-09-21T10:41:01.027 INFO:tasks.workunit.client.0.smithi060.stdout:3/476: rmdir d0/d1/d11/d2a/d8e 0 2024-09-21T10:41:01.027 INFO:tasks.workunit.client.0.smithi060.stdout:1/457: getdents d6 0 2024-09-21T10:41:01.028 INFO:tasks.workunit.client.0.smithi060.stdout:3/477: symlink d0/d1/d11/d2a/d45/l96 0 2024-09-21T10:41:01.028 INFO:tasks.workunit.client.0.smithi060.stdout:3/478: readlink d0/l22 0 2024-09-21T10:41:01.028 INFO:tasks.workunit.client.0.smithi060.stdout:3/479: readlink d0/l3c 0 2024-09-21T10:41:01.029 INFO:tasks.workunit.client.0.smithi060.stdout:1/458: rmdir d6/d24/da/db/d7e/d90/d99 0 2024-09-21T10:41:01.030 INFO:tasks.workunit.client.0.smithi060.stdout:1/459: creat d6/d24/da/db/dd/fa6 x:0 0 0 2024-09-21T10:41:01.030 INFO:tasks.workunit.client.0.smithi060.stdout:5/490: dwrite d5/d45/f4b [0,4194304] 0 2024-09-21T10:41:01.031 INFO:tasks.workunit.client.0.smithi060.stdout:3/480: link d0/f16 d0/d1/d11/d2a/d45/f97 0 2024-09-21T10:41:01.036 INFO:tasks.workunit.client.0.smithi060.stdout:5/491: mknod d5/d45/d6d/ca3 0 2024-09-21T10:41:01.036 INFO:tasks.workunit.client.0.smithi060.stdout:5/492: write d5/d45/d6d/d10/d19/d8d/d50/f58 [4232425,27726] 0 2024-09-21T10:41:01.054 INFO:tasks.workunit.client.0.smithi060.stdout:1/460: dwrite d6/d24/da/db/d1c/f36 [4194304,4194304] 0 2024-09-21T10:41:01.054 INFO:tasks.workunit.client.0.smithi060.stdout:9/440: mkdir d3/d15/d92 0 2024-09-21T10:41:01.054 INFO:tasks.workunit.client.0.smithi060.stdout:9/441: dread - d3/d5e/f82 zero size 2024-09-21T10:41:01.055 INFO:tasks.workunit.client.0.smithi060.stdout:1/461: mknod d6/d4a/d5a/ca7 0 2024-09-21T10:41:01.057 INFO:tasks.workunit.client.0.smithi060.stdout:1/462: write d6/d24/da/db/d1c/f26 [4927014,93481] 0 2024-09-21T10:41:01.057 INFO:tasks.workunit.client.0.smithi060.stdout:1/463: readlink d6/d24/l67 0 2024-09-21T10:41:01.057 INFO:tasks.workunit.client.0.smithi060.stdout:1/464: creat d6/d4a/fa8 x:0 0 0 2024-09-21T10:41:01.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/241: mknod d3/d7/d24/c4d 0 2024-09-21T10:41:01.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/242: chown d3/d20/d15/c2c 14662414 1 2024-09-21T10:41:01.062 INFO:tasks.workunit.client.0.smithi060.stdout:9/442: dread d3/d15/f3c [0,4194304] 0 2024-09-21T10:41:01.062 INFO:tasks.workunit.client.0.smithi060.stdout:9/443: fdatasync d3/f9 0 2024-09-21T10:41:01.063 INFO:tasks.workunit.client.0.smithi060.stdout:9/444: creat d3/d15/f93 x:0 0 0 2024-09-21T10:41:01.063 INFO:tasks.workunit.client.0.smithi060.stdout:9/445: fdatasync d3/d15/d78/f8c 0 2024-09-21T10:41:01.069 INFO:tasks.workunit.client.0.smithi060.stdout:3/481: dwrite d0/d1/d1e/f35 [0,4194304] 0 2024-09-21T10:41:01.069 INFO:tasks.workunit.client.0.smithi060.stdout:5/493: dwrite d5/d45/f85 [0,4194304] 0 2024-09-21T10:41:01.069 INFO:tasks.workunit.client.0.smithi060.stdout:2/243: dread d3/d7/d24/f49 [0,4194304] 0 2024-09-21T10:41:01.074 INFO:tasks.workunit.client.0.smithi060.stdout:3/482: mkdir d0/d1/d11/d53/d98 0 2024-09-21T10:41:01.074 INFO:tasks.workunit.client.0.smithi060.stdout:5/494: mknod d5/d7a/d84/ca4 0 2024-09-21T10:41:01.076 INFO:tasks.workunit.client.0.smithi060.stdout:2/244: mknod d3/d7/d24/d25/c4e 0 2024-09-21T10:41:01.078 INFO:tasks.workunit.client.0.smithi060.stdout:5/495: dread d5/d45/d6d/d10/d19/f72 [0,4194304] 0 2024-09-21T10:41:01.078 INFO:tasks.workunit.client.0.smithi060.stdout:5/496: write d5/d45/d6d/d10/d19/d21/d7f/d89/f41 [951263,6717] 0 2024-09-21T10:41:01.078 INFO:tasks.workunit.client.0.smithi060.stdout:1/465: dwrite d6/d24/f49 [0,4194304] 0 2024-09-21T10:41:01.079 INFO:tasks.workunit.client.0.smithi060.stdout:2/245: getdents d3/d7 0 2024-09-21T10:41:01.080 INFO:tasks.workunit.client.0.smithi060.stdout:1/466: dread d6/d24/da/db/f5f [0,4194304] 0 2024-09-21T10:41:01.080 INFO:tasks.workunit.client.0.smithi060.stdout:1/467: dread - d6/d24/da/db/dd/f92 zero size 2024-09-21T10:41:01.080 INFO:tasks.workunit.client.0.smithi060.stdout:5/497: creat d5/d7a/fa5 x:0 0 0 2024-09-21T10:41:01.082 INFO:tasks.workunit.client.0.smithi060.stdout:9/446: dwrite d3/d16/d5f/f84 [0,4194304] 0 2024-09-21T10:41:01.082 INFO:tasks.workunit.client.0.smithi060.stdout:9/447: write d3/d5e/d60/d2f/f68 [927518,108688] 0 2024-09-21T10:41:01.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/246: mkdir d3/d7/d24/d25/d4f 0 2024-09-21T10:41:01.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/247: readlink d3/d20/d15/l3c 0 2024-09-21T10:41:01.084 INFO:tasks.workunit.client.0.smithi060.stdout:2/248: dread d3/d7/f34 [0,4194304] 0 2024-09-21T10:41:01.084 INFO:tasks.workunit.client.0.smithi060.stdout:2/249: fsync d3/d7/d23/f2f 0 2024-09-21T10:41:01.084 INFO:tasks.workunit.client.0.smithi060.stdout:1/468: creat d6/d24/da/db/d79/d86/d9f/fa9 x:0 0 0 2024-09-21T10:41:01.085 INFO:tasks.workunit.client.0.smithi060.stdout:5/498: mkdir d5/d45/d6d/d10/d19/d21/da6 0 2024-09-21T10:41:01.088 INFO:tasks.workunit.client.0.smithi060.stdout:2/250: rmdir d3/d7 39 2024-09-21T10:41:01.089 INFO:tasks.workunit.client.0.smithi060.stdout:1/469: truncate d6/d24/da/db/dd/f1d 2381877 0 2024-09-21T10:41:01.090 INFO:tasks.workunit.client.0.smithi060.stdout:1/470: write d6/f65 [822979,61375] 0 2024-09-21T10:41:01.090 INFO:tasks.workunit.client.0.smithi060.stdout:9/448: dread d3/fa [0,4194304] 0 2024-09-21T10:41:01.091 INFO:tasks.workunit.client.0.smithi060.stdout:3/483: dwrite d0/f28 [4194304,4194304] 0 2024-09-21T10:41:01.091 INFO:tasks.workunit.client.0.smithi060.stdout:5/499: creat d5/d45/d77/fa7 x:0 0 0 2024-09-21T10:41:01.092 INFO:tasks.workunit.client.0.smithi060.stdout:1/471: mkdir d6/d24/da/db/d79/d86/d9f/daa 0 2024-09-21T10:41:01.095 INFO:tasks.workunit.client.0.smithi060.stdout:9/449: creat d3/d16/d42/d7e/f94 x:0 0 0 2024-09-21T10:41:01.096 INFO:tasks.workunit.client.0.smithi060.stdout:5/500: mknod d5/d45/d6d/ca8 0 2024-09-21T10:41:01.096 INFO:tasks.workunit.client.0.smithi060.stdout:5/501: getdents d5/d7a/d84/d88 0 2024-09-21T10:41:01.098 INFO:tasks.workunit.client.0.smithi060.stdout:8/548: sync 2024-09-21T10:41:01.098 INFO:tasks.workunit.client.0.smithi060.stdout:0/532: sync 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:6/509: sync 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:7/568: sync 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:8/549: stat d2/d5a/fb7 0 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:0/533: stat d5/d10/da/d20/f93 0 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:8/550: write d2/d26/d37/d64/d65/fb6 [616545,51926] 0 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:8/551: dread - d2/f97 zero size 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:8/552: stat d2/d26 0 2024-09-21T10:41:01.099 INFO:tasks.workunit.client.0.smithi060.stdout:9/450: mkdir d3/d16/d95 0 2024-09-21T10:41:01.101 INFO:tasks.workunit.client.0.smithi060.stdout:5/502: mknod d5/d7a/d84/ca9 0 2024-09-21T10:41:01.102 INFO:tasks.workunit.client.0.smithi060.stdout:7/569: symlink da/d14/d35/d32/lc1 0 2024-09-21T10:41:01.102 INFO:tasks.workunit.client.0.smithi060.stdout:3/484: dread d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:41:01.104 INFO:tasks.workunit.client.0.smithi060.stdout:6/510: creat d3/d12/d16/d1a/d21/d90/f9d x:0 0 0 2024-09-21T10:41:01.105 INFO:tasks.workunit.client.0.smithi060.stdout:8/553: unlink d2/d26/d37/d64/c80 0 2024-09-21T10:41:01.105 INFO:tasks.workunit.client.0.smithi060.stdout:8/554: chown d2/d26/d37 1 1 2024-09-21T10:41:01.107 INFO:tasks.workunit.client.0.smithi060.stdout:9/451: rename d3/d15/f61 to d3/d5e/d60/d2f/d5b/f96 0 2024-09-21T10:41:01.108 INFO:tasks.workunit.client.0.smithi060.stdout:0/534: write d5/d10/f5a [2390467,86315] 0 2024-09-21T10:41:01.108 INFO:tasks.workunit.client.0.smithi060.stdout:0/535: creat d5/d10/da/d4b/fa6 x:0 0 0 2024-09-21T10:41:01.108 INFO:tasks.workunit.client.0.smithi060.stdout:0/536: stat d5/d10/d11/f28 0 2024-09-21T10:41:01.110 INFO:tasks.workunit.client.0.smithi060.stdout:7/570: creat da/d14/d35/d79/db0/fc2 x:0 0 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:5/503: write d5/d45/d6d/d10/d19/d21/d30/f35 [2814327,42876] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:5/504: write d5/f7 [1725095,128708] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/251: dwrite d3/d20/d17/f4a [0,4194304] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/252: creat d3/d20/d17/f50 x:0 0 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/253: read d3/d7/d24/f2a [388910,108663] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/254: write d3/d7/d24/f2a [706590,103941] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/255: write d3/d20/d15/f3d [206796,103211] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/256: write d3/d7/d23/f2f [722908,78009] 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/257: readlink d3/d20/d15/d3b/l45 0 2024-09-21T10:41:01.112 INFO:tasks.workunit.client.0.smithi060.stdout:3/485: mknod d0/d1/d11/d2a/d43/c99 0 2024-09-21T10:41:01.115 INFO:tasks.workunit.client.0.smithi060.stdout:0/537: getdents d5/d10/da/d20/d45 0 2024-09-21T10:41:01.115 INFO:tasks.workunit.client.0.smithi060.stdout:2/258: fdatasync d3/d7/d23/f2f 0 2024-09-21T10:41:01.117 INFO:tasks.workunit.client.0.smithi060.stdout:7/571: link da/d14/l29 da/d14/d35/d79/lc3 0 2024-09-21T10:41:01.121 INFO:tasks.workunit.client.0.smithi060.stdout:1/472: rmdir d6/d24/da/db/dd 39 2024-09-21T10:41:01.121 INFO:tasks.workunit.client.0.smithi060.stdout:2/259: dread d3/f5 [0,4194304] 0 2024-09-21T10:41:01.124 INFO:tasks.workunit.client.0.smithi060.stdout:5/505: read d5/d45/f4b [283862,19576] 0 2024-09-21T10:41:01.126 INFO:tasks.workunit.client.0.smithi060.stdout:8/555: getdents d2/d26/d37/d62/d74/d83/d89/d9a 0 2024-09-21T10:41:01.126 INFO:tasks.workunit.client.0.smithi060.stdout:6/511: dwrite d3/d12/d38/d41/f46 [0,4194304] 0 2024-09-21T10:41:01.128 INFO:tasks.workunit.client.0.smithi060.stdout:3/486: unlink d0/d1/l8 0 2024-09-21T10:41:01.128 INFO:tasks.workunit.client.0.smithi060.stdout:3/487: truncate d0/d1/d11/f15 3470699 0 2024-09-21T10:41:01.134 INFO:tasks.workunit.client.0.smithi060.stdout:0/538: mkdir d5/d10/da/da7 0 2024-09-21T10:41:01.140 INFO:tasks.workunit.client.0.smithi060.stdout:7/572: truncate da/d60/d6e/f69 126708 0 2024-09-21T10:41:01.142 INFO:tasks.workunit.client.0.smithi060.stdout:1/473: creat d6/d24/da/db/de/fab x:0 0 0 2024-09-21T10:41:01.143 INFO:tasks.workunit.client.0.smithi060.stdout:2/260: stat d3/d7/d24/d33/l35 0 2024-09-21T10:41:01.143 INFO:tasks.workunit.client.0.smithi060.stdout:2/261: write d3/d20/d17/f50 [992934,63366] 0 2024-09-21T10:41:01.145 INFO:tasks.workunit.client.0.smithi060.stdout:5/506: dread d5/d45/d6d/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:41:01.145 INFO:tasks.workunit.client.0.smithi060.stdout:8/556: truncate d2/d26/d37/d64/d65/f57 431950 0 2024-09-21T10:41:01.145 INFO:tasks.workunit.client.0.smithi060.stdout:8/557: stat d2/d18/d4b/d61 0 2024-09-21T10:41:01.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/512: dread d3/d12/d38/d41/f44 [0,4194304] 0 2024-09-21T10:41:01.149 INFO:tasks.workunit.client.0.smithi060.stdout:7/573: dread da/f12 [0,4194304] 0 2024-09-21T10:41:01.149 INFO:tasks.workunit.client.0.smithi060.stdout:0/539: link d5/f56 d5/d10/da/d4b/da4/d76/fa8 0 2024-09-21T10:41:01.150 INFO:tasks.workunit.client.0.smithi060.stdout:0/540: dread - d5/d10/da/d15/f7d zero size 2024-09-21T10:41:01.153 INFO:tasks.workunit.client.0.smithi060.stdout:3/488: dwrite d0/d1/d24/f40 [4194304,4194304] 0 2024-09-21T10:41:01.153 INFO:tasks.workunit.client.0.smithi060.stdout:3/489: write d0/d1/d11/f32 [1520154,30704] 0 2024-09-21T10:41:01.157 INFO:tasks.workunit.client.0.smithi060.stdout:1/474: rmdir d6/d24/d50/d9b 0 2024-09-21T10:41:01.158 INFO:tasks.workunit.client.0.smithi060.stdout:2/262: creat d3/d7/d24/d25/f51 x:0 0 0 2024-09-21T10:41:01.159 INFO:tasks.workunit.client.0.smithi060.stdout:5/507: creat d5/d45/faa x:0 0 0 2024-09-21T10:41:01.160 INFO:tasks.workunit.client.0.smithi060.stdout:8/558: chown d2/c16 11 1 2024-09-21T10:41:01.161 INFO:tasks.workunit.client.0.smithi060.stdout:3/490: write d0/d1/d11/d2a/f4d [1508457,42087] 0 2024-09-21T10:41:01.161 INFO:tasks.workunit.client.0.smithi060.stdout:6/513: mkdir d3/d12/d38/d9e 0 2024-09-21T10:41:01.163 INFO:tasks.workunit.client.0.smithi060.stdout:7/574: symlink da/d14/d15/d8b/da7/lc4 0 2024-09-21T10:41:01.164 INFO:tasks.workunit.client.0.smithi060.stdout:0/541: mknod d5/d10/da/d4b/da4/d40/d48/d63/ca9 0 2024-09-21T10:41:01.166 INFO:tasks.workunit.client.0.smithi060.stdout:8/559: write d2/d26/d37/d64/d65/f9c [2296002,99761] 0 2024-09-21T10:41:01.166 INFO:tasks.workunit.client.0.smithi060.stdout:0/542: dread d5/d10/da/d20/f9a [0,4194304] 0 2024-09-21T10:41:01.168 INFO:tasks.workunit.client.0.smithi060.stdout:1/475: creat d6/d24/d50/fac x:0 0 0 2024-09-21T10:41:01.168 INFO:tasks.workunit.client.0.smithi060.stdout:1/476: dread - d6/d24/da/db/d79/d86/d9f/fa9 zero size 2024-09-21T10:41:01.171 INFO:tasks.workunit.client.0.smithi060.stdout:2/263: truncate f2 3477257 0 2024-09-21T10:41:01.171 INFO:tasks.workunit.client.0.smithi060.stdout:2/264: creat d3/d7/d18/f52 x:0 0 0 2024-09-21T10:41:01.172 INFO:tasks.workunit.client.0.smithi060.stdout:5/508: rename d5/fa0 to d5/fab 0 2024-09-21T10:41:01.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/514: creat d3/d12/d38/f9f x:0 0 0 2024-09-21T10:41:01.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/515: fsync d3/d12/d16/d1a/d21/f23 0 2024-09-21T10:41:01.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/516: write d3/d12/d38/f9f [656730,33041] 0 2024-09-21T10:41:01.177 INFO:tasks.workunit.client.0.smithi060.stdout:1/477: dread d6/d24/da/db/de/f77 [0,4194304] 0 2024-09-21T10:41:01.180 INFO:tasks.workunit.client.0.smithi060.stdout:8/560: truncate d2/fb9 816895 0 2024-09-21T10:41:01.180 INFO:tasks.workunit.client.0.smithi060.stdout:5/509: dread d5/d45/d6d/d10/d19/f4e [0,4194304] 0 2024-09-21T10:41:01.181 INFO:tasks.workunit.client.0.smithi060.stdout:0/543: rmdir d5/d10/d11 39 2024-09-21T10:41:01.184 INFO:tasks.workunit.client.0.smithi060.stdout:2/265: symlink d3/d20/d15/d30/d43/l53 0 2024-09-21T10:41:01.185 INFO:tasks.workunit.client.0.smithi060.stdout:3/491: getdents d0/d1/d1e/d34 0 2024-09-21T10:41:01.186 INFO:tasks.workunit.client.0.smithi060.stdout:3/492: creat d0/d1/d11/d2a/d45/f9a x:0 0 0 2024-09-21T10:41:01.186 INFO:tasks.workunit.client.0.smithi060.stdout:2/266: dread d3/d20/d15/d30/f3f [0,4194304] 0 2024-09-21T10:41:01.188 INFO:tasks.workunit.client.0.smithi060.stdout:6/517: creat d3/d12/d16/d25/d76/fa0 x:0 0 0 2024-09-21T10:41:01.188 INFO:tasks.workunit.client.0.smithi060.stdout:6/518: readlink d3/d12/d16/d5b/l78 0 2024-09-21T10:41:01.189 INFO:tasks.workunit.client.0.smithi060.stdout:7/575: rmdir da/d14/d2a/db6 39 2024-09-21T10:41:01.191 INFO:tasks.workunit.client.0.smithi060.stdout:0/544: dread d5/d10/da/d4b/da4/f5c [0,4194304] 0 2024-09-21T10:41:01.191 INFO:tasks.workunit.client.0.smithi060.stdout:0/545: fdatasync d5/d10/da/d4b/da4/f6c 0 2024-09-21T10:41:01.191 INFO:tasks.workunit.client.0.smithi060.stdout:0/546: chown d5/d10/d11 16 1 2024-09-21T10:41:01.191 INFO:tasks.workunit.client.0.smithi060.stdout:0/547: fsync d5/d10/da/d20/f93 0 2024-09-21T10:41:01.191 INFO:tasks.workunit.client.0.smithi060.stdout:1/478: getdents d6/d24/da/db/d1c 0 2024-09-21T10:41:01.193 INFO:tasks.workunit.client.0.smithi060.stdout:8/561: rmdir d2/d18 39 2024-09-21T10:41:01.193 INFO:tasks.workunit.client.0.smithi060.stdout:8/562: write d2/d26/d37/d62/d77/f90 [1686462,67210] 0 2024-09-21T10:41:01.196 INFO:tasks.workunit.client.0.smithi060.stdout:5/510: rename d5/d45/l68 to d5/d45/d6d/d10/d19/d21/d7f/d89/lac 0 2024-09-21T10:41:01.198 INFO:tasks.workunit.client.0.smithi060.stdout:7/576: write da/d14/d15/f76 [226652,120016] 0 2024-09-21T10:41:01.201 INFO:tasks.workunit.client.0.smithi060.stdout:2/267: creat d3/d20/d15/d30/d43/f54 x:0 0 0 2024-09-21T10:41:01.203 INFO:tasks.workunit.client.0.smithi060.stdout:6/519: mknod d3/d12/d16/d22/d58/d75/ca1 0 2024-09-21T10:41:01.203 INFO:tasks.workunit.client.0.smithi060.stdout:3/493: dwrite d0/d1/f70 [0,4194304] 0 2024-09-21T10:41:01.205 INFO:tasks.workunit.client.0.smithi060.stdout:0/548: getdents d5/d10/da/d4b/da4 0 2024-09-21T10:41:01.208 INFO:tasks.workunit.client.0.smithi060.stdout:1/479: mkdir d6/d24/da/db/d79/dad 0 2024-09-21T10:41:01.210 INFO:tasks.workunit.client.0.smithi060.stdout:5/511: creat d5/d45/d77/d8f/d91/fad x:0 0 0 2024-09-21T10:41:01.210 INFO:tasks.workunit.client.0.smithi060.stdout:5/512: fdatasync d5/d45/faa 0 2024-09-21T10:41:01.217 INFO:tasks.workunit.client.0.smithi060.stdout:7/577: creat da/d14/d15/fc5 x:0 0 0 2024-09-21T10:41:01.219 INFO:tasks.workunit.client.0.smithi060.stdout:2/268: mkdir d3/d7/d23/d55 0 2024-09-21T10:41:01.221 INFO:tasks.workunit.client.0.smithi060.stdout:6/520: rename d3/d12/f3b to d3/d12/d65/d66/fa2 0 2024-09-21T10:41:01.221 INFO:tasks.workunit.client.0.smithi060.stdout:6/521: fsync d3/d12/d16/f40 0 2024-09-21T10:41:01.227 INFO:tasks.workunit.client.0.smithi060.stdout:1/480: dwrite d6/d24/da/db/de/f21 [0,4194304] 0 2024-09-21T10:41:01.227 INFO:tasks.workunit.client.0.smithi060.stdout:1/481: dread - d6/d24/da/db/d79/d86/fa2 zero size 2024-09-21T10:41:01.227 INFO:tasks.workunit.client.0.smithi060.stdout:1/482: fsync d6/d24/da/f1f 0 2024-09-21T10:41:01.228 INFO:tasks.workunit.client.0.smithi060.stdout:0/549: truncate d5/d10/da/d20/f62 7137708 0 2024-09-21T10:41:01.228 INFO:tasks.workunit.client.0.smithi060.stdout:0/550: readlink d5/d10/da/d20/d45/l42 0 2024-09-21T10:41:01.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/513: symlink d5/d7a/lae 0 2024-09-21T10:41:01.231 INFO:tasks.workunit.client.0.smithi060.stdout:8/563: dwrite d2/fe [0,4194304] 0 2024-09-21T10:41:01.231 INFO:tasks.workunit.client.0.smithi060.stdout:8/564: write d2/d26/d37/f55 [459384,86105] 0 2024-09-21T10:41:01.232 INFO:tasks.workunit.client.0.smithi060.stdout:7/578: truncate da/d14/d35/f1d 914633 0 2024-09-21T10:41:01.234 INFO:tasks.workunit.client.0.smithi060.stdout:2/269: mknod d3/d20/d15/d30/d43/c56 0 2024-09-21T10:41:01.234 INFO:tasks.workunit.client.0.smithi060.stdout:2/270: write d3/d7/f34 [843235,62507] 0 2024-09-21T10:41:01.234 INFO:tasks.workunit.client.0.smithi060.stdout:2/271: dread - d3/f38 zero size 2024-09-21T10:41:01.238 INFO:tasks.workunit.client.0.smithi060.stdout:3/494: getdents d0/d1/d24/d81 0 2024-09-21T10:41:01.241 INFO:tasks.workunit.client.0.smithi060.stdout:1/483: creat d6/d24/da/d45/d76/fae x:0 0 0 2024-09-21T10:41:01.242 INFO:tasks.workunit.client.0.smithi060.stdout:0/551: link d5/d10/da/d20/d45/c47 d5/d10/da/d4b/da4/d76/caa 0 2024-09-21T10:41:01.244 INFO:tasks.workunit.client.0.smithi060.stdout:8/565: creat d2/d18/fbd x:0 0 0 2024-09-21T10:41:01.245 INFO:tasks.workunit.client.0.smithi060.stdout:2/272: getdents d3/d7/d24 0 2024-09-21T10:41:01.248 INFO:tasks.workunit.client.0.smithi060.stdout:3/495: mknod d0/d1/d11/d2a/d64/c9b 0 2024-09-21T10:41:01.249 INFO:tasks.workunit.client.0.smithi060.stdout:7/579: dwrite da/d14/d35/f78 [0,4194304] 0 2024-09-21T10:41:01.249 INFO:tasks.workunit.client.0.smithi060.stdout:5/514: dwrite d5/d45/d6d/d10/d19/d21/f2d [0,4194304] 0 2024-09-21T10:41:01.249 INFO:tasks.workunit.client.0.smithi060.stdout:1/484: creat d6/d24/da/db/dd/faf x:0 0 0 2024-09-21T10:41:01.249 INFO:tasks.workunit.client.0.smithi060.stdout:1/485: dread - d6/d24/d50/f78 zero size 2024-09-21T10:41:01.251 INFO:tasks.workunit.client.0.smithi060.stdout:8/566: truncate d2/f12 382423 0 2024-09-21T10:41:01.252 INFO:tasks.workunit.client.0.smithi060.stdout:2/273: stat d3/d7/d24/d33/c37 0 2024-09-21T10:41:01.254 INFO:tasks.workunit.client.0.smithi060.stdout:6/522: rename d3/d12/d16/d1a/d21/d90 to d3/d12/d16/d1a/d83/da3 0 2024-09-21T10:41:01.256 INFO:tasks.workunit.client.0.smithi060.stdout:3/496: write d0/d1/d1e/f4b [509129,12370] 0 2024-09-21T10:41:01.257 INFO:tasks.workunit.client.0.smithi060.stdout:7/580: dread da/f12 [0,4194304] 0 2024-09-21T10:41:01.257 INFO:tasks.workunit.client.0.smithi060.stdout:7/581: fsync da/d14/f48 0 2024-09-21T10:41:01.258 INFO:tasks.workunit.client.0.smithi060.stdout:5/515: symlink d5/d45/d6d/d10/d19/d21/laf 0 2024-09-21T10:41:01.258 INFO:tasks.workunit.client.0.smithi060.stdout:5/516: stat d5/d45/c81 0 2024-09-21T10:41:01.259 INFO:tasks.workunit.client.0.smithi060.stdout:5/517: write d5/d45/d77/d8f/f96 [761486,39202] 0 2024-09-21T10:41:01.261 INFO:tasks.workunit.client.0.smithi060.stdout:8/567: write d2/d18/f5e [2727005,20906] 0 2024-09-21T10:41:01.263 INFO:tasks.workunit.client.0.smithi060.stdout:6/523: mknod d3/d12/d16/d25/ca4 0 2024-09-21T10:41:01.265 INFO:tasks.workunit.client.0.smithi060.stdout:3/497: link d0/d1/f14 d0/d1/d11/d2a/d64/f9c 0 2024-09-21T10:41:01.269 INFO:tasks.workunit.client.0.smithi060.stdout:5/518: truncate d5/d45/d6d/d10/d19/d8d/d50/f58 4204763 0 2024-09-21T10:41:01.269 INFO:tasks.workunit.client.0.smithi060.stdout:5/519: chown d5/d45/d6d/d10/c3d 1 1 2024-09-21T10:41:01.271 INFO:tasks.workunit.client.0.smithi060.stdout:2/274: rmdir d3/d7/d24/d25 39 2024-09-21T10:41:01.271 INFO:tasks.workunit.client.0.smithi060.stdout:2/275: fdatasync d3/d20/d15/f3d 0 2024-09-21T10:41:01.273 INFO:tasks.workunit.client.0.smithi060.stdout:8/568: mkdir d2/d18/d4b/dbe 0 2024-09-21T10:41:01.274 INFO:tasks.workunit.client.0.smithi060.stdout:0/552: rename d5/d10/da/d20 to d5/d10/da/d4b/da4/d40/d48/dab 0 2024-09-21T10:41:01.276 INFO:tasks.workunit.client.0.smithi060.stdout:3/498: creat d0/d1/d11/d2a/d87/f9d x:0 0 0 2024-09-21T10:41:01.276 INFO:tasks.workunit.client.0.smithi060.stdout:3/499: write d0/d1/d11/d2a/f2e [1817745,71376] 0 2024-09-21T10:41:01.288 INFO:tasks.workunit.client.0.smithi060.stdout:2/276: creat d3/d7/d24/d33/f57 x:0 0 0 2024-09-21T10:41:01.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/569: mknod d2/d18/d4b/d61/d6e/cbf 0 2024-09-21T10:41:01.292 INFO:tasks.workunit.client.0.smithi060.stdout:1/486: rename d6/d24/d50 to d6/d4a/d5a/db0 0 2024-09-21T10:41:01.292 INFO:tasks.workunit.client.0.smithi060.stdout:1/487: truncate d6/d24/da/d45/d76/fae 182758 0 2024-09-21T10:41:01.292 INFO:tasks.workunit.client.0.smithi060.stdout:1/488: fsync d6/f89 0 2024-09-21T10:41:01.292 INFO:tasks.workunit.client.0.smithi060.stdout:1/489: write d6/f44 [3361208,61930] 0 2024-09-21T10:41:01.294 INFO:tasks.workunit.client.0.smithi060.stdout:0/553: creat d5/d10/da/d4b/da4/d40/d48/fac x:0 0 0 2024-09-21T10:41:01.294 INFO:tasks.workunit.client.0.smithi060.stdout:0/554: write d5/d10/da/d4b/da4/d40/d48/dab/f65 [690050,47428] 0 2024-09-21T10:41:01.297 INFO:tasks.workunit.client.0.smithi060.stdout:5/520: rmdir d5/d45/d6d/d10/d19/d21/d7f 39 2024-09-21T10:41:01.300 INFO:tasks.workunit.client.0.smithi060.stdout:8/570: unlink d2/d26/d37/d62/f68 0 2024-09-21T10:41:01.302 INFO:tasks.workunit.client.0.smithi060.stdout:7/582: rename da/d14/d25/d56/f6a to da/fc6 0 2024-09-21T10:41:01.303 INFO:tasks.workunit.client.0.smithi060.stdout:8/571: mknod d2/d26/da4/cc0 0 2024-09-21T10:41:01.303 INFO:tasks.workunit.client.0.smithi060.stdout:8/572: stat d2/d26/d37/d62/d74/d83/d89 0 2024-09-21T10:41:01.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/277: rename d3/d7/c41 to d3/d20/d15/d4c/c58 0 2024-09-21T10:41:01.307 INFO:tasks.workunit.client.0.smithi060.stdout:7/583: creat da/d14/d2a/d49/fc7 x:0 0 0 2024-09-21T10:41:01.308 INFO:tasks.workunit.client.0.smithi060.stdout:0/555: rename d5/d10/da/d4b/da4/d40/d48/dab/f93 to d5/d10/da/d4b/da4/fad 0 2024-09-21T10:41:01.309 INFO:tasks.workunit.client.0.smithi060.stdout:2/278: mknod d3/d7/d18/c59 0 2024-09-21T10:41:01.312 INFO:tasks.workunit.client.0.smithi060.stdout:0/556: rmdir d5/d10/da/d4b/da4 39 2024-09-21T10:41:01.312 INFO:tasks.workunit.client.0.smithi060.stdout:0/557: readlink d5/l34 0 2024-09-21T10:41:01.312 INFO:tasks.workunit.client.0.smithi060.stdout:2/279: creat d3/d7/d23/f5a x:0 0 0 2024-09-21T10:41:01.312 INFO:tasks.workunit.client.0.smithi060.stdout:2/280: stat d3/d20/c1e 0 2024-09-21T10:41:01.313 INFO:tasks.workunit.client.0.smithi060.stdout:0/558: truncate d5/d10/da/d2d/f5b 139545 0 2024-09-21T10:41:01.316 INFO:tasks.workunit.client.0.smithi060.stdout:0/559: mkdir d5/d10/da/d4b/da4/d40/d75/dae 0 2024-09-21T10:41:01.319 INFO:tasks.workunit.client.0.smithi060.stdout:0/560: symlink d5/d10/da/d2f/d66/laf 0 2024-09-21T10:41:01.320 INFO:tasks.workunit.client.0.smithi060.stdout:0/561: creat d5/d10/da/d4b/da4/d40/d75/fb0 x:0 0 0 2024-09-21T10:41:01.323 INFO:tasks.workunit.client.0.smithi060.stdout:1/490: dwrite d6/d24/da/db/dd/f1d [0,4194304] 0 2024-09-21T10:41:01.324 INFO:tasks.workunit.client.0.smithi060.stdout:1/491: creat d6/d4a/d5a/db0/fb1 x:0 0 0 2024-09-21T10:41:01.325 INFO:tasks.workunit.client.0.smithi060.stdout:1/492: mknod d6/d24/da/db/cb2 0 2024-09-21T10:41:01.325 INFO:tasks.workunit.client.0.smithi060.stdout:1/493: fdatasync d6/f20 0 2024-09-21T10:41:01.327 INFO:tasks.workunit.client.0.smithi060.stdout:7/584: dwrite da/fc6 [0,4194304] 0 2024-09-21T10:41:01.327 INFO:tasks.workunit.client.0.smithi060.stdout:5/521: dwrite d5/d45/d5a/f7e [0,4194304] 0 2024-09-21T10:41:01.328 INFO:tasks.workunit.client.0.smithi060.stdout:8/573: dwrite d2/d26/d37/d64/d65/fb6 [0,4194304] 0 2024-09-21T10:41:01.328 INFO:tasks.workunit.client.0.smithi060.stdout:8/574: fdatasync d2/f23 0 2024-09-21T10:41:01.339 INFO:tasks.workunit.client.0.smithi060.stdout:5/522: truncate d5/d45/d6d/d10/d19/f72 56128 0 2024-09-21T10:41:01.339 INFO:tasks.workunit.client.0.smithi060.stdout:5/523: chown d5/d45/d6d/d10/d19/c2a 0 1 2024-09-21T10:41:01.339 INFO:tasks.workunit.client.0.smithi060.stdout:5/524: readlink d5/d45/l92 0 2024-09-21T10:41:01.339 INFO:tasks.workunit.client.0.smithi060.stdout:5/525: fsync d5/d45/faa 0 2024-09-21T10:41:01.340 INFO:tasks.workunit.client.0.smithi060.stdout:2/281: fsync d3/d7/d23/f5a 0 2024-09-21T10:41:01.341 INFO:tasks.workunit.client.0.smithi060.stdout:0/562: dwrite d5/d10/da/d15/f4c [0,4194304] 0 2024-09-21T10:41:01.343 INFO:tasks.workunit.client.0.smithi060.stdout:8/575: rename d2/f23 to d2/d26/d37/d64/fc1 0 2024-09-21T10:41:01.344 INFO:tasks.workunit.client.0.smithi060.stdout:2/282: creat d3/d7/d24/d25/f5b x:0 0 0 2024-09-21T10:41:01.347 INFO:tasks.workunit.client.0.smithi060.stdout:0/563: mknod d5/d10/d43/cb1 0 2024-09-21T10:41:01.348 INFO:tasks.workunit.client.0.smithi060.stdout:0/564: readlink d5/d10/da/d2f/l67 0 2024-09-21T10:41:01.350 INFO:tasks.workunit.client.0.smithi060.stdout:5/526: rename d5/d45/d6d/d10/d19/d21/d7f/d89/c65 to d5/d45/d5a/cb0 0 2024-09-21T10:41:01.352 INFO:tasks.workunit.client.0.smithi060.stdout:0/565: symlink d5/d10/da/d2d/lb2 0 2024-09-21T10:41:01.355 INFO:tasks.workunit.client.0.smithi060.stdout:5/527: creat d5/d45/d6d/d10/d19/d8d/d50/fb1 x:0 0 0 2024-09-21T10:41:01.359 INFO:tasks.workunit.client.0.smithi060.stdout:2/283: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:41:01.359 INFO:tasks.workunit.client.0.smithi060.stdout:2/284: chown d3/d20/d17/c1a 10 1 2024-09-21T10:41:01.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/528: dread d5/d45/d5a/d3a/f5e [0,4194304] 0 2024-09-21T10:41:01.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/529: fdatasync d5/f7 0 2024-09-21T10:41:01.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/530: readlink d5/d45/d6d/d10/d19/d21/d30/d49/l4d 0 2024-09-21T10:41:01.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/531: chown d5/d45/d6d/d10/d19/d21/d30/d49 15296 1 2024-09-21T10:41:01.364 INFO:tasks.workunit.client.0.smithi060.stdout:5/532: fsync d5/d45/d5a/f20 0 2024-09-21T10:41:01.369 INFO:tasks.workunit.client.0.smithi060.stdout:0/566: dwrite d5/d10/da/f84 [4194304,4194304] 0 2024-09-21T10:41:01.369 INFO:tasks.workunit.client.0.smithi060.stdout:0/567: dread - d5/d10/da/d4b/da4/d76/f94 zero size 2024-09-21T10:41:01.378 INFO:tasks.workunit.client.0.smithi060.stdout:2/285: dwrite d3/d7/d23/f5a [0,4194304] 0 2024-09-21T10:41:01.382 INFO:tasks.workunit.client.0.smithi060.stdout:2/286: rename d3/d7/d24/d25/d46 to d3/d20/d15/d30/d5c 0 2024-09-21T10:41:01.384 INFO:tasks.workunit.client.0.smithi060.stdout:2/287: creat d3/d20/d15/d30/f5d x:0 0 0 2024-09-21T10:41:01.388 INFO:tasks.workunit.client.0.smithi060.stdout:5/533: dwrite d5/d45/d6d/d10/f90 [0,4194304] 0 2024-09-21T10:41:01.388 INFO:tasks.workunit.client.0.smithi060.stdout:0/568: dwrite d5/f21 [0,4194304] 0 2024-09-21T10:41:01.389 INFO:tasks.workunit.client.0.smithi060.stdout:4/441: sync 2024-09-21T10:41:01.393 INFO:tasks.workunit.client.0.smithi060.stdout:4/442: unlink d0/d83/d6a/d6b/d32/d57/f5b 0 2024-09-21T10:41:01.396 INFO:tasks.workunit.client.0.smithi060.stdout:4/443: rename d0/d5/d12/d15/d4d/c70 to d0/d3c/d67/c8e 0 2024-09-21T10:41:01.396 INFO:tasks.workunit.client.0.smithi060.stdout:4/444: fdatasync d0/d83/d6a/d6b/d32/d57/f77 0 2024-09-21T10:41:01.397 INFO:tasks.workunit.client.0.smithi060.stdout:5/534: dread d5/d45/d6d/d10/d19/d21/f44 [0,4194304] 0 2024-09-21T10:41:01.397 INFO:tasks.workunit.client.0.smithi060.stdout:4/445: rename d0/df/d88/d28 to d0/d5/d12/d15/d8f 0 2024-09-21T10:41:01.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/535: mknod d5/cb2 0 2024-09-21T10:41:01.399 INFO:tasks.workunit.client.0.smithi060.stdout:5/536: fsync d5/d45/d5a/f20 0 2024-09-21T10:41:01.401 INFO:tasks.workunit.client.0.smithi060.stdout:5/537: mknod d5/d45/d6d/d10/d19/d21/d30/cb3 0 2024-09-21T10:41:01.401 INFO:tasks.workunit.client.0.smithi060.stdout:5/538: creat d5/d45/fb4 x:0 0 0 2024-09-21T10:41:01.401 INFO:tasks.workunit.client.0.smithi060.stdout:5/539: write d5/d45/fb4 [37105,65683] 0 2024-09-21T10:41:01.403 INFO:tasks.workunit.client.0.smithi060.stdout:5/540: creat d5/d45/d6d/d10/d19/d21/d7f/d89/fb5 x:0 0 0 2024-09-21T10:41:01.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/541: mkdir d5/d45/d6d/d10/d19/d21/da6/db6 0 2024-09-21T10:41:01.407 INFO:tasks.workunit.client.0.smithi060.stdout:5/542: rename d5/d45/f4b to d5/d45/d6d/d10/d19/d8d/d60/fb7 0 2024-09-21T10:41:01.407 INFO:tasks.workunit.client.0.smithi060.stdout:5/543: write d5/d45/d6d/d10/d19/f34 [266546,53762] 0 2024-09-21T10:41:01.409 INFO:tasks.workunit.client.0.smithi060.stdout:5/544: dread d5/d45/d77/d8f/f96 [0,4194304] 0 2024-09-21T10:41:01.410 INFO:tasks.workunit.client.0.smithi060.stdout:4/446: write d0/d83/d6a/d6b/d65/f4a [3184956,98269] 0 2024-09-21T10:41:01.410 INFO:tasks.workunit.client.0.smithi060.stdout:2/288: dwrite d3/d7/d23/f48 [0,4194304] 0 2024-09-21T10:41:01.410 INFO:tasks.workunit.client.0.smithi060.stdout:5/545: creat d5/d45/d6d/d10/d19/fb8 x:0 0 0 2024-09-21T10:41:01.410 INFO:tasks.workunit.client.0.smithi060.stdout:2/289: write d3/d20/d15/d30/f3f [178335,103787] 0 2024-09-21T10:41:01.410 INFO:tasks.workunit.client.0.smithi060.stdout:2/290: truncate d3/d20/d15/d30/f3f 1194074 0 2024-09-21T10:41:01.410 INFO:tasks.workunit.client.0.smithi060.stdout:2/291: chown d3/d20/d17/f4a 888197 1 2024-09-21T10:41:01.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/569: dwrite d5/d10/da/d4b/da4/d40/d48/dab/d4d/f9f [0,4194304] 0 2024-09-21T10:41:01.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/570: chown d5/d10/da/d4b/da4/d40/d75/l90 6000060 1 2024-09-21T10:41:01.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/571: chown d5/d10/da/d4b/da4/d40/d48/dab/d79/c92 437244544 1 2024-09-21T10:41:01.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/572: readlink d5/d10/da/d4b/da4/d40/l89 0 2024-09-21T10:41:01.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/573: dread d5/d10/f5a [0,4194304] 0 2024-09-21T10:41:01.417 INFO:tasks.workunit.client.0.smithi060.stdout:0/574: write d5/d10/da/d4b/da4/f7f [83934,128591] 0 2024-09-21T10:41:01.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/546: truncate d5/d45/d6d/d10/d19/f31 2090521 0 2024-09-21T10:41:01.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/547: fdatasync d5/d45/d6d/d10/d19/f34 0 2024-09-21T10:41:01.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/548: chown d5/d45/c81 47 1 2024-09-21T10:41:01.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/549: chown d5/d45/d5a/f17 2335562 1 2024-09-21T10:41:01.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/550: chown d5/d45/d6d/d10/d19/d21/d7f/d89/lac 1591 1 2024-09-21T10:41:01.486 INFO:tasks.workunit.client.0.smithi060.stdout:5/551: write d5/f76 [1014063,120342] 0 2024-09-21T10:41:01.488 INFO:tasks.workunit.client.0.smithi060.stdout:2/292: symlink d3/d7/d24/d25/l5e 0 2024-09-21T10:41:01.539 INFO:tasks.workunit.client.0.smithi060.stdout:4/447: mkdir d0/d83/d6a/d6b/d32/d57/d90 0 2024-09-21T10:41:01.540 INFO:tasks.workunit.client.0.smithi060.stdout:4/448: dread d0/d5/d12/f73 [0,4194304] 0 2024-09-21T10:41:01.541 INFO:tasks.workunit.client.0.smithi060.stdout:0/575: mkdir d5/d10/da/d4b/da4/d40/d48/db3 0 2024-09-21T10:41:01.541 INFO:tasks.workunit.client.0.smithi060.stdout:4/449: write d0/d5/f36 [773329,54580] 0 2024-09-21T10:41:01.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/552: link d5/d45/d6d/d10/d19/d21/d7f/d89/l5b d5/d45/d6d/d10/lb9 0 2024-09-21T10:41:01.545 INFO:tasks.workunit.client.0.smithi060.stdout:2/293: symlink d3/d20/d17/l5f 0 2024-09-21T10:41:01.546 INFO:tasks.workunit.client.0.smithi060.stdout:0/576: symlink d5/d10/d11/lb4 0 2024-09-21T10:41:01.546 INFO:tasks.workunit.client.0.smithi060.stdout:0/577: write d5/d10/f61 [4402129,49641] 0 2024-09-21T10:41:01.546 INFO:tasks.workunit.client.0.smithi060.stdout:0/578: fdatasync d5/d10/da/d4b/da4/d40/d48/fac 0 2024-09-21T10:41:01.547 INFO:tasks.workunit.client.0.smithi060.stdout:5/553: creat d5/d45/d5a/d3a/fba x:0 0 0 2024-09-21T10:41:01.550 INFO:tasks.workunit.client.0.smithi060.stdout:2/294: symlink d3/d7/d24/l60 0 2024-09-21T10:41:01.552 INFO:tasks.workunit.client.0.smithi060.stdout:0/579: rmdir d5/d10/da/d4b/da4/d40/d48/dab/d4d 39 2024-09-21T10:41:01.555 INFO:tasks.workunit.client.0.smithi060.stdout:5/554: rename d5/d45/d6d/ca8 to d5/d45/d6d/d10/d19/d21/d30/d49/cbb 0 2024-09-21T10:41:01.555 INFO:tasks.workunit.client.0.smithi060.stdout:5/555: dread - d5/d45/d6d/d10/d19/d21/d7f/d89/fb5 zero size 2024-09-21T10:41:01.556 INFO:tasks.workunit.client.0.smithi060.stdout:0/580: link d5/d10/da/d4b/da4/d40/d48/d63/la1 d5/d10/da/d4b/da4/lb5 0 2024-09-21T10:41:01.557 INFO:tasks.workunit.client.0.smithi060.stdout:0/581: fdatasync d5/d10/da/d2d/fa2 0 2024-09-21T10:41:01.558 INFO:tasks.workunit.client.0.smithi060.stdout:5/556: mknod d5/d45/d5a/d3a/cbc 0 2024-09-21T10:41:01.559 INFO:tasks.workunit.client.0.smithi060.stdout:5/557: mkdir d5/d45/d5a/dbd 0 2024-09-21T10:41:01.559 INFO:tasks.workunit.client.0.smithi060.stdout:5/558: write d5/d45/d5a/f5d [180278,117029] 0 2024-09-21T10:41:01.569 INFO:tasks.workunit.client.0.smithi060.stdout:5/559: dread d5/d45/d5a/f5d [0,4194304] 0 2024-09-21T10:41:01.584 INFO:tasks.workunit.client.0.smithi060.stdout:4/450: dwrite d0/d83/d6a/d6b/d32/d57/f2b [0,4194304] 0 2024-09-21T10:41:01.585 INFO:tasks.workunit.client.0.smithi060.stdout:4/451: creat d0/d3c/f91 x:0 0 0 2024-09-21T10:41:01.586 INFO:tasks.workunit.client.0.smithi060.stdout:4/452: rename d0/d83/d6a/d6b/d32/d57/l4c to d0/df/d84/l92 0 2024-09-21T10:41:01.587 INFO:tasks.workunit.client.0.smithi060.stdout:0/582: dwrite d5/d10/f3d [0,4194304] 0 2024-09-21T10:41:01.587 INFO:tasks.workunit.client.0.smithi060.stdout:4/453: rename d0/d5/d12/d15/c2a to d0/d83/c93 0 2024-09-21T10:41:01.587 INFO:tasks.workunit.client.0.smithi060.stdout:2/295: dwrite d3/f5 [0,4194304] 0 2024-09-21T10:41:01.589 INFO:tasks.workunit.client.0.smithi060.stdout:0/583: link d5/d10/da/d4b/da4/f5c d5/d10/da/d4b/da4/d76/fb6 0 2024-09-21T10:41:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:4/454: mkdir d0/d5/d12/d3d/d94 0 2024-09-21T10:41:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:4/455: read - d0/d3c/f91 zero size 2024-09-21T10:41:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:4/456: creat d0/d5/d12/f95 x:0 0 0 2024-09-21T10:41:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:4/457: dread - d0/d3c/d67/d7d/d87/f7a zero size 2024-09-21T10:41:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:5/560: dwrite d5/d45/d6d/d10/d19/d8d/d60/f93 [0,4194304] 0 2024-09-21T10:41:01.590 INFO:tasks.workunit.client.0.smithi060.stdout:5/561: read d5/d45/d6d/d10/d19/d21/d30/f35 [935598,705] 0 2024-09-21T10:41:01.591 INFO:tasks.workunit.client.0.smithi060.stdout:2/296: mknod d3/d20/d15/d30/d5c/c61 0 2024-09-21T10:41:01.592 INFO:tasks.workunit.client.0.smithi060.stdout:0/584: creat d5/d10/da/da7/fb7 x:0 0 0 2024-09-21T10:41:01.592 INFO:tasks.workunit.client.0.smithi060.stdout:0/585: write d5/d10/da/d4b/da4/d76/fa8 [607653,37585] 0 2024-09-21T10:41:01.604 INFO:tasks.workunit.client.0.smithi060.stdout:5/562: mkdir d5/d45/d6d/d10/d19/d21/d7f/d89/dbe 0 2024-09-21T10:41:01.604 INFO:tasks.workunit.client.0.smithi060.stdout:5/563: dread - d5/d45/d6d/d10/d19/fb8 zero size 2024-09-21T10:41:01.604 INFO:tasks.workunit.client.0.smithi060.stdout:2/297: mkdir d3/d20/d15/d30/d43/d62 0 2024-09-21T10:41:01.605 INFO:tasks.workunit.client.0.smithi060.stdout:2/298: fsync d3/d20/d17/f50 0 2024-09-21T10:41:01.605 INFO:tasks.workunit.client.0.smithi060.stdout:2/299: readlink d3/lf 0 2024-09-21T10:41:01.607 INFO:tasks.workunit.client.0.smithi060.stdout:0/586: unlink d5/d10/da/d4b/da4/d40/l98 0 2024-09-21T10:41:01.608 INFO:tasks.workunit.client.0.smithi060.stdout:5/564: mknod d5/cbf 0 2024-09-21T10:41:01.610 INFO:tasks.workunit.client.0.smithi060.stdout:2/300: link d3/d20/d15/d30/f5d d3/d20/d15/f63 0 2024-09-21T10:41:01.610 INFO:tasks.workunit.client.0.smithi060.stdout:2/301: readlink d3/lf 0 2024-09-21T10:41:01.611 INFO:tasks.workunit.client.0.smithi060.stdout:4/458: dwrite d0/d5/f71 [0,4194304] 0 2024-09-21T10:41:01.611 INFO:tasks.workunit.client.0.smithi060.stdout:4/459: chown d0/d83/d6a/d6b/d32/d57/d90 14847326 1 2024-09-21T10:41:01.611 INFO:tasks.workunit.client.0.smithi060.stdout:4/460: chown d0/d5/d12/d3d 21887 1 2024-09-21T10:41:01.624 INFO:tasks.workunit.client.0.smithi060.stdout:5/565: link d5/d45/d6d/d10/d19/fb8 d5/d71/fc0 0 2024-09-21T10:41:01.624 INFO:tasks.workunit.client.0.smithi060.stdout:5/566: write d5/d45/d6d/f15 [1726693,107687] 0 2024-09-21T10:41:01.625 INFO:tasks.workunit.client.0.smithi060.stdout:5/567: read d5/d45/d77/d8f/f96 [234431,85493] 0 2024-09-21T10:41:01.639 INFO:tasks.workunit.client.0.smithi060.stdout:2/302: symlink d3/d7/l64 0 2024-09-21T10:41:01.641 INFO:tasks.workunit.client.0.smithi060.stdout:6/524: sync 2024-09-21T10:41:01.641 INFO:tasks.workunit.client.0.smithi060.stdout:9/452: sync 2024-09-21T10:41:01.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/500: sync 2024-09-21T10:41:01.651 INFO:tasks.workunit.client.0.smithi060.stdout:4/461: mknod d0/d5/d12/d3d/c96 0 2024-09-21T10:41:01.655 INFO:tasks.workunit.client.0.smithi060.stdout:5/568: link d5/d45/f85 d5/d7a/d84/fc1 0 2024-09-21T10:41:01.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/303: mknod d3/d20/d17/c65 0 2024-09-21T10:41:01.658 INFO:tasks.workunit.client.0.smithi060.stdout:3/501: mkdir d0/d1/d9e 0 2024-09-21T10:41:01.661 INFO:tasks.workunit.client.0.smithi060.stdout:5/569: dread d5/d45/d5a/f17 [0,4194304] 0 2024-09-21T10:41:01.661 INFO:tasks.workunit.client.0.smithi060.stdout:5/570: fdatasync d5/d45/d6d/d10/d19/d8d/d60/f93 0 2024-09-21T10:41:01.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/304: dread d3/d20/d15/f3d [0,4194304] 0 2024-09-21T10:41:01.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/305: readlink d3/lf 0 2024-09-21T10:41:01.662 INFO:tasks.workunit.client.0.smithi060.stdout:4/462: rename d0/d5/d3a/f6d to d0/d83/d6a/d6b/d32/d57/d90/f97 0 2024-09-21T10:41:01.662 INFO:tasks.workunit.client.0.smithi060.stdout:4/463: write d0/d5/d12/f95 [880581,22389] 0 2024-09-21T10:41:01.662 INFO:tasks.workunit.client.0.smithi060.stdout:9/453: dwrite d3/f9 [0,4194304] 0 2024-09-21T10:41:01.662 INFO:tasks.workunit.client.0.smithi060.stdout:4/464: dread - d0/d3c/d67/d7d/d87/f8d zero size 2024-09-21T10:41:01.663 INFO:tasks.workunit.client.0.smithi060.stdout:4/465: fsync d0/f41 0 2024-09-21T10:41:01.663 INFO:tasks.workunit.client.0.smithi060.stdout:7/585: sync 2024-09-21T10:41:01.663 INFO:tasks.workunit.client.0.smithi060.stdout:1/494: sync 2024-09-21T10:41:01.663 INFO:tasks.workunit.client.0.smithi060.stdout:1/495: write d6/d24/da/d45/d76/fae [731809,82099] 0 2024-09-21T10:41:01.664 INFO:tasks.workunit.client.0.smithi060.stdout:1/496: readlink d6/d24/da/db/dd/l83 0 2024-09-21T10:41:01.664 INFO:tasks.workunit.client.0.smithi060.stdout:3/502: mknod d0/d1/d1e/c9f 0 2024-09-21T10:41:01.665 INFO:tasks.workunit.client.0.smithi060.stdout:6/525: dwrite d3/fb [0,4194304] 0 2024-09-21T10:41:01.665 INFO:tasks.workunit.client.0.smithi060.stdout:6/526: chown d3/d12/d16/d22/d58/d75/ca1 24957 1 2024-09-21T10:41:01.668 INFO:tasks.workunit.client.0.smithi060.stdout:5/571: creat d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/fc2 x:0 0 0 2024-09-21T10:41:01.668 INFO:tasks.workunit.client.0.smithi060.stdout:6/527: dread d3/f4b [0,4194304] 0 2024-09-21T10:41:01.670 INFO:tasks.workunit.client.0.smithi060.stdout:4/466: creat d0/d5/d12/d15/d8f/f98 x:0 0 0 2024-09-21T10:41:01.672 INFO:tasks.workunit.client.0.smithi060.stdout:7/586: link da/d14/d35/c3b da/d14/d2a/d49/d27/cc8 0 2024-09-21T10:41:01.673 INFO:tasks.workunit.client.0.smithi060.stdout:5/572: mkdir d5/d7a/d84/dc3 0 2024-09-21T10:41:01.675 INFO:tasks.workunit.client.0.smithi060.stdout:4/467: creat d0/d83/d6a/d6b/d65/d51/f99 x:0 0 0 2024-09-21T10:41:01.675 INFO:tasks.workunit.client.0.smithi060.stdout:4/468: write d0/d5/f10 [1953494,40724] 0 2024-09-21T10:41:01.677 INFO:tasks.workunit.client.0.smithi060.stdout:5/573: truncate d5/d45/d6d/d10/d19/d21/d30/f47 563125 0 2024-09-21T10:41:01.677 INFO:tasks.workunit.client.0.smithi060.stdout:5/574: creat d5/d45/d6d/d10/d19/fc4 x:0 0 0 2024-09-21T10:41:01.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/576: sync 2024-09-21T10:41:01.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/577: write d2/d26/fb0 [895904,31604] 0 2024-09-21T10:41:01.679 INFO:tasks.workunit.client.0.smithi060.stdout:4/469: mkdir d0/d83/d6a/d6b/d65/d51/d9a 0 2024-09-21T10:41:01.679 INFO:tasks.workunit.client.0.smithi060.stdout:4/470: write d0/f41 [8964616,119099] 0 2024-09-21T10:41:01.681 INFO:tasks.workunit.client.0.smithi060.stdout:4/471: creat d0/d5/d12/d15/f9b x:0 0 0 2024-09-21T10:41:01.681 INFO:tasks.workunit.client.0.smithi060.stdout:4/472: fdatasync d0/d5/d3a/f5d 0 2024-09-21T10:41:01.685 INFO:tasks.workunit.client.0.smithi060.stdout:9/454: write d3/d5e/d60/f25 [1892826,255] 0 2024-09-21T10:41:01.686 INFO:tasks.workunit.client.0.smithi060.stdout:9/455: getdents d3/d16/d42/d7e/d85 0 2024-09-21T10:41:01.691 INFO:tasks.workunit.client.0.smithi060.stdout:1/497: read d6/d4a/f69 [1487404,87755] 0 2024-09-21T10:41:01.691 INFO:tasks.workunit.client.0.smithi060.stdout:2/306: dwrite d3/f38 [0,4194304] 0 2024-09-21T10:41:01.691 INFO:tasks.workunit.client.0.smithi060.stdout:2/307: fsync d3/d7/d24/d33/f57 0 2024-09-21T10:41:01.695 INFO:tasks.workunit.client.0.smithi060.stdout:6/528: write d3/d12/d16/d1a/d21/f88 [2984140,80412] 0 2024-09-21T10:41:01.695 INFO:tasks.workunit.client.0.smithi060.stdout:6/529: truncate d3/d12/d16/d25/f3e 1824161 0 2024-09-21T10:41:01.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/456: dread d3/d15/f3a [0,4194304] 0 2024-09-21T10:41:01.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/457: chown d3/d16/d1a/l48 72 1 2024-09-21T10:41:01.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/458: creat d3/d15/d53/f97 x:0 0 0 2024-09-21T10:41:01.695 INFO:tasks.workunit.client.0.smithi060.stdout:9/459: dread - d3/d5e/d60/f91 zero size 2024-09-21T10:41:01.696 INFO:tasks.workunit.client.0.smithi060.stdout:2/308: symlink d3/d7/d24/d33/l66 0 2024-09-21T10:41:01.697 INFO:tasks.workunit.client.0.smithi060.stdout:2/309: write d3/d20/d15/f3d [397766,28848] 0 2024-09-21T10:41:01.698 INFO:tasks.workunit.client.0.smithi060.stdout:6/530: unlink d3/d12/d16/d22/f48 0 2024-09-21T10:41:01.699 INFO:tasks.workunit.client.0.smithi060.stdout:3/503: dwrite d0/d1/d11/d2a/d45/f9a [0,4194304] 0 2024-09-21T10:41:01.701 INFO:tasks.workunit.client.0.smithi060.stdout:5/575: write d5/d45/d6d/d10/d19/d21/d7f/d89/f74 [2253710,28772] 0 2024-09-21T10:41:01.701 INFO:tasks.workunit.client.0.smithi060.stdout:5/576: chown d5/d45/d6d/d10/d19/f34 388669 1 2024-09-21T10:41:01.701 INFO:tasks.workunit.client.0.smithi060.stdout:5/577: fdatasync d5/fab 0 2024-09-21T10:41:01.703 INFO:tasks.workunit.client.0.smithi060.stdout:9/460: symlink d3/d16/d5f/l98 0 2024-09-21T10:41:01.706 INFO:tasks.workunit.client.0.smithi060.stdout:7/587: dwrite da/d14/d2a/d49/f88 [0,4194304] 0 2024-09-21T10:41:01.707 INFO:tasks.workunit.client.0.smithi060.stdout:1/498: write d6/d24/f59 [2450333,122399] 0 2024-09-21T10:41:01.707 INFO:tasks.workunit.client.0.smithi060.stdout:2/310: truncate d3/d7/f34 57541 0 2024-09-21T10:41:01.707 INFO:tasks.workunit.client.0.smithi060.stdout:2/311: readlink d3/d20/d15/d3b/l45 0 2024-09-21T10:41:01.707 INFO:tasks.workunit.client.0.smithi060.stdout:2/312: fdatasync d3/d7/d23/f48 0 2024-09-21T10:41:01.707 INFO:tasks.workunit.client.0.smithi060.stdout:2/313: creat d3/d20/d15/d30/d43/f67 x:0 0 0 2024-09-21T10:41:01.708 INFO:tasks.workunit.client.0.smithi060.stdout:6/531: mknod d3/d12/d38/d41/ca5 0 2024-09-21T10:41:01.708 INFO:tasks.workunit.client.0.smithi060.stdout:6/532: fdatasync d3/d12/d16/d1a/f4f 0 2024-09-21T10:41:01.710 INFO:tasks.workunit.client.0.smithi060.stdout:8/578: dwrite d2/d26/d37/d64/d65/fb6 [0,4194304] 0 2024-09-21T10:41:01.711 INFO:tasks.workunit.client.0.smithi060.stdout:8/579: fdatasync d2/d18/f22 0 2024-09-21T10:41:01.711 INFO:tasks.workunit.client.0.smithi060.stdout:8/580: creat d2/d26/d37/d62/fc2 x:0 0 0 2024-09-21T10:41:01.711 INFO:tasks.workunit.client.0.smithi060.stdout:5/578: rmdir d5/d45/d6d 39 2024-09-21T10:41:01.711 INFO:tasks.workunit.client.0.smithi060.stdout:5/579: read - d5/d45/d6d/d10/d19/d21/d30/d49/f75 zero size 2024-09-21T10:41:01.711 INFO:tasks.workunit.client.0.smithi060.stdout:5/580: write d5/d45/d6d/d10/d19/d21/d7f/f9b [265875,49964] 0 2024-09-21T10:41:01.713 INFO:tasks.workunit.client.0.smithi060.stdout:6/533: dread d3/d12/d38/d41/f44 [0,4194304] 0 2024-09-21T10:41:01.713 INFO:tasks.workunit.client.0.smithi060.stdout:6/534: readlink d3/d12/d16/d1a/d83/da3/l93 0 2024-09-21T10:41:01.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/461: link d3/d5e/d60/d2f/f31 d3/d15/d5a/d64/f99 0 2024-09-21T10:41:01.717 INFO:tasks.workunit.client.0.smithi060.stdout:7/588: creat da/d60/fc9 x:0 0 0 2024-09-21T10:41:01.717 INFO:tasks.workunit.client.0.smithi060.stdout:7/589: readlink da/d14/d25/l63 0 2024-09-21T10:41:01.720 INFO:tasks.workunit.client.0.smithi060.stdout:4/473: fsync d0/d5/d12/d15/f9b 0 2024-09-21T10:41:01.724 INFO:tasks.workunit.client.0.smithi060.stdout:1/499: symlink d6/lb3 0 2024-09-21T10:41:01.724 INFO:tasks.workunit.client.0.smithi060.stdout:8/581: dwrite d2/f15 [0,4194304] 0 2024-09-21T10:41:01.728 INFO:tasks.workunit.client.0.smithi060.stdout:5/581: creat d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/fc5 x:0 0 0 2024-09-21T10:41:01.728 INFO:tasks.workunit.client.0.smithi060.stdout:5/582: chown d5/d45/d6d/d10/d19/d21/f5f 33 1 2024-09-21T10:41:01.728 INFO:tasks.workunit.client.0.smithi060.stdout:6/535: creat d3/d12/d16/d1a/d21/fa6 x:0 0 0 2024-09-21T10:41:01.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/462: mknod d3/d16/d7f/c9a 0 2024-09-21T10:41:01.730 INFO:tasks.workunit.client.0.smithi060.stdout:7/590: link da/fc6 da/d14/d2a/d49/fca 0 2024-09-21T10:41:01.731 INFO:tasks.workunit.client.0.smithi060.stdout:4/474: mkdir d0/df/d9c 0 2024-09-21T10:41:01.731 INFO:tasks.workunit.client.0.smithi060.stdout:4/475: fdatasync d0/d83/d6a/d6b/f2f 0 2024-09-21T10:41:01.732 INFO:tasks.workunit.client.0.smithi060.stdout:1/500: mknod d6/d24/da/db/d79/d86/d9f/daa/cb4 0 2024-09-21T10:41:01.732 INFO:tasks.workunit.client.0.smithi060.stdout:1/501: write d6/d4a/d5a/f5e [1240955,72793] 0 2024-09-21T10:41:01.734 INFO:tasks.workunit.client.0.smithi060.stdout:8/582: creat d2/da7/fc3 x:0 0 0 2024-09-21T10:41:01.734 INFO:tasks.workunit.client.0.smithi060.stdout:8/583: write d2/f15 [4279733,67015] 0 2024-09-21T10:41:01.736 INFO:tasks.workunit.client.0.smithi060.stdout:8/584: write d2/d26/f38 [71153,70216] 0 2024-09-21T10:41:01.737 INFO:tasks.workunit.client.0.smithi060.stdout:8/585: truncate d2/d18/d4b/d61/f94 1522176 0 2024-09-21T10:41:01.739 INFO:tasks.workunit.client.0.smithi060.stdout:4/476: dread d0/d83/d6a/d6b/f2f [0,4194304] 0 2024-09-21T10:41:01.739 INFO:tasks.workunit.client.0.smithi060.stdout:4/477: fsync d0/d83/d6a/d6b/d32/f75 0 2024-09-21T10:41:01.741 INFO:tasks.workunit.client.0.smithi060.stdout:2/314: getdents d3/d20/d15/d30 0 2024-09-21T10:41:01.744 INFO:tasks.workunit.client.0.smithi060.stdout:5/583: mknod d5/d7a/cc6 0 2024-09-21T10:41:01.745 INFO:tasks.workunit.client.0.smithi060.stdout:9/463: unlink d3/d15/l40 0 2024-09-21T10:41:01.745 INFO:tasks.workunit.client.0.smithi060.stdout:9/464: read d3/d15/f17 [4658234,93051] 0 2024-09-21T10:41:01.746 INFO:tasks.workunit.client.0.smithi060.stdout:7/591: rmdir da/d14/d2a/d49/d27 39 2024-09-21T10:41:01.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/478: read d0/d5/f5a [2743325,43705] 0 2024-09-21T10:41:01.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/479: read d0/d83/d6a/d6b/f22 [4107067,108452] 0 2024-09-21T10:41:01.749 INFO:tasks.workunit.client.0.smithi060.stdout:8/586: creat d2/d26/d37/d62/d74/d83/dac/fc4 x:0 0 0 2024-09-21T10:41:01.749 INFO:tasks.workunit.client.0.smithi060.stdout:8/587: chown d2/d26/d37/d64/f87 208 1 2024-09-21T10:41:01.752 INFO:tasks.workunit.client.0.smithi060.stdout:5/584: link d5/d45/d6d/d10/l1f d5/d45/d6d/d10/d19/d8d/lc7 0 2024-09-21T10:41:01.753 INFO:tasks.workunit.client.0.smithi060.stdout:5/585: getdents d5/d45/d6d/d10/d19/d21/da6/db6 0 2024-09-21T10:41:01.753 INFO:tasks.workunit.client.0.smithi060.stdout:5/586: chown d5/d45/d6d/d10/d19/d8d/l82 1425680630 1 2024-09-21T10:41:01.754 INFO:tasks.workunit.client.0.smithi060.stdout:8/588: rename d2/d18/c33 to d2/d18/d4b/d61/cc5 0 2024-09-21T10:41:01.759 INFO:tasks.workunit.client.0.smithi060.stdout:5/587: unlink d5/fab 0 2024-09-21T10:41:01.766 INFO:tasks.workunit.client.0.smithi060.stdout:2/315: dwrite d3/d7/d24/d25/f51 [0,4194304] 0 2024-09-21T10:41:01.775 INFO:tasks.workunit.client.0.smithi060.stdout:5/588: dread d5/d45/d6d/d10/d19/d8d/f43 [0,4194304] 0 2024-09-21T10:41:01.777 INFO:tasks.workunit.client.0.smithi060.stdout:4/480: dwrite d0/d3c/f91 [0,4194304] 0 2024-09-21T10:41:01.778 INFO:tasks.workunit.client.0.smithi060.stdout:4/481: dread - d0/d83/d6a/d6b/f45 zero size 2024-09-21T10:41:01.778 INFO:tasks.workunit.client.0.smithi060.stdout:4/482: fdatasync d0/d5/d12/f5f 0 2024-09-21T10:41:01.780 INFO:tasks.workunit.client.0.smithi060.stdout:5/589: write d5/d45/d5a/f17 [1366301,25811] 0 2024-09-21T10:41:01.780 INFO:tasks.workunit.client.0.smithi060.stdout:5/590: write d5/d45/d6d/d10/d19/d21/d7f/f9b [982932,86048] 0 2024-09-21T10:41:01.783 INFO:tasks.workunit.client.0.smithi060.stdout:5/591: mkdir d5/d45/d6d/d10/d19/d8d/d60/d61/dc8 0 2024-09-21T10:41:01.783 INFO:tasks.workunit.client.0.smithi060.stdout:5/592: write d5/d71/fc0 [63394,121735] 0 2024-09-21T10:41:01.783 INFO:tasks.workunit.client.0.smithi060.stdout:5/593: read d5/d45/d6d/d10/d19/d21/d30/f47 [390927,76898] 0 2024-09-21T10:41:01.784 INFO:tasks.workunit.client.0.smithi060.stdout:9/465: dwrite d3/d5e/f82 [0,4194304] 0 2024-09-21T10:41:01.784 INFO:tasks.workunit.client.0.smithi060.stdout:9/466: chown d3/d15/f2b 4 1 2024-09-21T10:41:01.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/594: symlink d5/d45/d6d/d10/d19/d21/lc9 0 2024-09-21T10:41:01.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/595: chown d5/d45/d6d/d10/d19/d21/d30/c38 2 1 2024-09-21T10:41:01.786 INFO:tasks.workunit.client.0.smithi060.stdout:5/596: dread - d5/d45/f46 zero size 2024-09-21T10:41:01.788 INFO:tasks.workunit.client.0.smithi060.stdout:8/589: dwrite d2/d26/d37/d62/d77/fae [0,4194304] 0 2024-09-21T10:41:01.788 INFO:tasks.workunit.client.0.smithi060.stdout:8/590: dread - d2/d18/d4b/f86 zero size 2024-09-21T10:41:01.788 INFO:tasks.workunit.client.0.smithi060.stdout:8/591: fdatasync d2/f12 0 2024-09-21T10:41:01.789 INFO:tasks.workunit.client.0.smithi060.stdout:2/316: dwrite d3/d7/d23/f5a [4194304,4194304] 0 2024-09-21T10:41:01.790 INFO:tasks.workunit.client.0.smithi060.stdout:9/467: rename d3/ff to d3/d15/d58/f9b 0 2024-09-21T10:41:01.794 INFO:tasks.workunit.client.0.smithi060.stdout:8/592: creat d2/d26/d37/d62/d74/d83/da2/fc6 x:0 0 0 2024-09-21T10:41:01.798 INFO:tasks.workunit.client.0.smithi060.stdout:5/597: dread d5/d45/f85 [0,4194304] 0 2024-09-21T10:41:01.799 INFO:tasks.workunit.client.0.smithi060.stdout:2/317: mknod d3/d7/c68 0 2024-09-21T10:41:01.799 INFO:tasks.workunit.client.0.smithi060.stdout:2/318: truncate d3/d20/d15/d30/d43/f54 1044689 0 2024-09-21T10:41:01.799 INFO:tasks.workunit.client.0.smithi060.stdout:2/319: read - d3/d20/d15/f63 zero size 2024-09-21T10:41:01.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/468: mkdir d3/d16/d9c 0 2024-09-21T10:41:01.802 INFO:tasks.workunit.client.0.smithi060.stdout:5/598: truncate d5/d45/d5a/d3a/f5e 3160307 0 2024-09-21T10:41:01.803 INFO:tasks.workunit.client.0.smithi060.stdout:2/320: mkdir d3/d7/d24/d25/d4f/d69 0 2024-09-21T10:41:01.803 INFO:tasks.workunit.client.0.smithi060.stdout:5/599: fdatasync d5/d45/d6d/d10/d19/fb8 0 2024-09-21T10:41:01.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/600: creat d5/d45/fca x:0 0 0 2024-09-21T10:41:01.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/601: chown d5/f48 1699085 1 2024-09-21T10:41:01.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/602: stat d5/d45/d6d/d10/d19/d8d/d50/l54 0 2024-09-21T10:41:01.804 INFO:tasks.workunit.client.0.smithi060.stdout:5/603: chown d5/d45/d6d/d10/d19/f33 8190376 1 2024-09-21T10:41:01.805 INFO:tasks.workunit.client.0.smithi060.stdout:5/604: chown d5/d45/d6d/d10/d19/d21/f5f 3391 1 2024-09-21T10:41:01.805 INFO:tasks.workunit.client.0.smithi060.stdout:4/483: dwrite d0/d5/f71 [0,4194304] 0 2024-09-21T10:41:01.806 INFO:tasks.workunit.client.0.smithi060.stdout:9/469: rename d3/fa to d3/f9d 0 2024-09-21T10:41:01.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/321: mkdir d3/d20/d15/d30/d6a 0 2024-09-21T10:41:01.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/484: mkdir d0/d59/d9d 0 2024-09-21T10:41:01.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/485: write d0/d83/d6a/d6b/f22 [1143895,40041] 0 2024-09-21T10:41:01.813 INFO:tasks.workunit.client.0.smithi060.stdout:4/486: read d0/d83/d6a/d6b/d32/f75 [469875,22801] 0 2024-09-21T10:41:01.814 INFO:tasks.workunit.client.0.smithi060.stdout:9/470: mkdir d3/d15/d5a/d64/d9e 0 2024-09-21T10:41:01.815 INFO:tasks.workunit.client.0.smithi060.stdout:2/322: mknod d3/d20/d15/d30/d6a/c6b 0 2024-09-21T10:41:01.817 INFO:tasks.workunit.client.0.smithi060.stdout:9/471: rename d3/d15/f3a to d3/d16/d42/f9f 0 2024-09-21T10:41:01.826 INFO:tasks.workunit.client.0.smithi060.stdout:4/487: dread d0/d83/d6a/d6b/d32/f37 [0,4194304] 0 2024-09-21T10:41:01.827 INFO:tasks.workunit.client.0.smithi060.stdout:5/605: dwrite d5/d45/fb4 [0,4194304] 0 2024-09-21T10:41:01.828 INFO:tasks.workunit.client.0.smithi060.stdout:9/472: dread d3/fe [0,4194304] 0 2024-09-21T10:41:01.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/488: rename d0/d83/d6a/d6b/d65/d51/l7f to d0/df/d84/l9e 0 2024-09-21T10:41:01.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/489: dread - d0/d83/d6a/d6b/d65/d51/f99 zero size 2024-09-21T10:41:01.833 INFO:tasks.workunit.client.0.smithi060.stdout:5/606: mknod d5/d45/d6d/d10/d19/d21/ccb 0 2024-09-21T10:41:01.836 INFO:tasks.workunit.client.0.smithi060.stdout:9/473: unlink d3/f35 0 2024-09-21T10:41:01.836 INFO:tasks.workunit.client.0.smithi060.stdout:2/323: dwrite d3/d20/d15/f3d [0,4194304] 0 2024-09-21T10:41:01.844 INFO:tasks.workunit.client.0.smithi060.stdout:2/324: unlink d3/d7/d24/d33/l35 0 2024-09-21T10:41:01.849 INFO:tasks.workunit.client.0.smithi060.stdout:2/325: rename d3/d20/d15/f63 to d3/d20/d15/d30/d43/d4b/f6c 0 2024-09-21T10:41:01.849 INFO:tasks.workunit.client.0.smithi060.stdout:2/326: fdatasync d3/d20/d17/f4a 0 2024-09-21T10:41:01.851 INFO:tasks.workunit.client.0.smithi060.stdout:2/327: creat d3/d7/f6d x:0 0 0 2024-09-21T10:41:01.851 INFO:tasks.workunit.client.0.smithi060.stdout:2/328: write d3/d20/d15/d30/d43/f54 [1578199,60062] 0 2024-09-21T10:41:01.851 INFO:tasks.workunit.client.0.smithi060.stdout:2/329: write d3/d20/d15/d30/d43/f54 [2262459,86356] 0 2024-09-21T10:41:01.851 INFO:tasks.workunit.client.0.smithi060.stdout:2/330: chown d3/d20/d15/l3c 0 1 2024-09-21T10:41:01.853 INFO:tasks.workunit.client.0.smithi060.stdout:2/331: unlink d3/c14 0 2024-09-21T10:41:01.855 INFO:tasks.workunit.client.0.smithi060.stdout:2/332: creat d3/d7/d24/d25/d4f/f6e x:0 0 0 2024-09-21T10:41:01.856 INFO:tasks.workunit.client.0.smithi060.stdout:2/333: creat d3/d7/d23/d55/f6f x:0 0 0 2024-09-21T10:41:01.856 INFO:tasks.workunit.client.0.smithi060.stdout:2/334: write d3/d7/fd [671697,23918] 0 2024-09-21T10:41:01.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/607: dwrite d5/d45/d6d/d10/d19/d21/f83 [0,4194304] 0 2024-09-21T10:41:01.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/608: chown d5/d45/d6d/d10/d19/f4e 74258734 1 2024-09-21T10:41:01.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/609: chown d5/d45/d5a/d3a/f5e 43292788 1 2024-09-21T10:41:01.859 INFO:tasks.workunit.client.0.smithi060.stdout:9/474: dwrite d3/f76 [0,4194304] 0 2024-09-21T10:41:01.859 INFO:tasks.workunit.client.0.smithi060.stdout:9/475: getdents d3/d16/d95 0 2024-09-21T10:41:01.859 INFO:tasks.workunit.client.0.smithi060.stdout:9/476: write d3/d5e/d60/d2f/d5b/f96 [403376,113424] 0 2024-09-21T10:41:01.861 INFO:tasks.workunit.client.0.smithi060.stdout:2/335: write d3/d7/d24/f49 [1219942,15712] 0 2024-09-21T10:41:01.861 INFO:tasks.workunit.client.0.smithi060.stdout:4/490: dwrite d0/d83/d6a/d6b/d32/f7e [0,4194304] 0 2024-09-21T10:41:01.865 INFO:tasks.workunit.client.0.smithi060.stdout:5/610: rename d5/d45/d6d/d10/d19/d21/da6 to d5/d7a/d84/dcc 0 2024-09-21T10:41:01.880 INFO:tasks.workunit.client.0.smithi060.stdout:2/336: creat d3/d20/d15/d30/d43/d62/f70 x:0 0 0 2024-09-21T10:41:01.880 INFO:tasks.workunit.client.0.smithi060.stdout:2/337: fdatasync d3/d7/d23/d55/f6f 0 2024-09-21T10:41:01.880 INFO:tasks.workunit.client.0.smithi060.stdout:2/338: write d3/d7/d24/d25/f5b [692599,73542] 0 2024-09-21T10:41:01.890 INFO:tasks.workunit.client.0.smithi060.stdout:4/491: creat d0/d83/f9f x:0 0 0 2024-09-21T10:41:01.899 INFO:tasks.workunit.client.0.smithi060.stdout:9/477: truncate d3/d5e/d60/d2f/f31 1787761 0 2024-09-21T10:41:01.899 INFO:tasks.workunit.client.0.smithi060.stdout:9/478: write d3/f47 [679028,122341] 0 2024-09-21T10:41:01.899 INFO:tasks.workunit.client.0.smithi060.stdout:9/479: getdents d3/d16/d42/d7e/d85 0 2024-09-21T10:41:01.901 INFO:tasks.workunit.client.0.smithi060.stdout:2/339: rename d3/d20/d15/d30/d43/f54 to d3/d7/d23/f71 0 2024-09-21T10:41:01.903 INFO:tasks.workunit.client.0.smithi060.stdout:5/611: rmdir d5/d45/d6d/d10/d19/d8d/d60/d61/d8a 39 2024-09-21T10:41:01.908 INFO:tasks.workunit.client.0.smithi060.stdout:4/492: rename d0/d83/d6a/d6b/d32/d57/f2b to d0/d83/d6a/d6b/d32/fa0 0 2024-09-21T10:41:01.910 INFO:tasks.workunit.client.0.smithi060.stdout:5/612: symlink d5/d45/d5a/lcd 0 2024-09-21T10:41:01.911 INFO:tasks.workunit.client.0.smithi060.stdout:9/480: rename d3/d5e/d60/d2f/f57 to d3/d16/d1a/fa0 0 2024-09-21T10:41:01.913 INFO:tasks.workunit.client.0.smithi060.stdout:4/493: getdents d0/df/d88 0 2024-09-21T10:41:01.915 INFO:tasks.workunit.client.0.smithi060.stdout:5/613: creat d5/d71/fce x:0 0 0 2024-09-21T10:41:01.915 INFO:tasks.workunit.client.0.smithi060.stdout:5/614: write d5/d45/d6d/d10/d19/f33 [1551432,102004] 0 2024-09-21T10:41:01.918 INFO:tasks.workunit.client.0.smithi060.stdout:2/340: rename d3/d20/c1e to d3/d20/d15/d30/d43/d62/c72 0 2024-09-21T10:41:01.924 INFO:tasks.workunit.client.0.smithi060.stdout:2/341: mknod d3/d7/d24/c73 0 2024-09-21T10:41:01.924 INFO:tasks.workunit.client.0.smithi060.stdout:9/481: write d3/d15/f3c [1785796,34346] 0 2024-09-21T10:41:01.925 INFO:tasks.workunit.client.0.smithi060.stdout:4/494: rmdir d0/d83/d6a/d6b/d65/d51 39 2024-09-21T10:41:01.925 INFO:tasks.workunit.client.0.smithi060.stdout:4/495: chown d0/d3c/d67/d7d/d87/f8d 39169 1 2024-09-21T10:41:01.927 INFO:tasks.workunit.client.0.smithi060.stdout:5/615: getdents d5/d45 0 2024-09-21T10:41:01.928 INFO:tasks.workunit.client.0.smithi060.stdout:2/342: truncate f2 629014 0 2024-09-21T10:41:01.931 INFO:tasks.workunit.client.0.smithi060.stdout:9/482: creat d3/d16/d42/d7e/fa1 x:0 0 0 2024-09-21T10:41:01.933 INFO:tasks.workunit.client.0.smithi060.stdout:4/496: symlink d0/d5/d12/d15/d8f/la1 0 2024-09-21T10:41:01.934 INFO:tasks.workunit.client.0.smithi060.stdout:5/616: mknod d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/ccf 0 2024-09-21T10:41:01.939 INFO:tasks.workunit.client.0.smithi060.stdout:2/343: creat d3/d20/d15/f74 x:0 0 0 2024-09-21T10:41:01.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/483: rename d3/d16/c3d to d3/d16/d42/d7e/d85/d8f/ca2 0 2024-09-21T10:41:01.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:01 smithi060 ceph-mon[28215]: pgmap v17: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 334 MiB/s rd, 393 MiB/s wr, 564 op/s 2024-09-21T10:41:01.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:01 smithi112 ceph-mon[35117]: pgmap v17: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 334 MiB/s rd, 393 MiB/s wr, 564 op/s 2024-09-21T10:41:01.952 INFO:tasks.workunit.client.0.smithi060.stdout:2/344: mkdir d3/d7/d18/d75 0 2024-09-21T10:41:01.953 INFO:tasks.workunit.client.0.smithi060.stdout:9/484: truncate d3/d15/f22 3613678 0 2024-09-21T10:41:01.955 INFO:tasks.workunit.client.0.smithi060.stdout:4/497: symlink d0/d83/d6a/d6b/d32/d57/la2 0 2024-09-21T10:41:01.957 INFO:tasks.workunit.client.0.smithi060.stdout:2/345: creat d3/d20/d15/d30/d5c/f76 x:0 0 0 2024-09-21T10:41:01.957 INFO:tasks.workunit.client.0.smithi060.stdout:2/346: creat d3/d7/d24/d25/d4f/f77 x:0 0 0 2024-09-21T10:41:01.957 INFO:tasks.workunit.client.0.smithi060.stdout:2/347: truncate d3/d20/d15/f74 780049 0 2024-09-21T10:41:01.958 INFO:tasks.workunit.client.0.smithi060.stdout:2/348: fdatasync d3/d7/d23/d55/f6f 0 2024-09-21T10:41:01.959 INFO:tasks.workunit.client.0.smithi060.stdout:4/498: unlink d0/d5/d12/c50 0 2024-09-21T10:41:01.962 INFO:tasks.workunit.client.0.smithi060.stdout:2/349: unlink d3/d20/d15/f3d 0 2024-09-21T10:41:01.964 INFO:tasks.workunit.client.0.smithi060.stdout:4/499: symlink d0/df/d84/la3 0 2024-09-21T10:41:01.964 INFO:tasks.workunit.client.0.smithi060.stdout:4/500: write d0/d5/d12/f95 [1408576,60116] 0 2024-09-21T10:41:01.964 INFO:tasks.workunit.client.0.smithi060.stdout:4/501: fdatasync d0/d5/d12/d15/d8f/f98 0 2024-09-21T10:41:01.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/350: rename d3/d20/d15/c47 to d3/d20/d15/d4c/c78 0 2024-09-21T10:41:01.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/351: chown d3/d7/d24/d33 2790111 1 2024-09-21T10:41:01.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/352: stat d3/d7/d24/d25 0 2024-09-21T10:41:01.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/353: write d3/d7/f6d [391847,85755] 0 2024-09-21T10:41:01.966 INFO:tasks.workunit.client.0.smithi060.stdout:4/502: mkdir d0/d59/da4 0 2024-09-21T10:41:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:2/354: mkdir d3/d79 0 2024-09-21T10:41:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:2/355: read f2 [29769,77544] 0 2024-09-21T10:41:01.967 INFO:tasks.workunit.client.0.smithi060.stdout:9/485: dwrite d3/d15/d58/f9b [0,4194304] 0 2024-09-21T10:41:01.968 INFO:tasks.workunit.client.0.smithi060.stdout:9/486: write d3/d16/d1a/f72 [1242148,16451] 0 2024-09-21T10:41:01.969 INFO:tasks.workunit.client.0.smithi060.stdout:4/503: creat d0/df/d9c/fa5 x:0 0 0 2024-09-21T10:41:01.970 INFO:tasks.workunit.client.0.smithi060.stdout:2/356: mknod d3/d7/d24/d25/c7a 0 2024-09-21T10:41:01.978 INFO:tasks.workunit.client.0.smithi060.stdout:9/487: symlink d3/d16/d42/d7e/la3 0 2024-09-21T10:41:01.979 INFO:tasks.workunit.client.0.smithi060.stdout:2/357: write d3/d20/d17/f4a [1460601,82152] 0 2024-09-21T10:41:01.979 INFO:tasks.workunit.client.0.smithi060.stdout:2/358: write d3/d7/d23/d55/f6f [82337,8594] 0 2024-09-21T10:41:01.979 INFO:tasks.workunit.client.0.smithi060.stdout:2/359: chown d3/d7/f34 14627 1 2024-09-21T10:41:01.980 INFO:tasks.workunit.client.0.smithi060.stdout:2/360: chown d3/d20/d17/c65 8434809 1 2024-09-21T10:41:01.980 INFO:tasks.workunit.client.0.smithi060.stdout:4/504: mkdir d0/d5/d12/d15/da6 0 2024-09-21T10:41:01.984 INFO:tasks.workunit.client.0.smithi060.stdout:2/361: unlink d3/d7/d24/d33/l66 0 2024-09-21T10:41:01.985 INFO:tasks.workunit.client.0.smithi060.stdout:4/505: rmdir d0/d83/d6a/d6b/d65/d51/d9a 0 2024-09-21T10:41:01.988 INFO:tasks.workunit.client.0.smithi060.stdout:9/488: mkdir d3/da4 0 2024-09-21T10:41:01.988 INFO:tasks.workunit.client.0.smithi060.stdout:9/489: stat d3/d16/d1a/fa0 0 2024-09-21T10:41:01.989 INFO:tasks.workunit.client.0.smithi060.stdout:2/362: creat d3/d79/f7b x:0 0 0 2024-09-21T10:41:01.989 INFO:tasks.workunit.client.0.smithi060.stdout:2/363: write d3/d7/d23/d55/f6f [151220,1563] 0 2024-09-21T10:41:01.989 INFO:tasks.workunit.client.0.smithi060.stdout:2/364: dread - d3/d7/d24/d33/f57 zero size 2024-09-21T10:41:01.989 INFO:tasks.workunit.client.0.smithi060.stdout:2/365: creat d3/d7/d23/f7c x:0 0 0 2024-09-21T10:41:01.989 INFO:tasks.workunit.client.0.smithi060.stdout:4/506: symlink d0/d5/la7 0 2024-09-21T10:41:01.991 INFO:tasks.workunit.client.0.smithi060.stdout:9/490: readlink d3/l7a 0 2024-09-21T10:41:01.993 INFO:tasks.workunit.client.0.smithi060.stdout:2/366: symlink d3/d20/d15/d30/d6a/l7d 0 2024-09-21T10:41:01.993 INFO:tasks.workunit.client.0.smithi060.stdout:2/367: stat d3/d7/d24/f2a 0 2024-09-21T10:41:01.994 INFO:tasks.workunit.client.0.smithi060.stdout:2/368: mknod d3/d20/d15/d30/d43/c7e 0 2024-09-21T10:41:01.995 INFO:tasks.workunit.client.0.smithi060.stdout:2/369: write d3/d7/d24/d33/f57 [210025,41487] 0 2024-09-21T10:41:01.999 INFO:tasks.workunit.client.0.smithi060.stdout:4/507: symlink d0/d83/d6a/d6b/d32/d57/la8 0 2024-09-21T10:41:01.999 INFO:tasks.workunit.client.0.smithi060.stdout:4/508: truncate d0/d5/d12/d15/d8f/f98 311700 0 2024-09-21T10:41:02.000 INFO:tasks.workunit.client.0.smithi060.stdout:2/370: symlink d3/d7/d24/l7f 0 2024-09-21T10:41:02.001 INFO:tasks.workunit.client.0.smithi060.stdout:4/509: truncate d0/f41 6839496 0 2024-09-21T10:41:02.001 INFO:tasks.workunit.client.0.smithi060.stdout:4/510: chown d0/d5/d12/d15 60749750 1 2024-09-21T10:41:02.001 INFO:tasks.workunit.client.0.smithi060.stdout:4/511: chown d0/d3c/f81 111043949 1 2024-09-21T10:41:02.011 INFO:tasks.workunit.client.0.smithi060.stdout:2/371: dread d3/d7/d23/f5a [4194304,4194304] 0 2024-09-21T10:41:02.011 INFO:tasks.workunit.client.0.smithi060.stdout:2/372: write d3/d20/d15/f74 [1775062,36094] 0 2024-09-21T10:41:02.011 INFO:tasks.workunit.client.0.smithi060.stdout:2/373: stat d3/d20/d15/d30/d6a/c6b 0 2024-09-21T10:41:02.011 INFO:tasks.workunit.client.0.smithi060.stdout:2/374: write d3/d20/d15/d30/d43/f67 [471433,24394] 0 2024-09-21T10:41:02.011 INFO:tasks.workunit.client.0.smithi060.stdout:2/375: readlink d3/d7/d24/l60 0 2024-09-21T10:41:02.013 INFO:tasks.workunit.client.0.smithi060.stdout:2/376: symlink d3/d20/d15/l80 0 2024-09-21T10:41:02.019 INFO:tasks.workunit.client.0.smithi060.stdout:0/587: sync 2024-09-21T10:41:02.020 INFO:tasks.workunit.client.0.smithi060.stdout:0/588: mknod d5/d10/da/d4b/da4/d40/cb8 0 2024-09-21T10:41:02.020 INFO:tasks.workunit.client.0.smithi060.stdout:4/512: dwrite d0/d3c/d67/d7d/d87/f8d [0,4194304] 0 2024-09-21T10:41:02.021 INFO:tasks.workunit.client.0.smithi060.stdout:4/513: rename d0/d3c/d67 to d0/d3c/d67/da9 22 2024-09-21T10:41:02.023 INFO:tasks.workunit.client.0.smithi060.stdout:0/589: symlink d5/d10/da/d4b/da4/d40/d48/lb9 0 2024-09-21T10:41:02.023 INFO:tasks.workunit.client.0.smithi060.stdout:0/590: dread - d5/d10/da/fa5 zero size 2024-09-21T10:41:02.024 INFO:tasks.workunit.client.0.smithi060.stdout:0/591: dread - d5/d10/d43/f5d zero size 2024-09-21T10:41:02.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/592: mkdir d5/d10/d4e/dba 0 2024-09-21T10:41:02.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/593: chown d5/d10/da/d4b/da4/d76/f94 63 1 2024-09-21T10:41:02.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/594: write d5/d10/d4e/f8f [672532,120590] 0 2024-09-21T10:41:02.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/595: chown d5/d10/da/d2d/l69 315007 1 2024-09-21T10:41:02.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/596: chown d5/d10/da/d2d/fa2 901 1 2024-09-21T10:41:02.027 INFO:tasks.workunit.client.0.smithi060.stdout:0/597: write d5/d10/d4e/f9c [623151,12043] 0 2024-09-21T10:41:02.029 INFO:tasks.workunit.client.0.smithi060.stdout:2/377: dwrite d3/d7/d24/d25/f5b [0,4194304] 0 2024-09-21T10:41:02.029 INFO:tasks.workunit.client.0.smithi060.stdout:0/598: mkdir d5/d10/da/d4b/da4/d40/d75/dbb 0 2024-09-21T10:41:02.029 INFO:tasks.workunit.client.0.smithi060.stdout:0/599: chown d5/d10/da/d2f/d66/l73 27413 1 2024-09-21T10:41:02.037 INFO:tasks.workunit.client.0.smithi060.stdout:2/378: link d3/d20/d17/f4a d3/d7/d18/f81 0 2024-09-21T10:41:02.038 INFO:tasks.workunit.client.0.smithi060.stdout:4/514: dwrite d0/d5/f1a [4194304,4194304] 0 2024-09-21T10:41:02.038 INFO:tasks.workunit.client.0.smithi060.stdout:4/515: truncate d0/d3c/f81 675315 0 2024-09-21T10:41:02.040 INFO:tasks.workunit.client.0.smithi060.stdout:0/600: symlink d5/lbc 0 2024-09-21T10:41:02.040 INFO:tasks.workunit.client.0.smithi060.stdout:0/601: truncate d5/d10/da/d4b/da4/d40/d48/fac 193482 0 2024-09-21T10:41:02.040 INFO:tasks.workunit.client.0.smithi060.stdout:0/602: chown d5/d10/f60 11 1 2024-09-21T10:41:02.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/516: dread d0/d5/d12/f95 [0,4194304] 0 2024-09-21T10:41:02.042 INFO:tasks.workunit.client.0.smithi060.stdout:2/379: mkdir d3/d20/d15/d4c/d82 0 2024-09-21T10:41:02.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/603: mkdir d5/d10/d4e/dbd 0 2024-09-21T10:41:02.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/604: read - d5/d10/da/d4b/f8b zero size 2024-09-21T10:41:02.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/605: fdatasync d5/d10/d43/f5d 0 2024-09-21T10:41:02.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/606: write d5/d10/da/fa5 [314114,26634] 0 2024-09-21T10:41:02.046 INFO:tasks.workunit.client.0.smithi060.stdout:0/607: chown d5/d10/da/d2d 4 1 2024-09-21T10:41:02.048 INFO:tasks.workunit.client.0.smithi060.stdout:4/517: mknod d0/d5/d12/d15/caa 0 2024-09-21T10:41:02.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/518: mkdir d0/d3c/dab 0 2024-09-21T10:41:02.051 INFO:tasks.workunit.client.0.smithi060.stdout:4/519: fsync d0/f60 0 2024-09-21T10:41:02.055 INFO:tasks.workunit.client.0.smithi060.stdout:4/520: creat d0/d83/d6a/d6b/d32/d57/d90/fac x:0 0 0 2024-09-21T10:41:02.055 INFO:tasks.workunit.client.0.smithi060.stdout:4/521: fsync d0/d5/f71 0 2024-09-21T10:41:02.055 INFO:tasks.workunit.client.0.smithi060.stdout:0/608: write d5/d10/da/d4b/da4/f5c [562934,64581] 0 2024-09-21T10:41:02.055 INFO:tasks.workunit.client.0.smithi060.stdout:0/609: getdents d5/d10/da/d4b/da4/d40/d48/dab/d45 0 2024-09-21T10:41:02.062 INFO:tasks.workunit.client.0.smithi060.stdout:2/380: dwrite d3/d7/d24/f2a [0,4194304] 0 2024-09-21T10:41:02.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/381: mkdir d3/d7/d24/d25/d4f/d69/d83 0 2024-09-21T10:41:02.064 INFO:tasks.workunit.client.0.smithi060.stdout:2/382: dread - d3/d7/d23/f7c zero size 2024-09-21T10:41:02.065 INFO:tasks.workunit.client.0.smithi060.stdout:2/383: truncate d3/d20/d15/d30/d43/f67 838667 0 2024-09-21T10:41:02.065 INFO:tasks.workunit.client.0.smithi060.stdout:2/384: chown d3/d20/d15/d4c/d82 174 1 2024-09-21T10:41:02.068 INFO:tasks.workunit.client.0.smithi060.stdout:2/385: link d3/d20/d15/c2c d3/d7/d18/c84 0 2024-09-21T10:41:02.069 INFO:tasks.workunit.client.0.smithi060.stdout:4/522: dwrite d0/d3c/d67/d7d/d87/f7a [0,4194304] 0 2024-09-21T10:41:02.069 INFO:tasks.workunit.client.0.smithi060.stdout:2/386: mknod d3/d7/d24/d25/d4f/d69/c85 0 2024-09-21T10:41:02.072 INFO:tasks.workunit.client.0.smithi060.stdout:4/523: creat d0/d8b/fad x:0 0 0 2024-09-21T10:41:02.087 INFO:tasks.workunit.client.0.smithi060.stdout:2/387: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:41:02.088 INFO:tasks.workunit.client.0.smithi060.stdout:2/388: rmdir d3/d20/d15/d30/d5c 39 2024-09-21T10:41:02.088 INFO:tasks.workunit.client.0.smithi060.stdout:2/389: dread - d3/d20/d15/d30/d43/d4b/f6c zero size 2024-09-21T10:41:02.090 INFO:tasks.workunit.client.0.smithi060.stdout:4/524: dwrite d0/d3c/f48 [0,4194304] 0 2024-09-21T10:41:02.093 INFO:tasks.workunit.client.0.smithi060.stdout:4/525: creat d0/d5/d12/d15/da6/fae x:0 0 0 2024-09-21T10:41:02.096 INFO:tasks.workunit.client.0.smithi060.stdout:4/526: creat d0/df/d84/faf x:0 0 0 2024-09-21T10:41:02.101 INFO:tasks.workunit.client.0.smithi060.stdout:2/390: dwrite d3/d20/d15/f74 [0,4194304] 0 2024-09-21T10:41:02.103 INFO:tasks.workunit.client.0.smithi060.stdout:2/391: dread d3/d20/d15/d30/d43/f67 [0,4194304] 0 2024-09-21T10:41:02.103 INFO:tasks.workunit.client.0.smithi060.stdout:2/392: fsync d3/d7/f6d 0 2024-09-21T10:41:02.103 INFO:tasks.workunit.client.0.smithi060.stdout:2/393: stat d3/d7/d23/f5a 0 2024-09-21T10:41:02.103 INFO:tasks.workunit.client.0.smithi060.stdout:2/394: chown d3/d7/d24/c73 377002109 1 2024-09-21T10:41:02.104 INFO:tasks.workunit.client.0.smithi060.stdout:4/527: dread d0/d5/f10 [0,4194304] 0 2024-09-21T10:41:02.104 INFO:tasks.workunit.client.0.smithi060.stdout:4/528: write d0/d5/d12/d15/d4d/f54 [625642,4992] 0 2024-09-21T10:41:02.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/395: rmdir d3/d20/d15 39 2024-09-21T10:41:02.118 INFO:tasks.workunit.client.0.smithi060.stdout:4/529: dwrite d0/d5/f36 [0,4194304] 0 2024-09-21T10:41:02.122 INFO:tasks.workunit.client.0.smithi060.stdout:4/530: rename d0/d83/d6a/d6b/d32/fa0 to d0/d83/fb0 0 2024-09-21T10:41:02.136 INFO:tasks.workunit.client.0.smithi060.stdout:4/531: dwrite d0/d3c/d67/f68 [0,4194304] 0 2024-09-21T10:41:02.144 INFO:tasks.workunit.client.0.smithi060.stdout:4/532: rename d0/d5/d12/d3d/c55 to d0/d59/d9d/cb1 0 2024-09-21T10:41:02.147 INFO:tasks.workunit.client.0.smithi060.stdout:4/533: getdents d0/d3c/d67/d7d 0 2024-09-21T10:41:02.148 INFO:tasks.workunit.client.0.smithi060.stdout:4/534: write d0/d83/d6a/d6b/d32/f75 [229150,74141] 0 2024-09-21T10:41:02.148 INFO:tasks.workunit.client.0.smithi060.stdout:4/535: fsync d0/d59/f5c 0 2024-09-21T10:41:02.148 INFO:tasks.workunit.client.0.smithi060.stdout:4/536: dread - d0/d5/d12/f5f zero size 2024-09-21T10:41:02.148 INFO:tasks.workunit.client.0.smithi060.stdout:4/537: creat d0/d5/d12/d15/d4d/fb2 x:0 0 0 2024-09-21T10:41:02.149 INFO:tasks.workunit.client.0.smithi060.stdout:3/504: sync 2024-09-21T10:41:02.149 INFO:tasks.workunit.client.0.smithi060.stdout:3/505: fdatasync d0/d1/d11/d2a/f63 0 2024-09-21T10:41:02.153 INFO:tasks.workunit.client.0.smithi060.stdout:3/506: unlink d0/d1/d11/d2a/d64/c66 0 2024-09-21T10:41:02.155 INFO:tasks.workunit.client.0.smithi060.stdout:3/507: rename d0/d1/d11/d2a/d45/f86 to d0/d1/d5c/fa0 0 2024-09-21T10:41:02.169 INFO:tasks.workunit.client.0.smithi060.stdout:4/538: dwrite d0/fc [0,4194304] 0 2024-09-21T10:41:02.185 INFO:tasks.workunit.client.0.smithi060.stdout:4/539: dwrite d0/d5/f36 [0,4194304] 0 2024-09-21T10:41:02.191 INFO:tasks.workunit.client.0.smithi060.stdout:3/508: mknod d0/d1/d11/ca1 0 2024-09-21T10:41:02.193 INFO:tasks.workunit.client.0.smithi060.stdout:4/540: unlink d0/d83/d6a/d6b/d32/f5e 0 2024-09-21T10:41:02.193 INFO:tasks.workunit.client.0.smithi060.stdout:4/541: truncate d0/d83/d6a/d6b/d65/d51/f99 804662 0 2024-09-21T10:41:02.212 INFO:tasks.workunit.client.0.smithi060.stdout:3/509: dwrite d0/d1/d11/f32 [0,4194304] 0 2024-09-21T10:41:02.212 INFO:tasks.workunit.client.0.smithi060.stdout:3/510: truncate d0/f28 3862343 0 2024-09-21T10:41:02.215 INFO:tasks.workunit.client.0.smithi060.stdout:3/511: rmdir d0/d1/d11/d2a/d43/d4e 39 2024-09-21T10:41:02.215 INFO:tasks.workunit.client.0.smithi060.stdout:3/512: fdatasync d0/d1/d11/d2a/d64/f9c 0 2024-09-21T10:41:02.222 INFO:tasks.workunit.client.0.smithi060.stdout:4/542: dwrite d0/d83/fb0 [0,4194304] 0 2024-09-21T10:41:02.222 INFO:tasks.workunit.client.0.smithi060.stdout:4/543: write d0/fc [4488419,125835] 0 2024-09-21T10:41:02.239 INFO:tasks.workunit.client.0.smithi060.stdout:3/513: dwrite d0/d1/d5c/fa0 [0,4194304] 0 2024-09-21T10:41:02.240 INFO:tasks.workunit.client.0.smithi060.stdout:4/544: dwrite d0/d5/f66 [0,4194304] 0 2024-09-21T10:41:02.240 INFO:tasks.workunit.client.0.smithi060.stdout:4/545: read d0/d5/f5a [629842,28028] 0 2024-09-21T10:41:02.240 INFO:tasks.workunit.client.0.smithi060.stdout:3/514: mkdir d0/d1/d11/d53/da2 0 2024-09-21T10:41:02.243 INFO:tasks.workunit.client.0.smithi060.stdout:4/546: symlink d0/df/lb3 0 2024-09-21T10:41:02.243 INFO:tasks.workunit.client.0.smithi060.stdout:4/547: dread - d0/d83/d6a/d6b/f45 zero size 2024-09-21T10:41:02.244 INFO:tasks.workunit.client.0.smithi060.stdout:3/515: symlink d0/la3 0 2024-09-21T10:41:02.246 INFO:tasks.workunit.client.0.smithi060.stdout:3/516: unlink d0/d1/d11/d53/c80 0 2024-09-21T10:41:02.248 INFO:tasks.workunit.client.0.smithi060.stdout:3/517: mknod d0/d1/ca4 0 2024-09-21T10:41:02.250 INFO:tasks.workunit.client.0.smithi060.stdout:3/518: symlink d0/d1/d1e/d34/la5 0 2024-09-21T10:41:02.254 INFO:tasks.workunit.client.0.smithi060.stdout:3/519: rmdir d0/d1/d24 39 2024-09-21T10:41:02.255 INFO:tasks.workunit.client.0.smithi060.stdout:3/520: symlink d0/d1/d11/d2a/d43/la6 0 2024-09-21T10:41:02.255 INFO:tasks.workunit.client.0.smithi060.stdout:3/521: fdatasync d0/d1/d11/f15 0 2024-09-21T10:41:02.256 INFO:tasks.workunit.client.0.smithi060.stdout:4/548: dwrite d0/d5/d12/d15/d8f/f3b [0,4194304] 0 2024-09-21T10:41:02.303 INFO:tasks.workunit.client.0.smithi060.stdout:3/522: mknod d0/d1/d11/d53/d98/ca7 0 2024-09-21T10:41:02.308 INFO:tasks.workunit.client.0.smithi060.stdout:4/549: getdents d0/d3c/d67/d7d/d87 0 2024-09-21T10:41:02.308 INFO:tasks.workunit.client.0.smithi060.stdout:4/550: dread - d0/d83/d6a/d6b/d32/d57/d90/fac zero size 2024-09-21T10:41:02.308 INFO:tasks.workunit.client.0.smithi060.stdout:4/551: write d0/d5/d12/d15/f9b [844113,82949] 0 2024-09-21T10:41:02.308 INFO:tasks.workunit.client.0.smithi060.stdout:4/552: stat d0/d5/d12/f73 0 2024-09-21T10:41:02.312 INFO:tasks.workunit.client.0.smithi060.stdout:4/553: truncate d0/d5/d12/d15/d8f/f3b 2288464 0 2024-09-21T10:41:02.312 INFO:tasks.workunit.client.0.smithi060.stdout:3/523: write d0/d1/d11/d2a/d64/f9c [97938,61830] 0 2024-09-21T10:41:02.313 INFO:tasks.workunit.client.0.smithi060.stdout:4/554: symlink d0/df/d84/lb4 0 2024-09-21T10:41:02.316 INFO:tasks.workunit.client.0.smithi060.stdout:4/555: creat d0/fb5 x:0 0 0 2024-09-21T10:41:02.316 INFO:tasks.workunit.client.0.smithi060.stdout:4/556: fsync d0/d8b/fad 0 2024-09-21T10:41:02.318 INFO:tasks.workunit.client.0.smithi060.stdout:4/557: symlink d0/d3c/d67/d7d/lb6 0 2024-09-21T10:41:02.318 INFO:tasks.workunit.client.0.smithi060.stdout:4/558: creat d0/d3c/fb7 x:0 0 0 2024-09-21T10:41:02.320 INFO:tasks.workunit.client.0.smithi060.stdout:4/559: symlink d0/d83/d6a/d6b/d32/d57/lb8 0 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/560: dread d0/d83/d6a/d6b/f2f [0,4194304] 0 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/561: truncate d0/d5/d12/d15/d8f/f98 1008658 0 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/562: write d0/d5/d12/d15/d72/f80 [619641,125797] 0 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/563: readlink d0/df/d84/l92 0 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/564: chown d0/d5/d12/d15/da6/fae 41 1 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:3/524: dwrite d0/d1/d11/d2a/d45/f91 [0,4194304] 0 2024-09-21T10:41:02.329 INFO:tasks.workunit.client.0.smithi060.stdout:3/525: read d0/d1/d11/d2a/f33 [668297,122560] 0 2024-09-21T10:41:02.330 INFO:tasks.workunit.client.0.smithi060.stdout:4/565: mknod d0/d3c/d67/d7d/d87/cb9 0 2024-09-21T10:41:02.331 INFO:tasks.workunit.client.0.smithi060.stdout:4/566: creat d0/d5/d12/d15/d8f/fba x:0 0 0 2024-09-21T10:41:02.331 INFO:tasks.workunit.client.0.smithi060.stdout:4/567: stat d0/d5/d12/f95 0 2024-09-21T10:41:02.335 INFO:tasks.workunit.client.0.smithi060.stdout:3/526: link d0/d1/d11/d46/f59 d0/d1/d11/d2a/d85/fa8 0 2024-09-21T10:41:02.340 INFO:tasks.workunit.client.0.smithi060.stdout:4/568: unlink d0/fb5 0 2024-09-21T10:41:02.340 INFO:tasks.workunit.client.0.smithi060.stdout:4/569: fsync d0/d5/d12/f5f 0 2024-09-21T10:41:02.342 INFO:tasks.workunit.client.0.smithi060.stdout:3/527: symlink d0/d1/d24/d81/la9 0 2024-09-21T10:41:02.345 INFO:tasks.workunit.client.0.smithi060.stdout:4/570: symlink d0/d83/d6a/d6b/d32/lbb 0 2024-09-21T10:41:02.346 INFO:tasks.workunit.client.0.smithi060.stdout:4/571: fdatasync d0/d5/d12/d15/d8f/fba 0 2024-09-21T10:41:02.346 INFO:tasks.workunit.client.0.smithi060.stdout:3/528: mknod d0/d1/d11/d53/caa 0 2024-09-21T10:41:02.346 INFO:tasks.workunit.client.0.smithi060.stdout:3/529: dread d0/d1/f8b [0,4194304] 0 2024-09-21T10:41:02.347 INFO:tasks.workunit.client.0.smithi060.stdout:4/572: creat d0/d83/d6a/d6b/d32/d57/fbc x:0 0 0 2024-09-21T10:41:02.347 INFO:tasks.workunit.client.0.smithi060.stdout:4/573: readlink d0/d5/d12/d3d/l86 0 2024-09-21T10:41:02.349 INFO:tasks.workunit.client.0.smithi060.stdout:3/530: rename d0/d1/d5c/c8a to d0/d1/d11/d2a/d45/cab 0 2024-09-21T10:41:02.352 INFO:tasks.workunit.client.0.smithi060.stdout:3/531: rename d0/d1/d52/l61 to d0/d1/d11/d2a/d87/lac 0 2024-09-21T10:41:02.353 INFO:tasks.workunit.client.0.smithi060.stdout:3/532: stat d0/d1/d1e/c6a 0 2024-09-21T10:41:02.358 INFO:tasks.workunit.client.0.smithi060.stdout:3/533: rename d0/l60 to d0/d1/d52/lad 0 2024-09-21T10:41:02.379 INFO:tasks.workunit.client.0.smithi060.stdout:3/534: dwrite d0/f7d [0,4194304] 0 2024-09-21T10:41:02.379 INFO:tasks.workunit.client.0.smithi060.stdout:3/535: fsync d0/d1/d11/d2a/d45/f9a 0 2024-09-21T10:41:02.379 INFO:tasks.workunit.client.0.smithi060.stdout:3/536: fsync d0/f7d 0 2024-09-21T10:41:02.383 INFO:tasks.workunit.client.0.smithi060.stdout:3/537: read d0/d1/d11/d2a/f5d [231673,33885] 0 2024-09-21T10:41:02.383 INFO:tasks.workunit.client.0.smithi060.stdout:3/538: write d0/d1/d11/d2a/d64/f9c [1892606,113208] 0 2024-09-21T10:41:02.383 INFO:tasks.workunit.client.0.smithi060.stdout:3/539: stat d0/la3 0 2024-09-21T10:41:02.384 INFO:tasks.workunit.client.0.smithi060.stdout:3/540: getdents d0/d1/d11/d2a/d87 0 2024-09-21T10:41:02.393 INFO:tasks.workunit.client.0.smithi060.stdout:3/541: read d0/d1/f70 [634831,101010] 0 2024-09-21T10:41:02.402 INFO:tasks.workunit.client.0.smithi060.stdout:3/542: dread d0/f1c [0,4194304] 0 2024-09-21T10:41:02.403 INFO:tasks.workunit.client.0.smithi060.stdout:3/543: dread d0/d1/d11/d46/f31 [0,4194304] 0 2024-09-21T10:41:02.403 INFO:tasks.workunit.client.0.smithi060.stdout:3/544: read d0/f21 [1548795,48302] 0 2024-09-21T10:41:02.405 INFO:tasks.workunit.client.0.smithi060.stdout:3/545: mknod d0/d1/d1e/d34/cae 0 2024-09-21T10:41:02.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/546: unlink d0/d1/d1e/c9f 0 2024-09-21T10:41:02.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/547: readlink d0/d1/d1e/l41 0 2024-09-21T10:41:02.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/548: stat d0/d1/d11/d53/c83 0 2024-09-21T10:41:02.408 INFO:tasks.workunit.client.0.smithi060.stdout:3/549: creat d0/d1/d52/faf x:0 0 0 2024-09-21T10:41:02.409 INFO:tasks.workunit.client.0.smithi060.stdout:3/550: mkdir d0/d1/db0 0 2024-09-21T10:41:02.410 INFO:tasks.workunit.client.0.smithi060.stdout:3/551: write d0/d1/d11/d2a/f4d [4281120,130064] 0 2024-09-21T10:41:02.423 INFO:tasks.workunit.client.0.smithi060.stdout:3/552: dwrite d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:41:02.439 INFO:tasks.workunit.client.0.smithi060.stdout:3/553: dwrite d0/d1/d11/d2a/f7e [0,4194304] 0 2024-09-21T10:41:02.439 INFO:tasks.workunit.client.0.smithi060.stdout:3/554: write d0/d1/d11/f32 [4850191,9198] 0 2024-09-21T10:41:02.440 INFO:tasks.workunit.client.0.smithi060.stdout:3/555: dread d0/d1/d11/f42 [0,4194304] 0 2024-09-21T10:41:02.447 INFO:tasks.workunit.client.0.smithi060.stdout:3/556: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:41:02.449 INFO:tasks.workunit.client.0.smithi060.stdout:3/557: creat d0/d1/d11/d2a/d87/fb1 x:0 0 0 2024-09-21T10:41:02.451 INFO:tasks.workunit.client.0.smithi060.stdout:3/558: dread d0/d1/d11/f51 [0,4194304] 0 2024-09-21T10:41:02.451 INFO:tasks.workunit.client.0.smithi060.stdout:3/559: creat d0/d1/d11/d2a/d45/fb2 x:0 0 0 2024-09-21T10:41:02.455 INFO:tasks.workunit.client.0.smithi060.stdout:3/560: symlink d0/d1/db0/lb3 0 2024-09-21T10:41:02.455 INFO:tasks.workunit.client.0.smithi060.stdout:3/561: truncate d0/d1/d11/d46/f59 6012575 0 2024-09-21T10:41:02.457 INFO:tasks.workunit.client.0.smithi060.stdout:3/562: symlink d0/d1/d11/lb4 0 2024-09-21T10:41:02.461 INFO:tasks.workunit.client.0.smithi060.stdout:3/563: rename d0/d1/db0/lb3 to d0/d1/d1e/d89/lb5 0 2024-09-21T10:41:02.461 INFO:tasks.workunit.client.0.smithi060.stdout:3/564: fsync d0/d1/d11/d2a/d43/f88 0 2024-09-21T10:41:02.461 INFO:tasks.workunit.client.0.smithi060.stdout:3/565: stat d0/d1/d11/d2a/d45 0 2024-09-21T10:41:02.466 INFO:tasks.workunit.client.0.smithi060.stdout:3/566: rename d0/d1/d24/f25 to d0/d1/d9e/fb6 0 2024-09-21T10:41:02.470 INFO:tasks.workunit.client.0.smithi060.stdout:3/567: rmdir d0/d1/d11/d53 39 2024-09-21T10:41:02.472 INFO:tasks.workunit.client.0.smithi060.stdout:3/568: unlink d0/d1/l56 0 2024-09-21T10:41:02.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/569: dread d0/d1/d11/d2a/f63 [0,4194304] 0 2024-09-21T10:41:02.484 INFO:tasks.workunit.client.0.smithi060.stdout:7/592: sync 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:6/536: sync 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:1/502: sync 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:8/593: sync 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:5/617: sync 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:5/618: chown d5/d71/fc0 0 1 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:8/594: readlink d2/d26/d37/d64/d65/la0 0 2024-09-21T10:41:02.485 INFO:tasks.workunit.client.0.smithi060.stdout:5/619: stat d5/d45/d5a/l2e 0 2024-09-21T10:41:02.487 INFO:tasks.workunit.client.0.smithi060.stdout:6/537: link d3/d12/d38/d41/l42 d3/d12/d16/d1a/la7 0 2024-09-21T10:41:02.489 INFO:tasks.workunit.client.0.smithi060.stdout:1/503: link d6/d24/da/db/de/d32/c53 d6/d24/da/db/de/cb5 0 2024-09-21T10:41:02.489 INFO:tasks.workunit.client.0.smithi060.stdout:3/570: dwrite d0/d1/d11/d2a/f7e [0,4194304] 0 2024-09-21T10:41:02.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/593: mknod da/d14/d2a/d49/d2e/ccb 0 2024-09-21T10:41:02.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/594: chown da/d14/lb8 413 1 2024-09-21T10:41:02.492 INFO:tasks.workunit.client.0.smithi060.stdout:7/595: write da/d14/d2a/fad [139999,43559] 0 2024-09-21T10:41:02.492 INFO:tasks.workunit.client.0.smithi060.stdout:9/491: sync 2024-09-21T10:41:02.492 INFO:tasks.workunit.client.0.smithi060.stdout:0/610: sync 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:9/492: dread - d3/d15/d53/f97 zero size 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:0/611: dread - d5/d10/da/d4b/da4/d76/f94 zero size 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:9/493: readlink d3/d16/d1a/l48 0 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:0/612: dread - d5/d10/da/d4b/da4/d76/f94 zero size 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:9/494: truncate d3/d16/d7f/f8d 65021 0 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:0/613: write d5/d10/da/d4b/da4/d40/d48/dab/d4d/f87 [51106,101700] 0 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:8/595: creat d2/d18/d4b/d61/d6e/fc7 x:0 0 0 2024-09-21T10:41:02.493 INFO:tasks.workunit.client.0.smithi060.stdout:8/596: stat d2/d18/f5e 0 2024-09-21T10:41:02.497 INFO:tasks.workunit.client.0.smithi060.stdout:5/620: getdents d5/d7a/d84/dcc 0 2024-09-21T10:41:02.497 INFO:tasks.workunit.client.0.smithi060.stdout:5/621: fsync d5/f24 0 2024-09-21T10:41:02.498 INFO:tasks.workunit.client.0.smithi060.stdout:6/538: mkdir d3/d54/da8 0 2024-09-21T10:41:02.500 INFO:tasks.workunit.client.0.smithi060.stdout:1/504: mknod d6/d24/da/d45/d47/cb6 0 2024-09-21T10:41:02.501 INFO:tasks.workunit.client.0.smithi060.stdout:7/596: link da/c28 da/d14/d25/ccc 0 2024-09-21T10:41:02.502 INFO:tasks.workunit.client.0.smithi060.stdout:0/614: unlink d5/d10/da/c52 0 2024-09-21T10:41:02.504 INFO:tasks.workunit.client.0.smithi060.stdout:8/597: mknod d2/d26/da4/daa/cc8 0 2024-09-21T10:41:02.507 INFO:tasks.workunit.client.0.smithi060.stdout:5/622: dread d5/d45/d6d/d10/f90 [0,4194304] 0 2024-09-21T10:41:02.507 INFO:tasks.workunit.client.0.smithi060.stdout:3/571: dwrite d0/d1/d1e/d34/f49 [4194304,4194304] 0 2024-09-21T10:41:02.507 INFO:tasks.workunit.client.0.smithi060.stdout:6/539: rename d3/d12/d16/d1a/d83/d97 to d3/d12/d16/d25/d76/da9 0 2024-09-21T10:41:02.507 INFO:tasks.workunit.client.0.smithi060.stdout:6/540: readlink d3/d12/d16/l2e 0 2024-09-21T10:41:02.507 INFO:tasks.workunit.client.0.smithi060.stdout:6/541: fsync d3/d12/d38/d41/f62 0 2024-09-21T10:41:02.509 INFO:tasks.workunit.client.0.smithi060.stdout:9/495: getdents d3/d15/d58 0 2024-09-21T10:41:02.509 INFO:tasks.workunit.client.0.smithi060.stdout:9/496: getdents d3/d16/d42/d7e/d85 0 2024-09-21T10:41:02.511 INFO:tasks.workunit.client.0.smithi060.stdout:0/615: link d5/d10/da/d4b/da4/d40/d48/dab/f55 d5/d10/da/d4b/da4/d40/d48/dab/fbe 0 2024-09-21T10:41:02.512 INFO:tasks.workunit.client.0.smithi060.stdout:0/616: write d5/d10/da/d15/f7d [166683,29409] 0 2024-09-21T10:41:02.515 INFO:tasks.workunit.client.0.smithi060.stdout:8/598: dread d2/d26/d37/f58 [0,4194304] 0 2024-09-21T10:41:02.515 INFO:tasks.workunit.client.0.smithi060.stdout:8/599: fdatasync d2/d18/d4b/d61/d6e/fc7 0 2024-09-21T10:41:02.515 INFO:tasks.workunit.client.0.smithi060.stdout:8/600: chown d2/d26/d37/c98 1 1 2024-09-21T10:41:02.515 INFO:tasks.workunit.client.0.smithi060.stdout:8/601: chown d2/d26/d37/c98 0 1 2024-09-21T10:41:02.518 INFO:tasks.workunit.client.0.smithi060.stdout:1/505: rename d6/d24/da/db/de/f38 to d6/d24/da/db/d79/d86/fb7 0 2024-09-21T10:41:02.518 INFO:tasks.workunit.client.0.smithi060.stdout:1/506: chown d6/d24 30 1 2024-09-21T10:41:02.518 INFO:tasks.workunit.client.0.smithi060.stdout:5/623: write d5/d45/d6d/d10/d19/d8d/d50/f58 [2803147,111453] 0 2024-09-21T10:41:02.519 INFO:tasks.workunit.client.0.smithi060.stdout:3/572: dread d0/d1/d1e/d34/f49 [4194304,4194304] 0 2024-09-21T10:41:02.519 INFO:tasks.workunit.client.0.smithi060.stdout:3/573: write d0/d1/d11/d2a/f2d [976010,81547] 0 2024-09-21T10:41:02.520 INFO:tasks.workunit.client.0.smithi060.stdout:4/574: sync 2024-09-21T10:41:02.520 INFO:tasks.workunit.client.0.smithi060.stdout:2/396: sync 2024-09-21T10:41:02.520 INFO:tasks.workunit.client.0.smithi060.stdout:2/397: creat d3/d7/d23/f86 x:0 0 0 2024-09-21T10:41:02.520 INFO:tasks.workunit.client.0.smithi060.stdout:0/617: unlink d5/d10/da/d4b/da4/f6c 0 2024-09-21T10:41:02.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/618: stat d5/d10/da/d4b/da4/d40/d48/dab/d45/f30 0 2024-09-21T10:41:02.521 INFO:tasks.workunit.client.0.smithi060.stdout:7/597: dwrite da/d14/d35/d79/db0/fc2 [0,4194304] 0 2024-09-21T10:41:02.523 INFO:tasks.workunit.client.0.smithi060.stdout:8/602: creat d2/d18/d4b/dbe/fc9 x:0 0 0 2024-09-21T10:41:02.526 INFO:tasks.workunit.client.0.smithi060.stdout:4/575: dread d0/d5/d12/d15/d8f/f3b [0,4194304] 0 2024-09-21T10:41:02.529 INFO:tasks.workunit.client.0.smithi060.stdout:1/507: link d6/d4a/l8c d6/d4a/lb8 0 2024-09-21T10:41:02.529 INFO:tasks.workunit.client.0.smithi060.stdout:1/508: read - d6/d4a/d5a/db0/f78 zero size 2024-09-21T10:41:02.530 INFO:tasks.workunit.client.0.smithi060.stdout:1/509: truncate d6/d24/da/f1f 1046047 0 2024-09-21T10:41:02.530 INFO:tasks.workunit.client.0.smithi060.stdout:1/510: fdatasync d6/d24/f3f 0 2024-09-21T10:41:02.531 INFO:tasks.workunit.client.0.smithi060.stdout:5/624: creat d5/d45/fd0 x:0 0 0 2024-09-21T10:41:02.535 INFO:tasks.workunit.client.0.smithi060.stdout:3/574: mknod d0/d1/d24/d81/cb7 0 2024-09-21T10:41:02.538 INFO:tasks.workunit.client.0.smithi060.stdout:6/542: dwrite d3/d12/d16/d25/f45 [0,4194304] 0 2024-09-21T10:41:02.539 INFO:tasks.workunit.client.0.smithi060.stdout:6/543: chown d3/d12/d16/d25/d27/f61 31283786 1 2024-09-21T10:41:02.542 INFO:tasks.workunit.client.0.smithi060.stdout:2/398: link d3/d79/f7b d3/d7/d24/d25/d4f/d69/d83/f87 0 2024-09-21T10:41:02.542 INFO:tasks.workunit.client.0.smithi060.stdout:0/619: unlink d5/d10/f7b 0 2024-09-21T10:41:02.548 INFO:tasks.workunit.client.0.smithi060.stdout:6/544: write d3/fb [2333935,21200] 0 2024-09-21T10:41:02.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/399: unlink d3/d7/d24/d33/f57 0 2024-09-21T10:41:02.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/400: dread - d3/d7/d18/f52 zero size 2024-09-21T10:41:02.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/401: chown d3/d20/d15/c3e 33 1 2024-09-21T10:41:02.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/598: rename da/d14/d2a to da/d14/d15/d8b/da7/dcd 0 2024-09-21T10:41:02.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/599: chown da/lb2 9 1 2024-09-21T10:41:02.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/600: write da/d14/d15/f18 [5725962,106076] 0 2024-09-21T10:41:02.553 INFO:tasks.workunit.client.0.smithi060.stdout:6/545: mkdir d3/d12/d16/d22/d5d/d70/d89/daa 0 2024-09-21T10:41:02.553 INFO:tasks.workunit.client.0.smithi060.stdout:6/546: dread - d3/dd/f64 zero size 2024-09-21T10:41:02.556 INFO:tasks.workunit.client.0.smithi060.stdout:5/625: rename d5/d45/d6d/d10/d19/d21/d30/c3c to d5/d45/d6d/d10/d19/d21/d7f/cd1 0 2024-09-21T10:41:02.557 INFO:tasks.workunit.client.0.smithi060.stdout:0/620: write d5/d10/f61 [936086,82324] 0 2024-09-21T10:41:02.557 INFO:tasks.workunit.client.0.smithi060.stdout:7/601: mknod da/d14/d25/cce 0 2024-09-21T10:41:02.558 INFO:tasks.workunit.client.0.smithi060.stdout:6/547: symlink d3/d12/d65/d66/lab 0 2024-09-21T10:41:02.559 INFO:tasks.workunit.client.0.smithi060.stdout:5/626: creat d5/d45/d6d/d10/d19/d21/d7f/fd2 x:0 0 0 2024-09-21T10:41:02.559 INFO:tasks.workunit.client.0.smithi060.stdout:5/627: dread - d5/d45/fd0 zero size 2024-09-21T10:41:02.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/621: mknod d5/d10/da/d4b/da4/d40/cbf 0 2024-09-21T10:41:02.562 INFO:tasks.workunit.client.0.smithi060.stdout:6/548: mkdir d3/d12/d16/d1a/d60/dac 0 2024-09-21T10:41:02.563 INFO:tasks.workunit.client.0.smithi060.stdout:7/602: truncate da/d14/d25/d56/f58 731949 0 2024-09-21T10:41:02.563 INFO:tasks.workunit.client.0.smithi060.stdout:0/622: rmdir d5/d10/da/d2f 39 2024-09-21T10:41:02.563 INFO:tasks.workunit.client.0.smithi060.stdout:0/623: chown d5/d10/da/d4b/da4/d40/d48/dab/f62 7251278 1 2024-09-21T10:41:02.563 INFO:tasks.workunit.client.0.smithi060.stdout:7/603: rmdir da 39 2024-09-21T10:41:02.564 INFO:tasks.workunit.client.0.smithi060.stdout:9/497: dwrite d3/d5e/d60/d2f/f50 [0,4194304] 0 2024-09-21T10:41:02.564 INFO:tasks.workunit.client.0.smithi060.stdout:6/549: symlink d3/d12/d38/d9e/lad 0 2024-09-21T10:41:02.564 INFO:tasks.workunit.client.0.smithi060.stdout:0/624: mknod d5/d10/da/d2d/cc0 0 2024-09-21T10:41:02.566 INFO:tasks.workunit.client.0.smithi060.stdout:7/604: read da/d14/d35/f1d [583703,50484] 0 2024-09-21T10:41:02.567 INFO:tasks.workunit.client.0.smithi060.stdout:0/625: dread d5/d10/da/fa5 [0,4194304] 0 2024-09-21T10:41:02.569 INFO:tasks.workunit.client.0.smithi060.stdout:0/626: link d5/d10/da/l88 d5/d10/da/d4b/da4/d40/d48/dab/d79/lc1 0 2024-09-21T10:41:02.570 INFO:tasks.workunit.client.0.smithi060.stdout:0/627: unlink d5/c58 0 2024-09-21T10:41:02.571 INFO:tasks.workunit.client.0.smithi060.stdout:0/628: truncate d5/d10/f5a 1513857 0 2024-09-21T10:41:02.573 INFO:tasks.workunit.client.0.smithi060.stdout:9/498: write d3/f4f [833911,86313] 0 2024-09-21T10:41:02.574 INFO:tasks.workunit.client.0.smithi060.stdout:9/499: symlink d3/d15/d58/la5 0 2024-09-21T10:41:02.575 INFO:tasks.workunit.client.0.smithi060.stdout:9/500: link d3/d5e/d60/c33 d3/d16/d9c/ca6 0 2024-09-21T10:41:02.585 INFO:tasks.workunit.client.0.smithi060.stdout:0/629: read d5/d10/da/d4b/da4/d40/d75/f7c [2191326,116209] 0 2024-09-21T10:41:02.585 INFO:tasks.workunit.client.0.smithi060.stdout:4/576: dwrite d0/d83/f9f [0,4194304] 0 2024-09-21T10:41:02.585 INFO:tasks.workunit.client.0.smithi060.stdout:8/603: dwrite d2/d26/d37/d62/d74/d83/da2/f7e [0,4194304] 0 2024-09-21T10:41:02.589 INFO:tasks.workunit.client.0.smithi060.stdout:8/604: stat d2/d26/d37/d64/d65/la0 0 2024-09-21T10:41:02.589 INFO:tasks.workunit.client.0.smithi060.stdout:8/605: truncate d2/d18/d4b/dbe/fc9 927942 0 2024-09-21T10:41:02.591 INFO:tasks.workunit.client.0.smithi060.stdout:8/606: link d2/d18/f5e d2/d18/d4b/d61/d6e/fca 0 2024-09-21T10:41:02.592 INFO:tasks.workunit.client.0.smithi060.stdout:8/607: rename d2/d18/d4b/f86 to d2/d26/d37/d62/d74/d83/dac/fcb 0 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:6/550: dwrite d3/d12/d16/d5b/f92 [0,4194304] 0 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:6/551: chown d3/d12/d16/d5b 7362071 1 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:1/511: dwrite d6/d24/da/db/de/f77 [0,4194304] 0 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:7/605: dwrite da/d14/d15/d8b/da7/dcd/d49/d2e/fc0 [0,4194304] 0 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:1/512: chown d6/d4a/d5a/l74 21 1 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:1/513: truncate d6/d24/da/db/d1c/f55 274688 0 2024-09-21T10:41:02.594 INFO:tasks.workunit.client.0.smithi060.stdout:3/575: dwrite d0/d1/d11/d46/f31 [0,4194304] 0 2024-09-21T10:41:02.595 INFO:tasks.workunit.client.0.smithi060.stdout:2/402: dwrite d3/d20/d15/d30/d5c/f76 [0,4194304] 0 2024-09-21T10:41:02.599 INFO:tasks.workunit.client.0.smithi060.stdout:4/577: write d0/d83/f9f [3519371,111212] 0 2024-09-21T10:41:02.600 INFO:tasks.workunit.client.0.smithi060.stdout:4/578: dread - d0/d5/d12/d15/da6/fae zero size 2024-09-21T10:41:02.602 INFO:tasks.workunit.client.0.smithi060.stdout:6/552: creat d3/d12/d16/d1a/d60/fae x:0 0 0 2024-09-21T10:41:02.606 INFO:tasks.workunit.client.0.smithi060.stdout:7/606: link da/l1c da/lcf 0 2024-09-21T10:41:02.607 INFO:tasks.workunit.client.0.smithi060.stdout:1/514: truncate d6/d24/da/db/de/f18 1759116 0 2024-09-21T10:41:02.610 INFO:tasks.workunit.client.0.smithi060.stdout:8/608: dwrite d2/d26/d37/d62/d77/f79 [0,4194304] 0 2024-09-21T10:41:02.612 INFO:tasks.workunit.client.0.smithi060.stdout:4/579: dread d0/d3c/d67/d7d/d87/f8d [0,4194304] 0 2024-09-21T10:41:02.612 INFO:tasks.workunit.client.0.smithi060.stdout:4/580: chown d0/d83/c93 6001 1 2024-09-21T10:41:02.622 INFO:tasks.workunit.client.0.smithi060.stdout:2/403: mknod d3/d7/d18/c88 0 2024-09-21T10:41:02.622 INFO:tasks.workunit.client.0.smithi060.stdout:2/404: fdatasync d3/d7/d24/f2a 0 2024-09-21T10:41:02.622 INFO:tasks.workunit.client.0.smithi060.stdout:2/405: stat d3/d79 0 2024-09-21T10:41:02.632 INFO:tasks.workunit.client.0.smithi060.stdout:9/501: write d3/d15/d5a/d64/f99 [1337735,109568] 0 2024-09-21T10:41:02.632 INFO:tasks.workunit.client.0.smithi060.stdout:9/502: chown d3/d15/f2b 0 1 2024-09-21T10:41:02.632 INFO:tasks.workunit.client.0.smithi060.stdout:8/609: dwrite d2/d18/f5c [0,4194304] 0 2024-09-21T10:41:02.634 INFO:tasks.workunit.client.0.smithi060.stdout:4/581: dwrite d0/d83/d6a/d6b/d32/d57/f77 [0,4194304] 0 2024-09-21T10:41:02.635 INFO:tasks.workunit.client.0.smithi060.stdout:6/553: symlink d3/d12/d16/d22/d5d/d70/d89/daa/laf 0 2024-09-21T10:41:02.636 INFO:tasks.workunit.client.0.smithi060.stdout:7/607: mkdir da/d60/d6e/dd0 0 2024-09-21T10:41:02.636 INFO:tasks.workunit.client.0.smithi060.stdout:7/608: dread - da/d14/d15/d8b/da7/dcd/d49/fc7 zero size 2024-09-21T10:41:02.636 INFO:tasks.workunit.client.0.smithi060.stdout:7/609: fdatasync da/d14/d15/d8b/fb3 0 2024-09-21T10:41:02.638 INFO:tasks.workunit.client.0.smithi060.stdout:2/406: truncate d3/d7/d23/d55/f6f 149882 0 2024-09-21T10:41:02.641 INFO:tasks.workunit.client.0.smithi060.stdout:9/503: symlink d3/d5e/d60/d2f/la7 0 2024-09-21T10:41:02.641 INFO:tasks.workunit.client.0.smithi060.stdout:9/504: chown d3/d16/d1a/f4c 4 1 2024-09-21T10:41:02.645 INFO:tasks.workunit.client.0.smithi060.stdout:6/554: getdents d3/d12/d65/d66 0 2024-09-21T10:41:02.645 INFO:tasks.workunit.client.0.smithi060.stdout:6/555: chown d3/d12/d16/d5b/l78 22601094 1 2024-09-21T10:41:02.645 INFO:tasks.workunit.client.0.smithi060.stdout:4/582: write d0/d83/d6a/d6b/d32/f7e [2768182,5364] 0 2024-09-21T10:41:02.645 INFO:tasks.workunit.client.0.smithi060.stdout:4/583: write d0/d3c/f81 [139405,107124] 0 2024-09-21T10:41:02.645 INFO:tasks.workunit.client.0.smithi060.stdout:4/584: stat d0/d5/d12/d15/da6 0 2024-09-21T10:41:02.646 INFO:tasks.workunit.client.0.smithi060.stdout:2/407: symlink d3/d20/d15/d30/d5c/l89 0 2024-09-21T10:41:02.646 INFO:tasks.workunit.client.0.smithi060.stdout:2/408: read - d3/d20/d15/d30/d43/d62/f70 zero size 2024-09-21T10:41:02.646 INFO:tasks.workunit.client.0.smithi060.stdout:2/409: stat d3/d20/d17/f50 0 2024-09-21T10:41:02.649 INFO:tasks.workunit.client.0.smithi060.stdout:7/610: dread da/d14/d15/d8b/da7/dcd/d49/f7b [0,4194304] 0 2024-09-21T10:41:02.652 INFO:tasks.workunit.client.0.smithi060.stdout:2/410: dread d3/d7/d23/f71 [0,4194304] 0 2024-09-21T10:41:02.652 INFO:tasks.workunit.client.0.smithi060.stdout:2/411: chown d3/d7/d18/c88 1307568 1 2024-09-21T10:41:02.652 INFO:tasks.workunit.client.0.smithi060.stdout:2/412: fdatasync d3/d20/d15/d30/d43/f67 0 2024-09-21T10:41:02.661 INFO:tasks.workunit.client.0.smithi060.stdout:8/610: getdents d2/d26/d37/d62/d74 0 2024-09-21T10:41:02.668 INFO:tasks.workunit.client.0.smithi060.stdout:6/556: creat d3/d12/d16/d1a/d83/da3/fb0 x:0 0 0 2024-09-21T10:41:02.669 INFO:tasks.workunit.client.0.smithi060.stdout:4/585: mknod d0/d83/d6a/d6b/d65/cbd 0 2024-09-21T10:41:02.674 INFO:tasks.workunit.client.0.smithi060.stdout:6/557: mknod d3/d54/da8/cb1 0 2024-09-21T10:41:02.674 INFO:tasks.workunit.client.0.smithi060.stdout:4/586: mkdir d0/d5/d3a/dbe 0 2024-09-21T10:41:02.674 INFO:tasks.workunit.client.0.smithi060.stdout:4/587: readlink d0/df/d84/la3 0 2024-09-21T10:41:02.677 INFO:tasks.workunit.client.0.smithi060.stdout:6/558: rmdir d3/d12/d16/d1a/d83/da3/d9c 0 2024-09-21T10:41:02.677 INFO:tasks.workunit.client.0.smithi060.stdout:4/588: symlink d0/d5/d12/d3d/lbf 0 2024-09-21T10:41:02.680 INFO:tasks.workunit.client.0.smithi060.stdout:6/559: creat d3/d12/d16/d22/d5d/d70/d89/daa/fb2 x:0 0 0 2024-09-21T10:41:02.680 INFO:tasks.workunit.client.0.smithi060.stdout:4/589: creat d0/d3c/fc0 x:0 0 0 2024-09-21T10:41:02.682 INFO:tasks.workunit.client.0.smithi060.stdout:6/560: creat d3/d12/fb3 x:0 0 0 2024-09-21T10:41:02.682 INFO:tasks.workunit.client.0.smithi060.stdout:6/561: dread - d3/d54/f77 zero size 2024-09-21T10:41:02.683 INFO:tasks.workunit.client.0.smithi060.stdout:6/562: dread - d3/d12/d16/d1a/d83/da3/f9d zero size 2024-09-21T10:41:02.683 INFO:tasks.workunit.client.0.smithi060.stdout:6/563: read - d3/f52 zero size 2024-09-21T10:41:02.683 INFO:tasks.workunit.client.0.smithi060.stdout:4/590: mknod d0/d5/d12/d15/d4d/cc1 0 2024-09-21T10:41:02.686 INFO:tasks.workunit.client.0.smithi060.stdout:6/564: rename d3/d12/d16/d1a/d60/fae to d3/d12/d16/d1a/d60/fb4 0 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:2/413: dwrite d3/f38 [0,4194304] 0 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/505: dwrite d3/f76 [0,4194304] 0 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/506: chown d3/d15/d5a 97 1 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/507: read - d3/d15/d53/f97 zero size 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/508: write d3/d16/d1f/f49 [1680627,83619] 0 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/509: dread - d3/d15/f93 zero size 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/510: chown d3/d15/d5a/d64/d9e 596 1 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/511: fdatasync d3/d15/f3c 0 2024-09-21T10:41:02.688 INFO:tasks.workunit.client.0.smithi060.stdout:7/611: dwrite da/d14/d15/d8b/da7/dcd/db6/fba [0,4194304] 0 2024-09-21T10:41:02.689 INFO:tasks.workunit.client.0.smithi060.stdout:6/565: unlink d3/d12/d65/f82 0 2024-09-21T10:41:02.689 INFO:tasks.workunit.client.0.smithi060.stdout:8/611: dwrite d2/d26/d37/d62/d77/f79 [0,4194304] 0 2024-09-21T10:41:02.689 INFO:tasks.workunit.client.0.smithi060.stdout:6/566: write d3/d12/d16/d25/d76/fa0 [471624,2719] 0 2024-09-21T10:41:02.689 INFO:tasks.workunit.client.0.smithi060.stdout:6/567: dread - d3/d12/d16/d1a/d83/da3/f9d zero size 2024-09-21T10:41:02.689 INFO:tasks.workunit.client.0.smithi060.stdout:6/568: stat d3/d12/d65/d66/fa2 0 2024-09-21T10:41:02.699 INFO:tasks.workunit.client.0.smithi060.stdout:8/612: write d2/d18/f30 [972539,94962] 0 2024-09-21T10:41:02.699 INFO:tasks.workunit.client.0.smithi060.stdout:8/613: dread - d2/d18/d4b/d61/f78 zero size 2024-09-21T10:41:02.701 INFO:tasks.workunit.client.0.smithi060.stdout:7/612: rename da/lcf to da/d14/d15/d8b/da7/dcd/d49/ld1 0 2024-09-21T10:41:02.703 INFO:tasks.workunit.client.0.smithi060.stdout:6/569: mkdir d3/d12/d65/d7f/db5 0 2024-09-21T10:41:02.708 INFO:tasks.workunit.client.0.smithi060.stdout:7/613: link da/d14/d15/d8b/da7/dcd/d49/d2e/c66 da/d14/d15/cd2 0 2024-09-21T10:41:02.708 INFO:tasks.workunit.client.0.smithi060.stdout:7/614: creat da/d14/d15/fd3 x:0 0 0 2024-09-21T10:41:02.709 INFO:tasks.workunit.client.0.smithi060.stdout:4/591: dwrite d0/d83/d6a/d6b/f22 [4194304,4194304] 0 2024-09-21T10:41:02.710 INFO:tasks.workunit.client.0.smithi060.stdout:2/414: dwrite d3/d20/d15/d30/f3f [4194304,4194304] 0 2024-09-21T10:41:02.710 INFO:tasks.workunit.client.0.smithi060.stdout:2/415: dread - d3/d20/d15/d30/d43/d62/f70 zero size 2024-09-21T10:41:02.710 INFO:tasks.workunit.client.0.smithi060.stdout:2/416: readlink d3/d7/l42 0 2024-09-21T10:41:02.712 INFO:tasks.workunit.client.0.smithi060.stdout:7/615: mknod da/d60/d6e/dd0/cd4 0 2024-09-21T10:41:02.718 INFO:tasks.workunit.client.0.smithi060.stdout:2/417: write d3/d7/d23/f5a [1435133,129463] 0 2024-09-21T10:41:02.720 INFO:tasks.workunit.client.0.smithi060.stdout:6/570: dwrite d3/d12/d16/f40 [4194304,4194304] 0 2024-09-21T10:41:02.720 INFO:tasks.workunit.client.0.smithi060.stdout:7/616: mkdir da/d60/d6e/dd5 0 2024-09-21T10:41:02.722 INFO:tasks.workunit.client.0.smithi060.stdout:7/617: rmdir da/d14/d35 39 2024-09-21T10:41:02.735 INFO:tasks.workunit.client.0.smithi060.stdout:7/618: write da/d14/d15/d8b/da7/dcd/d49/d27/f64 [266525,111677] 0 2024-09-21T10:41:02.735 INFO:tasks.workunit.client.0.smithi060.stdout:2/418: dwrite d3/d7/d18/f52 [0,4194304] 0 2024-09-21T10:41:02.735 INFO:tasks.workunit.client.0.smithi060.stdout:7/619: read - da/d14/d15/fc5 zero size 2024-09-21T10:41:02.735 INFO:tasks.workunit.client.0.smithi060.stdout:2/419: truncate d3/d20/d15/d30/f5d 950538 0 2024-09-21T10:41:02.735 INFO:tasks.workunit.client.0.smithi060.stdout:7/620: fsync da/d14/d15/d8b/da7/faf 0 2024-09-21T10:41:02.741 INFO:tasks.workunit.client.0.smithi060.stdout:7/621: symlink da/d14/d15/d8b/da7/dcd/d49/ld6 0 2024-09-21T10:41:02.744 INFO:tasks.workunit.client.0.smithi060.stdout:6/571: dwrite d3/d12/d38/d41/f62 [0,4194304] 0 2024-09-21T10:41:02.747 INFO:tasks.workunit.client.0.smithi060.stdout:6/572: rename d3/d12/d16/d22/d58/c6b to d3/d12/d16/d1a/d21/cb6 0 2024-09-21T10:41:02.747 INFO:tasks.workunit.client.0.smithi060.stdout:6/573: dread - d3/d12/d16/d25/d76/f85 zero size 2024-09-21T10:41:02.750 INFO:tasks.workunit.client.0.smithi060.stdout:2/420: dread d3/f5 [0,4194304] 0 2024-09-21T10:41:02.755 INFO:tasks.workunit.client.0.smithi060.stdout:6/574: read d3/d12/d16/f40 [7717929,57605] 0 2024-09-21T10:41:02.755 INFO:tasks.workunit.client.0.smithi060.stdout:6/575: write d3/d12/d16/d1a/d83/da3/f9d [371875,43621] 0 2024-09-21T10:41:02.758 INFO:tasks.workunit.client.0.smithi060.stdout:2/421: write d3/d7/d24/f2a [5638594,39160] 0 2024-09-21T10:41:02.760 INFO:tasks.workunit.client.0.smithi060.stdout:2/422: mkdir d3/d7/d24/d25/d8a 0 2024-09-21T10:41:02.765 INFO:tasks.workunit.client.0.smithi060.stdout:6/576: dread d3/d12/d16/d22/f2f [0,4194304] 0 2024-09-21T10:41:02.768 INFO:tasks.workunit.client.0.smithi060.stdout:2/423: rename d3/d7/d24/d25/d4f to d3/d20/d15/d30/d8b 0 2024-09-21T10:41:02.769 INFO:tasks.workunit.client.0.smithi060.stdout:6/577: symlink d3/d54/lb7 0 2024-09-21T10:41:02.769 INFO:tasks.workunit.client.0.smithi060.stdout:6/578: write d3/f52 [847632,44369] 0 2024-09-21T10:41:02.771 INFO:tasks.workunit.client.0.smithi060.stdout:6/579: unlink d3/d12/d4e/f53 0 2024-09-21T10:41:02.773 INFO:tasks.workunit.client.0.smithi060.stdout:6/580: symlink d3/d12/d38/d9e/lb8 0 2024-09-21T10:41:02.776 INFO:tasks.workunit.client.0.smithi060.stdout:6/581: rename d3/d12/d16/d22/d58/d75/f7d to d3/d12/d16/d1a/d83/da3/fb9 0 2024-09-21T10:41:02.776 INFO:tasks.workunit.client.0.smithi060.stdout:6/582: write d3/d12/d16/d1a/d60/fb4 [580744,26711] 0 2024-09-21T10:41:02.779 INFO:tasks.workunit.client.0.smithi060.stdout:6/583: truncate d3/d12/d16/d25/d27/f61 3593240 0 2024-09-21T10:41:02.779 INFO:tasks.workunit.client.0.smithi060.stdout:6/584: fdatasync d3/d12/d38/d41/f46 0 2024-09-21T10:41:02.781 INFO:tasks.workunit.client.0.smithi060.stdout:2/424: dwrite d3/d7/d23/f48 [0,4194304] 0 2024-09-21T10:41:02.781 INFO:tasks.workunit.client.0.smithi060.stdout:2/425: stat d3/d20/d17/l5f 0 2024-09-21T10:41:02.782 INFO:tasks.workunit.client.0.smithi060.stdout:2/426: dread d3/d7/f6d [0,4194304] 0 2024-09-21T10:41:02.782 INFO:tasks.workunit.client.0.smithi060.stdout:2/427: truncate d3/d20/d15/d30/d43/f67 1432848 0 2024-09-21T10:41:02.782 INFO:tasks.workunit.client.0.smithi060.stdout:6/585: unlink d3/d12/d16/d1a/f1e 0 2024-09-21T10:41:02.784 INFO:tasks.workunit.client.0.smithi060.stdout:6/586: rmdir d3/d12/d65/d66 39 2024-09-21T10:41:02.784 INFO:tasks.workunit.client.0.smithi060.stdout:6/587: chown d3/d12/d16/d5b/f92 0 1 2024-09-21T10:41:02.788 INFO:tasks.workunit.client.0.smithi060.stdout:6/588: rename d3/d12/d16/d1a/d83/da3/fb9 to d3/d12/d16/d25/d27/fba 0 2024-09-21T10:41:02.791 INFO:tasks.workunit.client.0.smithi060.stdout:6/589: getdents d3/d12/d16/d22 0 2024-09-21T10:41:02.793 INFO:tasks.workunit.client.0.smithi060.stdout:6/590: symlink d3/d12/d16/d22/d5d/d70/d89/lbb 0 2024-09-21T10:41:02.795 INFO:tasks.workunit.client.0.smithi060.stdout:6/591: mknod d3/d12/d38/cbc 0 2024-09-21T10:41:02.796 INFO:tasks.workunit.client.0.smithi060.stdout:2/428: dwrite d3/d7/d24/d25/f5b [0,4194304] 0 2024-09-21T10:41:02.799 INFO:tasks.workunit.client.0.smithi060.stdout:6/592: rename d3/d12/d38/d41/l42 to d3/d12/d16/d22/d58/d75/lbd 0 2024-09-21T10:41:02.799 INFO:tasks.workunit.client.0.smithi060.stdout:6/593: readlink d3/d12/d65/d66/l95 0 2024-09-21T10:41:02.800 INFO:tasks.workunit.client.0.smithi060.stdout:2/429: mknod d3/d20/d15/d30/d43/c8c 0 2024-09-21T10:41:02.800 INFO:tasks.workunit.client.0.smithi060.stdout:2/430: truncate d3/d7/d18/f81 5029335 0 2024-09-21T10:41:02.804 INFO:tasks.workunit.client.0.smithi060.stdout:2/431: unlink d3/d20/d15/d30/d8b/d69/d83/f87 0 2024-09-21T10:41:02.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/594: getdents d3/d12/d16/d22/d58/d75 0 2024-09-21T10:41:02.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/595: chown d3/d12/d16/d22/d5d/d70/d89/lbb 6 1 2024-09-21T10:41:02.807 INFO:tasks.workunit.client.0.smithi060.stdout:6/596: write d3/d12/d16/f18 [8574009,72341] 0 2024-09-21T10:41:02.808 INFO:tasks.workunit.client.0.smithi060.stdout:6/597: truncate d3/d12/d38/d41/f68 4749893 0 2024-09-21T10:41:02.808 INFO:tasks.workunit.client.0.smithi060.stdout:6/598: truncate d3/d12/d16/d25/f28 4746770 0 2024-09-21T10:41:02.817 INFO:tasks.workunit.client.0.smithi060.stdout:2/432: link d3/d20/l40 d3/d20/d15/d3b/l8d 0 2024-09-21T10:41:02.820 INFO:tasks.workunit.client.0.smithi060.stdout:6/599: dwrite d3/d12/d16/d25/d27/f61 [4194304,4194304] 0 2024-09-21T10:41:02.820 INFO:tasks.workunit.client.0.smithi060.stdout:6/600: truncate d3/d12/d16/d25/d76/fa0 993224 0 2024-09-21T10:41:02.823 INFO:tasks.workunit.client.0.smithi060.stdout:6/601: mkdir d3/d12/d38/d9e/dbe 0 2024-09-21T10:41:02.833 INFO:tasks.workunit.client.0.smithi060.stdout:2/433: dwrite d3/d7/fd [0,4194304] 0 2024-09-21T10:41:02.834 INFO:tasks.workunit.client.0.smithi060.stdout:6/602: dread d3/d12/d16/d1a/f4c [0,4194304] 0 2024-09-21T10:41:02.834 INFO:tasks.workunit.client.0.smithi060.stdout:6/603: truncate d3/d12/d16/d1a/f4f 5203094 0 2024-09-21T10:41:02.834 INFO:tasks.workunit.client.0.smithi060.stdout:6/604: stat d3/d54/f71 0 2024-09-21T10:41:02.837 INFO:tasks.workunit.client.0.smithi060.stdout:6/605: rename d3/dd/c50 to d3/d12/d16/d1a/d9a/cbf 0 2024-09-21T10:41:02.839 INFO:tasks.workunit.client.0.smithi060.stdout:6/606: creat d3/d12/d16/d1a/fc0 x:0 0 0 2024-09-21T10:41:02.841 INFO:tasks.workunit.client.0.smithi060.stdout:6/607: creat d3/d12/d16/d25/d76/da9/fc1 x:0 0 0 2024-09-21T10:41:02.842 INFO:tasks.workunit.client.0.smithi060.stdout:6/608: mknod d3/d12/d16/d25/cc2 0 2024-09-21T10:41:02.851 INFO:tasks.workunit.client.0.smithi060.stdout:6/609: dread d3/d12/d38/d41/f68 [0,4194304] 0 2024-09-21T10:41:02.852 INFO:tasks.workunit.client.0.smithi060.stdout:6/610: symlink d3/d12/d16/d22/d5d/d70/d89/lc3 0 2024-09-21T10:41:02.854 INFO:tasks.workunit.client.0.smithi060.stdout:6/611: mknod d3/d12/d65/d7f/db5/cc4 0 2024-09-21T10:41:02.854 INFO:tasks.workunit.client.0.smithi060.stdout:6/612: fsync d3/dd/f64 0 2024-09-21T10:41:02.854 INFO:tasks.workunit.client.0.smithi060.stdout:6/613: readlink d3/d12/l5c 0 2024-09-21T10:41:02.855 INFO:tasks.workunit.client.0.smithi060.stdout:6/614: symlink d3/d12/d38/d41/lc5 0 2024-09-21T10:41:02.855 INFO:tasks.workunit.client.0.smithi060.stdout:6/615: rmdir d3 39 2024-09-21T10:41:02.856 INFO:tasks.workunit.client.0.smithi060.stdout:6/616: truncate d3/d12/d16/d5b/f92 3986172 0 2024-09-21T10:41:02.856 INFO:tasks.workunit.client.0.smithi060.stdout:6/617: creat d3/d54/fc6 x:0 0 0 2024-09-21T10:41:02.856 INFO:tasks.workunit.client.0.smithi060.stdout:6/618: write d3/fb [1425161,57504] 0 2024-09-21T10:41:02.857 INFO:tasks.workunit.client.0.smithi060.stdout:2/434: dwrite d3/d79/f7b [0,4194304] 0 2024-09-21T10:41:02.858 INFO:tasks.workunit.client.0.smithi060.stdout:6/619: mkdir d3/d12/d65/d7f/dc7 0 2024-09-21T10:41:02.858 INFO:tasks.workunit.client.0.smithi060.stdout:2/435: read d3/d7/f6d [340729,124120] 0 2024-09-21T10:41:02.861 INFO:tasks.workunit.client.0.smithi060.stdout:6/620: symlink d3/d12/d16/d1a/d83/lc8 0 2024-09-21T10:41:02.861 INFO:tasks.workunit.client.0.smithi060.stdout:6/621: stat d3/d12/d16/d1a/d83/da3/l93 0 2024-09-21T10:41:02.863 INFO:tasks.workunit.client.0.smithi060.stdout:2/436: write d3/f5 [3720700,63008] 0 2024-09-21T10:41:02.872 INFO:tasks.workunit.client.0.smithi060.stdout:2/437: read d3/d7/fd [1964627,41557] 0 2024-09-21T10:41:02.873 INFO:tasks.workunit.client.0.smithi060.stdout:6/622: getdents d3/dd 0 2024-09-21T10:41:02.874 INFO:tasks.workunit.client.0.smithi060.stdout:2/438: creat d3/d20/d15/d30/d43/d4b/f8e x:0 0 0 2024-09-21T10:41:02.876 INFO:tasks.workunit.client.0.smithi060.stdout:2/439: mkdir d3/d20/d15/d30/d8f 0 2024-09-21T10:41:02.878 INFO:tasks.workunit.client.0.smithi060.stdout:2/440: unlink d3/d7/d23/d55/f6f 0 2024-09-21T10:41:02.878 INFO:tasks.workunit.client.0.smithi060.stdout:2/441: read d3/f5 [825958,3984] 0 2024-09-21T10:41:02.879 INFO:tasks.workunit.client.0.smithi060.stdout:2/442: rename d3/d20/d15/d30/d43/l53 to d3/d20/d15/d30/d5c/l90 0 2024-09-21T10:41:02.879 INFO:tasks.workunit.client.0.smithi060.stdout:2/443: fsync d3/d20/d15/d30/d8b/f77 0 2024-09-21T10:41:02.879 INFO:tasks.workunit.client.0.smithi060.stdout:2/444: write d3/d20/d15/d30/d8b/f77 [257174,71376] 0 2024-09-21T10:41:02.880 INFO:tasks.workunit.client.0.smithi060.stdout:5/628: sync 2024-09-21T10:41:02.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/623: dread d3/d12/d16/d25/d27/f5a [0,4194304] 0 2024-09-21T10:41:02.881 INFO:tasks.workunit.client.0.smithi060.stdout:6/624: readlink d3/dd/l39 0 2024-09-21T10:41:02.882 INFO:tasks.workunit.client.0.smithi060.stdout:6/625: mknod d3/dd/cc9 0 2024-09-21T10:41:02.883 INFO:tasks.workunit.client.0.smithi060.stdout:6/626: write d3/d12/d38/d41/f68 [4501819,2297] 0 2024-09-21T10:41:02.884 INFO:tasks.workunit.client.0.smithi060.stdout:6/627: stat d3/d12/d65/l8f 0 2024-09-21T10:41:02.884 INFO:tasks.workunit.client.0.smithi060.stdout:6/628: readlink d3/l15 0 2024-09-21T10:41:02.884 INFO:tasks.workunit.client.0.smithi060.stdout:6/629: chown d3/d12/d16/d1a/c1f 126040586 1 2024-09-21T10:41:02.884 INFO:tasks.workunit.client.0.smithi060.stdout:6/630: fsync d3/d12/d16/d25/d76/da9/fc1 0 2024-09-21T10:41:02.885 INFO:tasks.workunit.client.0.smithi060.stdout:6/631: rmdir d3/d12/d16/d1a/d83 39 2024-09-21T10:41:02.885 INFO:tasks.workunit.client.0.smithi060.stdout:6/632: dread - d3/d54/f71 zero size 2024-09-21T10:41:02.890 INFO:tasks.workunit.client.0.smithi060.stdout:6/633: dread d3/d12/d38/f9f [0,4194304] 0 2024-09-21T10:41:02.891 INFO:tasks.workunit.client.0.smithi060.stdout:6/634: mkdir d3/d12/d16/d1a/dca 0 2024-09-21T10:41:02.892 INFO:tasks.workunit.client.0.smithi060.stdout:6/635: dread - d3/d12/d16/d1a/fc0 zero size 2024-09-21T10:41:02.893 INFO:tasks.workunit.client.0.smithi060.stdout:5/629: dwrite d5/f86 [0,4194304] 0 2024-09-21T10:41:02.895 INFO:tasks.workunit.client.0.smithi060.stdout:5/630: mknod d5/d45/d5a/dbd/cd3 0 2024-09-21T10:41:02.895 INFO:tasks.workunit.client.0.smithi060.stdout:5/631: write d5/f7 [1931779,23091] 0 2024-09-21T10:41:02.898 INFO:tasks.workunit.client.0.smithi060.stdout:5/632: truncate d5/d45/d6d/d10/d19/d8d/d60/f93 2158036 0 2024-09-21T10:41:02.898 INFO:tasks.workunit.client.0.smithi060.stdout:5/633: fdatasync d5/d45/d5a/f17 0 2024-09-21T10:41:02.899 INFO:tasks.workunit.client.0.smithi060.stdout:6/636: dread d3/d12/d38/d41/f68 [0,4194304] 0 2024-09-21T10:41:02.900 INFO:tasks.workunit.client.0.smithi060.stdout:5/634: read d5/f24 [83998,96855] 0 2024-09-21T10:41:02.900 INFO:tasks.workunit.client.0.smithi060.stdout:6/637: rename d3/d12/d16/d1a/d21/l81 to d3/d12/d65/d66/lcb 0 2024-09-21T10:41:02.904 INFO:tasks.workunit.client.0.smithi060.stdout:5/635: truncate d5/d45/d6d/d10/d19/d21/f2d 3184281 0 2024-09-21T10:41:02.904 INFO:tasks.workunit.client.0.smithi060.stdout:5/636: chown d5/d45/d6d/d10/d19/c2a 107465464 1 2024-09-21T10:41:02.906 INFO:tasks.workunit.client.0.smithi060.stdout:6/638: creat d3/d12/d16/d25/fcc x:0 0 0 2024-09-21T10:41:02.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/639: dread d3/d12/d16/d1a/d60/fb4 [0,4194304] 0 2024-09-21T10:41:02.907 INFO:tasks.workunit.client.0.smithi060.stdout:6/640: chown d3/d12/d38/d41/lc5 7 1 2024-09-21T10:41:02.908 INFO:tasks.workunit.client.0.smithi060.stdout:6/641: creat d3/d12/d16/d25/d27/fcd x:0 0 0 2024-09-21T10:41:02.910 INFO:tasks.workunit.client.0.smithi060.stdout:5/637: unlink d5/d45/d6d/d10/d19/f34 0 2024-09-21T10:41:02.910 INFO:tasks.workunit.client.0.smithi060.stdout:5/638: dread - d5/d45/d6d/d10/d19/d21/d30/d49/f75 zero size 2024-09-21T10:41:02.910 INFO:tasks.workunit.client.0.smithi060.stdout:5/639: truncate d5/d45/d5a/d3a/fba 779107 0 2024-09-21T10:41:02.915 INFO:tasks.workunit.client.0.smithi060.stdout:5/640: creat d5/d45/d6d/d10/d19/d8d/d60/d9e/fd4 x:0 0 0 2024-09-21T10:41:02.915 INFO:tasks.workunit.client.0.smithi060.stdout:6/642: read d3/d12/d16/d25/d27/f61 [4153834,119621] 0 2024-09-21T10:41:02.915 INFO:tasks.workunit.client.0.smithi060.stdout:6/643: stat d3/d12/d38 0 2024-09-21T10:41:02.929 INFO:tasks.workunit.client.0.smithi060.stdout:6/644: write d3/d12/d38/d41/f62 [2437421,65791] 0 2024-09-21T10:41:02.929 INFO:tasks.workunit.client.0.smithi060.stdout:5/641: read d5/d45/fb4 [2447481,91759] 0 2024-09-21T10:41:02.930 INFO:tasks.workunit.client.0.smithi060.stdout:6/645: unlink d3/d54/l67 0 2024-09-21T10:41:02.931 INFO:tasks.workunit.client.0.smithi060.stdout:6/646: dread d3/f4b [0,4194304] 0 2024-09-21T10:41:02.933 INFO:tasks.workunit.client.0.smithi060.stdout:5/642: mknod d5/d45/d6d/d10/d19/d8d/cd5 0 2024-09-21T10:41:02.933 INFO:tasks.workunit.client.0.smithi060.stdout:5/643: creat d5/d45/d6d/d10/d19/d8d/d60/d9e/fd6 x:0 0 0 2024-09-21T10:41:02.937 INFO:tasks.workunit.client.0.smithi060.stdout:5/644: creat d5/d45/d6d/fd7 x:0 0 0 2024-09-21T10:41:02.951 INFO:tasks.workunit.client.0.smithi060.stdout:6/647: dwrite d3/d12/d16/d1a/d21/f23 [0,4194304] 0 2024-09-21T10:41:02.957 INFO:tasks.workunit.client.0.smithi060.stdout:6/648: rmdir d3/d12 39 2024-09-21T10:41:02.957 INFO:tasks.workunit.client.0.smithi060.stdout:6/649: write d3/d12/d38/f96 [175671,81158] 0 2024-09-21T10:41:02.959 INFO:tasks.workunit.client.0.smithi060.stdout:5/645: dwrite d5/d45/d6d/f40 [0,4194304] 0 2024-09-21T10:41:02.959 INFO:tasks.workunit.client.0.smithi060.stdout:5/646: stat d5/d45/d6d/d10/d19/d21/d30/d49/c87 0 2024-09-21T10:41:02.963 INFO:tasks.workunit.client.0.smithi060.stdout:6/650: write d3/d12/d38/d41/f68 [3311389,80288] 0 2024-09-21T10:41:02.963 INFO:tasks.workunit.client.0.smithi060.stdout:6/651: write d3/d12/d16/d25/d27/f61 [5248404,128909] 0 2024-09-21T10:41:02.964 INFO:tasks.workunit.client.0.smithi060.stdout:6/652: write d3/d12/d38/d41/f62 [4221892,67845] 0 2024-09-21T10:41:02.964 INFO:tasks.workunit.client.0.smithi060.stdout:6/653: write d3/d12/d38/f3a [136039,121069] 0 2024-09-21T10:41:02.965 INFO:tasks.workunit.client.0.smithi060.stdout:6/654: mkdir d3/d12/d16/d25/d76/dce 0 2024-09-21T10:41:02.966 INFO:tasks.workunit.client.0.smithi060.stdout:6/655: rename d3/d12/d16/d25/d76/da9 to d3/d12/d38/d9e/dcf 0 2024-09-21T10:41:02.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/656: mknod d3/d12/d16/d1a/d60/cd0 0 2024-09-21T10:41:02.967 INFO:tasks.workunit.client.0.smithi060.stdout:6/657: chown d3/dd/c43 1073519122 1 2024-09-21T10:41:02.969 INFO:tasks.workunit.client.0.smithi060.stdout:6/658: rename d3/d12/d38/c7b to d3/d12/d16/d25/d27/cd1 0 2024-09-21T10:41:02.969 INFO:tasks.workunit.client.0.smithi060.stdout:6/659: write d3/d12/d16/d1a/d21/fa6 [627849,110275] 0 2024-09-21T10:41:02.969 INFO:tasks.workunit.client.0.smithi060.stdout:5/647: write d5/d45/d5a/d3a/f53 [1296259,88373] 0 2024-09-21T10:41:02.969 INFO:tasks.workunit.client.0.smithi060.stdout:5/648: truncate d5/d71/fce 854482 0 2024-09-21T10:41:02.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/649: stat d5/d45/d6d/d10/d19/d8d/d50/f58 0 2024-09-21T10:41:02.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/650: dread - d5/d45/d6d/d10/d19/d8d/d50/fb1 zero size 2024-09-21T10:41:02.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/651: readlink d5/d45/l92 0 2024-09-21T10:41:02.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/652: chown d5/d45/d6d/d10/d19/d8d/d60/d61 87 1 2024-09-21T10:41:02.971 INFO:tasks.workunit.client.0.smithi060.stdout:5/653: link d5/d45/d6d/d10/d19/d8d/d50/l54 d5/ld8 0 2024-09-21T10:41:02.972 INFO:tasks.workunit.client.0.smithi060.stdout:5/654: mknod d5/d45/d6d/d10/d19/d8d/d50/cd9 0 2024-09-21T10:41:02.974 INFO:tasks.workunit.client.0.smithi060.stdout:5/655: symlink d5/d45/d6d/d10/d19/d21/d30/lda 0 2024-09-21T10:41:02.975 INFO:tasks.workunit.client.0.smithi060.stdout:6/660: rename d3/d12/d16/d25/d76 to d3/d12/d16/d22/dd2 0 2024-09-21T10:41:02.976 INFO:tasks.workunit.client.0.smithi060.stdout:5/656: rmdir d5/d45/d5a 39 2024-09-21T10:41:02.977 INFO:tasks.workunit.client.0.smithi060.stdout:6/661: creat d3/d12/d16/d22/dd2/fd3 x:0 0 0 2024-09-21T10:41:02.979 INFO:tasks.workunit.client.0.smithi060.stdout:5/657: creat d5/d45/d6d/d10/d19/d8d/d60/d61/fdb x:0 0 0 2024-09-21T10:41:02.980 INFO:tasks.workunit.client.0.smithi060.stdout:6/662: rmdir d3/d12/d16/d22/d58/d75 39 2024-09-21T10:41:02.981 INFO:tasks.workunit.client.0.smithi060.stdout:5/658: unlink d5/d45/d6d/d10/d19/d21/f5f 0 2024-09-21T10:41:02.982 INFO:tasks.workunit.client.0.smithi060.stdout:6/663: mkdir d3/d12/d16/d25/d27/dd4 0 2024-09-21T10:41:02.982 INFO:tasks.workunit.client.0.smithi060.stdout:6/664: fdatasync d3/d12/d38/d41/f44 0 2024-09-21T10:41:02.983 INFO:tasks.workunit.client.0.smithi060.stdout:6/665: mknod d3/d12/d16/d1a/dca/cd5 0 2024-09-21T10:41:02.992 INFO:tasks.workunit.client.0.smithi060.stdout:6/666: dread d3/d12/d65/f6c [0,4194304] 0 2024-09-21T10:41:02.994 INFO:tasks.workunit.client.0.smithi060.stdout:6/667: creat d3/d12/d65/fd6 x:0 0 0 2024-09-21T10:41:02.994 INFO:tasks.workunit.client.0.smithi060.stdout:6/668: fsync d3/d12/d16/d1a/d21/f23 0 2024-09-21T10:41:02.994 INFO:tasks.workunit.client.0.smithi060.stdout:6/669: dread - d3/d12/d16/d1a/d83/da3/fb0 zero size 2024-09-21T10:41:02.994 INFO:tasks.workunit.client.0.smithi060.stdout:6/670: creat d3/d54/fd7 x:0 0 0 2024-09-21T10:41:02.995 INFO:tasks.workunit.client.0.smithi060.stdout:5/659: dwrite d5/f86 [0,4194304] 0 2024-09-21T10:41:02.997 INFO:tasks.workunit.client.0.smithi060.stdout:6/671: rmdir d3/d12/d16/d1a/d83/da3 39 2024-09-21T10:41:02.999 INFO:tasks.workunit.client.0.smithi060.stdout:6/672: dread d3/d12/d38/f9f [0,4194304] 0 2024-09-21T10:41:03.000 INFO:tasks.workunit.client.0.smithi060.stdout:5/660: mkdir d5/d45/d6d/d10/d19/d21/d7f/ddc 0 2024-09-21T10:41:03.000 INFO:tasks.workunit.client.0.smithi060.stdout:5/661: creat d5/d45/d6d/fdd x:0 0 0 2024-09-21T10:41:03.000 INFO:tasks.workunit.client.0.smithi060.stdout:5/662: creat d5/d45/d5a/d3a/fde x:0 0 0 2024-09-21T10:41:03.002 INFO:tasks.workunit.client.0.smithi060.stdout:6/673: link d3/d12/d16/d25/d27/fcd d3/d54/da8/fd8 0 2024-09-21T10:41:03.009 INFO:tasks.workunit.client.0.smithi060.stdout:5/663: truncate d5/d45/d6d/d10/f90 3645090 0 2024-09-21T10:41:03.011 INFO:tasks.workunit.client.0.smithi060.stdout:6/674: creat d3/d12/d38/d41/fd9 x:0 0 0 2024-09-21T10:41:03.020 INFO:tasks.workunit.client.0.smithi060.stdout:5/664: mkdir d5/d45/d6d/ddf 0 2024-09-21T10:41:03.022 INFO:tasks.workunit.client.0.smithi060.stdout:6/675: mkdir d3/d12/d38/d9e/dda 0 2024-09-21T10:41:03.022 INFO:tasks.workunit.client.0.smithi060.stdout:6/676: fdatasync d3/d12/d16/d1a/d21/f88 0 2024-09-21T10:41:03.022 INFO:tasks.workunit.client.0.smithi060.stdout:6/677: chown d3/d12/d38/d9e/dbe 2043219 1 2024-09-21T10:41:03.022 INFO:tasks.workunit.client.0.smithi060.stdout:5/665: mkdir d5/d7a/d84/d88/de0 0 2024-09-21T10:41:03.025 INFO:tasks.workunit.client.0.smithi060.stdout:6/678: mknod d3/d12/d16/d1a/d60/cdb 0 2024-09-21T10:41:03.028 INFO:tasks.workunit.client.0.smithi060.stdout:6/679: creat d3/d12/d16/d1a/d60/fdc x:0 0 0 2024-09-21T10:41:03.031 INFO:tasks.workunit.client.0.smithi060.stdout:5/666: dread d5/d7a/d84/fc1 [0,4194304] 0 2024-09-21T10:41:03.034 INFO:tasks.workunit.client.0.smithi060.stdout:5/667: mkdir d5/d45/d5a/dbd/de1 0 2024-09-21T10:41:03.036 INFO:tasks.workunit.client.0.smithi060.stdout:6/680: rename d3/d12/d38/d41 to d3/d12/d16/d1a/d83/ddd 0 2024-09-21T10:41:03.038 INFO:tasks.workunit.client.0.smithi060.stdout:6/681: mknod d3/d54/cde 0 2024-09-21T10:41:03.039 INFO:tasks.workunit.client.0.smithi060.stdout:6/682: rmdir d3/d12/d16/d1a/d9a 39 2024-09-21T10:41:03.039 INFO:tasks.workunit.client.0.smithi060.stdout:6/683: stat d3/d54 0 2024-09-21T10:41:03.042 INFO:tasks.workunit.client.0.smithi060.stdout:6/684: unlink d3/d12/d16/d25/f57 0 2024-09-21T10:41:03.042 INFO:tasks.workunit.client.0.smithi060.stdout:6/685: truncate d3/d12/d16/d1a/fc0 505033 0 2024-09-21T10:41:03.043 INFO:tasks.workunit.client.0.smithi060.stdout:6/686: unlink d3/d12/d38/cbc 0 2024-09-21T10:41:03.043 INFO:tasks.workunit.client.0.smithi060.stdout:6/687: write d3/d12/d16/d25/d27/fcd [323605,95693] 0 2024-09-21T10:41:03.045 INFO:tasks.workunit.client.0.smithi060.stdout:6/688: symlink d3/d12/d16/d22/ldf 0 2024-09-21T10:41:03.046 INFO:tasks.workunit.client.0.smithi060.stdout:6/689: getdents d3/d12/d16/d22/d5d/d70/d89/daa 0 2024-09-21T10:41:03.046 INFO:tasks.workunit.client.0.smithi060.stdout:6/690: truncate d3/fb 5216045 0 2024-09-21T10:41:03.046 INFO:tasks.workunit.client.0.smithi060.stdout:6/691: write d3/d12/d38/f3a [1287114,88404] 0 2024-09-21T10:41:03.055 INFO:tasks.workunit.client.0.smithi060.stdout:6/692: dread d3/d12/d16/d5b/f92 [0,4194304] 0 2024-09-21T10:41:03.056 INFO:tasks.workunit.client.0.smithi060.stdout:6/693: symlink d3/d12/d65/le0 0 2024-09-21T10:41:03.057 INFO:tasks.workunit.client.0.smithi060.stdout:6/694: symlink d3/d12/d16/d22/le1 0 2024-09-21T10:41:03.070 INFO:tasks.workunit.client.0.smithi060.stdout:6/695: dwrite d3/d12/d65/fd6 [0,4194304] 0 2024-09-21T10:41:03.075 INFO:tasks.workunit.client.0.smithi060.stdout:6/696: dread d3/fb [0,4194304] 0 2024-09-21T10:41:03.077 INFO:tasks.workunit.client.0.smithi060.stdout:6/697: mknod d3/d12/d16/ce2 0 2024-09-21T10:41:03.080 INFO:tasks.workunit.client.0.smithi060.stdout:6/698: rename d3/d12/d16/d5b/l80 to d3/dd/le3 0 2024-09-21T10:41:03.080 INFO:tasks.workunit.client.0.smithi060.stdout:6/699: readlink d3/d12/d16/d22/d5d/d70/d89/daa/laf 0 2024-09-21T10:41:03.080 INFO:tasks.workunit.client.0.smithi060.stdout:6/700: read - d3/d12/d38/d9e/dcf/fc1 zero size 2024-09-21T10:41:03.080 INFO:tasks.workunit.client.0.smithi060.stdout:6/701: truncate d3/d54/fc6 859036 0 2024-09-21T10:41:03.084 INFO:tasks.workunit.client.0.smithi060.stdout:6/702: dread d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:41:03.084 INFO:tasks.workunit.client.0.smithi060.stdout:6/703: chown d3/d12/d16/d1a/d83/da3/fb0 4 1 2024-09-21T10:41:03.084 INFO:tasks.workunit.client.0.smithi060.stdout:6/704: chown d3/d12/d38/l59 0 1 2024-09-21T10:41:03.085 INFO:tasks.workunit.client.0.smithi060.stdout:6/705: dread d3/d12/d16/d1a/d60/fb4 [0,4194304] 0 2024-09-21T10:41:03.086 INFO:tasks.workunit.client.0.smithi060.stdout:6/706: mkdir d3/d12/d38/d9e/dcf/de4 0 2024-09-21T10:41:03.087 INFO:tasks.workunit.client.0.smithi060.stdout:6/707: rmdir d3/d12/d16/d1a/d9a 39 2024-09-21T10:41:03.096 INFO:tasks.workunit.client.0.smithi060.stdout:0/630: sync 2024-09-21T10:41:03.098 INFO:tasks.workunit.client.0.smithi060.stdout:0/631: rename d5/d10/da/d4b/da4/d40/c82 to d5/d10/da/d15/cc2 0 2024-09-21T10:41:03.099 INFO:tasks.workunit.client.0.smithi060.stdout:0/632: creat d5/d10/da/d2f/fc3 x:0 0 0 2024-09-21T10:41:03.104 INFO:tasks.workunit.client.0.smithi060.stdout:6/708: dwrite d3/f52 [0,4194304] 0 2024-09-21T10:41:03.104 INFO:tasks.workunit.client.0.smithi060.stdout:6/709: write d3/d12/d16/d1a/d83/ddd/f4d [1707551,113889] 0 2024-09-21T10:41:03.107 INFO:tasks.workunit.client.0.smithi060.stdout:6/710: mkdir d3/d12/d16/d25/de5 0 2024-09-21T10:41:03.107 INFO:tasks.workunit.client.0.smithi060.stdout:6/711: fsync d3/d54/f71 0 2024-09-21T10:41:03.109 INFO:tasks.workunit.client.0.smithi060.stdout:6/712: link d3/f26 d3/d12/d16/d22/d5d/fe6 0 2024-09-21T10:41:03.110 INFO:tasks.workunit.client.0.smithi060.stdout:6/713: truncate d3/d12/d65/f6c 2036899 0 2024-09-21T10:41:03.111 INFO:tasks.workunit.client.0.smithi060.stdout:6/714: dread - d3/d54/fd7 zero size 2024-09-21T10:41:03.111 INFO:tasks.workunit.client.0.smithi060.stdout:6/715: write d3/d12/d16/d22/f6e [1029081,52282] 0 2024-09-21T10:41:03.112 INFO:tasks.workunit.client.0.smithi060.stdout:6/716: link d3/d12/d16/d1a/d83/da3/f9d d3/d12/d16/d1a/d83/fe7 0 2024-09-21T10:41:03.114 INFO:tasks.workunit.client.0.smithi060.stdout:6/717: symlink d3/d12/d16/d22/d5d/d70/d89/daa/le8 0 2024-09-21T10:41:03.114 INFO:tasks.workunit.client.0.smithi060.stdout:6/718: fdatasync d3/d12/d16/d1a/d83/ddd/f62 0 2024-09-21T10:41:03.115 INFO:tasks.workunit.client.0.smithi060.stdout:6/719: symlink d3/d12/d16/d1a/d60/le9 0 2024-09-21T10:41:03.116 INFO:tasks.workunit.client.0.smithi060.stdout:0/633: dwrite d5/d10/da/d4b/da4/d40/d48/dab/d45/f4f [0,4194304] 0 2024-09-21T10:41:03.119 INFO:tasks.workunit.client.0.smithi060.stdout:0/634: mknod d5/d10/da/d4b/cc4 0 2024-09-21T10:41:03.127 INFO:tasks.workunit.client.0.smithi060.stdout:6/720: write d3/d12/d16/d1a/f4f [2031619,113521] 0 2024-09-21T10:41:03.131 INFO:tasks.workunit.client.0.smithi060.stdout:6/721: mkdir d3/dea 0 2024-09-21T10:41:03.131 INFO:tasks.workunit.client.0.smithi060.stdout:0/635: write d5/d10/f8 [567802,59650] 0 2024-09-21T10:41:03.133 INFO:tasks.workunit.client.0.smithi060.stdout:6/722: creat d3/d12/d38/d9e/feb x:0 0 0 2024-09-21T10:41:03.135 INFO:tasks.workunit.client.0.smithi060.stdout:0/636: mknod d5/d10/da/d4b/da4/d76/cc5 0 2024-09-21T10:41:03.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/637: write d5/d10/da/d2d/fa2 [3355690,96899] 0 2024-09-21T10:41:03.136 INFO:tasks.workunit.client.0.smithi060.stdout:0/638: chown d5/d10/da/d4b/da4/d40/d48/dab/d4d/f9f 478217 1 2024-09-21T10:41:03.136 INFO:tasks.workunit.client.0.smithi060.stdout:6/723: stat d3/d12/d16/d1a/d60/c6d 0 2024-09-21T10:41:03.138 INFO:tasks.workunit.client.0.smithi060.stdout:0/639: symlink d5/d10/da/d4b/lc6 0 2024-09-21T10:41:03.140 INFO:tasks.workunit.client.0.smithi060.stdout:0/640: link d5/d10/da/d4b/da4/d40/d48/dab/d45/f30 d5/d10/da/d4b/da4/d40/d48/fc7 0 2024-09-21T10:41:03.140 INFO:tasks.workunit.client.0.smithi060.stdout:0/641: readlink d5/d10/da/d4b/da4/d40/d48/dab/l6d 0 2024-09-21T10:41:03.140 INFO:tasks.workunit.client.0.smithi060.stdout:0/642: dread - d5/d10/da/d4b/da4/d40/d75/fb0 zero size 2024-09-21T10:41:03.142 INFO:tasks.workunit.client.0.smithi060.stdout:0/643: symlink d5/d10/da/d2f/d66/lc8 0 2024-09-21T10:41:03.152 INFO:tasks.workunit.client.0.smithi060.stdout:6/724: dwrite d3/d12/d16/d25/d27/f61 [4194304,4194304] 0 2024-09-21T10:41:03.152 INFO:tasks.workunit.client.0.smithi060.stdout:6/725: fsync d3/d12/d38/d9e/feb 0 2024-09-21T10:41:03.158 INFO:tasks.workunit.client.0.smithi060.stdout:6/726: dread d3/d12/d16/d25/f3e [0,4194304] 0 2024-09-21T10:41:03.160 INFO:tasks.workunit.client.0.smithi060.stdout:0/644: dwrite d5/d10/da/d2f/f6b [0,4194304] 0 2024-09-21T10:41:03.161 INFO:tasks.workunit.client.0.smithi060.stdout:0/645: symlink d5/d10/da/d4b/da4/d40/d48/dab/d4d/lc9 0 2024-09-21T10:41:03.163 INFO:tasks.workunit.client.0.smithi060.stdout:0/646: mkdir d5/d10/da/d4b/da4/d40/d75/dca 0 2024-09-21T10:41:03.163 INFO:tasks.workunit.client.0.smithi060.stdout:0/647: readlink d5/d10/da/l2e 0 2024-09-21T10:41:03.163 INFO:tasks.workunit.client.0.smithi060.stdout:6/727: write d3/d12/d16/d1a/f4c [2055283,100000] 0 2024-09-21T10:41:03.164 INFO:tasks.workunit.client.0.smithi060.stdout:0/648: rename d5/d10/da/d4b/da4/f7f to d5/d10/da/d4b/da4/d40/d75/dca/fcb 0 2024-09-21T10:41:03.166 INFO:tasks.workunit.client.0.smithi060.stdout:6/728: getdents d3/d12/d16/d22/dd2 0 2024-09-21T10:41:03.166 INFO:tasks.workunit.client.0.smithi060.stdout:6/729: write d3/d12/d16/d1a/d21/f23 [5065373,90898] 0 2024-09-21T10:41:03.189 INFO:tasks.workunit.client.0.smithi060.stdout:0/649: dwrite d5/d10/da/d4b/da4/d40/d75/f7c [4194304,4194304] 0 2024-09-21T10:41:03.189 INFO:tasks.workunit.client.0.smithi060.stdout:6/730: dwrite d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:41:03.189 INFO:tasks.workunit.client.0.smithi060.stdout:6/731: fdatasync d3/d12/d16/d25/d27/fba 0 2024-09-21T10:41:03.189 INFO:tasks.workunit.client.0.smithi060.stdout:6/732: truncate d3/d12/d38/f96 824067 0 2024-09-21T10:41:03.199 INFO:tasks.workunit.client.0.smithi060.stdout:0/650: rename d5/d10/da/d2f/f64 to d5/d10/da/d4b/da4/d40/d48/d63/d96/fcc 0 2024-09-21T10:41:03.200 INFO:tasks.workunit.client.0.smithi060.stdout:6/733: truncate d3/d12/d16/d25/f45 863517 0 2024-09-21T10:41:03.200 INFO:tasks.workunit.client.0.smithi060.stdout:0/651: read d5/d10/da/d4b/da4/d76/fa8 [635268,74061] 0 2024-09-21T10:41:03.200 INFO:tasks.workunit.client.0.smithi060.stdout:0/652: write d5/d10/da/d4b/da4/d40/d48/fac [389471,88189] 0 2024-09-21T10:41:03.204 INFO:tasks.workunit.client.0.smithi060.stdout:0/653: rename d5/d10/da/d4b/da4/d40/d48/dab/d45/f27 to d5/d10/da/d4b/da4/d40/d48/fcd 0 2024-09-21T10:41:03.207 INFO:tasks.workunit.client.0.smithi060.stdout:0/654: link d5/d10/da/d4b/da4/d40/d48/dab/d45/f4f d5/d10/da/d4b/da4/d40/d75/dae/fce 0 2024-09-21T10:41:03.219 INFO:tasks.workunit.client.0.smithi060.stdout:0/655: rmdir d5/d10 39 2024-09-21T10:41:03.219 INFO:tasks.workunit.client.0.smithi060.stdout:0/656: readlink d5/d10/da/d4b/da4/d40/d48/dab/d45/l37 0 2024-09-21T10:41:03.234 INFO:tasks.workunit.client.0.smithi060.stdout:0/657: dwrite d5/d10/da/d4b/da4/d40/d75/dae/fce [4194304,4194304] 0 2024-09-21T10:41:03.234 INFO:tasks.workunit.client.0.smithi060.stdout:0/658: fsync d5/d10/d4e/f9c 0 2024-09-21T10:41:03.234 INFO:tasks.workunit.client.0.smithi060.stdout:6/734: dwrite d3/d12/d65/d66/fa2 [0,4194304] 0 2024-09-21T10:41:03.234 INFO:tasks.workunit.client.0.smithi060.stdout:6/735: write d3/fb [2844651,70268] 0 2024-09-21T10:41:03.234 INFO:tasks.workunit.client.0.smithi060.stdout:6/736: dread - d3/dd/f64 zero size 2024-09-21T10:41:03.240 INFO:tasks.workunit.client.0.smithi060.stdout:6/737: creat d3/d12/d16/d22/dd2/fec x:0 0 0 2024-09-21T10:41:03.240 INFO:tasks.workunit.client.0.smithi060.stdout:0/659: write d5/d10/f60 [3465247,50758] 0 2024-09-21T10:41:03.242 INFO:tasks.workunit.client.0.smithi060.stdout:6/738: mknod d3/d54/da8/ced 0 2024-09-21T10:41:03.243 INFO:tasks.workunit.client.0.smithi060.stdout:6/739: chown d3/f30 32530 1 2024-09-21T10:41:03.244 INFO:tasks.workunit.client.0.smithi060.stdout:0/660: symlink d5/d10/da/d4b/da4/d40/d48/db3/lcf 0 2024-09-21T10:41:03.244 INFO:tasks.workunit.client.0.smithi060.stdout:0/661: read d5/d10/da/d4b/da4/d76/fa8 [772883,98845] 0 2024-09-21T10:41:03.245 INFO:tasks.workunit.client.0.smithi060.stdout:6/740: creat d3/d12/d65/d7f/db5/fee x:0 0 0 2024-09-21T10:41:03.245 INFO:tasks.workunit.client.0.smithi060.stdout:6/741: readlink d3/d12/d38/d9e/lad 0 2024-09-21T10:41:03.248 INFO:tasks.workunit.client.0.smithi060.stdout:0/662: mknod d5/d10/da/cd0 0 2024-09-21T10:41:03.248 INFO:tasks.workunit.client.0.smithi060.stdout:0/663: chown d5/d10/da/d4b/da4/d40/d48/dab/l50 1 1 2024-09-21T10:41:03.248 INFO:tasks.workunit.client.0.smithi060.stdout:0/664: readlink d5/d10/d11/l83 0 2024-09-21T10:41:03.251 INFO:tasks.workunit.client.0.smithi060.stdout:3/576: sync 2024-09-21T10:41:03.251 INFO:tasks.workunit.client.0.smithi060.stdout:3/577: chown d0/d1/d9e 1 1 2024-09-21T10:41:03.251 INFO:tasks.workunit.client.0.smithi060.stdout:3/578: dread - d0/d1/d11/d2a/d87/fb1 zero size 2024-09-21T10:41:03.262 INFO:tasks.workunit.client.0.smithi060.stdout:0/665: dread d5/f21 [4194304,4194304] 0 2024-09-21T10:41:03.262 INFO:tasks.workunit.client.0.smithi060.stdout:0/666: chown d5/d10/da/d4b/da4/d40/d75/dca 86382985 1 2024-09-21T10:41:03.264 INFO:tasks.workunit.client.0.smithi060.stdout:0/667: mknod d5/d10/da/d4b/da4/d40/d48/db3/cd1 0 2024-09-21T10:41:03.264 INFO:tasks.workunit.client.0.smithi060.stdout:0/668: write d5/d10/da/da7/fb7 [625961,46022] 0 2024-09-21T10:41:03.269 INFO:tasks.workunit.client.0.smithi060.stdout:3/579: dread d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:41:03.270 INFO:tasks.workunit.client.0.smithi060.stdout:3/580: chown d0/d1/d11/d2a/d43/d4e/l8f 310634 1 2024-09-21T10:41:03.279 INFO:tasks.workunit.client.0.smithi060.stdout:6/742: dwrite d3/d12/d16/d1a/f4f [0,4194304] 0 2024-09-21T10:41:03.290 INFO:tasks.workunit.client.0.smithi060.stdout:6/743: dread d3/f30 [0,4194304] 0 2024-09-21T10:41:03.290 INFO:tasks.workunit.client.0.smithi060.stdout:6/744: chown d3/d12/d16/d22/dd2/fec 3 1 2024-09-21T10:41:03.291 INFO:tasks.workunit.client.0.smithi060.stdout:6/745: dread - d3/d54/fd7 zero size 2024-09-21T10:41:03.293 INFO:tasks.workunit.client.0.smithi060.stdout:0/669: dwrite d5/d10/da/d4b/da4/d76/f94 [0,4194304] 0 2024-09-21T10:41:03.293 INFO:tasks.workunit.client.0.smithi060.stdout:3/581: dwrite d0/d1/d11/d2a/d64/f9c [0,4194304] 0 2024-09-21T10:41:03.293 INFO:tasks.workunit.client.0.smithi060.stdout:3/582: write d0/d1/d11/f51 [1405188,98768] 0 2024-09-21T10:41:03.311 INFO:tasks.workunit.client.0.smithi060.stdout:6/746: dwrite d3/d12/d16/d1a/d83/ddd/f46 [0,4194304] 0 2024-09-21T10:41:03.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/670: creat d5/d10/da/d4b/da4/d40/d75/dae/fd2 x:0 0 0 2024-09-21T10:41:03.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/671: chown d5/d10/da/d4b/da4/d40/d48/dab/d4d/f87 248988505 1 2024-09-21T10:41:03.376 INFO:tasks.workunit.client.0.smithi060.stdout:3/583: mkdir d0/d1/d11/d53/d98/db8 0 2024-09-21T10:41:03.376 INFO:tasks.workunit.client.0.smithi060.stdout:3/584: chown d0/d1/d11/d53/d98/db8 12107 1 2024-09-21T10:41:03.377 INFO:tasks.workunit.client.0.smithi060.stdout:6/747: mkdir d3/d12/d16/def 0 2024-09-21T10:41:03.383 INFO:tasks.workunit.client.0.smithi060.stdout:0/672: creat d5/d10/da/d4b/da4/fd3 x:0 0 0 2024-09-21T10:41:03.383 INFO:tasks.workunit.client.0.smithi060.stdout:0/673: stat d5/d10/d43 0 2024-09-21T10:41:03.385 INFO:tasks.workunit.client.0.smithi060.stdout:6/748: write d3/d12/d16/d1a/d83/ddd/f46 [1165442,29085] 0 2024-09-21T10:41:03.386 INFO:tasks.workunit.client.0.smithi060.stdout:3/585: creat d0/d1/fb9 x:0 0 0 2024-09-21T10:41:03.386 INFO:tasks.workunit.client.0.smithi060.stdout:3/586: write d0/d1/d11/d2a/d45/fb2 [1040748,6906] 0 2024-09-21T10:41:03.391 INFO:tasks.workunit.client.0.smithi060.stdout:3/587: mkdir d0/d1/db0/dba 0 2024-09-21T10:41:03.393 INFO:tasks.workunit.client.0.smithi060.stdout:3/588: mkdir d0/d1/d11/d53/dbb 0 2024-09-21T10:41:03.393 INFO:tasks.workunit.client.0.smithi060.stdout:3/589: stat d0/d1/d1e/f4b 0 2024-09-21T10:41:03.393 INFO:tasks.workunit.client.0.smithi060.stdout:3/590: readlink d0/d1/d1e/l6e 0 2024-09-21T10:41:03.394 INFO:tasks.workunit.client.0.smithi060.stdout:3/591: chown d0/d1/d52/l7b 230591 1 2024-09-21T10:41:03.396 INFO:tasks.workunit.client.0.smithi060.stdout:3/592: rename d0/d1/d11/d2a/f7e to d0/d1/d11/d2a/fbc 0 2024-09-21T10:41:03.402 INFO:tasks.workunit.client.0.smithi060.stdout:0/674: dwrite d5/d10/da/d4b/da4/d40/d48/dab/d45/f30 [0,4194304] 0 2024-09-21T10:41:03.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/515: sync 2024-09-21T10:41:03.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/516: chown d6/d24/da/d45 179 1 2024-09-21T10:41:03.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/517: read - d6/d4a/d5a/fa4 zero size 2024-09-21T10:41:03.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/518: fsync d6/d24/da/fa5 0 2024-09-21T10:41:03.411 INFO:tasks.workunit.client.0.smithi060.stdout:1/519: chown d6/d4a/d5a/f5e 21940486 1 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:6/749: dwrite d3/d12/d16/d25/f45 [0,4194304] 0 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:6/750: creat d3/d54/ff0 x:0 0 0 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:1/520: creat d6/d4a/d5a/db0/d97/fb9 x:0 0 0 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:1/521: dread - d6/d24/da/db/d1c/d4b/f72 zero size 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:1/522: dread - d6/f89 zero size 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/593: dwrite d0/d1/d1e/d34/f49 [4194304,4194304] 0 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/594: fdatasync d0/d1/d11/d2a/f63 0 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/595: readlink d0/d1/d52/l58 0 2024-09-21T10:41:03.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/596: creat d0/d1/fbd x:0 0 0 2024-09-21T10:41:03.417 INFO:tasks.workunit.client.0.smithi060.stdout:6/751: symlink d3/d12/d16/d22/d5d/lf1 0 2024-09-21T10:41:03.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/523: truncate d6/d24/f59 2175947 0 2024-09-21T10:41:03.418 INFO:tasks.workunit.client.0.smithi060.stdout:0/675: dwrite d5/d10/f60 [0,4194304] 0 2024-09-21T10:41:03.423 INFO:tasks.workunit.client.0.smithi060.stdout:3/597: mknod d0/d1/d11/d2a/d45/cbe 0 2024-09-21T10:41:03.423 INFO:tasks.workunit.client.0.smithi060.stdout:3/598: chown d0/d1/d11/d2a/d64/c73 3537663 1 2024-09-21T10:41:03.423 INFO:tasks.workunit.client.0.smithi060.stdout:3/599: write d0/d1/fb9 [640754,93959] 0 2024-09-21T10:41:03.425 INFO:tasks.workunit.client.0.smithi060.stdout:6/752: dread d3/d12/f51 [0,4194304] 0 2024-09-21T10:41:03.430 INFO:tasks.workunit.client.0.smithi060.stdout:1/524: unlink d6/f2c 0 2024-09-21T10:41:03.431 INFO:tasks.workunit.client.0.smithi060.stdout:3/600: creat d0/d1/d11/d46/fbf x:0 0 0 2024-09-21T10:41:03.433 INFO:tasks.workunit.client.0.smithi060.stdout:6/753: mkdir d3/d12/d4e/df2 0 2024-09-21T10:41:03.434 INFO:tasks.workunit.client.0.smithi060.stdout:1/525: creat d6/d4a/d5a/db0/fba x:0 0 0 2024-09-21T10:41:03.435 INFO:tasks.workunit.client.0.smithi060.stdout:3/601: creat d0/d1/d11/d2a/d85/fc0 x:0 0 0 2024-09-21T10:41:03.436 INFO:tasks.workunit.client.0.smithi060.stdout:6/754: mknod d3/d12/d16/d22/dd2/cf3 0 2024-09-21T10:41:03.438 INFO:tasks.workunit.client.0.smithi060.stdout:6/755: mkdir d3/dd/df4 0 2024-09-21T10:41:03.439 INFO:tasks.workunit.client.0.smithi060.stdout:0/676: dwrite d5/d10/da/f86 [0,4194304] 0 2024-09-21T10:41:03.441 INFO:tasks.workunit.client.0.smithi060.stdout:1/526: dread d6/d24/da/db/d1c/d4b/f82 [0,4194304] 0 2024-09-21T10:41:03.445 INFO:tasks.workunit.client.0.smithi060.stdout:3/602: dread d0/d1/d11/d2a/d45/f97 [0,4194304] 0 2024-09-21T10:41:03.445 INFO:tasks.workunit.client.0.smithi060.stdout:0/677: creat d5/d10/da/d4b/fd4 x:0 0 0 2024-09-21T10:41:03.445 INFO:tasks.workunit.client.0.smithi060.stdout:0/678: read - d5/d10/da/d4b/fa6 zero size 2024-09-21T10:41:03.445 INFO:tasks.workunit.client.0.smithi060.stdout:0/679: stat d5/d10/da/d2f/d66/l8c 0 2024-09-21T10:41:03.446 INFO:tasks.workunit.client.0.smithi060.stdout:0/680: stat d5/d10/f3d 0 2024-09-21T10:41:03.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/527: getdents d6/d24/da/db/d79/d86/d95 0 2024-09-21T10:41:03.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/528: write d6/d24/da/db/de/f8d [650314,64704] 0 2024-09-21T10:41:03.446 INFO:tasks.workunit.client.0.smithi060.stdout:1/529: stat d6/d24/da/db/de/d32/l7a 0 2024-09-21T10:41:03.448 INFO:tasks.workunit.client.0.smithi060.stdout:3/603: symlink d0/d1/db0/lc1 0 2024-09-21T10:41:03.448 INFO:tasks.workunit.client.0.smithi060.stdout:3/604: chown d0/d1/db0/dba 0 1 2024-09-21T10:41:03.448 INFO:tasks.workunit.client.0.smithi060.stdout:3/605: fsync d0/d1/f8b 0 2024-09-21T10:41:03.449 INFO:tasks.workunit.client.0.smithi060.stdout:0/681: creat d5/d10/da/d4b/da4/d40/d48/db3/fd5 x:0 0 0 2024-09-21T10:41:03.451 INFO:tasks.workunit.client.0.smithi060.stdout:1/530: mkdir d6/d24/da/db/d79/dad/dbb 0 2024-09-21T10:41:03.453 INFO:tasks.workunit.client.0.smithi060.stdout:3/606: mkdir d0/d1/d11/d2a/dc2 0 2024-09-21T10:41:03.454 INFO:tasks.workunit.client.0.smithi060.stdout:1/531: symlink d6/d24/da/d45/d47/lbc 0 2024-09-21T10:41:03.455 INFO:tasks.workunit.client.0.smithi060.stdout:6/756: dwrite d3/d12/d16/d22/f7a [0,4194304] 0 2024-09-21T10:41:03.456 INFO:tasks.workunit.client.0.smithi060.stdout:3/607: link d0/d1/d52/faf d0/d1/d11/d53/dbb/fc3 0 2024-09-21T10:41:03.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/532: rename d6/d24/da/l9c to d6/lbd 0 2024-09-21T10:41:03.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/533: write d6/d24/da/db/de/d32/f37 [9238699,47558] 0 2024-09-21T10:41:03.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/534: readlink d6/d24/da/db/d1c/l2b 0 2024-09-21T10:41:03.459 INFO:tasks.workunit.client.0.smithi060.stdout:1/535: fsync d6/d24/da/db/d7e/f9a 0 2024-09-21T10:41:03.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/757: unlink d3/d12/c87 0 2024-09-21T10:41:03.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/758: write d3/d12/d38/f96 [838083,16355] 0 2024-09-21T10:41:03.462 INFO:tasks.workunit.client.0.smithi060.stdout:6/759: chown d3/d12/d16/d22/d5d/d70 14657970 1 2024-09-21T10:41:03.462 INFO:tasks.workunit.client.0.smithi060.stdout:3/608: mkdir d0/d1/d5c/dc4 0 2024-09-21T10:41:03.463 INFO:tasks.workunit.client.0.smithi060.stdout:0/682: dread d5/d10/da/f86 [0,4194304] 0 2024-09-21T10:41:03.465 INFO:tasks.workunit.client.0.smithi060.stdout:1/536: link d6/d24/da/d45/d76/c81 d6/d24/da/db/cbe 0 2024-09-21T10:41:03.467 INFO:tasks.workunit.client.0.smithi060.stdout:6/760: symlink d3/d12/d65/d7f/lf5 0 2024-09-21T10:41:03.467 INFO:tasks.workunit.client.0.smithi060.stdout:6/761: dread - d3/d54/f77 zero size 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/683: dread d5/d10/da/d4b/da4/d40/d48/dab/f62 [0,4194304] 0 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:1/537: dread d6/d4a/d5a/db0/f8f [0,4194304] 0 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:1/538: dread - d6/d4a/d5a/fa4 zero size 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/609: creat d0/d1/d1e/d34/fc5 x:0 0 0 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/610: creat d0/d1/d11/d2a/fc6 x:0 0 0 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/611: creat d0/d1/fc7 x:0 0 0 2024-09-21T10:41:03.474 INFO:tasks.workunit.client.0.smithi060.stdout:6/762: mkdir d3/d12/d16/d22/dd2/df6 0 2024-09-21T10:41:03.475 INFO:tasks.workunit.client.0.smithi060.stdout:6/763: write d3/d54/ff0 [463340,45837] 0 2024-09-21T10:41:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/684: unlink d5/d10/da/d4b/f8b 0 2024-09-21T10:41:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/685: readlink d5/d10/da/d4b/da4/d40/l89 0 2024-09-21T10:41:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:1/539: mknod d6/d24/da/db/d79/dad/cbf 0 2024-09-21T10:41:03.477 INFO:tasks.workunit.client.0.smithi060.stdout:1/540: write d6/f20 [1563843,87344] 0 2024-09-21T10:41:03.483 INFO:tasks.workunit.client.0.smithi060.stdout:3/612: mkdir d0/d1/d11/d53/da2/dc8 0 2024-09-21T10:41:03.483 INFO:tasks.workunit.client.0.smithi060.stdout:3/613: chown d0/d1/d1e/c6a 5270 1 2024-09-21T10:41:03.483 INFO:tasks.workunit.client.0.smithi060.stdout:6/764: mknod d3/d12/d16/d1a/d60/dac/cf7 0 2024-09-21T10:41:03.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/686: creat d5/d10/da/d4b/da4/d40/d75/dca/fd6 x:0 0 0 2024-09-21T10:41:03.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/687: chown d5/d10/d4e/dbd 11 1 2024-09-21T10:41:03.488 INFO:tasks.workunit.client.0.smithi060.stdout:3/614: creat d0/d1/d11/d53/da2/dc8/fc9 x:0 0 0 2024-09-21T10:41:03.489 INFO:tasks.workunit.client.0.smithi060.stdout:6/765: mkdir d3/d12/d16/d22/d58/d75/df8 0 2024-09-21T10:41:03.491 INFO:tasks.workunit.client.0.smithi060.stdout:6/766: dread d3/d12/d16/d1a/d21/fa6 [0,4194304] 0 2024-09-21T10:41:03.494 INFO:tasks.workunit.client.0.smithi060.stdout:9/512: sync 2024-09-21T10:41:03.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/614: sync 2024-09-21T10:41:03.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/615: write d2/d26/d37/d62/d74/d83/d89/fa1 [1633944,97890] 0 2024-09-21T10:41:03.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/616: creat d2/d26/d37/d62/d74/d83/dac/fcc x:0 0 0 2024-09-21T10:41:03.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/617: creat d2/d18/d4b/dbe/fcd x:0 0 0 2024-09-21T10:41:03.496 INFO:tasks.workunit.client.0.smithi060.stdout:1/541: getdents d6 0 2024-09-21T10:41:03.498 INFO:tasks.workunit.client.0.smithi060.stdout:3/615: rename d0/d1/d11/d46/f59 to d0/d1/d11/d2a/d43/fca 0 2024-09-21T10:41:03.498 INFO:tasks.workunit.client.0.smithi060.stdout:3/616: read d0/d1/d24/f40 [3984374,45958] 0 2024-09-21T10:41:03.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/513: creat d3/d15/d92/fa8 x:0 0 0 2024-09-21T10:41:03.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/514: creat d3/d16/d42/d7e/fa9 x:0 0 0 2024-09-21T10:41:03.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/618: symlink d2/d26/d37/d62/d74/d83/lce 0 2024-09-21T10:41:03.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/619: stat d2/f17 0 2024-09-21T10:41:03.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/620: creat d2/d5a/fcf x:0 0 0 2024-09-21T10:41:03.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/621: fsync d2/da7/fc3 0 2024-09-21T10:41:03.511 INFO:tasks.workunit.client.0.smithi060.stdout:6/767: dwrite d3/d12/d16/d25/fcc [0,4194304] 0 2024-09-21T10:41:03.511 INFO:tasks.workunit.client.0.smithi060.stdout:1/542: dwrite d6/d24/da/db/d1c/f26 [4194304,4194304] 0 2024-09-21T10:41:03.511 INFO:tasks.workunit.client.0.smithi060.stdout:1/543: fsync d6/d24/da/d45/f6a 0 2024-09-21T10:41:03.512 INFO:tasks.workunit.client.0.smithi060.stdout:3/617: creat d0/d1/d11/d2a/d64/fcb x:0 0 0 2024-09-21T10:41:03.512 INFO:tasks.workunit.client.0.smithi060.stdout:3/618: truncate d0/f21 4887219 0 2024-09-21T10:41:03.518 INFO:tasks.workunit.client.0.smithi060.stdout:9/515: rename d3/d5e/d60/l30 to d3/d16/d95/laa 0 2024-09-21T10:41:03.520 INFO:tasks.workunit.client.0.smithi060.stdout:8/622: chown d2/c5b 4705 1 2024-09-21T10:41:03.526 INFO:tasks.workunit.client.0.smithi060.stdout:3/619: unlink d0/d1/d11/d53/c83 0 2024-09-21T10:41:03.528 INFO:tasks.workunit.client.0.smithi060.stdout:6/768: rename d3/d12/d16/d5b/f92 to d3/d12/d16/def/ff9 0 2024-09-21T10:41:03.530 INFO:tasks.workunit.client.0.smithi060.stdout:9/516: symlink d3/d15/d5a/d64/d9e/lab 0 2024-09-21T10:41:03.533 INFO:tasks.workunit.client.0.smithi060.stdout:9/517: mkdir d3/d5e/d60/d2f/dac 0 2024-09-21T10:41:03.535 INFO:tasks.workunit.client.0.smithi060.stdout:6/769: rmdir d3/d12/d65 39 2024-09-21T10:41:03.536 INFO:tasks.workunit.client.0.smithi060.stdout:6/770: write d3/d54/ff0 [397718,61684] 0 2024-09-21T10:41:03.538 INFO:tasks.workunit.client.0.smithi060.stdout:9/518: symlink d3/d5e/d60/d2f/lad 0 2024-09-21T10:41:03.538 INFO:tasks.workunit.client.0.smithi060.stdout:9/519: truncate d3/d5e/f6a 153122 0 2024-09-21T10:41:03.538 INFO:tasks.workunit.client.0.smithi060.stdout:6/771: truncate d3/d12/d16/d1a/f4f 3582863 0 2024-09-21T10:41:03.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/544: dwrite d6/d24/da/f12 [0,4194304] 0 2024-09-21T10:41:03.541 INFO:tasks.workunit.client.0.smithi060.stdout:9/520: creat d3/d15/d5a/d64/fae x:0 0 0 2024-09-21T10:41:03.543 INFO:tasks.workunit.client.0.smithi060.stdout:8/623: dwrite d2/f1e [0,4194304] 0 2024-09-21T10:41:03.544 INFO:tasks.workunit.client.0.smithi060.stdout:3/620: dwrite d0/d1/d11/d2a/d64/f72 [0,4194304] 0 2024-09-21T10:41:03.544 INFO:tasks.workunit.client.0.smithi060.stdout:9/521: mkdir d3/d15/d5a/d64/d9e/daf 0 2024-09-21T10:41:03.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/621: truncate d0/d1/d1e/f35 551419 0 2024-09-21T10:41:03.549 INFO:tasks.workunit.client.0.smithi060.stdout:9/522: mkdir d3/d16/d95/db0 0 2024-09-21T10:41:03.550 INFO:tasks.workunit.client.0.smithi060.stdout:1/545: dread d6/d24/da/db/de/d32/f37 [4194304,4194304] 0 2024-09-21T10:41:03.550 INFO:tasks.workunit.client.0.smithi060.stdout:1/546: chown d6/d24/da/d45/d47/cb6 500030784 1 2024-09-21T10:41:03.550 INFO:tasks.workunit.client.0.smithi060.stdout:1/547: creat d6/d24/da/db/d79/d86/d9f/fc0 x:0 0 0 2024-09-21T10:41:03.550 INFO:tasks.workunit.client.0.smithi060.stdout:3/622: getdents d0/d1/db0 0 2024-09-21T10:41:03.551 INFO:tasks.workunit.client.0.smithi060.stdout:3/623: getdents d0/d1/db0/dba 0 2024-09-21T10:41:03.553 INFO:tasks.workunit.client.0.smithi060.stdout:9/523: mknod d3/d5e/d60/cb1 0 2024-09-21T10:41:03.553 INFO:tasks.workunit.client.0.smithi060.stdout:9/524: readlink d3/d5e/d60/d2f/d5b/l77 0 2024-09-21T10:41:03.557 INFO:tasks.workunit.client.0.smithi060.stdout:8/624: dwrite d2/d26/d37/d62/faf [0,4194304] 0 2024-09-21T10:41:03.558 INFO:tasks.workunit.client.0.smithi060.stdout:1/548: rename d6/d24/da/d45/d76/fae to d6/d24/da/db/d7e/fc1 0 2024-09-21T10:41:03.564 INFO:tasks.workunit.client.0.smithi060.stdout:8/625: mknod d2/d26/d37/d62/d77/cd0 0 2024-09-21T10:41:03.565 INFO:tasks.workunit.client.0.smithi060.stdout:1/549: mkdir d6/d24/da/db/dc2 0 2024-09-21T10:41:03.569 INFO:tasks.workunit.client.0.smithi060.stdout:1/550: symlink d6/d24/lc3 0 2024-09-21T10:41:03.570 INFO:tasks.workunit.client.0.smithi060.stdout:3/624: dwrite d0/d1/d11/d2a/d43/fca [0,4194304] 0 2024-09-21T10:41:03.573 INFO:tasks.workunit.client.0.smithi060.stdout:1/551: creat d6/d24/da/db/fc4 x:0 0 0 2024-09-21T10:41:03.576 INFO:tasks.workunit.client.0.smithi060.stdout:1/552: link d6/d24/da/db/c19 d6/d24/da/db/de/d32/cc5 0 2024-09-21T10:41:03.576 INFO:tasks.workunit.client.0.smithi060.stdout:1/553: write d6/d4a/d5a/fa4 [219327,25224] 0 2024-09-21T10:41:03.582 INFO:tasks.workunit.client.0.smithi060.stdout:9/525: dwrite d3/f9 [0,4194304] 0 2024-09-21T10:41:03.582 INFO:tasks.workunit.client.0.smithi060.stdout:9/526: chown d3/d15/d5a/c6e 851408 1 2024-09-21T10:41:03.582 INFO:tasks.workunit.client.0.smithi060.stdout:9/527: chown d3/d15/d58/l59 1161 1 2024-09-21T10:41:03.583 INFO:tasks.workunit.client.0.smithi060.stdout:8/626: dwrite d2/d26/d37/d62/faf [0,4194304] 0 2024-09-21T10:41:03.583 INFO:tasks.workunit.client.0.smithi060.stdout:9/528: rmdir d3/d5e/d60/d2f/d5b 39 2024-09-21T10:41:03.585 INFO:tasks.workunit.client.0.smithi060.stdout:9/529: symlink d3/d16/d9c/lb2 0 2024-09-21T10:41:03.586 INFO:tasks.workunit.client.0.smithi060.stdout:3/625: dread d0/d1/f3f [0,4194304] 0 2024-09-21T10:41:03.587 INFO:tasks.workunit.client.0.smithi060.stdout:9/530: rmdir d3/d16/d95/db0 0 2024-09-21T10:41:03.587 INFO:tasks.workunit.client.0.smithi060.stdout:9/531: mknod d3/d15/d5a/cb3 0 2024-09-21T10:41:03.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/532: readlink d3/l7 0 2024-09-21T10:41:03.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/533: chown d3/d16/c38 13315053 1 2024-09-21T10:41:03.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/534: fdatasync d3/f9 0 2024-09-21T10:41:03.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/535: chown d3/d15/d58/la5 7699740 1 2024-09-21T10:41:03.594 INFO:tasks.workunit.client.0.smithi060.stdout:8/627: dread d2/d26/d37/d62/d77/f79 [0,4194304] 0 2024-09-21T10:41:03.594 INFO:tasks.workunit.client.0.smithi060.stdout:8/628: truncate d2/f14 2458342 0 2024-09-21T10:41:03.596 INFO:tasks.workunit.client.0.smithi060.stdout:2/445: sync 2024-09-21T10:41:03.596 INFO:tasks.workunit.client.0.smithi060.stdout:5/668: sync 2024-09-21T10:41:03.596 INFO:tasks.workunit.client.0.smithi060.stdout:7/622: sync 2024-09-21T10:41:03.596 INFO:tasks.workunit.client.0.smithi060.stdout:4/592: sync 2024-09-21T10:41:03.597 INFO:tasks.workunit.client.0.smithi060.stdout:7/623: dread da/d14/d25/d56/f58 [0,4194304] 0 2024-09-21T10:41:03.598 INFO:tasks.workunit.client.0.smithi060.stdout:1/554: dwrite d6/d24/da/d45/f6a [0,4194304] 0 2024-09-21T10:41:03.598 INFO:tasks.workunit.client.0.smithi060.stdout:8/629: symlink d2/d26/d37/d62/d77/da8/ld1 0 2024-09-21T10:41:03.598 INFO:tasks.workunit.client.0.smithi060.stdout:3/626: write d0/d1/d11/d2a/d93/f94 [367602,102573] 0 2024-09-21T10:41:03.598 INFO:tasks.workunit.client.0.smithi060.stdout:8/630: write d2/d26/d37/f93 [272040,30120] 0 2024-09-21T10:41:03.598 INFO:tasks.workunit.client.0.smithi060.stdout:3/627: write d0/d1/d52/faf [601687,92122] 0 2024-09-21T10:41:03.601 INFO:tasks.workunit.client.0.smithi060.stdout:5/669: link d5/d45/d6d/d10/d19/d21/d30/d49/f78 d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/fe2 0 2024-09-21T10:41:03.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/593: rename d0/d5/d12/l89 to d0/d83/d6a/d6b/d65/lc2 0 2024-09-21T10:41:03.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/594: chown d0/d59/d9d/cb1 2759 1 2024-09-21T10:41:03.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/595: creat d0/d83/d6a/d6b/d32/d57/d90/fc3 x:0 0 0 2024-09-21T10:41:03.604 INFO:tasks.workunit.client.0.smithi060.stdout:9/536: dwrite d3/d16/f4b [0,4194304] 0 2024-09-21T10:41:03.606 INFO:tasks.workunit.client.0.smithi060.stdout:1/555: mknod d6/d24/da/db/d79/d86/cc6 0 2024-09-21T10:41:03.607 INFO:tasks.workunit.client.0.smithi060.stdout:3/628: mknod d0/d1/d5c/dc4/ccc 0 2024-09-21T10:41:03.615 INFO:tasks.workunit.client.0.smithi060.stdout:2/446: dwrite d3/f12 [0,4194304] 0 2024-09-21T10:41:03.615 INFO:tasks.workunit.client.0.smithi060.stdout:2/447: readlink d3/d20/d15/d3b/l45 0 2024-09-21T10:41:03.616 INFO:tasks.workunit.client.0.smithi060.stdout:1/556: dread d6/d24/f59 [0,4194304] 0 2024-09-21T10:41:03.616 INFO:tasks.workunit.client.0.smithi060.stdout:1/557: fsync d6/d4a/fa8 0 2024-09-21T10:41:03.616 INFO:tasks.workunit.client.0.smithi060.stdout:1/558: stat d6 0 2024-09-21T10:41:03.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/629: read d0/d1/f14 [791938,37452] 0 2024-09-21T10:41:03.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/630: write d0/d1/d11/d2a/d43/f88 [111301,74810] 0 2024-09-21T10:41:03.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/631: chown d0/c50 14 1 2024-09-21T10:41:03.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/632: fdatasync d0/d1/d11/f77 0 2024-09-21T10:41:03.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/633: fdatasync d0/d1/d52/f7c 0 2024-09-21T10:41:03.625 INFO:tasks.workunit.client.0.smithi060.stdout:4/596: mknod d0/d3c/d67/d7d/cc4 0 2024-09-21T10:41:03.629 INFO:tasks.workunit.client.0.smithi060.stdout:2/448: symlink d3/d20/d15/d30/d8b/l91 0 2024-09-21T10:41:03.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/559: symlink d6/d24/da/db/d79/lc7 0 2024-09-21T10:41:03.632 INFO:tasks.workunit.client.0.smithi060.stdout:3/634: mknod d0/d1/ccd 0 2024-09-21T10:41:03.632 INFO:tasks.workunit.client.0.smithi060.stdout:3/635: fsync d0/d1/fbd 0 2024-09-21T10:41:03.633 INFO:tasks.workunit.client.0.smithi060.stdout:4/597: dread d0/df/d88/f47 [0,4194304] 0 2024-09-21T10:41:03.633 INFO:tasks.workunit.client.0.smithi060.stdout:2/449: dread d3/d7/d23/f71 [0,4194304] 0 2024-09-21T10:41:03.637 INFO:tasks.workunit.client.0.smithi060.stdout:1/560: rmdir d6 39 2024-09-21T10:41:03.646 INFO:tasks.workunit.client.0.smithi060.stdout:7/624: rename da/d14/d15 to da/d14/d35/d79/db0/dd7 0 2024-09-21T10:41:03.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/561: creat d6/fc8 x:0 0 0 2024-09-21T10:41:03.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/562: chown d6/d24/da/db/d7e/f9a 11106748 1 2024-09-21T10:41:03.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/563: stat d6/d24/da/db/de/f21 0 2024-09-21T10:41:03.647 INFO:tasks.workunit.client.0.smithi060.stdout:1/564: chown d6/d24/da/l34 188827009 1 2024-09-21T10:41:03.648 INFO:tasks.workunit.client.0.smithi060.stdout:1/565: write d6/d24/f3f [541745,48756] 0 2024-09-21T10:41:03.649 INFO:tasks.workunit.client.0.smithi060.stdout:2/450: getdents d3/d7 0 2024-09-21T10:41:03.652 INFO:tasks.workunit.client.0.smithi060.stdout:8/631: rename d2/f1f to d2/d26/d37/d64/fd2 0 2024-09-21T10:41:03.652 INFO:tasks.workunit.client.0.smithi060.stdout:8/632: dread - d2/d26/d37/d62/d74/d83/d89/d9a/fab zero size 2024-09-21T10:41:03.652 INFO:tasks.workunit.client.0.smithi060.stdout:8/633: fdatasync d2/d26/d37/d62/d74/d83/d89/f92 0 2024-09-21T10:41:03.655 INFO:tasks.workunit.client.0.smithi060.stdout:7/625: symlink da/d14/d35/d79/db0/ld8 0 2024-09-21T10:41:03.658 INFO:tasks.workunit.client.0.smithi060.stdout:3/636: rename d0/d1/d11/d2a/f4d to d0/d1/d1e/d89/fce 0 2024-09-21T10:41:03.658 INFO:tasks.workunit.client.0.smithi060.stdout:3/637: dread - d0/d1/fbd zero size 2024-09-21T10:41:03.658 INFO:tasks.workunit.client.0.smithi060.stdout:3/638: truncate d0/d1/d11/d2a/d85/fc0 940000 0 2024-09-21T10:41:03.659 INFO:tasks.workunit.client.0.smithi060.stdout:3/639: stat d0/l5 0 2024-09-21T10:41:03.659 INFO:tasks.workunit.client.0.smithi060.stdout:8/634: symlink d2/d26/da4/ld3 0 2024-09-21T10:41:03.659 INFO:tasks.workunit.client.0.smithi060.stdout:8/635: dread - d2/d26/d37/d62/fc2 zero size 2024-09-21T10:41:03.666 INFO:tasks.workunit.client.0.smithi060.stdout:4/598: rename d0/d3c/f56 to d0/d5/fc5 0 2024-09-21T10:41:03.666 INFO:tasks.workunit.client.0.smithi060.stdout:4/599: creat d0/d3c/d67/fc6 x:0 0 0 2024-09-21T10:41:03.670 INFO:tasks.workunit.client.0.smithi060.stdout:1/566: dwrite d6/d24/da/db/f5f [0,4194304] 0 2024-09-21T10:41:03.670 INFO:tasks.workunit.client.0.smithi060.stdout:1/567: chown d6/d24/da/d45/l6c 1684 1 2024-09-21T10:41:03.670 INFO:tasks.workunit.client.0.smithi060.stdout:1/568: dread - d6/d24/da/db/f29 zero size 2024-09-21T10:41:03.672 INFO:tasks.workunit.client.0.smithi060.stdout:4/600: symlink d0/lc7 0 2024-09-21T10:41:03.672 INFO:tasks.workunit.client.0.smithi060.stdout:4/601: creat d0/d5/d12/d15/fc8 x:0 0 0 2024-09-21T10:41:03.675 INFO:tasks.workunit.client.0.smithi060.stdout:4/602: symlink d0/d5/d12/d15/lc9 0 2024-09-21T10:41:03.676 INFO:tasks.workunit.client.0.smithi060.stdout:3/640: dwrite d0/d1/d11/d2a/d64/f72 [0,4194304] 0 2024-09-21T10:41:03.677 INFO:tasks.workunit.client.0.smithi060.stdout:4/603: mknod d0/d59/cca 0 2024-09-21T10:41:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:3/641: creat d0/d1/d9e/fcf x:0 0 0 2024-09-21T10:41:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:3/642: truncate d0/d1/d11/d2a/d64/fcb 175634 0 2024-09-21T10:41:03.678 INFO:tasks.workunit.client.0.smithi060.stdout:3/643: stat d0/d1/d11/d46 0 2024-09-21T10:41:03.679 INFO:tasks.workunit.client.0.smithi060.stdout:4/604: truncate d0/d5/d3a/f5d 1774932 0 2024-09-21T10:41:03.679 INFO:tasks.workunit.client.0.smithi060.stdout:4/605: read d0/d5/f1a [4121825,44717] 0 2024-09-21T10:41:03.679 INFO:tasks.workunit.client.0.smithi060.stdout:3/644: mknod d0/d1/d11/d2a/d87/cd0 0 2024-09-21T10:41:03.680 INFO:tasks.workunit.client.0.smithi060.stdout:4/606: symlink d0/d59/lcb 0 2024-09-21T10:41:03.681 INFO:tasks.workunit.client.0.smithi060.stdout:4/607: creat d0/d83/d6a/d6b/d65/d51/fcc x:0 0 0 2024-09-21T10:41:03.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/608: readlink d0/d5/la7 0 2024-09-21T10:41:03.682 INFO:tasks.workunit.client.0.smithi060.stdout:4/609: dread d0/d5/d12/d15/d8f/f98 [0,4194304] 0 2024-09-21T10:41:03.683 INFO:tasks.workunit.client.0.smithi060.stdout:7/626: dwrite da/d14/d25/f2c [0,4194304] 0 2024-09-21T10:41:03.684 INFO:tasks.workunit.client.0.smithi060.stdout:8/636: dwrite d2/fb9 [0,4194304] 0 2024-09-21T10:41:03.684 INFO:tasks.workunit.client.0.smithi060.stdout:8/637: fdatasync d2/d5a/f8b 0 2024-09-21T10:41:03.684 INFO:tasks.workunit.client.0.smithi060.stdout:8/638: fsync d2/d26/d37/d62/d77/f96 0 2024-09-21T10:41:03.684 INFO:tasks.workunit.client.0.smithi060.stdout:8/639: creat d2/d26/d37/d62/d74/d83/d89/fd4 x:0 0 0 2024-09-21T10:41:03.690 INFO:tasks.workunit.client.0.smithi060.stdout:4/610: dread d0/d3c/d67/f68 [0,4194304] 0 2024-09-21T10:41:03.692 INFO:tasks.workunit.client.0.smithi060.stdout:7/627: read da/f73 [1431688,7716] 0 2024-09-21T10:41:03.692 INFO:tasks.workunit.client.0.smithi060.stdout:7/628: dread - da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f94 zero size 2024-09-21T10:41:03.696 INFO:tasks.workunit.client.0.smithi060.stdout:8/640: mkdir d2/d26/d37/d64/d65/dd5 0 2024-09-21T10:41:03.696 INFO:tasks.workunit.client.0.smithi060.stdout:8/641: creat d2/da7/fd6 x:0 0 0 2024-09-21T10:41:03.697 INFO:tasks.workunit.client.0.smithi060.stdout:4/611: creat d0/d5/d3a/dbe/fcd x:0 0 0 2024-09-21T10:41:03.698 INFO:tasks.workunit.client.0.smithi060.stdout:7/629: mknod da/d14/d35/d32/cd9 0 2024-09-21T10:41:03.699 INFO:tasks.workunit.client.0.smithi060.stdout:4/612: mknod d0/d5/d12/d3d/cce 0 2024-09-21T10:41:03.700 INFO:tasks.workunit.client.0.smithi060.stdout:1/569: dwrite d6/d24/da/db/dd/faf [0,4194304] 0 2024-09-21T10:41:03.700 INFO:tasks.workunit.client.0.smithi060.stdout:3/645: dwrite d0/d1/fbd [0,4194304] 0 2024-09-21T10:41:03.701 INFO:tasks.workunit.client.0.smithi060.stdout:7/630: rename da/d14/d35/d79/db0/dd7/cd2 to da/d60/d6e/db1/cda 0 2024-09-21T10:41:03.701 INFO:tasks.workunit.client.0.smithi060.stdout:7/631: write da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f65 [451827,121136] 0 2024-09-21T10:41:03.702 INFO:tasks.workunit.client.0.smithi060.stdout:8/642: dread d2/d26/f38 [0,4194304] 0 2024-09-21T10:41:03.702 INFO:tasks.workunit.client.0.smithi060.stdout:4/613: rmdir d0/d59/da4 0 2024-09-21T10:41:03.706 INFO:tasks.workunit.client.0.smithi060.stdout:3/646: mknod d0/d1/d11/d2a/d43/cd1 0 2024-09-21T10:41:03.708 INFO:tasks.workunit.client.0.smithi060.stdout:1/570: rename d6/d24/da/db/c19 to d6/d24/da/db/dd/cc9 0 2024-09-21T10:41:03.708 INFO:tasks.workunit.client.0.smithi060.stdout:1/571: chown d6/d24/da/d45/d47/lbc 27071810 1 2024-09-21T10:41:03.710 INFO:tasks.workunit.client.0.smithi060.stdout:7/632: unlink da/lb2 0 2024-09-21T10:41:03.710 INFO:tasks.workunit.client.0.smithi060.stdout:7/633: write da/d14/d35/d79/db0/dd7/f13 [145914,42472] 0 2024-09-21T10:41:03.710 INFO:tasks.workunit.client.0.smithi060.stdout:8/643: mkdir d2/d26/da4/dd7 0 2024-09-21T10:41:03.712 INFO:tasks.workunit.client.0.smithi060.stdout:4/614: truncate d0/d83/d6a/d6b/f2f 2302285 0 2024-09-21T10:41:03.712 INFO:tasks.workunit.client.0.smithi060.stdout:3/647: truncate d0/d1/d24/f40 3473141 0 2024-09-21T10:41:03.712 INFO:tasks.workunit.client.0.smithi060.stdout:3/648: read - d0/d1/d11/d53/da2/dc8/fc9 zero size 2024-09-21T10:41:03.713 INFO:tasks.workunit.client.0.smithi060.stdout:1/572: mknod d6/d24/da/db/de/d7c/cca 0 2024-09-21T10:41:03.714 INFO:tasks.workunit.client.0.smithi060.stdout:7/634: truncate da/fc 2458478 0 2024-09-21T10:41:03.716 INFO:tasks.workunit.client.0.smithi060.stdout:8/644: unlink d2/d18/d4b/d61/d6e/fc7 0 2024-09-21T10:41:03.717 INFO:tasks.workunit.client.0.smithi060.stdout:4/615: getdents d0/d83/d6a/d6b/d65 0 2024-09-21T10:41:03.717 INFO:tasks.workunit.client.0.smithi060.stdout:4/616: readlink d0/df/d84/lb4 0 2024-09-21T10:41:03.719 INFO:tasks.workunit.client.0.smithi060.stdout:7/635: getdents da/d14/d25 0 2024-09-21T10:41:03.719 INFO:tasks.workunit.client.0.smithi060.stdout:7/636: fsync da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/fae 0 2024-09-21T10:41:03.719 INFO:tasks.workunit.client.0.smithi060.stdout:3/649: write d0/d1/d11/d46/f31 [1955845,19464] 0 2024-09-21T10:41:03.721 INFO:tasks.workunit.client.0.smithi060.stdout:7/637: truncate da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f4c 94576 0 2024-09-21T10:41:03.723 INFO:tasks.workunit.client.0.smithi060.stdout:7/638: getdents da/d14/d35/d79/db0/dd7/d8b/da7 0 2024-09-21T10:41:03.723 INFO:tasks.workunit.client.0.smithi060.stdout:7/639: read - da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f94 zero size 2024-09-21T10:41:03.723 INFO:tasks.workunit.client.0.smithi060.stdout:7/640: readlink da/d14/l29 0 2024-09-21T10:41:03.723 INFO:tasks.workunit.client.0.smithi060.stdout:7/641: chown da/d14/d35/d32/cd9 70042 1 2024-09-21T10:41:03.723 INFO:tasks.workunit.client.0.smithi060.stdout:7/642: creat da/d14/d25/d56/fdb x:0 0 0 2024-09-21T10:41:03.725 INFO:tasks.workunit.client.0.smithi060.stdout:1/573: write d6/d24/f49 [2069758,45626] 0 2024-09-21T10:41:03.725 INFO:tasks.workunit.client.0.smithi060.stdout:1/574: creat d6/fcb x:0 0 0 2024-09-21T10:41:03.725 INFO:tasks.workunit.client.0.smithi060.stdout:1/575: write d6/d24/da/d45/d76/f84 [266477,3089] 0 2024-09-21T10:41:03.725 INFO:tasks.workunit.client.0.smithi060.stdout:1/576: chown d6/d24/da/db/dd/l83 29 1 2024-09-21T10:41:03.726 INFO:tasks.workunit.client.0.smithi060.stdout:7/643: getdents da/d60 0 2024-09-21T10:41:03.727 INFO:tasks.workunit.client.0.smithi060.stdout:4/617: dread d0/d83/d6a/d6b/d32/d57/f77 [0,4194304] 0 2024-09-21T10:41:03.729 INFO:tasks.workunit.client.0.smithi060.stdout:3/650: dread d0/d1/f20 [0,4194304] 0 2024-09-21T10:41:03.731 INFO:tasks.workunit.client.0.smithi060.stdout:1/577: symlink d6/d24/da/db/d7e/lcc 0 2024-09-21T10:41:03.731 INFO:tasks.workunit.client.0.smithi060.stdout:1/578: fsync d6/d24/da/d45/f6a 0 2024-09-21T10:41:03.731 INFO:tasks.workunit.client.0.smithi060.stdout:3/651: write d0/d1/d11/d2a/f2d [202300,79873] 0 2024-09-21T10:41:03.732 INFO:tasks.workunit.client.0.smithi060.stdout:7/644: rename da/d60/lbe to da/d14/d35/d32/ldc 0 2024-09-21T10:41:03.733 INFO:tasks.workunit.client.0.smithi060.stdout:1/579: mkdir d6/d24/da/db/d79/d86/d9f/dcd 0 2024-09-21T10:41:03.735 INFO:tasks.workunit.client.0.smithi060.stdout:3/652: mknod d0/d1/d11/d53/d98/db8/cd2 0 2024-09-21T10:41:03.736 INFO:tasks.workunit.client.0.smithi060.stdout:7/645: unlink da/d14/d25/fbd 0 2024-09-21T10:41:03.736 INFO:tasks.workunit.client.0.smithi060.stdout:7/646: chown da/d14/d35/d32/c8d 28957474 1 2024-09-21T10:41:03.738 INFO:tasks.workunit.client.0.smithi060.stdout:1/580: dread d6/d24/da/db/d1c/f55 [0,4194304] 0 2024-09-21T10:41:03.738 INFO:tasks.workunit.client.0.smithi060.stdout:3/653: creat d0/d1/d11/fd3 x:0 0 0 2024-09-21T10:41:03.741 INFO:tasks.workunit.client.0.smithi060.stdout:7/647: creat da/d14/d25/fdd x:0 0 0 2024-09-21T10:41:03.742 INFO:tasks.workunit.client.0.smithi060.stdout:1/581: mkdir d6/d24/da/db/d79/d86/d95/dce 0 2024-09-21T10:41:03.744 INFO:tasks.workunit.client.0.smithi060.stdout:7/648: getdents da/d14/d35/d79/db0/dd7/d8b/da7/dcd 0 2024-09-21T10:41:03.745 INFO:tasks.workunit.client.0.smithi060.stdout:1/582: link d6/d24/da/db/de/c22 d6/d24/da/d45/ccf 0 2024-09-21T10:41:03.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/654: write d0/d1/fbd [2176573,62355] 0 2024-09-21T10:41:03.747 INFO:tasks.workunit.client.0.smithi060.stdout:3/655: write d0/d1/d11/d46/fbf [226409,85016] 0 2024-09-21T10:41:03.748 INFO:tasks.workunit.client.0.smithi060.stdout:3/656: chown d0/d1/d52/l7b 108 1 2024-09-21T10:41:03.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/583: mkdir d6/d4a/d5a/db0/dd0 0 2024-09-21T10:41:03.749 INFO:tasks.workunit.client.0.smithi060.stdout:1/584: truncate d6/d24/da/db/de/f8d 1462969 0 2024-09-21T10:41:03.749 INFO:tasks.workunit.client.0.smithi060.stdout:3/657: dread d0/d1/d11/d2a/f63 [0,4194304] 0 2024-09-21T10:41:03.753 INFO:tasks.workunit.client.0.smithi060.stdout:1/585: creat d6/d24/da/d45/d47/fd1 x:0 0 0 2024-09-21T10:41:03.753 INFO:tasks.workunit.client.0.smithi060.stdout:1/586: stat d6/d4a/d5a/f5e 0 2024-09-21T10:41:03.753 INFO:tasks.workunit.client.0.smithi060.stdout:3/658: mkdir d0/d1/d11/d2a/dd4 0 2024-09-21T10:41:03.753 INFO:tasks.workunit.client.0.smithi060.stdout:3/659: chown d0/d1/d11/f32 401805 1 2024-09-21T10:41:03.753 INFO:tasks.workunit.client.0.smithi060.stdout:3/660: write d0/d1/fc7 [924591,62072] 0 2024-09-21T10:41:03.758 INFO:tasks.workunit.client.0.smithi060.stdout:1/587: symlink d6/d24/da/db/d79/d86/d95/ld2 0 2024-09-21T10:41:03.759 INFO:tasks.workunit.client.0.smithi060.stdout:3/661: unlink d0/d1/f8b 0 2024-09-21T10:41:03.760 INFO:tasks.workunit.client.0.smithi060.stdout:3/662: dread - d0/d1/d1e/d34/fc5 zero size 2024-09-21T10:41:03.763 INFO:tasks.workunit.client.0.smithi060.stdout:3/663: link d0/d1/d1e/d34/cae d0/d1/db0/cd5 0 2024-09-21T10:41:03.767 INFO:tasks.workunit.client.0.smithi060.stdout:7/649: dwrite da/d14/d35/d79/db0/fc2 [0,4194304] 0 2024-09-21T10:41:03.775 INFO:tasks.workunit.client.0.smithi060.stdout:7/650: rename da/d14/d35/d32/f68 to da/d60/d6e/dd5/fde 0 2024-09-21T10:41:03.780 INFO:tasks.workunit.client.0.smithi060.stdout:7/651: dread da/d14/d35/d79/db0/dd7/f18 [4194304,4194304] 0 2024-09-21T10:41:03.780 INFO:tasks.workunit.client.0.smithi060.stdout:7/652: write da/f59 [518824,30859] 0 2024-09-21T10:41:03.802 INFO:tasks.workunit.client.0.smithi060.stdout:7/653: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/f2d [4194304,4194304] 0 2024-09-21T10:41:03.803 INFO:tasks.workunit.client.0.smithi060.stdout:7/654: chown da/d14/d35/d79/db0/dd7/d8b/da7 290554 1 2024-09-21T10:41:03.803 INFO:tasks.workunit.client.0.smithi060.stdout:7/655: write da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f94 [909556,124213] 0 2024-09-21T10:41:03.807 INFO:tasks.workunit.client.0.smithi060.stdout:7/656: mknod da/d14/d35/d79/db0/dd7/cdf 0 2024-09-21T10:41:03.811 INFO:tasks.workunit.client.0.smithi060.stdout:7/657: truncate da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/f5f 557032 0 2024-09-21T10:41:03.823 INFO:tasks.workunit.client.0.smithi060.stdout:7/658: write da/fc6 [1105528,15987] 0 2024-09-21T10:41:03.826 INFO:tasks.workunit.client.0.smithi060.stdout:1/588: rmdir d6/d4a/d5a/db0 39 2024-09-21T10:41:03.826 INFO:tasks.workunit.client.0.smithi060.stdout:1/589: chown d6/d24/da/d45/l7d 0 1 2024-09-21T10:41:03.827 INFO:tasks.workunit.client.0.smithi060.stdout:7/659: rmdir da/d60/d6e/dd5 39 2024-09-21T10:41:03.859 INFO:tasks.workunit.client.0.smithi060.stdout:1/590: mkdir d6/dd3 0 2024-09-21T10:41:03.861 INFO:tasks.workunit.client.0.smithi060.stdout:7/660: creat da/d14/d35/d79/db0/dd7/d8b/da7/fe0 x:0 0 0 2024-09-21T10:41:03.863 INFO:tasks.workunit.client.0.smithi060.stdout:1/591: symlink d6/d24/da/db/d7e/d90/ld4 0 2024-09-21T10:41:03.865 INFO:tasks.workunit.client.0.smithi060.stdout:1/592: getdents d6/d24/da/db/de/d32 0 2024-09-21T10:41:03.889 INFO:tasks.workunit.client.0.smithi060.stdout:7/661: dwrite da/d14/d35/d79/db0/fc2 [0,4194304] 0 2024-09-21T10:41:03.889 INFO:tasks.workunit.client.0.smithi060.stdout:1/593: dwrite d6/d4a/d5a/db0/f78 [0,4194304] 0 2024-09-21T10:41:03.889 INFO:tasks.workunit.client.0.smithi060.stdout:1/594: write d6/d24/da/db/d79/d86/fa2 [740129,129422] 0 2024-09-21T10:41:03.891 INFO:tasks.workunit.client.0.smithi060.stdout:7/662: mkdir da/d14/d35/d79/db0/dd7/de1 0 2024-09-21T10:41:03.891 INFO:tasks.workunit.client.0.smithi060.stdout:7/663: chown da/d14/l5a 68 1 2024-09-21T10:41:03.895 INFO:tasks.workunit.client.0.smithi060.stdout:1/595: truncate d6/d24/fc 6131693 0 2024-09-21T10:41:03.895 INFO:tasks.workunit.client.0.smithi060.stdout:1/596: write d6/d24/da/db/f29 [78258,23302] 0 2024-09-21T10:41:03.895 INFO:tasks.workunit.client.0.smithi060.stdout:1/597: stat d6/d24/da/db/d79/d86/cc6 0 2024-09-21T10:41:03.897 INFO:tasks.workunit.client.0.smithi060.stdout:1/598: creat d6/dd3/fd5 x:0 0 0 2024-09-21T10:41:03.897 INFO:tasks.workunit.client.0.smithi060.stdout:1/599: fsync d6/d24/da/db/dd/f1d 0 2024-09-21T10:41:03.900 INFO:tasks.workunit.client.0.smithi060.stdout:1/600: link d6/d24/da/db/dd/l83 d6/d24/da/db/d7e/d90/ld6 0 2024-09-21T10:41:03.901 INFO:tasks.workunit.client.0.smithi060.stdout:1/601: mknod d6/d24/da/db/de/d32/cd7 0 2024-09-21T10:41:03.903 INFO:tasks.workunit.client.0.smithi060.stdout:1/602: mkdir d6/d24/da/db/dc2/dd8 0 2024-09-21T10:41:03.904 INFO:tasks.workunit.client.0.smithi060.stdout:1/603: symlink d6/d24/da/d45/ld9 0 2024-09-21T10:41:03.904 INFO:tasks.workunit.client.0.smithi060.stdout:1/604: dread - d6/fcb zero size 2024-09-21T10:41:03.906 INFO:tasks.workunit.client.0.smithi060.stdout:1/605: rename d6/d24/da/db/dd/f3d to d6/d4a/d5a/fda 0 2024-09-21T10:41:03.906 INFO:tasks.workunit.client.0.smithi060.stdout:7/664: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/f88 [4194304,4194304] 0 2024-09-21T10:41:03.909 INFO:tasks.workunit.client.0.smithi060.stdout:1/606: rename d6/d24/da/fa5 to d6/d24/da/db/d1c/d4b/fdb 0 2024-09-21T10:41:03.910 INFO:tasks.workunit.client.0.smithi060.stdout:1/607: fdatasync d6/d24/da/db/de/f8d 0 2024-09-21T10:41:03.913 INFO:tasks.workunit.client.0.smithi060.stdout:1/608: creat d6/d24/da/db/d1c/fdc x:0 0 0 2024-09-21T10:41:03.915 INFO:tasks.workunit.client.0.smithi060.stdout:0/688: sync 2024-09-21T10:41:03.919 INFO:tasks.workunit.client.0.smithi060.stdout:0/689: unlink l3 0 2024-09-21T10:41:03.927 INFO:tasks.workunit.client.0.smithi060.stdout:7/665: dwrite da/d14/d25/d56/fa6 [0,4194304] 0 2024-09-21T10:41:03.929 INFO:tasks.workunit.client.0.smithi060.stdout:7/666: symlink da/d14/d35/d79/db0/dd7/d8b/da7/dcd/le2 0 2024-09-21T10:41:03.938 INFO:tasks.workunit.client.0.smithi060.stdout:7/667: dread da/d14/d25/d56/f92 [0,4194304] 0 2024-09-21T10:41:03.941 INFO:tasks.workunit.client.0.smithi060.stdout:7/668: truncate da/d60/f97 948372 0 2024-09-21T10:41:03.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:03 smithi060 ceph-mon[28215]: pgmap v18: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 234 MiB/s rd, 276 MiB/s wr, 393 op/s 2024-09-21T10:41:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:03 smithi112 ceph-mon[35117]: pgmap v18: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 234 MiB/s rd, 276 MiB/s wr, 393 op/s 2024-09-21T10:41:03.961 INFO:tasks.workunit.client.0.smithi060.stdout:7/669: dwrite da/d14/f72 [0,4194304] 0 2024-09-21T10:41:03.964 INFO:tasks.workunit.client.0.smithi060.stdout:7/670: rename da/d14/d35/d79/db0/dd7/c41 to da/d14/d25/ce3 0 2024-09-21T10:41:03.966 INFO:tasks.workunit.client.0.smithi060.stdout:7/671: mkdir da/d60/de4 0 2024-09-21T10:41:03.967 INFO:tasks.workunit.client.0.smithi060.stdout:7/672: mknod da/d14/d35/d79/ce5 0 2024-09-21T10:41:03.969 INFO:tasks.workunit.client.0.smithi060.stdout:7/673: symlink da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/le6 0 2024-09-21T10:41:03.971 INFO:tasks.workunit.client.0.smithi060.stdout:7/674: mkdir da/d14/d35/de7 0 2024-09-21T10:41:03.971 INFO:tasks.workunit.client.0.smithi060.stdout:7/675: fsync da/d14/d25/f2c 0 2024-09-21T10:41:03.973 INFO:tasks.workunit.client.0.smithi060.stdout:7/676: mknod da/d14/d35/ce8 0 2024-09-21T10:41:03.984 INFO:tasks.workunit.client.0.smithi060.stdout:7/677: dwrite da/d14/d35/d79/db0/dd7/d8b/fb7 [0,4194304] 0 2024-09-21T10:41:03.984 INFO:tasks.workunit.client.0.smithi060.stdout:7/678: dread - da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f8f zero size 2024-09-21T10:41:03.984 INFO:tasks.workunit.client.0.smithi060.stdout:7/679: write da/f12 [763835,83970] 0 2024-09-21T10:41:03.994 INFO:tasks.workunit.client.0.smithi060.stdout:7/680: dread da/d14/d25/d56/f62 [0,4194304] 0 2024-09-21T10:41:03.996 INFO:tasks.workunit.client.0.smithi060.stdout:7/681: unlink da/d14/d35/d79/db0/dd7/f76 0 2024-09-21T10:41:03.998 INFO:tasks.workunit.client.0.smithi060.stdout:7/682: mkdir da/d60/de4/de9 0 2024-09-21T10:41:04.090 INFO:tasks.workunit.client.0.smithi060.stdout:6/772: sync 2024-09-21T10:41:04.090 INFO:tasks.workunit.client.0.smithi060.stdout:6/773: truncate d3/d12/d38/d9e/dcf/fc1 968600 0 2024-09-21T10:41:04.092 INFO:tasks.workunit.client.0.smithi060.stdout:6/774: rename d3/d12/d16/d25/d27/l33 to d3/d12/d16/d1a/dca/lfa 0 2024-09-21T10:41:04.092 INFO:tasks.workunit.client.0.smithi060.stdout:6/775: stat d3/d12/d16/d1a/d83/da3/fb0 0 2024-09-21T10:41:04.093 INFO:tasks.workunit.client.0.smithi060.stdout:6/776: dread d3/d54/fc6 [0,4194304] 0 2024-09-21T10:41:04.094 INFO:tasks.workunit.client.0.smithi060.stdout:6/777: link d3/dd/l39 d3/d12/d16/d22/d58/d75/lfb 0 2024-09-21T10:41:04.096 INFO:tasks.workunit.client.0.smithi060.stdout:6/778: rmdir d3/d12/d65/d7f/dc7 0 2024-09-21T10:41:04.097 INFO:tasks.workunit.client.0.smithi060.stdout:6/779: symlink d3/d12/d16/d22/d5d/d70/d89/lfc 0 2024-09-21T10:41:04.098 INFO:tasks.workunit.client.0.smithi060.stdout:6/780: truncate d3/d12/d16/d1a/d83/ddd/f46 5699082 0 2024-09-21T10:41:04.098 INFO:tasks.workunit.client.0.smithi060.stdout:6/781: write d3/d12/d16/d1a/d83/ddd/f44 [5140629,96468] 0 2024-09-21T10:41:04.104 INFO:tasks.workunit.client.0.smithi060.stdout:6/782: write d3/d12/d65/fd6 [1055337,107595] 0 2024-09-21T10:41:04.107 INFO:tasks.workunit.client.0.smithi060.stdout:6/783: mknod d3/d12/d16/d1a/d83/da3/cfd 0 2024-09-21T10:41:04.107 INFO:tasks.workunit.client.0.smithi060.stdout:6/784: readlink d3/d12/d16/d22/d5d/d70/d89/lfc 0 2024-09-21T10:41:04.107 INFO:tasks.workunit.client.0.smithi060.stdout:6/785: chown d3/d12/d16/d25/d27/f29 0 1 2024-09-21T10:41:04.110 INFO:tasks.workunit.client.0.smithi060.stdout:6/786: dread d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:41:04.110 INFO:tasks.workunit.client.0.smithi060.stdout:6/787: read d3/d12/d16/d1a/d83/ddd/f4d [601836,37106] 0 2024-09-21T10:41:04.127 INFO:tasks.workunit.client.0.smithi060.stdout:6/788: dwrite d3/d12/d16/d1a/fc0 [0,4194304] 0 2024-09-21T10:41:04.130 INFO:tasks.workunit.client.0.smithi060.stdout:6/789: rmdir d3/d12/d16/d1a/d83/da3 39 2024-09-21T10:41:04.131 INFO:tasks.workunit.client.0.smithi060.stdout:6/790: creat d3/d12/d16/ffe x:0 0 0 2024-09-21T10:41:04.131 INFO:tasks.workunit.client.0.smithi060.stdout:6/791: readlink d3/d12/d16/d22/d5d/d70/d89/daa/laf 0 2024-09-21T10:41:04.146 INFO:tasks.workunit.client.0.smithi060.stdout:6/792: dwrite d3/d12/d65/d66/fa2 [0,4194304] 0 2024-09-21T10:41:04.146 INFO:tasks.workunit.client.0.smithi060.stdout:6/793: dread - d3/d12/d16/d1a/d60/fdc zero size 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/794: mknod d3/d12/d16/d1a/dca/cff 0 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/795: readlink d3/d12/d38/d9e/lb8 0 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/796: fdatasync d3/d12/d16/d25/f3e 0 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/797: fsync d3/d12/d16/d25/d27/f5a 0 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/798: fsync d3/d12/d16/d1a/d83/ddd/f62 0 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/799: chown d3/d12/d38/l6a 100672 1 2024-09-21T10:41:04.149 INFO:tasks.workunit.client.0.smithi060.stdout:6/800: chown d3/d12/d16/d1a/d21/f88 3176410 1 2024-09-21T10:41:04.155 INFO:tasks.workunit.client.0.smithi060.stdout:6/801: dread d3/d12/d16/d25/f28 [0,4194304] 0 2024-09-21T10:41:04.169 INFO:tasks.workunit.client.0.smithi060.stdout:6/802: dwrite d3/d12/d38/f3a [0,4194304] 0 2024-09-21T10:41:04.172 INFO:tasks.workunit.client.0.smithi060.stdout:6/803: creat d3/d12/d16/d1a/d9a/f100 x:0 0 0 2024-09-21T10:41:04.173 INFO:tasks.workunit.client.0.smithi060.stdout:6/804: read d3/d12/d16/d1a/d21/f88 [1770100,12391] 0 2024-09-21T10:41:04.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/805: rename d3/d54/lb7 to d3/dd/l101 0 2024-09-21T10:41:04.175 INFO:tasks.workunit.client.0.smithi060.stdout:6/806: readlink d3/d12/d16/d22/d5d/d70/d89/daa/laf 0 2024-09-21T10:41:04.177 INFO:tasks.workunit.client.0.smithi060.stdout:6/807: creat d3/d12/d16/d22/d58/d75/f102 x:0 0 0 2024-09-21T10:41:04.177 INFO:tasks.workunit.client.0.smithi060.stdout:6/808: rmdir d3/d12/d16/d22/d5d/d70/d89/daa 39 2024-09-21T10:41:04.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/809: rename d3/d12/d16/d25/f3e to d3/d12/d16/d25/d27/f103 0 2024-09-21T10:41:04.195 INFO:tasks.workunit.client.0.smithi060.stdout:6/810: dwrite d3/d12/d38/f9f [0,4194304] 0 2024-09-21T10:41:04.198 INFO:tasks.workunit.client.0.smithi060.stdout:6/811: dread d3/d12/f51 [0,4194304] 0 2024-09-21T10:41:04.198 INFO:tasks.workunit.client.0.smithi060.stdout:5/670: sync 2024-09-21T10:41:04.198 INFO:tasks.workunit.client.0.smithi060.stdout:9/537: sync 2024-09-21T10:41:04.201 INFO:tasks.workunit.client.0.smithi060.stdout:5/671: creat d5/d45/d5a/dbd/fe3 x:0 0 0 2024-09-21T10:41:04.213 INFO:tasks.workunit.client.0.smithi060.stdout:5/672: write d5/d45/d6d/d10/d19/d21/d7f/d89/f8c [385377,25618] 0 2024-09-21T10:41:04.213 INFO:tasks.workunit.client.0.smithi060.stdout:5/673: stat d5/d45/d6d/d10/d19/d21/d30/c38 0 2024-09-21T10:41:04.216 INFO:tasks.workunit.client.0.smithi060.stdout:6/812: dwrite d3/f4b [0,4194304] 0 2024-09-21T10:41:04.216 INFO:tasks.workunit.client.0.smithi060.stdout:6/813: chown d3/d12/d38/d9e/dcf/de4 0 1 2024-09-21T10:41:04.216 INFO:tasks.workunit.client.0.smithi060.stdout:9/538: dwrite d3/f69 [4194304,4194304] 0 2024-09-21T10:41:04.216 INFO:tasks.workunit.client.0.smithi060.stdout:5/674: rmdir d5/d45/d5a 39 2024-09-21T10:41:04.222 INFO:tasks.workunit.client.0.smithi060.stdout:9/539: creat d3/d16/d1f/fb4 x:0 0 0 2024-09-21T10:41:04.225 INFO:tasks.workunit.client.0.smithi060.stdout:6/814: write d3/d12/d16/d25/d27/f29 [1626526,45924] 0 2024-09-21T10:41:04.226 INFO:tasks.workunit.client.0.smithi060.stdout:5/675: read d5/d45/d6d/d10/d19/f33 [3739963,75692] 0 2024-09-21T10:41:04.226 INFO:tasks.workunit.client.0.smithi060.stdout:5/676: fdatasync d5/d45/d6d/d10/d19/d21/d7f/d89/f41 0 2024-09-21T10:41:04.228 INFO:tasks.workunit.client.0.smithi060.stdout:6/815: symlink d3/d12/l104 0 2024-09-21T10:41:04.228 INFO:tasks.workunit.client.0.smithi060.stdout:6/816: write d3/d12/d65/fd6 [409525,98684] 0 2024-09-21T10:41:04.232 INFO:tasks.workunit.client.0.smithi060.stdout:6/817: unlink d3/f26 0 2024-09-21T10:41:04.238 INFO:tasks.workunit.client.0.smithi060.stdout:9/540: dwrite d3/f4f [4194304,4194304] 0 2024-09-21T10:41:04.240 INFO:tasks.workunit.client.0.smithi060.stdout:9/541: rmdir d3/d5e/d60/d2f/d5b 39 2024-09-21T10:41:04.260 INFO:tasks.workunit.client.0.smithi060.stdout:6/818: dwrite d3/d12/d16/d1a/fc0 [0,4194304] 0 2024-09-21T10:41:04.260 INFO:tasks.workunit.client.0.smithi060.stdout:9/542: dwrite d3/f10 [0,4194304] 0 2024-09-21T10:41:04.261 INFO:tasks.workunit.client.0.smithi060.stdout:6/819: symlink d3/d12/d16/d22/dd2/l105 0 2024-09-21T10:41:04.264 INFO:tasks.workunit.client.0.smithi060.stdout:9/543: rename d3/d15/f22 to d3/da4/fb5 0 2024-09-21T10:41:04.266 INFO:tasks.workunit.client.0.smithi060.stdout:9/544: unlink d3/d16/d95/laa 0 2024-09-21T10:41:04.266 INFO:tasks.workunit.client.0.smithi060.stdout:9/545: write d3/d16/d1f/fb4 [748261,28663] 0 2024-09-21T10:41:04.267 INFO:tasks.workunit.client.0.smithi060.stdout:9/546: creat d3/d16/fb6 x:0 0 0 2024-09-21T10:41:04.268 INFO:tasks.workunit.client.0.smithi060.stdout:9/547: creat d3/fb7 x:0 0 0 2024-09-21T10:41:04.268 INFO:tasks.workunit.client.0.smithi060.stdout:9/548: write d3/d15/d92/fa8 [836989,81595] 0 2024-09-21T10:41:04.285 INFO:tasks.workunit.client.0.smithi060.stdout:9/549: dwrite d3/d15/f17 [0,4194304] 0 2024-09-21T10:41:04.285 INFO:tasks.workunit.client.0.smithi060.stdout:6/820: dwrite d3/d54/da8/fd8 [0,4194304] 0 2024-09-21T10:41:04.285 INFO:tasks.workunit.client.0.smithi060.stdout:6/821: write d3/dd/f14 [4670532,99714] 0 2024-09-21T10:41:04.286 INFO:tasks.workunit.client.0.smithi060.stdout:9/550: mkdir d3/d5e/db8 0 2024-09-21T10:41:04.286 INFO:tasks.workunit.client.0.smithi060.stdout:9/551: creat d3/d16/fb9 x:0 0 0 2024-09-21T10:41:04.293 INFO:tasks.workunit.client.0.smithi060.stdout:6/822: write d3/d12/d16/d1a/f4f [2815729,95823] 0 2024-09-21T10:41:04.293 INFO:tasks.workunit.client.0.smithi060.stdout:6/823: truncate d3/d54/fc6 1795868 0 2024-09-21T10:41:04.318 INFO:tasks.workunit.client.0.smithi060.stdout:9/552: dwrite d3/d16/f44 [0,4194304] 0 2024-09-21T10:41:04.318 INFO:tasks.workunit.client.0.smithi060.stdout:6/824: dwrite d3/d12/d16/f18 [0,4194304] 0 2024-09-21T10:41:04.332 INFO:tasks.workunit.client.0.smithi060.stdout:9/553: rmdir d3 39 2024-09-21T10:41:04.334 INFO:tasks.workunit.client.0.smithi060.stdout:6/825: link d3/d12/d16/d22/d5d/d70/d89/lfc d3/d12/d16/d5b/l106 0 2024-09-21T10:41:04.335 INFO:tasks.workunit.client.0.smithi060.stdout:9/554: creat d3/d16/d7f/fba x:0 0 0 2024-09-21T10:41:04.335 INFO:tasks.workunit.client.0.smithi060.stdout:9/555: fdatasync d3/d5e/d60/f91 0 2024-09-21T10:41:04.335 INFO:tasks.workunit.client.0.smithi060.stdout:9/556: write d3/d15/f93 [919986,36752] 0 2024-09-21T10:41:04.342 INFO:tasks.workunit.client.0.smithi060.stdout:9/557: write d3/d15/d58/f9b [1472825,6018] 0 2024-09-21T10:41:04.342 INFO:tasks.workunit.client.0.smithi060.stdout:9/558: dread - d3/d15/d78/f7d zero size 2024-09-21T10:41:04.343 INFO:tasks.workunit.client.0.smithi060.stdout:6/826: rename d3/c11 to d3/d12/d16/d22/dd2/df6/c107 0 2024-09-21T10:41:04.343 INFO:tasks.workunit.client.0.smithi060.stdout:6/827: dread - d3/d12/d16/ffe zero size 2024-09-21T10:41:04.343 INFO:tasks.workunit.client.0.smithi060.stdout:6/828: chown d3/dd/le3 349 1 2024-09-21T10:41:04.343 INFO:tasks.workunit.client.0.smithi060.stdout:6/829: stat d3/l8 0 2024-09-21T10:41:04.343 INFO:tasks.workunit.client.0.smithi060.stdout:6/830: chown d3/dd/le3 255947206 1 2024-09-21T10:41:04.346 INFO:tasks.workunit.client.0.smithi060.stdout:9/559: creat d3/d16/d5f/fbb x:0 0 0 2024-09-21T10:41:04.347 INFO:tasks.workunit.client.0.smithi060.stdout:6/831: creat d3/d54/da8/f108 x:0 0 0 2024-09-21T10:41:04.347 INFO:tasks.workunit.client.0.smithi060.stdout:6/832: chown d3/d12/d16/d1a/la7 1858700942 1 2024-09-21T10:41:04.357 INFO:tasks.workunit.client.0.smithi060.stdout:9/560: dread d3/d16/f44 [0,4194304] 0 2024-09-21T10:41:04.358 INFO:tasks.workunit.client.0.smithi060.stdout:6/833: write d3/d12/d16/def/ff9 [3566952,93554] 0 2024-09-21T10:41:04.358 INFO:tasks.workunit.client.0.smithi060.stdout:6/834: fdatasync d3/f4b 0 2024-09-21T10:41:04.360 INFO:tasks.workunit.client.0.smithi060.stdout:6/835: creat d3/d12/d16/d25/d27/f109 x:0 0 0 2024-09-21T10:41:04.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/836: readlink d3/d12/d16/d22/l35 0 2024-09-21T10:41:04.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/837: write d3/d54/ff0 [954516,129038] 0 2024-09-21T10:41:04.361 INFO:tasks.workunit.client.0.smithi060.stdout:9/561: dread d3/d16/d1a/f26 [0,4194304] 0 2024-09-21T10:41:04.362 INFO:tasks.workunit.client.0.smithi060.stdout:6/838: creat d3/d12/d16/d1a/f10a x:0 0 0 2024-09-21T10:41:04.362 INFO:tasks.workunit.client.0.smithi060.stdout:9/562: link d3/d16/d9c/ca6 d3/d5e/cbc 0 2024-09-21T10:41:04.371 INFO:tasks.workunit.client.0.smithi060.stdout:9/563: dread d3/d16/d42/f9f [0,4194304] 0 2024-09-21T10:41:04.373 INFO:tasks.workunit.client.0.smithi060.stdout:9/564: creat d3/d5e/fbd x:0 0 0 2024-09-21T10:41:04.379 INFO:tasks.workunit.client.0.smithi060.stdout:6/839: dwrite d3/d12/d16/f18 [8388608,4194304] 0 2024-09-21T10:41:04.380 INFO:tasks.workunit.client.0.smithi060.stdout:6/840: readlink d3/d12/d65/d66/l95 0 2024-09-21T10:41:04.384 INFO:tasks.workunit.client.0.smithi060.stdout:9/565: write d3/d16/d1a/f1d [851997,112081] 0 2024-09-21T10:41:04.388 INFO:tasks.workunit.client.0.smithi060.stdout:9/566: truncate d3/d16/d1a/fa0 2627650 0 2024-09-21T10:41:04.389 INFO:tasks.workunit.client.0.smithi060.stdout:9/567: readlink d3/l7a 0 2024-09-21T10:41:04.389 INFO:tasks.workunit.client.0.smithi060.stdout:9/568: creat d3/d16/d5f/fbe x:0 0 0 2024-09-21T10:41:04.390 INFO:tasks.workunit.client.0.smithi060.stdout:9/569: mknod d3/d15/d92/cbf 0 2024-09-21T10:41:04.390 INFO:tasks.workunit.client.0.smithi060.stdout:9/570: dread - d3/d5e/d60/f91 zero size 2024-09-21T10:41:04.392 INFO:tasks.workunit.client.0.smithi060.stdout:9/571: creat d3/d15/d5a/d64/d9e/fc0 x:0 0 0 2024-09-21T10:41:04.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/572: mknod d3/d5e/cc1 0 2024-09-21T10:41:04.397 INFO:tasks.workunit.client.0.smithi060.stdout:9/573: rename d3/l19 to d3/d15/d78/lc2 0 2024-09-21T10:41:04.406 INFO:tasks.workunit.client.0.smithi060.stdout:9/574: write d3/d5e/d60/f39 [2679503,5395] 0 2024-09-21T10:41:04.409 INFO:tasks.workunit.client.0.smithi060.stdout:9/575: symlink d3/d16/d42/d7e/d85/lc3 0 2024-09-21T10:41:04.409 INFO:tasks.workunit.client.0.smithi060.stdout:9/576: chown d3/d15/d5a/d64/f99 2409289 1 2024-09-21T10:41:04.409 INFO:tasks.workunit.client.0.smithi060.stdout:9/577: stat d3/d5e/d60/d2f/d5b 0 2024-09-21T10:41:04.410 INFO:tasks.workunit.client.0.smithi060.stdout:9/578: mknod d3/d16/d42/d7e/d85/cc4 0 2024-09-21T10:41:04.410 INFO:tasks.workunit.client.0.smithi060.stdout:9/579: write d3/d5e/d60/f91 [837159,18901] 0 2024-09-21T10:41:04.412 INFO:tasks.workunit.client.0.smithi060.stdout:9/580: creat d3/d16/d1a/fc5 x:0 0 0 2024-09-21T10:41:04.419 INFO:tasks.workunit.client.0.smithi060.stdout:9/581: getdents d3/d16/d1a 0 2024-09-21T10:41:04.419 INFO:tasks.workunit.client.0.smithi060.stdout:9/582: truncate d3/d15/d5a/f67 5006829 0 2024-09-21T10:41:04.437 INFO:tasks.workunit.client.0.smithi060.stdout:9/583: dwrite d3/d5e/d60/f39 [4194304,4194304] 0 2024-09-21T10:41:04.437 INFO:tasks.workunit.client.0.smithi060.stdout:9/584: truncate d3/d15/d5a/d64/fae 865472 0 2024-09-21T10:41:04.667 INFO:tasks.workunit.client.0.smithi060.stdout:2/451: sync 2024-09-21T10:41:04.667 INFO:tasks.workunit.client.0.smithi060.stdout:8/645: sync 2024-09-21T10:41:04.667 INFO:tasks.workunit.client.0.smithi060.stdout:3/664: sync 2024-09-21T10:41:04.667 INFO:tasks.workunit.client.0.smithi060.stdout:4/618: sync 2024-09-21T10:41:04.667 INFO:tasks.workunit.client.0.smithi060.stdout:4/619: write d0/df/d84/faf [78534,13152] 0 2024-09-21T10:41:04.669 INFO:tasks.workunit.client.0.smithi060.stdout:8/646: rename d2/d26/d37/d62/d77/f79 to d2/d26/d37/d62/d74/d83/da2/fd8 0 2024-09-21T10:41:04.670 INFO:tasks.workunit.client.0.smithi060.stdout:3/665: mknod d0/d1/d52/cd6 0 2024-09-21T10:41:04.670 INFO:tasks.workunit.client.0.smithi060.stdout:3/666: write d0/f21 [3047292,62667] 0 2024-09-21T10:41:04.670 INFO:tasks.workunit.client.0.smithi060.stdout:3/667: stat d0/d1/d1e/d34 0 2024-09-21T10:41:04.673 INFO:tasks.workunit.client.0.smithi060.stdout:4/620: mknod d0/ccf 0 2024-09-21T10:41:04.674 INFO:tasks.workunit.client.0.smithi060.stdout:3/668: symlink d0/d1/ld7 0 2024-09-21T10:41:04.674 INFO:tasks.workunit.client.0.smithi060.stdout:3/669: read d0/d1/d11/d2a/f5d [713701,29750] 0 2024-09-21T10:41:04.677 INFO:tasks.workunit.client.0.smithi060.stdout:4/621: mknod d0/d3c/d67/d7d/cd0 0 2024-09-21T10:41:04.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/647: read d2/d26/d37/d62/d74/d83/da2/fd8 [1260192,36871] 0 2024-09-21T10:41:04.685 INFO:tasks.workunit.client.0.smithi060.stdout:4/622: dread d0/d5/f4b [0,4194304] 0 2024-09-21T10:41:04.685 INFO:tasks.workunit.client.0.smithi060.stdout:4/623: chown d0/d83/d6a/d6b/d32/d57/f77 2962 1 2024-09-21T10:41:04.685 INFO:tasks.workunit.client.0.smithi060.stdout:4/624: write d0/d83/d6a/d6b/d32/d57/fbc [546291,37646] 0 2024-09-21T10:41:04.685 INFO:tasks.workunit.client.0.smithi060.stdout:4/625: creat d0/d83/fd1 x:0 0 0 2024-09-21T10:41:04.685 INFO:tasks.workunit.client.0.smithi060.stdout:4/626: chown d0/d3c/d67/d7d/d87/f8d 54927 1 2024-09-21T10:41:04.686 INFO:tasks.workunit.client.0.smithi060.stdout:8/648: dread d2/fb9 [0,4194304] 0 2024-09-21T10:41:04.686 INFO:tasks.workunit.client.0.smithi060.stdout:4/627: truncate d0/d3c/f81 449791 0 2024-09-21T10:41:04.686 INFO:tasks.workunit.client.0.smithi060.stdout:4/628: dread - d0/d83/d6a/d6b/d32/d57/d90/fac zero size 2024-09-21T10:41:04.686 INFO:tasks.workunit.client.0.smithi060.stdout:4/629: creat d0/d5/d12/fd2 x:0 0 0 2024-09-21T10:41:04.688 INFO:tasks.workunit.client.0.smithi060.stdout:8/649: rename d2/f5d to d2/d26/d37/d62/d74/d83/d89/fd9 0 2024-09-21T10:41:04.689 INFO:tasks.workunit.client.0.smithi060.stdout:3/670: dwrite d0/d1/d11/d2a/d45/f91 [4194304,4194304] 0 2024-09-21T10:41:04.690 INFO:tasks.workunit.client.0.smithi060.stdout:3/671: write d0/d1/d11/d2a/d64/fcb [273923,117252] 0 2024-09-21T10:41:04.691 INFO:tasks.workunit.client.0.smithi060.stdout:4/630: symlink d0/d5/d12/d3d/ld3 0 2024-09-21T10:41:04.691 INFO:tasks.workunit.client.0.smithi060.stdout:4/631: stat d0/d3c/d67/d7d 0 2024-09-21T10:41:04.691 INFO:tasks.workunit.client.0.smithi060.stdout:8/650: unlink d2/d18/c4c 0 2024-09-21T10:41:04.694 INFO:tasks.workunit.client.0.smithi060.stdout:4/632: rename d0/d5/d12/d3d/l52 to d0/d83/d6a/d6b/d65/ld4 0 2024-09-21T10:41:04.710 INFO:tasks.workunit.client.0.smithi060.stdout:3/672: dwrite d0/d1/d11/f47 [4194304,4194304] 0 2024-09-21T10:41:04.710 INFO:tasks.workunit.client.0.smithi060.stdout:3/673: write d0/d1/d11/d2a/d87/fb1 [814469,37429] 0 2024-09-21T10:41:04.721 INFO:tasks.workunit.client.0.smithi060.stdout:3/674: write d0/d1/d11/d2a/d45/f91 [2590789,1618] 0 2024-09-21T10:41:04.723 INFO:tasks.workunit.client.0.smithi060.stdout:3/675: mknod d0/d1/d11/d53/d98/db8/cd8 0 2024-09-21T10:41:04.724 INFO:tasks.workunit.client.0.smithi060.stdout:3/676: mknod d0/d1/d11/d2a/dd4/cd9 0 2024-09-21T10:41:04.724 INFO:tasks.workunit.client.0.smithi060.stdout:3/677: readlink d0/d1/d1e/d89/lb5 0 2024-09-21T10:41:04.725 INFO:tasks.workunit.client.0.smithi060.stdout:8/651: dwrite d2/f15 [0,4194304] 0 2024-09-21T10:41:04.726 INFO:tasks.workunit.client.0.smithi060.stdout:3/678: creat d0/d1/d5c/dc4/fda x:0 0 0 2024-09-21T10:41:04.727 INFO:tasks.workunit.client.0.smithi060.stdout:4/633: dwrite d0/d5/d12/d15/d8f/f2d [0,4194304] 0 2024-09-21T10:41:04.730 INFO:tasks.workunit.client.0.smithi060.stdout:8/652: creat d2/d18/d4b/fda x:0 0 0 2024-09-21T10:41:04.733 INFO:tasks.workunit.client.0.smithi060.stdout:3/679: mkdir d0/d1/d11/d2a/d93/ddb 0 2024-09-21T10:41:04.735 INFO:tasks.workunit.client.0.smithi060.stdout:4/634: write d0/d5/f66 [468719,122148] 0 2024-09-21T10:41:04.740 INFO:tasks.workunit.client.0.smithi060.stdout:8/653: chown d2/c3c 1587 1 2024-09-21T10:41:04.746 INFO:tasks.workunit.client.0.smithi060.stdout:4/635: getdents d0/df/d9c 0 2024-09-21T10:41:04.748 INFO:tasks.workunit.client.0.smithi060.stdout:3/680: write d0/d1/d5c/fa0 [691943,26210] 0 2024-09-21T10:41:04.755 INFO:tasks.workunit.client.0.smithi060.stdout:4/636: rename d0/d5/d12/d15/d8f to d0/d5/d12/d3d/dd5 0 2024-09-21T10:41:04.755 INFO:tasks.workunit.client.0.smithi060.stdout:8/654: dwrite d2/d18/d4b/d61/d6e/f85 [0,4194304] 0 2024-09-21T10:41:04.757 INFO:tasks.workunit.client.0.smithi060.stdout:4/637: mkdir d0/d83/d6a/d6b/d32/dd6 0 2024-09-21T10:41:04.760 INFO:tasks.workunit.client.0.smithi060.stdout:4/638: creat d0/d83/d6a/d6b/d65/fd7 x:0 0 0 2024-09-21T10:41:04.760 INFO:tasks.workunit.client.0.smithi060.stdout:4/639: write d0/df/d84/faf [714505,115755] 0 2024-09-21T10:41:04.761 INFO:tasks.workunit.client.0.smithi060.stdout:8/655: rmdir d2/da7 39 2024-09-21T10:41:04.763 INFO:tasks.workunit.client.0.smithi060.stdout:4/640: mkdir d0/d8b/dd8 0 2024-09-21T10:41:04.765 INFO:tasks.workunit.client.0.smithi060.stdout:8/656: getdents d2/d26/d37/d64 0 2024-09-21T10:41:04.769 INFO:tasks.workunit.client.0.smithi060.stdout:8/657: symlink d2/ldb 0 2024-09-21T10:41:04.772 INFO:tasks.workunit.client.0.smithi060.stdout:8/658: link d2/d26/f29 d2/d26/da4/daa/fdc 0 2024-09-21T10:41:04.773 INFO:tasks.workunit.client.0.smithi060.stdout:8/659: truncate d2/d18/d4b/fda 144268 0 2024-09-21T10:41:04.775 INFO:tasks.workunit.client.0.smithi060.stdout:3/681: dwrite d0/f1c [0,4194304] 0 2024-09-21T10:41:04.777 INFO:tasks.workunit.client.0.smithi060.stdout:4/641: dread d0/d5/f1a [4194304,4194304] 0 2024-09-21T10:41:04.779 INFO:tasks.workunit.client.0.smithi060.stdout:3/682: mknod d0/d1/d11/d53/d98/db8/cdc 0 2024-09-21T10:41:04.779 INFO:tasks.workunit.client.0.smithi060.stdout:3/683: fsync d0/d1/d24/f5f 0 2024-09-21T10:41:04.779 INFO:tasks.workunit.client.0.smithi060.stdout:3/684: fsync d0/d1/d24/f40 0 2024-09-21T10:41:04.780 INFO:tasks.workunit.client.0.smithi060.stdout:4/642: dread d0/d83/d6a/d6b/d32/f75 [0,4194304] 0 2024-09-21T10:41:04.785 INFO:tasks.workunit.client.0.smithi060.stdout:4/643: mknod d0/df/cd9 0 2024-09-21T10:41:04.785 INFO:tasks.workunit.client.0.smithi060.stdout:4/644: truncate d0/d83/d6a/d6b/d32/d57/fbc 967596 0 2024-09-21T10:41:04.788 INFO:tasks.workunit.client.0.smithi060.stdout:4/645: mkdir d0/d83/dda 0 2024-09-21T10:41:04.788 INFO:tasks.workunit.client.0.smithi060.stdout:4/646: truncate d0/d3c/fb7 796 0 2024-09-21T10:41:04.789 INFO:tasks.workunit.client.0.smithi060.stdout:8/660: write d2/d26/d37/d62/d74/d83/d89/fd9 [4164190,29015] 0 2024-09-21T10:41:04.819 INFO:tasks.workunit.client.0.smithi060.stdout:4/647: dwrite d0/d5/d12/d3d/dd5/f2d [0,4194304] 0 2024-09-21T10:41:04.820 INFO:tasks.workunit.client.0.smithi060.stdout:4/648: fsync d0/d5/f71 0 2024-09-21T10:41:04.821 INFO:tasks.workunit.client.0.smithi060.stdout:8/661: dwrite d2/d26/d37/d64/d65/f81 [0,4194304] 0 2024-09-21T10:41:04.831 INFO:tasks.workunit.client.0.smithi060.stdout:8/662: write d2/d26/d37/d62/d74/d83/d89/f92 [3822425,6480] 0 2024-09-21T10:41:04.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/663: symlink d2/da7/ldd 0 2024-09-21T10:41:04.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/664: write d2/d18/f36 [4298190,27250] 0 2024-09-21T10:41:04.837 INFO:tasks.workunit.client.0.smithi060.stdout:4/649: dwrite d0/f41 [0,4194304] 0 2024-09-21T10:41:04.839 INFO:tasks.workunit.client.0.smithi060.stdout:8/665: rename d2/d5a/fb7 to d2/d26/d37/d64/d65/fde 0 2024-09-21T10:41:04.839 INFO:tasks.workunit.client.0.smithi060.stdout:8/666: write d2/d26/d37/d62/d74/d83/dac/fcc [118071,37695] 0 2024-09-21T10:41:04.843 INFO:tasks.workunit.client.0.smithi060.stdout:8/667: symlink d2/d26/d37/d62/d74/d83/da2/ldf 0 2024-09-21T10:41:04.844 INFO:tasks.workunit.client.0.smithi060.stdout:1/609: sync 2024-09-21T10:41:04.844 INFO:tasks.workunit.client.0.smithi060.stdout:1/610: stat d6/d24/f49 0 2024-09-21T10:41:04.844 INFO:tasks.workunit.client.0.smithi060.stdout:1/611: read - d6/d24/da/db/d1c/fdc zero size 2024-09-21T10:41:04.846 INFO:tasks.workunit.client.0.smithi060.stdout:8/668: mknod d2/da7/ce0 0 2024-09-21T10:41:04.849 INFO:tasks.workunit.client.0.smithi060.stdout:8/669: write d2/d26/fb0 [420215,30628] 0 2024-09-21T10:41:04.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/612: link d6/d24/da/l34 d6/d4a/d5a/db0/dd0/ldd 0 2024-09-21T10:41:04.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/613: write d6/d24/da/db/f29 [687884,52978] 0 2024-09-21T10:41:04.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/614: chown d6/d24/da/db/d79/dad/dbb 58 1 2024-09-21T10:41:04.849 INFO:tasks.workunit.client.0.smithi060.stdout:1/615: creat d6/d24/da/db/de/fde x:0 0 0 2024-09-21T10:41:04.852 INFO:tasks.workunit.client.0.smithi060.stdout:8/670: chown d2/c1b 198839 1 2024-09-21T10:41:04.854 INFO:tasks.workunit.client.0.smithi060.stdout:1/616: mknod d6/d4a/d5a/db0/cdf 0 2024-09-21T10:41:04.856 INFO:tasks.workunit.client.0.smithi060.stdout:4/650: dwrite d0/d83/d6a/d6b/d65/d51/f99 [0,4194304] 0 2024-09-21T10:41:04.856 INFO:tasks.workunit.client.0.smithi060.stdout:4/651: fsync d0/d3c/f91 0 2024-09-21T10:41:04.857 INFO:tasks.workunit.client.0.smithi060.stdout:4/652: truncate d0/d5/d12/d3d/dd5/fba 896852 0 2024-09-21T10:41:04.858 INFO:tasks.workunit.client.0.smithi060.stdout:8/671: mknod d2/d18/d4b/dbe/ce1 0 2024-09-21T10:41:04.863 INFO:tasks.workunit.client.0.smithi060.stdout:1/617: read d6/d24/da/db/d1c/f4c [1208759,38252] 0 2024-09-21T10:41:04.869 INFO:tasks.workunit.client.0.smithi060.stdout:4/653: symlink d0/d5/d12/d3d/d94/ldb 0 2024-09-21T10:41:04.872 INFO:tasks.workunit.client.0.smithi060.stdout:4/654: symlink d0/d5/ldc 0 2024-09-21T10:41:04.885 INFO:tasks.workunit.client.0.smithi060.stdout:4/655: write d0/d5/f36 [2322616,17145] 0 2024-09-21T10:41:04.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/672: dwrite d2/d26/d37/d62/d74/d83/dac/fc4 [0,4194304] 0 2024-09-21T10:41:04.889 INFO:tasks.workunit.client.0.smithi060.stdout:8/673: chown d2/d26/d37/cb3 28832 1 2024-09-21T10:41:04.890 INFO:tasks.workunit.client.0.smithi060.stdout:1/618: dwrite d6/d24/da/db/d79/d86/fb7 [0,4194304] 0 2024-09-21T10:41:04.890 INFO:tasks.workunit.client.0.smithi060.stdout:1/619: write d6/d24/da/db/d1c/d4b/f72 [162098,90179] 0 2024-09-21T10:41:04.894 INFO:tasks.workunit.client.0.smithi060.stdout:1/620: rename d6/d24/da/db/cbe to d6/d24/da/db/dc2/dd8/ce0 0 2024-09-21T10:41:04.894 INFO:tasks.workunit.client.0.smithi060.stdout:1/621: read d6/f89 [867324,67655] 0 2024-09-21T10:41:04.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:04 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:04.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:04 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:04.988 INFO:tasks.workunit.client.0.smithi060.stdout:8/674: dread d2/fe [0,4194304] 0 2024-09-21T10:41:04.989 INFO:tasks.workunit.client.0.smithi060.stdout:8/675: symlink d2/d26/d37/d62/d74/d83/da2/le2 0 2024-09-21T10:41:04.990 INFO:tasks.workunit.client.0.smithi060.stdout:8/676: fsync d2/d26/fb0 0 2024-09-21T10:41:04.990 INFO:tasks.workunit.client.0.smithi060.stdout:8/677: creat d2/d26/d37/d62/d74/d83/da2/fe3 x:0 0 0 2024-09-21T10:41:04.992 INFO:tasks.workunit.client.0.smithi060.stdout:1/622: write d6/d24/da/db/dd/f1d [2704979,39450] 0 2024-09-21T10:41:04.999 INFO:tasks.workunit.client.0.smithi060.stdout:8/678: write d2/d18/f5c [1008733,90305] 0 2024-09-21T10:41:04.999 INFO:tasks.workunit.client.0.smithi060.stdout:8/679: truncate d2/d26/d37/d62/d74/d83/d89/fd4 376544 0 2024-09-21T10:41:04.999 INFO:tasks.workunit.client.0.smithi060.stdout:8/680: read - d2/d18/fbd zero size 2024-09-21T10:41:05.002 INFO:tasks.workunit.client.0.smithi060.stdout:8/681: getdents d2/d5a 0 2024-09-21T10:41:05.002 INFO:tasks.workunit.client.0.smithi060.stdout:1/623: dread d6/d24/da/db/f85 [0,4194304] 0 2024-09-21T10:41:05.002 INFO:tasks.workunit.client.0.smithi060.stdout:8/682: write d2/d5a/fcf [779327,41625] 0 2024-09-21T10:41:05.005 INFO:tasks.workunit.client.0.smithi060.stdout:1/624: unlink d6/d24/da/db/de/fde 0 2024-09-21T10:41:05.005 INFO:tasks.workunit.client.0.smithi060.stdout:1/625: read d6/d24/da/db/dd/f1d [1768626,39715] 0 2024-09-21T10:41:05.019 INFO:tasks.workunit.client.0.smithi060.stdout:8/683: dwrite d2/d26/d37/d62/d74/d83/da2/f7e [0,4194304] 0 2024-09-21T10:41:05.019 INFO:tasks.workunit.client.0.smithi060.stdout:1/626: dwrite d6/d24/da/db/d79/d86/fb7 [4194304,4194304] 0 2024-09-21T10:41:05.023 INFO:tasks.workunit.client.0.smithi060.stdout:1/627: dread d6/d24/da/db/f29 [0,4194304] 0 2024-09-21T10:41:05.041 INFO:tasks.workunit.client.0.smithi060.stdout:1/628: dwrite d6/d24/f3f [0,4194304] 0 2024-09-21T10:41:05.041 INFO:tasks.workunit.client.0.smithi060.stdout:1/629: truncate d6/d4a/d5a/db0/d97/fb9 798612 0 2024-09-21T10:41:05.055 INFO:tasks.workunit.client.0.smithi060.stdout:1/630: dwrite d6/d24/da/db/f56 [0,4194304] 0 2024-09-21T10:41:05.055 INFO:tasks.workunit.client.0.smithi060.stdout:1/631: chown d6/d24/da/d45/l6e 113814 1 2024-09-21T10:41:05.058 INFO:tasks.workunit.client.0.smithi060.stdout:0/690: sync 2024-09-21T10:41:05.058 INFO:tasks.workunit.client.0.smithi060.stdout:5/677: sync 2024-09-21T10:41:05.058 INFO:tasks.workunit.client.0.smithi060.stdout:9/585: sync 2024-09-21T10:41:05.058 INFO:tasks.workunit.client.0.smithi060.stdout:6/841: sync 2024-09-21T10:41:05.058 INFO:tasks.workunit.client.0.smithi060.stdout:7/683: sync 2024-09-21T10:41:05.059 INFO:tasks.workunit.client.0.smithi060.stdout:5/678: dread - d5/d45/d5a/d3a/fde zero size 2024-09-21T10:41:05.059 INFO:tasks.workunit.client.0.smithi060.stdout:0/691: write d5/d10/da/d4b/fd4 [963021,8366] 0 2024-09-21T10:41:05.059 INFO:tasks.workunit.client.0.smithi060.stdout:0/692: dread - d5/d10/da/d4b/da4/d40/d75/dae/fd2 zero size 2024-09-21T10:41:05.059 INFO:tasks.workunit.client.0.smithi060.stdout:0/693: chown d5/d10/da/f81 4 1 2024-09-21T10:41:05.062 INFO:tasks.workunit.client.0.smithi060.stdout:9/586: link d3/d5e/f6c d3/d5e/d60/d2f/d5b/fc6 0 2024-09-21T10:41:05.064 INFO:tasks.workunit.client.0.smithi060.stdout:5/679: mkdir d5/d45/d6d/ddf/de4 0 2024-09-21T10:41:05.064 INFO:tasks.workunit.client.0.smithi060.stdout:0/694: getdents d5/d10/da/d4b/da4/d40/d48/d63/d96 0 2024-09-21T10:41:05.067 INFO:tasks.workunit.client.0.smithi060.stdout:0/695: getdents d5/d10/da/d4b/da4/d40/d48/dab/d79 0 2024-09-21T10:41:05.067 INFO:tasks.workunit.client.0.smithi060.stdout:9/587: dread d3/d15/d5a/d64/f99 [0,4194304] 0 2024-09-21T10:41:05.067 INFO:tasks.workunit.client.0.smithi060.stdout:5/680: write d5/d71/fce [112552,24632] 0 2024-09-21T10:41:05.068 INFO:tasks.workunit.client.0.smithi060.stdout:6/842: dread d3/d12/d16/d1a/d83/ddd/f46 [0,4194304] 0 2024-09-21T10:41:05.069 INFO:tasks.workunit.client.0.smithi060.stdout:9/588: dread d3/d5e/d60/d2f/f62 [0,4194304] 0 2024-09-21T10:41:05.069 INFO:tasks.workunit.client.0.smithi060.stdout:1/632: dwrite d6/d24/da/f1f [0,4194304] 0 2024-09-21T10:41:05.069 INFO:tasks.workunit.client.0.smithi060.stdout:1/633: fdatasync d6/d24/f49 0 2024-09-21T10:41:05.069 INFO:tasks.workunit.client.0.smithi060.stdout:1/634: creat d6/d24/fe1 x:0 0 0 2024-09-21T10:41:05.070 INFO:tasks.workunit.client.0.smithi060.stdout:7/684: link da/d14/d35/d32/l57 da/d60/de4/lea 0 2024-09-21T10:41:05.078 INFO:tasks.workunit.client.0.smithi060.stdout:0/696: write d5/d10/da/d4b/da4/d40/d48/dab/d45/f4f [7342620,55310] 0 2024-09-21T10:41:05.079 INFO:tasks.workunit.client.0.smithi060.stdout:1/635: read d6/d4a/d5a/db0/f78 [3846112,47012] 0 2024-09-21T10:41:05.083 INFO:tasks.workunit.client.0.smithi060.stdout:6/843: rmdir d3/d54 39 2024-09-21T10:41:05.083 INFO:tasks.workunit.client.0.smithi060.stdout:6/844: stat d3/d12/d65/le0 0 2024-09-21T10:41:05.084 INFO:tasks.workunit.client.0.smithi060.stdout:7/685: dread da/fc [0,4194304] 0 2024-09-21T10:41:05.084 INFO:tasks.workunit.client.0.smithi060.stdout:5/681: dwrite d5/d45/d6d/d10/d19/d21/f44 [0,4194304] 0 2024-09-21T10:41:05.084 INFO:tasks.workunit.client.0.smithi060.stdout:5/682: write d5/f8 [3985591,42051] 0 2024-09-21T10:41:05.086 INFO:tasks.workunit.client.0.smithi060.stdout:0/697: mknod d5/d10/da/d4b/cd7 0 2024-09-21T10:41:05.086 INFO:tasks.workunit.client.0.smithi060.stdout:0/698: fsync d5/d10/da/d4b/da4/d40/d48/dab/f55 0 2024-09-21T10:41:05.086 INFO:tasks.workunit.client.0.smithi060.stdout:0/699: readlink d5/d10/da/d4b/da4/d40/d48/dab/d45/l37 0 2024-09-21T10:41:05.092 INFO:tasks.workunit.client.0.smithi060.stdout:5/683: rename d5/d45/d6d/d10/d19/f7b to d5/d45/d77/fe5 0 2024-09-21T10:41:05.092 INFO:tasks.workunit.client.0.smithi060.stdout:5/684: dread - d5/d45/d6d/fd7 zero size 2024-09-21T10:41:05.093 INFO:tasks.workunit.client.0.smithi060.stdout:5/685: stat d5/f76 0 2024-09-21T10:41:05.093 INFO:tasks.workunit.client.0.smithi060.stdout:0/700: truncate d5/d10/da/f84 6959455 0 2024-09-21T10:41:05.095 INFO:tasks.workunit.client.0.smithi060.stdout:0/701: truncate d5/d10/da/d4b/da4/d40/d48/dab/f55 5073053 0 2024-09-21T10:41:05.095 INFO:tasks.workunit.client.0.smithi060.stdout:7/686: dwrite da/d14/d35/d79/db0/dd7/fc5 [0,4194304] 0 2024-09-21T10:41:05.157 INFO:tasks.workunit.client.0.smithi060.stdout:5/686: getdents d5/d7a/d84/d88 0 2024-09-21T10:41:05.157 INFO:tasks.workunit.client.0.smithi060.stdout:0/702: rmdir d5/d10/da/d4b/da4/d40/d48 39 2024-09-21T10:41:05.163 INFO:tasks.workunit.client.0.smithi060.stdout:7/687: rmdir da/d60/de4 39 2024-09-21T10:41:05.170 INFO:tasks.workunit.client.0.smithi060.stdout:7/688: dread da/d14/d35/d79/db0/dd7/f13 [0,4194304] 0 2024-09-21T10:41:05.171 INFO:tasks.workunit.client.0.smithi060.stdout:7/689: chown da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/ld1 2463 1 2024-09-21T10:41:05.171 INFO:tasks.workunit.client.0.smithi060.stdout:7/690: fsync f8 0 2024-09-21T10:41:05.171 INFO:tasks.workunit.client.0.smithi060.stdout:7/691: fsync da/d14/d35/d79/db0/dd7/d8b/da7/dcd/f81 0 2024-09-21T10:41:05.171 INFO:tasks.workunit.client.0.smithi060.stdout:0/703: dwrite d5/d10/da/fa5 [0,4194304] 0 2024-09-21T10:41:05.173 INFO:tasks.workunit.client.0.smithi060.stdout:0/704: creat d5/d10/da/d15/fd8 x:0 0 0 2024-09-21T10:41:05.174 INFO:tasks.workunit.client.0.smithi060.stdout:0/705: link d5/d10/da/d4b/da4/d40/c59 d5/d10/da/d4b/da4/d40/d48/db3/cd9 0 2024-09-21T10:41:05.175 INFO:tasks.workunit.client.0.smithi060.stdout:0/706: creat d5/d10/da/d4b/da4/d40/d75/dbb/fda x:0 0 0 2024-09-21T10:41:05.175 INFO:tasks.workunit.client.0.smithi060.stdout:7/692: dread da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f65 [0,4194304] 0 2024-09-21T10:41:05.175 INFO:tasks.workunit.client.0.smithi060.stdout:7/693: stat da/d14/d25/d56/f75 0 2024-09-21T10:41:05.177 INFO:tasks.workunit.client.0.smithi060.stdout:0/707: creat d5/d10/da/d2d/fdb x:0 0 0 2024-09-21T10:41:05.177 INFO:tasks.workunit.client.0.smithi060.stdout:0/708: fsync f2 0 2024-09-21T10:41:05.178 INFO:tasks.workunit.client.0.smithi060.stdout:7/694: creat da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/feb x:0 0 0 2024-09-21T10:41:05.179 INFO:tasks.workunit.client.0.smithi060.stdout:0/709: truncate d5/d10/da/d4b/da4/d40/d75/dca/fcb 116966 0 2024-09-21T10:41:05.180 INFO:tasks.workunit.client.0.smithi060.stdout:7/695: creat da/d14/d35/de7/fec x:0 0 0 2024-09-21T10:41:05.182 INFO:tasks.workunit.client.0.smithi060.stdout:0/710: link d5/d10/da/d4b/da4/d40/d75/fb0 d5/d10/da/d4b/da4/d40/d48/d63/d96/fdc 0 2024-09-21T10:41:05.183 INFO:tasks.workunit.client.0.smithi060.stdout:7/696: creat da/d14/d35/d79/db0/dd7/d8b/fed x:0 0 0 2024-09-21T10:41:05.185 INFO:tasks.workunit.client.0.smithi060.stdout:0/711: mkdir d5/ddd 0 2024-09-21T10:41:05.185 INFO:tasks.workunit.client.0.smithi060.stdout:7/697: symlink da/d14/d35/d32/lee 0 2024-09-21T10:41:05.188 INFO:tasks.workunit.client.0.smithi060.stdout:0/712: mkdir d5/d10/d43/dde 0 2024-09-21T10:41:05.189 INFO:tasks.workunit.client.0.smithi060.stdout:7/698: getdents da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27 0 2024-09-21T10:41:05.194 INFO:tasks.workunit.client.0.smithi060.stdout:0/713: symlink d5/d10/ldf 0 2024-09-21T10:41:05.194 INFO:tasks.workunit.client.0.smithi060.stdout:0/714: write d5/d10/da/d4b/da4/d40/d75/dbb/fda [205577,11891] 0 2024-09-21T10:41:05.196 INFO:tasks.workunit.client.0.smithi060.stdout:0/715: creat d5/d10/d43/fe0 x:0 0 0 2024-09-21T10:41:05.204 INFO:tasks.workunit.client.0.smithi060.stdout:0/716: dread d5/d10/da/d4b/da4/d40/d48/fc7 [0,4194304] 0 2024-09-21T10:41:05.206 INFO:tasks.workunit.client.0.smithi060.stdout:7/699: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/fc7 [0,4194304] 0 2024-09-21T10:41:05.206 INFO:tasks.workunit.client.0.smithi060.stdout:0/717: creat d5/d10/da/d4b/da4/d40/d48/d63/d96/fe1 x:0 0 0 2024-09-21T10:41:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:3/685: sync 2024-09-21T10:41:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:2/452: sync 2024-09-21T10:41:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:2/453: stat d3/d20/ce 0 2024-09-21T10:41:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:2/454: stat d3/d20/d15/d30/d43 0 2024-09-21T10:41:05.207 INFO:tasks.workunit.client.0.smithi060.stdout:3/686: truncate d0/d1/d11/d2a/f33 1529292 0 2024-09-21T10:41:05.211 INFO:tasks.workunit.client.0.smithi060.stdout:0/718: unlink d5/d10/da/d4b/da4/d40/d75/fb0 0 2024-09-21T10:41:05.231 INFO:tasks.workunit.client.0.smithi060.stdout:7/700: dwrite da/f90 [4194304,4194304] 0 2024-09-21T10:41:05.231 INFO:tasks.workunit.client.0.smithi060.stdout:7/701: write da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f65 [1335993,49116] 0 2024-09-21T10:41:05.231 INFO:tasks.workunit.client.0.smithi060.stdout:7/702: dread - da/d14/f54 zero size 2024-09-21T10:41:05.231 INFO:tasks.workunit.client.0.smithi060.stdout:7/703: write da/d14/d25/d56/f62 [6098255,4112] 0 2024-09-21T10:41:05.246 INFO:tasks.workunit.client.0.smithi060.stdout:7/704: dwrite da/d14/d35/d79/db0/dd7/d8b/fb3 [0,4194304] 0 2024-09-21T10:41:05.293 INFO:tasks.workunit.client.0.smithi060.stdout:2/455: rmdir d3/d20/d15/d30/d43 39 2024-09-21T10:41:05.295 INFO:tasks.workunit.client.0.smithi060.stdout:3/687: creat d0/d1/d11/d2a/dd4/fdd x:0 0 0 2024-09-21T10:41:05.301 INFO:tasks.workunit.client.0.smithi060.stdout:0/719: truncate f2 1210838 0 2024-09-21T10:41:05.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/456: write d3/d7/d24/d25/f51 [1241467,32247] 0 2024-09-21T10:41:05.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/457: creat d3/d20/d17/f92 x:0 0 0 2024-09-21T10:41:05.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/458: creat d3/d7/d24/d33/f93 x:0 0 0 2024-09-21T10:41:05.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/459: chown d3/d7/l42 1385 1 2024-09-21T10:41:05.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/460: readlink d3/d20/d15/d30/d6a/l7d 0 2024-09-21T10:41:05.304 INFO:tasks.workunit.client.0.smithi060.stdout:2/461: read d3/d7/fd [1869171,31421] 0 2024-09-21T10:41:05.313 INFO:tasks.workunit.client.0.smithi060.stdout:7/705: creat da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/fef x:0 0 0 2024-09-21T10:41:05.320 INFO:tasks.workunit.client.0.smithi060.stdout:2/462: dwrite d3/d20/d15/d30/f3f [4194304,4194304] 0 2024-09-21T10:41:05.320 INFO:tasks.workunit.client.0.smithi060.stdout:2/463: write d3/f5 [2713665,130399] 0 2024-09-21T10:41:05.320 INFO:tasks.workunit.client.0.smithi060.stdout:2/464: write d3/d20/d17/f50 [1921895,48104] 0 2024-09-21T10:41:05.321 INFO:tasks.workunit.client.0.smithi060.stdout:3/688: truncate d0/d1/d11/d2a/d85/fa8 4268408 0 2024-09-21T10:41:05.323 INFO:tasks.workunit.client.0.smithi060.stdout:0/720: unlink d5/d10/da/d4b/da4/d40/d48/dab/f55 0 2024-09-21T10:41:05.324 INFO:tasks.workunit.client.0.smithi060.stdout:0/721: fsync d5/d10/da/d15/f1b 0 2024-09-21T10:41:05.331 INFO:tasks.workunit.client.0.smithi060.stdout:7/706: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f87 [0,4194304] 0 2024-09-21T10:41:05.333 INFO:tasks.workunit.client.0.smithi060.stdout:2/465: mknod d3/d20/d15/c94 0 2024-09-21T10:41:05.337 INFO:tasks.workunit.client.0.smithi060.stdout:3/689: mkdir d0/d1/d24/dde 0 2024-09-21T10:41:05.339 INFO:tasks.workunit.client.0.smithi060.stdout:0/722: rmdir d5/d10/da/da7 39 2024-09-21T10:41:05.344 INFO:tasks.workunit.client.0.smithi060.stdout:2/466: symlink d3/d7/d18/l95 0 2024-09-21T10:41:05.347 INFO:tasks.workunit.client.0.smithi060.stdout:7/707: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f94 [0,4194304] 0 2024-09-21T10:41:05.347 INFO:tasks.workunit.client.0.smithi060.stdout:7/708: chown da/d60/d6e 4216 1 2024-09-21T10:41:05.349 INFO:tasks.workunit.client.0.smithi060.stdout:3/690: mknod d0/d1/d11/d2a/dd4/cdf 0 2024-09-21T10:41:05.351 INFO:tasks.workunit.client.0.smithi060.stdout:0/723: mkdir d5/d10/da/d4b/da4/d40/d75/dae/de2 0 2024-09-21T10:41:05.351 INFO:tasks.workunit.client.0.smithi060.stdout:0/724: chown d5/d10/d4e 1471 1 2024-09-21T10:41:05.351 INFO:tasks.workunit.client.0.smithi060.stdout:0/725: chown d5/d10/da/d4b/da4/d40/d75/dae/fce 1973 1 2024-09-21T10:41:05.353 INFO:tasks.workunit.client.0.smithi060.stdout:2/467: mknod d3/d20/d15/d4c/d82/c96 0 2024-09-21T10:41:05.362 INFO:tasks.workunit.client.0.smithi060.stdout:2/468: mknod d3/d20/d15/d4c/d82/c97 0 2024-09-21T10:41:05.362 INFO:tasks.workunit.client.0.smithi060.stdout:0/726: write d5/d10/da/d4b/da4/d40/d48/dab/f65 [270695,32131] 0 2024-09-21T10:41:05.364 INFO:tasks.workunit.client.0.smithi060.stdout:0/727: creat d5/d10/da/d4b/da4/d40/d48/d63/d96/fe3 x:0 0 0 2024-09-21T10:41:05.364 INFO:tasks.workunit.client.0.smithi060.stdout:0/728: readlink d5/d10/da/d4b/da4/d40/d48/db3/lcf 0 2024-09-21T10:41:05.364 INFO:tasks.workunit.client.0.smithi060.stdout:0/729: chown d5/d10/da/d15/f97 190 1 2024-09-21T10:41:05.365 INFO:tasks.workunit.client.0.smithi060.stdout:3/691: dwrite d0/d1/d11/d53/dbb/fc3 [0,4194304] 0 2024-09-21T10:41:05.367 INFO:tasks.workunit.client.0.smithi060.stdout:0/730: mknod d5/d10/da/d4b/da4/d40/d48/dab/d79/ce4 0 2024-09-21T10:41:05.368 INFO:tasks.workunit.client.0.smithi060.stdout:0/731: chown d5/d10/da/f13 60 1 2024-09-21T10:41:05.371 INFO:tasks.workunit.client.0.smithi060.stdout:2/469: dread d3/d20/d15/d30/f3f [0,4194304] 0 2024-09-21T10:41:05.371 INFO:tasks.workunit.client.0.smithi060.stdout:2/470: readlink d3/d7/d24/l60 0 2024-09-21T10:41:05.372 INFO:tasks.workunit.client.0.smithi060.stdout:0/732: link d5/d10/da/d4b/cd7 d5/d10/da/d4b/da4/d40/d48/d63/ce5 0 2024-09-21T10:41:05.375 INFO:tasks.workunit.client.0.smithi060.stdout:2/471: creat d3/d20/f98 x:0 0 0 2024-09-21T10:41:05.376 INFO:tasks.workunit.client.0.smithi060.stdout:3/692: dwrite d0/d1/d11/d2a/d45/fb2 [0,4194304] 0 2024-09-21T10:41:05.377 INFO:tasks.workunit.client.0.smithi060.stdout:0/733: chown d5/d10/da/d4b/da4/d40/d48/dab/d45/l37 48911 1 2024-09-21T10:41:05.379 INFO:tasks.workunit.client.0.smithi060.stdout:2/472: getdents d3/d20/d15/d30 0 2024-09-21T10:41:05.384 INFO:tasks.workunit.client.0.smithi060.stdout:3/693: dread d0/d1/d11/d46/f31 [0,4194304] 0 2024-09-21T10:41:05.384 INFO:tasks.workunit.client.0.smithi060.stdout:0/734: rmdir d5/d10/da/d4b/da4/d40/d48/dab/d45 39 2024-09-21T10:41:05.384 INFO:tasks.workunit.client.0.smithi060.stdout:0/735: write f0 [215729,9676] 0 2024-09-21T10:41:05.386 INFO:tasks.workunit.client.0.smithi060.stdout:2/473: rename d3/d7/fd to d3/d20/d15/d4c/f99 0 2024-09-21T10:41:05.386 INFO:tasks.workunit.client.0.smithi060.stdout:2/474: write d3/d20/d17/f4a [205442,126949] 0 2024-09-21T10:41:05.387 INFO:tasks.workunit.client.0.smithi060.stdout:3/694: mkdir d0/d1/d11/d2a/d43/de0 0 2024-09-21T10:41:05.390 INFO:tasks.workunit.client.0.smithi060.stdout:0/736: mkdir d5/d10/da/d4b/de6 0 2024-09-21T10:41:05.390 INFO:tasks.workunit.client.0.smithi060.stdout:0/737: creat d5/d10/da/d4b/da4/d40/d48/db3/fe7 x:0 0 0 2024-09-21T10:41:05.390 INFO:tasks.workunit.client.0.smithi060.stdout:0/738: chown d5/d10/da/d4b/da4/d76/caa 24 1 2024-09-21T10:41:05.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/475: mkdir d3/d20/d15/d30/d6a/d9a 0 2024-09-21T10:41:05.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/476: fdatasync d3/d79/f7b 0 2024-09-21T10:41:05.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/477: chown d3/d20/d15/d30/d8f 7 1 2024-09-21T10:41:05.392 INFO:tasks.workunit.client.0.smithi060.stdout:2/478: creat d3/d7/d23/f9b x:0 0 0 2024-09-21T10:41:05.393 INFO:tasks.workunit.client.0.smithi060.stdout:0/739: mknod d5/d10/d43/ce8 0 2024-09-21T10:41:05.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/695: write d0/d1/d11/d2a/d64/f72 [1829295,10643] 0 2024-09-21T10:41:05.395 INFO:tasks.workunit.client.0.smithi060.stdout:3/696: creat d0/d1/d11/d2a/d45/fe1 x:0 0 0 2024-09-21T10:41:05.395 INFO:tasks.workunit.client.0.smithi060.stdout:2/479: symlink d3/d79/l9c 0 2024-09-21T10:41:05.396 INFO:tasks.workunit.client.0.smithi060.stdout:2/480: dread d3/d7/f34 [0,4194304] 0 2024-09-21T10:41:05.396 INFO:tasks.workunit.client.0.smithi060.stdout:2/481: readlink d3/d20/d15/d30/d6a/l7d 0 2024-09-21T10:41:05.400 INFO:tasks.workunit.client.0.smithi060.stdout:3/697: symlink d0/d1/db0/le2 0 2024-09-21T10:41:05.400 INFO:tasks.workunit.client.0.smithi060.stdout:3/698: chown d0/d1/d11/d53 1089814 1 2024-09-21T10:41:05.400 INFO:tasks.workunit.client.0.smithi060.stdout:3/699: write d0/d1/d24/f40 [1925753,82801] 0 2024-09-21T10:41:05.401 INFO:tasks.workunit.client.0.smithi060.stdout:3/700: readlink d0/d1/d52/l7b 0 2024-09-21T10:41:05.402 INFO:tasks.workunit.client.0.smithi060.stdout:3/701: mkdir d0/d1/d11/d2a/de3 0 2024-09-21T10:41:05.403 INFO:tasks.workunit.client.0.smithi060.stdout:0/740: dread d5/f3e [0,4194304] 0 2024-09-21T10:41:05.404 INFO:tasks.workunit.client.0.smithi060.stdout:2/482: dread d3/d7/d24/d25/f5b [0,4194304] 0 2024-09-21T10:41:05.404 INFO:tasks.workunit.client.0.smithi060.stdout:3/702: creat d0/d1/d11/d53/da2/fe4 x:0 0 0 2024-09-21T10:41:05.407 INFO:tasks.workunit.client.0.smithi060.stdout:3/703: link d0/d1/d11/d53/d98/db8/cd2 d0/d1/db0/ce5 0 2024-09-21T10:41:05.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/741: creat d5/d10/da/d4b/da4/d40/d48/dab/d4d/fe9 x:0 0 0 2024-09-21T10:41:05.408 INFO:tasks.workunit.client.0.smithi060.stdout:0/742: chown d5/d10/da/d4b/da4/d40/d48/db3/lcf 7490 1 2024-09-21T10:41:05.410 INFO:tasks.workunit.client.0.smithi060.stdout:3/704: unlink d0/d1/d11/d2a/d64/fcb 0 2024-09-21T10:41:05.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/743: mknod d5/d10/da/d4b/da4/d76/cea 0 2024-09-21T10:41:05.411 INFO:tasks.workunit.client.0.smithi060.stdout:0/744: write d5/d10/da/d4b/da4/d40/d48/dab/d4d/f6e [569960,104679] 0 2024-09-21T10:41:05.413 INFO:tasks.workunit.client.0.smithi060.stdout:3/705: symlink d0/d1/d11/d2a/d85/le6 0 2024-09-21T10:41:05.413 INFO:tasks.workunit.client.0.smithi060.stdout:2/483: write d3/f38 [3259253,119468] 0 2024-09-21T10:41:05.413 INFO:tasks.workunit.client.0.smithi060.stdout:2/484: write d3/d7/f6d [1107223,29048] 0 2024-09-21T10:41:05.413 INFO:tasks.workunit.client.0.smithi060.stdout:2/485: write d3/d20/d17/f50 [2505992,130832] 0 2024-09-21T10:41:05.413 INFO:tasks.workunit.client.0.smithi060.stdout:2/486: truncate d3/d20/d17/f92 106996 0 2024-09-21T10:41:05.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/706: mkdir d0/d1/d11/d53/dbb/de7 0 2024-09-21T10:41:05.414 INFO:tasks.workunit.client.0.smithi060.stdout:3/707: chown d0/d1/d11/d53 399132 1 2024-09-21T10:41:05.416 INFO:tasks.workunit.client.0.smithi060.stdout:2/487: mknod d3/d20/d15/d30/d43/d4b/c9d 0 2024-09-21T10:41:05.416 INFO:tasks.workunit.client.0.smithi060.stdout:3/708: creat d0/d1/d11/fe8 x:0 0 0 2024-09-21T10:41:05.418 INFO:tasks.workunit.client.0.smithi060.stdout:3/709: mkdir d0/d1/d11/d53/d98/db8/de9 0 2024-09-21T10:41:05.418 INFO:tasks.workunit.client.0.smithi060.stdout:3/710: creat d0/d1/d11/d2a/d87/fea x:0 0 0 2024-09-21T10:41:05.427 INFO:tasks.workunit.client.0.smithi060.stdout:3/711: write d0/d1/d11/d2a/d45/f97 [538701,47103] 0 2024-09-21T10:41:05.428 INFO:tasks.workunit.client.0.smithi060.stdout:3/712: mknod d0/d1/d11/d53/d98/ceb 0 2024-09-21T10:41:05.428 INFO:tasks.workunit.client.0.smithi060.stdout:3/713: read d0/d1/d9e/fb6 [7682162,34281] 0 2024-09-21T10:41:05.436 INFO:tasks.workunit.client.0.smithi060.stdout:3/714: write d0/d1/d11/d2a/d45/fb2 [260353,68308] 0 2024-09-21T10:41:05.441 INFO:tasks.workunit.client.0.smithi060.stdout:3/715: dread d0/d1/d24/f5f [0,4194304] 0 2024-09-21T10:41:05.442 INFO:tasks.workunit.client.0.smithi060.stdout:0/745: dwrite d5/d10/da/f86 [0,4194304] 0 2024-09-21T10:41:05.443 INFO:tasks.workunit.client.0.smithi060.stdout:2/488: dwrite d3/d20/d15/d30/d43/d4b/f8e [0,4194304] 0 2024-09-21T10:41:05.443 INFO:tasks.workunit.client.0.smithi060.stdout:3/716: symlink d0/d1/d11/d53/da2/dc8/lec 0 2024-09-21T10:41:05.443 INFO:tasks.workunit.client.0.smithi060.stdout:3/717: readlink d0/d1/d1e/d89/l90 0 2024-09-21T10:41:05.450 INFO:tasks.workunit.client.0.smithi060.stdout:0/746: dread d5/d10/f60 [0,4194304] 0 2024-09-21T10:41:05.450 INFO:tasks.workunit.client.0.smithi060.stdout:0/747: dread - d5/d10/da/d4b/da4/d40/d48/dab/d4d/fe9 zero size 2024-09-21T10:41:05.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/489: write d3/d7/d23/f48 [2857651,17475] 0 2024-09-21T10:41:05.474 INFO:tasks.workunit.client.0.smithi060.stdout:3/718: link d0/d1/d52/l7b d0/d1/led 0 2024-09-21T10:41:05.475 INFO:tasks.workunit.client.0.smithi060.stdout:3/719: truncate d0/d1/d9e/fcf 197254 0 2024-09-21T10:41:05.475 INFO:tasks.workunit.client.0.smithi060.stdout:3/720: fdatasync d0/d1/fbd 0 2024-09-21T10:41:05.475 INFO:tasks.workunit.client.0.smithi060.stdout:3/721: chown d0 0 1 2024-09-21T10:41:05.475 INFO:tasks.workunit.client.0.smithi060.stdout:3/722: getdents d0/d1/d11/d53/d98/db8/de9 0 2024-09-21T10:41:05.475 INFO:tasks.workunit.client.0.smithi060.stdout:0/748: truncate d5/d10/da/d4b/da4/d40/d48/d63/d96/fe1 365792 0 2024-09-21T10:41:05.477 INFO:tasks.workunit.client.0.smithi060.stdout:2/490: creat d3/d7/d24/f9e x:0 0 0 2024-09-21T10:41:05.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/749: fdatasync d5/d10/da/d4b/da4/d40/d48/dab/d4d/f6e 0 2024-09-21T10:41:05.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/750: chown d5/d10/da/d4b/da4/f5c 0 1 2024-09-21T10:41:05.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/751: fsync d5/d10/da/d4b/da4/d40/d48/d63/d96/fe3 0 2024-09-21T10:41:05.479 INFO:tasks.workunit.client.0.smithi060.stdout:3/723: rename d0/d1/d24/d81/f82 to d0/d1/d11/d2a/dd4/fee 0 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:6/845: sync 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:8/684: sync 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:4/656: sync 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:5/687: sync 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:9/589: sync 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:1/636: sync 2024-09-21T10:41:05.484 INFO:tasks.workunit.client.0.smithi060.stdout:7/709: sync 2024-09-21T10:41:05.485 INFO:tasks.workunit.client.0.smithi060.stdout:2/491: dread d3/d20/d17/f50 [0,4194304] 0 2024-09-21T10:41:05.485 INFO:tasks.workunit.client.0.smithi060.stdout:2/492: creat d3/d7/d23/d55/f9f x:0 0 0 2024-09-21T10:41:05.486 INFO:tasks.workunit.client.0.smithi060.stdout:6/846: unlink d3/d12/f51 0 2024-09-21T10:41:05.489 INFO:tasks.workunit.client.0.smithi060.stdout:4/657: mknod d0/d5/cdd 0 2024-09-21T10:41:05.489 INFO:tasks.workunit.client.0.smithi060.stdout:5/688: truncate d5/d45/d6d/d10/d19/d21/f2d 2508081 0 2024-09-21T10:41:05.490 INFO:tasks.workunit.client.0.smithi060.stdout:9/590: mkdir d3/d15/d5a/dc7 0 2024-09-21T10:41:05.491 INFO:tasks.workunit.client.0.smithi060.stdout:9/591: fdatasync d3/d5e/d60/f8e 0 2024-09-21T10:41:05.491 INFO:tasks.workunit.client.0.smithi060.stdout:1/637: unlink d6/d24/da/db/f56 0 2024-09-21T10:41:05.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/685: read d2/f17 [3442028,59219] 0 2024-09-21T10:41:05.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/686: write d2/d18/d4b/d61/d6e/f85 [4851252,54916] 0 2024-09-21T10:41:05.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/687: readlink d2/d26/d37/d62/d74/d83/dac/lb5 0 2024-09-21T10:41:05.494 INFO:tasks.workunit.client.0.smithi060.stdout:7/710: mkdir da/d14/d35/d79/db0/df0 0 2024-09-21T10:41:05.500 INFO:tasks.workunit.client.0.smithi060.stdout:2/493: link d3/d20/d15/l1d d3/d20/d15/d30/d5c/la0 0 2024-09-21T10:41:05.501 INFO:tasks.workunit.client.0.smithi060.stdout:6/847: truncate d3/d12/d38/f9f 473874 0 2024-09-21T10:41:05.503 INFO:tasks.workunit.client.0.smithi060.stdout:0/752: dwrite d5/d10/da/d4b/da4/d40/d48/fc7 [0,4194304] 0 2024-09-21T10:41:05.503 INFO:tasks.workunit.client.0.smithi060.stdout:4/658: creat d0/d3c/d67/d7d/d87/fde x:0 0 0 2024-09-21T10:41:05.503 INFO:tasks.workunit.client.0.smithi060.stdout:5/689: stat d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/c98 0 2024-09-21T10:41:05.503 INFO:tasks.workunit.client.0.smithi060.stdout:3/724: dwrite d0/d1/d11/d53/da2/dc8/fc9 [0,4194304] 0 2024-09-21T10:41:05.504 INFO:tasks.workunit.client.0.smithi060.stdout:5/690: write d5/f48 [5321,70360] 0 2024-09-21T10:41:05.504 INFO:tasks.workunit.client.0.smithi060.stdout:5/691: truncate d5/d45/d6d/d10/d19/fc4 743517 0 2024-09-21T10:41:05.505 INFO:tasks.workunit.client.0.smithi060.stdout:9/592: unlink d3/d16/d1a/fc5 0 2024-09-21T10:41:05.508 INFO:tasks.workunit.client.0.smithi060.stdout:1/638: rename d6/d24/da/d45/l6e to d6/d4a/d5a/db0/d97/le2 0 2024-09-21T10:41:05.510 INFO:tasks.workunit.client.0.smithi060.stdout:7/711: creat da/d14/d35/ff1 x:0 0 0 2024-09-21T10:41:05.512 INFO:tasks.workunit.client.0.smithi060.stdout:6/848: symlink d3/d12/d16/d25/d27/dd4/l10b 0 2024-09-21T10:41:05.513 INFO:tasks.workunit.client.0.smithi060.stdout:6/849: readlink d3/d12/d16/d22/le1 0 2024-09-21T10:41:05.514 INFO:tasks.workunit.client.0.smithi060.stdout:1/639: write d6/d24/da/db/de/d32/f37 [6108339,72914] 0 2024-09-21T10:41:05.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/753: link d5/d10/da/d2f/c32 d5/d10/ceb 0 2024-09-21T10:41:05.516 INFO:tasks.workunit.client.0.smithi060.stdout:4/659: getdents d0/df 0 2024-09-21T10:41:05.516 INFO:tasks.workunit.client.0.smithi060.stdout:4/660: read - d0/d83/d6a/d6b/d65/fd7 zero size 2024-09-21T10:41:05.528 INFO:tasks.workunit.client.0.smithi060.stdout:3/725: rename d0/d1/d11/d2a/dd4/cd9 to d0/d1/d9e/cef 0 2024-09-21T10:41:05.528 INFO:tasks.workunit.client.0.smithi060.stdout:3/726: dread - d0/d1/d11/d2a/d87/f9d zero size 2024-09-21T10:41:05.531 INFO:tasks.workunit.client.0.smithi060.stdout:7/712: creat da/d14/d35/d79/db0/df0/ff2 x:0 0 0 2024-09-21T10:41:05.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/850: creat d3/d12/d16/d22/d5d/d70/d89/daa/f10c x:0 0 0 2024-09-21T10:41:05.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/851: chown d3/d12/d16/d1a/d21/fa6 97 1 2024-09-21T10:41:05.534 INFO:tasks.workunit.client.0.smithi060.stdout:0/754: chown d5/d10/da/d4b/da4/d40/d48/dab/f9a 624867 1 2024-09-21T10:41:05.536 INFO:tasks.workunit.client.0.smithi060.stdout:4/661: symlink d0/df/d88/ldf 0 2024-09-21T10:41:05.542 INFO:tasks.workunit.client.0.smithi060.stdout:6/852: dread d3/d12/d16/d1a/d21/f23 [0,4194304] 0 2024-09-21T10:41:05.542 INFO:tasks.workunit.client.0.smithi060.stdout:6/853: write d3/d12/d16/d1a/d21/f88 [3392748,29216] 0 2024-09-21T10:41:05.547 INFO:tasks.workunit.client.0.smithi060.stdout:5/692: rmdir d5/d45/d6d/d10/d19 39 2024-09-21T10:41:05.548 INFO:tasks.workunit.client.0.smithi060.stdout:9/593: rename d3/da4 to d3/d15/d53/dc8 0 2024-09-21T10:41:05.549 INFO:tasks.workunit.client.0.smithi060.stdout:3/727: dwrite d0/d1/d1e/d34/fc5 [0,4194304] 0 2024-09-21T10:41:05.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/713: unlink da/d60/d6e/dd0/cd4 0 2024-09-21T10:41:05.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/714: fdatasync da/d14/f48 0 2024-09-21T10:41:05.551 INFO:tasks.workunit.client.0.smithi060.stdout:7/715: creat da/d14/d35/d32/ff3 x:0 0 0 2024-09-21T10:41:05.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/755: getdents d5/d10/da/d4b/da4/d76 0 2024-09-21T10:41:05.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/756: chown d5/d10/da/f13 346122 1 2024-09-21T10:41:05.555 INFO:tasks.workunit.client.0.smithi060.stdout:7/716: dread da/f90 [8388608,4194304] 0 2024-09-21T10:41:05.556 INFO:tasks.workunit.client.0.smithi060.stdout:4/662: symlink d0/d83/d6a/d6b/le0 0 2024-09-21T10:41:05.558 INFO:tasks.workunit.client.0.smithi060.stdout:6/854: rmdir d3/d12/d16/d22/d5d/d70/d89 39 2024-09-21T10:41:05.560 INFO:tasks.workunit.client.0.smithi060.stdout:6/855: read d3/d12/d16/d1a/d83/ddd/f4d [871414,130175] 0 2024-09-21T10:41:05.561 INFO:tasks.workunit.client.0.smithi060.stdout:5/693: mknod d5/d71/ce6 0 2024-09-21T10:41:05.561 INFO:tasks.workunit.client.0.smithi060.stdout:5/694: chown d5/d45/d6d/d10/lb9 12207 1 2024-09-21T10:41:05.564 INFO:tasks.workunit.client.0.smithi060.stdout:1/640: rename d6/d24/da/d45/d47/l8a to d6/d24/da/db/d79/d86/d9f/le3 0 2024-09-21T10:41:05.564 INFO:tasks.workunit.client.0.smithi060.stdout:1/641: chown d6/d24/da/d45/f6a 126579 1 2024-09-21T10:41:05.564 INFO:tasks.workunit.client.0.smithi060.stdout:1/642: creat d6/d24/da/db/de/fe4 x:0 0 0 2024-09-21T10:41:05.566 INFO:tasks.workunit.client.0.smithi060.stdout:9/594: symlink d3/d5e/d60/d2f/d5b/lc9 0 2024-09-21T10:41:05.569 INFO:tasks.workunit.client.0.smithi060.stdout:3/728: creat d0/d1/d1e/d89/ff0 x:0 0 0 2024-09-21T10:41:05.569 INFO:tasks.workunit.client.0.smithi060.stdout:3/729: creat d0/d1/d11/d2a/d43/ff1 x:0 0 0 2024-09-21T10:41:05.570 INFO:tasks.workunit.client.0.smithi060.stdout:0/757: dwrite d5/d10/da/d4b/da4/d40/d75/f9d [4194304,4194304] 0 2024-09-21T10:41:05.571 INFO:tasks.workunit.client.0.smithi060.stdout:7/717: truncate da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f64 1614077 0 2024-09-21T10:41:05.571 INFO:tasks.workunit.client.0.smithi060.stdout:7/718: creat da/d14/d25/d56/ff4 x:0 0 0 2024-09-21T10:41:05.573 INFO:tasks.workunit.client.0.smithi060.stdout:5/695: dread d5/f86 [0,4194304] 0 2024-09-21T10:41:05.573 INFO:tasks.workunit.client.0.smithi060.stdout:4/663: mknod d0/d83/d6a/d6b/ce1 0 2024-09-21T10:41:05.574 INFO:tasks.workunit.client.0.smithi060.stdout:5/696: dread d5/d45/d6d/d10/d19/f72 [0,4194304] 0 2024-09-21T10:41:05.577 INFO:tasks.workunit.client.0.smithi060.stdout:1/643: mkdir d6/d24/da/db/d79/d86/d9f/daa/de5 0 2024-09-21T10:41:05.578 INFO:tasks.workunit.client.0.smithi060.stdout:9/595: creat d3/d16/d1a/d71/fca x:0 0 0 2024-09-21T10:41:05.579 INFO:tasks.workunit.client.0.smithi060.stdout:9/596: chown d3/d16/d1a/d71 4 1 2024-09-21T10:41:05.579 INFO:tasks.workunit.client.0.smithi060.stdout:9/597: fsync d3/d16/d42/d7e/f94 0 2024-09-21T10:41:05.580 INFO:tasks.workunit.client.0.smithi060.stdout:6/856: dwrite d3/d12/d16/d1a/d83/ddd/f62 [0,4194304] 0 2024-09-21T10:41:05.580 INFO:tasks.workunit.client.0.smithi060.stdout:6/857: creat d3/d12/d16/d1a/d9a/f10d x:0 0 0 2024-09-21T10:41:05.588 INFO:tasks.workunit.client.0.smithi060.stdout:6/858: dread d3/d12/d16/d25/d27/f29 [0,4194304] 0 2024-09-21T10:41:05.589 INFO:tasks.workunit.client.0.smithi060.stdout:7/719: dwrite da/d14/d35/f78 [0,4194304] 0 2024-09-21T10:41:05.603 INFO:tasks.workunit.client.0.smithi060.stdout:0/758: unlink d5/d10/da/d4b/da4/d76/cc5 0 2024-09-21T10:41:05.608 INFO:tasks.workunit.client.0.smithi060.stdout:4/664: mknod d0/d5/d12/d3d/ce2 0 2024-09-21T10:41:05.611 INFO:tasks.workunit.client.0.smithi060.stdout:5/697: creat d5/d45/d6d/d10/d19/d21/fe7 x:0 0 0 2024-09-21T10:41:05.611 INFO:tasks.workunit.client.0.smithi060.stdout:5/698: stat d5/d45/d6d/d10/d19/d21/laf 0 2024-09-21T10:41:05.615 INFO:tasks.workunit.client.0.smithi060.stdout:1/644: truncate d6/d24/da/db/f29 384383 0 2024-09-21T10:41:05.615 INFO:tasks.workunit.client.0.smithi060.stdout:1/645: fdatasync d6/d4a/d5a/db0/fba 0 2024-09-21T10:41:05.615 INFO:tasks.workunit.client.0.smithi060.stdout:1/646: write d6/fcb [623362,44460] 0 2024-09-21T10:41:05.615 INFO:tasks.workunit.client.0.smithi060.stdout:9/598: chown d3/cd 32132514 1 2024-09-21T10:41:05.624 INFO:tasks.workunit.client.0.smithi060.stdout:6/859: rename d3/d12/d16/d22/dd2/dce to d3/d12/d16/d22/d10e 0 2024-09-21T10:41:05.626 INFO:tasks.workunit.client.0.smithi060.stdout:9/599: write d3/d5e/f82 [2335192,78198] 0 2024-09-21T10:41:05.626 INFO:tasks.workunit.client.0.smithi060.stdout:9/600: stat d3/d5e/d60/d2f/d5b 0 2024-09-21T10:41:05.627 INFO:tasks.workunit.client.0.smithi060.stdout:4/665: dwrite d0/d83/d6a/d6b/d65/f4a [0,4194304] 0 2024-09-21T10:41:05.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/730: getdents d0/d1/d11/d53 0 2024-09-21T10:41:05.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/731: write d0/d1/d24/f5f [1924653,48039] 0 2024-09-21T10:41:05.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/732: chown d0/d1/d11/d2a/f33 478959 1 2024-09-21T10:41:05.629 INFO:tasks.workunit.client.0.smithi060.stdout:3/733: fsync d0/f7d 0 2024-09-21T10:41:05.632 INFO:tasks.workunit.client.0.smithi060.stdout:0/759: link d5/d10/d11/c14 d5/d10/da/cec 0 2024-09-21T10:41:05.634 INFO:tasks.workunit.client.0.smithi060.stdout:0/760: dread d5/d10/da/f13 [0,4194304] 0 2024-09-21T10:41:05.635 INFO:tasks.workunit.client.0.smithi060.stdout:9/601: dread d3/d5e/f6c [0,4194304] 0 2024-09-21T10:41:05.637 INFO:tasks.workunit.client.0.smithi060.stdout:5/699: symlink d5/d45/d6d/d10/d19/d21/d7f/d89/le8 0 2024-09-21T10:41:05.644 INFO:tasks.workunit.client.0.smithi060.stdout:6/860: creat d3/d12/d16/d25/de5/f10f x:0 0 0 2024-09-21T10:41:05.647 INFO:tasks.workunit.client.0.smithi060.stdout:0/761: dwrite d5/d10/da/d15/f97 [0,4194304] 0 2024-09-21T10:41:05.652 INFO:tasks.workunit.client.0.smithi060.stdout:4/666: rename d0/d5/f66 to d0/d5/fe3 0 2024-09-21T10:41:05.661 INFO:tasks.workunit.client.0.smithi060.stdout:3/734: mknod d0/d1/cf2 0 2024-09-21T10:41:05.662 INFO:tasks.workunit.client.0.smithi060.stdout:3/735: creat d0/d1/ff3 x:0 0 0 2024-09-21T10:41:05.662 INFO:tasks.workunit.client.0.smithi060.stdout:3/736: creat d0/d1/d1e/d89/ff4 x:0 0 0 2024-09-21T10:41:05.663 INFO:tasks.workunit.client.0.smithi060.stdout:9/602: creat d3/d5e/d60/fcb x:0 0 0 2024-09-21T10:41:05.666 INFO:tasks.workunit.client.0.smithi060.stdout:5/700: creat d5/d45/d6d/d10/d19/d21/d7f/d89/fe9 x:0 0 0 2024-09-21T10:41:05.666 INFO:tasks.workunit.client.0.smithi060.stdout:5/701: truncate d5/d45/d6d/d10/d19/f72 751911 0 2024-09-21T10:41:05.667 INFO:tasks.workunit.client.0.smithi060.stdout:5/702: read d5/d45/d6d/f40 [822004,127582] 0 2024-09-21T10:41:05.667 INFO:tasks.workunit.client.0.smithi060.stdout:5/703: creat d5/d45/d77/d8f/d91/fea x:0 0 0 2024-09-21T10:41:05.669 INFO:tasks.workunit.client.0.smithi060.stdout:6/861: getdents d3/d12/d16/d22/d58 0 2024-09-21T10:41:05.669 INFO:tasks.workunit.client.0.smithi060.stdout:6/862: write d3/d54/f71 [655941,118295] 0 2024-09-21T10:41:05.672 INFO:tasks.workunit.client.0.smithi060.stdout:0/762: link d5/d10/d11/l7a d5/d10/da/da7/led 0 2024-09-21T10:41:05.672 INFO:tasks.workunit.client.0.smithi060.stdout:0/763: read d5/d10/da/d2d/fa2 [662578,53176] 0 2024-09-21T10:41:05.674 INFO:tasks.workunit.client.0.smithi060.stdout:4/667: getdents d0/d83/d6a 0 2024-09-21T10:41:05.680 INFO:tasks.workunit.client.0.smithi060.stdout:9/603: creat d3/d15/d5a/d64/d9e/daf/fcc x:0 0 0 2024-09-21T10:41:05.686 INFO:tasks.workunit.client.0.smithi060.stdout:5/704: creat d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/feb x:0 0 0 2024-09-21T10:41:05.686 INFO:tasks.workunit.client.0.smithi060.stdout:5/705: chown d5/cb 879567008 1 2024-09-21T10:41:05.688 INFO:tasks.workunit.client.0.smithi060.stdout:6/863: unlink d3/d12/d16/d1a/f4f 0 2024-09-21T10:41:05.688 INFO:tasks.workunit.client.0.smithi060.stdout:6/864: dread - d3/d12/d16/d25/d27/f109 zero size 2024-09-21T10:41:05.688 INFO:tasks.workunit.client.0.smithi060.stdout:6/865: fdatasync d3/d12/d16/d22/dd2/fec 0 2024-09-21T10:41:05.689 INFO:tasks.workunit.client.0.smithi060.stdout:4/668: dwrite d0/d83/d6a/d6b/d65/d51/f99 [0,4194304] 0 2024-09-21T10:41:05.689 INFO:tasks.workunit.client.0.smithi060.stdout:4/669: chown d0/d3c/dab 2843072 1 2024-09-21T10:41:05.689 INFO:tasks.workunit.client.0.smithi060.stdout:4/670: read - d0/d83/d6a/d6b/d65/d51/fcc zero size 2024-09-21T10:41:05.690 INFO:tasks.workunit.client.0.smithi060.stdout:0/764: rename d5/d10/da/d4b/da4/d40/d75/dae/de2 to d5/d10/d43/dee 0 2024-09-21T10:41:05.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/604: mknod d3/d16/d1a/ccd 0 2024-09-21T10:41:05.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/605: dread - d3/d5e/d60/fcb zero size 2024-09-21T10:41:05.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/606: dread - d3/d16/d1a/d71/fca zero size 2024-09-21T10:41:05.692 INFO:tasks.workunit.client.0.smithi060.stdout:5/706: mknod d5/d45/d6d/d10/d19/cec 0 2024-09-21T10:41:05.693 INFO:tasks.workunit.client.0.smithi060.stdout:6/866: symlink d3/l110 0 2024-09-21T10:41:05.698 INFO:tasks.workunit.client.0.smithi060.stdout:4/671: write d0/f41 [526086,35570] 0 2024-09-21T10:41:05.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:05 smithi060 ceph-mon[28215]: pgmap v19: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 297 MiB/s rd, 361 MiB/s wr, 546 op/s 2024-09-21T10:41:05.700 INFO:tasks.workunit.client.0.smithi060.stdout:0/765: rmdir d5/d10/da/d4b/da4/d40/d48/d63 39 2024-09-21T10:41:05.701 INFO:tasks.workunit.client.0.smithi060.stdout:0/766: write d5/d10/da/d4b/da4/d40/d48/dab/d4d/f6e [354418,89381] 0 2024-09-21T10:41:05.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/607: symlink d3/d15/d5a/lce 0 2024-09-21T10:41:05.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/608: dread - d3/d16/d7f/fba zero size 2024-09-21T10:41:05.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/609: fdatasync d3/d16/d7f/fba 0 2024-09-21T10:41:05.703 INFO:tasks.workunit.client.0.smithi060.stdout:6/867: symlink d3/d12/d38/d9e/dcf/l111 0 2024-09-21T10:41:05.703 INFO:tasks.workunit.client.0.smithi060.stdout:6/868: readlink d3/d12/d16/d1a/d60/le9 0 2024-09-21T10:41:05.704 INFO:tasks.workunit.client.0.smithi060.stdout:4/672: creat d0/d5/d12/d3d/fe4 x:0 0 0 2024-09-21T10:41:05.708 INFO:tasks.workunit.client.0.smithi060.stdout:0/767: rename d5/d10/da/d2f/d66 to d5/d10/da/d4b/da4/d40/d48/d63/def 0 2024-09-21T10:41:05.708 INFO:tasks.workunit.client.0.smithi060.stdout:0/768: write f0 [540419,11645] 0 2024-09-21T10:41:05.708 INFO:tasks.workunit.client.0.smithi060.stdout:0/769: truncate d5/d10/da/d4b/da4/d40/d48/dab/d4d/f6e 1209596 0 2024-09-21T10:41:05.708 INFO:tasks.workunit.client.0.smithi060.stdout:0/770: creat d5/d10/da/d4b/da4/d40/d48/db3/ff0 x:0 0 0 2024-09-21T10:41:05.709 INFO:tasks.workunit.client.0.smithi060.stdout:9/610: symlink d3/d15/d5a/dc7/lcf 0 2024-09-21T10:41:05.711 INFO:tasks.workunit.client.0.smithi060.stdout:5/707: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/fe9 [0,4194304] 0 2024-09-21T10:41:05.711 INFO:tasks.workunit.client.0.smithi060.stdout:4/673: creat d0/d83/d6a/d6b/fe5 x:0 0 0 2024-09-21T10:41:05.712 INFO:tasks.workunit.client.0.smithi060.stdout:6/869: dread d3/d12/d16/d1a/f4c [0,4194304] 0 2024-09-21T10:41:05.715 INFO:tasks.workunit.client.0.smithi060.stdout:0/771: mkdir d5/d10/da/d4b/da4/d76/df1 0 2024-09-21T10:41:05.715 INFO:tasks.workunit.client.0.smithi060.stdout:0/772: fdatasync d5/f3e 0 2024-09-21T10:41:05.715 INFO:tasks.workunit.client.0.smithi060.stdout:0/773: chown d5/d10/da/d4b/da4/d40/d48/db3 13261 1 2024-09-21T10:41:05.716 INFO:tasks.workunit.client.0.smithi060.stdout:0/774: creat d5/d10/d43/ff2 x:0 0 0 2024-09-21T10:41:05.721 INFO:tasks.workunit.client.0.smithi060.stdout:5/708: rename d5/d7a/lae to d5/d45/d6d/d10/led 0 2024-09-21T10:41:05.723 INFO:tasks.workunit.client.0.smithi060.stdout:4/674: creat d0/d83/d6a/d6b/d32/d57/fe6 x:0 0 0 2024-09-21T10:41:05.723 INFO:tasks.workunit.client.0.smithi060.stdout:4/675: chown d0/d5/d12/d3d/dd5/f3b 4861 1 2024-09-21T10:41:05.729 INFO:tasks.workunit.client.0.smithi060.stdout:4/676: write d0/d5/d12/d3d/dd5/f3b [1767668,52880] 0 2024-09-21T10:41:05.729 INFO:tasks.workunit.client.0.smithi060.stdout:4/677: write d0/d83/d6a/d6b/d32/d57/d90/f97 [164368,121745] 0 2024-09-21T10:41:05.729 INFO:tasks.workunit.client.0.smithi060.stdout:4/678: stat d0/d83/d6a/d6b/d32/d57/la8 0 2024-09-21T10:41:05.734 INFO:tasks.workunit.client.0.smithi060.stdout:5/709: dwrite d5/d45/d5a/d3a/f53 [4194304,4194304] 0 2024-09-21T10:41:05.742 INFO:tasks.workunit.client.0.smithi060.stdout:0/775: creat d5/d10/ff3 x:0 0 0 2024-09-21T10:41:05.743 INFO:tasks.workunit.client.0.smithi060.stdout:9/611: link d3/c36 d3/d5e/d60/cd0 0 2024-09-21T10:41:05.746 INFO:tasks.workunit.client.0.smithi060.stdout:4/679: dwrite d0/d3c/f48 [0,4194304] 0 2024-09-21T10:41:05.750 INFO:tasks.workunit.client.0.smithi060.stdout:0/776: symlink d5/d10/da/d4b/da4/d40/d48/dab/d4d/lf4 0 2024-09-21T10:41:05.754 INFO:tasks.workunit.client.0.smithi060.stdout:4/680: creat d0/d59/d9d/fe7 x:0 0 0 2024-09-21T10:41:05.754 INFO:tasks.workunit.client.0.smithi060.stdout:4/681: creat d0/d83/d6a/d6b/d65/d51/fe8 x:0 0 0 2024-09-21T10:41:05.754 INFO:tasks.workunit.client.0.smithi060.stdout:4/682: rename d0 to d0/d5/d12/de9 22 2024-09-21T10:41:05.757 INFO:tasks.workunit.client.0.smithi060.stdout:5/710: dwrite d5/d7a/d84/fc1 [0,4194304] 0 2024-09-21T10:41:05.757 INFO:tasks.workunit.client.0.smithi060.stdout:9/612: dread d3/d5e/d60/f86 [0,4194304] 0 2024-09-21T10:41:05.760 INFO:tasks.workunit.client.0.smithi060.stdout:0/777: dread d5/d10/da/d4b/da4/d40/d75/f9d [0,4194304] 0 2024-09-21T10:41:05.760 INFO:tasks.workunit.client.0.smithi060.stdout:5/711: unlink d5/f86 0 2024-09-21T10:41:05.760 INFO:tasks.workunit.client.0.smithi060.stdout:5/712: chown d5/d45/d6d/d10/d19/d21/d30/l6e 0 1 2024-09-21T10:41:05.762 INFO:tasks.workunit.client.0.smithi060.stdout:9/613: rmdir d3/d5e/d60/d2f/d5b 39 2024-09-21T10:41:05.825 INFO:tasks.workunit.client.0.smithi060.stdout:9/614: mkdir d3/d16/d1f/dd1 0 2024-09-21T10:41:05.825 INFO:tasks.workunit.client.0.smithi060.stdout:9/615: fsync d3/d16/d5f/fbe 0 2024-09-21T10:41:05.825 INFO:tasks.workunit.client.0.smithi060.stdout:9/616: write d3/d15/d58/f9b [3220713,130394] 0 2024-09-21T10:41:05.836 INFO:tasks.workunit.client.0.smithi060.stdout:0/778: dwrite d5/d10/da/d4b/da4/d40/d48/dab/f62 [4194304,4194304] 0 2024-09-21T10:41:05.897 INFO:tasks.workunit.client.0.smithi060.stdout:8/688: sync 2024-09-21T10:41:05.930 INFO:tasks.workunit.client.0.smithi060.stdout:0/779: mkdir d5/d10/da/d4b/da4/d40/d48/dab/d79/df5 0 2024-09-21T10:41:05.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:05 smithi112 ceph-mon[35117]: pgmap v19: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 297 MiB/s rd, 361 MiB/s wr, 546 op/s 2024-09-21T10:41:05.956 INFO:tasks.workunit.client.0.smithi060.stdout:0/780: creat d5/d10/d43/dee/ff6 x:0 0 0 2024-09-21T10:41:05.965 INFO:tasks.workunit.client.0.smithi060.stdout:0/781: rmdir d5/d10/da/d4b/da4/d40/d48/d63/d96 39 2024-09-21T10:41:05.969 INFO:tasks.workunit.client.0.smithi060.stdout:0/782: symlink d5/d10/da/d4b/da4/d76/df1/lf7 0 2024-09-21T10:41:05.987 INFO:tasks.workunit.client.0.smithi060.stdout:8/689: unlink d2/d18/d4b/d61/f94 0 2024-09-21T10:41:05.990 INFO:tasks.workunit.client.0.smithi060.stdout:0/783: dwrite d5/d10/d43/dee/ff6 [0,4194304] 0 2024-09-21T10:41:05.994 INFO:tasks.workunit.client.0.smithi060.stdout:8/690: getdents d2 0 2024-09-21T10:41:06.001 INFO:tasks.workunit.client.0.smithi060.stdout:5/713: link d5/d45/d6d/d10/d19/f72 d5/d45/d6d/d10/d19/d8d/d60/fee 0 2024-09-21T10:41:06.003 INFO:tasks.workunit.client.0.smithi060.stdout:9/617: rename d3/d16/d5f/f6b to d3/d16/d42/fd2 0 2024-09-21T10:41:06.003 INFO:tasks.workunit.client.0.smithi060.stdout:9/618: write d3/d15/d78/f7d [288770,18676] 0 2024-09-21T10:41:06.006 INFO:tasks.workunit.client.0.smithi060.stdout:5/714: rename d5/d45/d6d/f40 to d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/fef 0 2024-09-21T10:41:06.006 INFO:tasks.workunit.client.0.smithi060.stdout:5/715: write d5/d45/d6d/d10/d19/d8d/d50/f58 [3735872,56984] 0 2024-09-21T10:41:06.009 INFO:tasks.workunit.client.0.smithi060.stdout:5/716: creat d5/d7a/d84/ff0 x:0 0 0 2024-09-21T10:41:06.009 INFO:tasks.workunit.client.0.smithi060.stdout:5/717: truncate d5/d45/d6d/d10/d19/d8d/d60/fee 1634579 0 2024-09-21T10:41:06.009 INFO:tasks.workunit.client.0.smithi060.stdout:5/718: stat d5/d45/d5a/dbd/cd3 0 2024-09-21T10:41:06.010 INFO:tasks.workunit.client.0.smithi060.stdout:5/719: creat d5/ff1 x:0 0 0 2024-09-21T10:41:06.010 INFO:tasks.workunit.client.0.smithi060.stdout:5/720: creat d5/d45/d6d/d10/d19/d21/ff2 x:0 0 0 2024-09-21T10:41:06.010 INFO:tasks.workunit.client.0.smithi060.stdout:5/721: readlink d5/d45/d6d/d10/d19/d8d/d50/l54 0 2024-09-21T10:41:06.017 INFO:tasks.workunit.client.0.smithi060.stdout:0/784: dwrite d5/d10/da/d4b/da4/d40/d48/fac [0,4194304] 0 2024-09-21T10:41:06.018 INFO:tasks.workunit.client.0.smithi060.stdout:8/691: dwrite d2/fb9 [4194304,4194304] 0 2024-09-21T10:41:06.021 INFO:tasks.workunit.client.0.smithi060.stdout:9/619: dread d3/d5e/d60/f39 [0,4194304] 0 2024-09-21T10:41:06.021 INFO:tasks.workunit.client.0.smithi060.stdout:9/620: chown d3/d16/d5f/f65 11201323 1 2024-09-21T10:41:06.022 INFO:tasks.workunit.client.0.smithi060.stdout:8/692: unlink d2/cb 0 2024-09-21T10:41:06.023 INFO:tasks.workunit.client.0.smithi060.stdout:9/621: creat d3/d16/d95/fd3 x:0 0 0 2024-09-21T10:41:06.025 INFO:tasks.workunit.client.0.smithi060.stdout:9/622: mknod d3/d5e/d60/d2f/cd4 0 2024-09-21T10:41:06.025 INFO:tasks.workunit.client.0.smithi060.stdout:9/623: chown d3/d16/d1a/f4c 43 1 2024-09-21T10:41:06.026 INFO:tasks.workunit.client.0.smithi060.stdout:9/624: creat d3/d15/d53/dc8/fd5 x:0 0 0 2024-09-21T10:41:06.030 INFO:tasks.workunit.client.0.smithi060.stdout:5/722: dwrite d5/d45/d6d/d10/d19/d21/d7f/f9b [0,4194304] 0 2024-09-21T10:41:06.030 INFO:tasks.workunit.client.0.smithi060.stdout:5/723: write d5/d45/d6d/d10/d19/d8d/d60/fb7 [2201741,91311] 0 2024-09-21T10:41:06.033 INFO:tasks.workunit.client.0.smithi060.stdout:5/724: mkdir d5/d7a/d84/dc3/df3 0 2024-09-21T10:41:06.034 INFO:tasks.workunit.client.0.smithi060.stdout:9/625: dread d3/d16/d5f/f84 [0,4194304] 0 2024-09-21T10:41:06.034 INFO:tasks.workunit.client.0.smithi060.stdout:9/626: getdents d3/d15/d5a/dc7 0 2024-09-21T10:41:06.035 INFO:tasks.workunit.client.0.smithi060.stdout:9/627: read - d3/d16/d42/fd2 zero size 2024-09-21T10:41:06.037 INFO:tasks.workunit.client.0.smithi060.stdout:5/725: dread d5/f7 [0,4194304] 0 2024-09-21T10:41:06.038 INFO:tasks.workunit.client.0.smithi060.stdout:5/726: creat d5/d45/d6d/d10/d19/d21/d30/d49/ff4 x:0 0 0 2024-09-21T10:41:06.039 INFO:tasks.workunit.client.0.smithi060.stdout:5/727: rmdir d5/d45/d6d/d10/d19/d8d/d60/d9e 39 2024-09-21T10:41:06.040 INFO:tasks.workunit.client.0.smithi060.stdout:5/728: symlink d5/d45/d6d/d10/d19/d8d/d60/d9e/lf5 0 2024-09-21T10:41:06.042 INFO:tasks.workunit.client.0.smithi060.stdout:9/628: dread d3/d16/f4b [0,4194304] 0 2024-09-21T10:41:06.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/785: rename d5/d10/ff3 to d5/d10/da/d2f/ff8 0 2024-09-21T10:41:06.045 INFO:tasks.workunit.client.0.smithi060.stdout:0/786: read d5/f56 [998247,29515] 0 2024-09-21T10:41:06.048 INFO:tasks.workunit.client.0.smithi060.stdout:8/693: rename d2/d18/d4b/c56 to d2/d26/d37/d62/d74/d83/da2/ce4 0 2024-09-21T10:41:06.055 INFO:tasks.workunit.client.0.smithi060.stdout:0/787: dread d5/d10/da/d4b/da4/d40/d75/f9d [4194304,4194304] 0 2024-09-21T10:41:06.055 INFO:tasks.workunit.client.0.smithi060.stdout:0/788: fdatasync d5/d10/da/d4b/da4/d40/d75/dae/fd2 0 2024-09-21T10:41:06.073 INFO:tasks.workunit.client.0.smithi060.stdout:5/729: dwrite d5/d45/d6d/d10/d19/d21/f83 [0,4194304] 0 2024-09-21T10:41:06.073 INFO:tasks.workunit.client.0.smithi060.stdout:9/629: dwrite d3/d5e/d60/d2f/f31 [0,4194304] 0 2024-09-21T10:41:06.073 INFO:tasks.workunit.client.0.smithi060.stdout:9/630: readlink d3/d5e/d60/d2f/d5b/lc9 0 2024-09-21T10:41:06.087 INFO:tasks.workunit.client.0.smithi060.stdout:5/730: dwrite d5/d45/d5a/f62 [8388608,4194304] 0 2024-09-21T10:41:06.089 INFO:tasks.workunit.client.0.smithi060.stdout:5/731: truncate d5/d45/d6d/d10/f90 1683870 0 2024-09-21T10:41:06.089 INFO:tasks.workunit.client.0.smithi060.stdout:5/732: stat d5/d45/d6d/d10/d19/c73 0 2024-09-21T10:41:06.090 INFO:tasks.workunit.client.0.smithi060.stdout:5/733: getdents d5/d45/d6d/d10/d19/d21/d7f 0 2024-09-21T10:41:06.092 INFO:tasks.workunit.client.0.smithi060.stdout:9/631: dwrite d3/d16/d1a/f1d [0,4194304] 0 2024-09-21T10:41:06.095 INFO:tasks.workunit.client.0.smithi060.stdout:9/632: mkdir d3/d16/d42/d7e/d85/dd6 0 2024-09-21T10:41:06.096 INFO:tasks.workunit.client.0.smithi060.stdout:9/633: read d3/d15/d92/fa8 [250804,19455] 0 2024-09-21T10:41:06.106 INFO:tasks.workunit.client.0.smithi060.stdout:5/734: dread d5/d45/d6d/d10/d19/d8d/d60/fb7 [0,4194304] 0 2024-09-21T10:41:06.106 INFO:tasks.workunit.client.0.smithi060.stdout:5/735: truncate d5/ff1 1006635 0 2024-09-21T10:41:06.106 INFO:tasks.workunit.client.0.smithi060.stdout:9/634: dread d3/d5e/d60/d2f/f31 [0,4194304] 0 2024-09-21T10:41:06.107 INFO:tasks.workunit.client.0.smithi060.stdout:5/736: write d5/d45/d5a/f20 [335316,1644] 0 2024-09-21T10:41:06.107 INFO:tasks.workunit.client.0.smithi060.stdout:5/737: write d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/fc5 [648273,74367] 0 2024-09-21T10:41:06.108 INFO:tasks.workunit.client.0.smithi060.stdout:9/635: creat d3/d5e/d60/d2f/fd7 x:0 0 0 2024-09-21T10:41:06.110 INFO:tasks.workunit.client.0.smithi060.stdout:5/738: creat d5/d7a/d84/dcc/db6/ff6 x:0 0 0 2024-09-21T10:41:06.110 INFO:tasks.workunit.client.0.smithi060.stdout:5/739: read d5/d45/fb4 [2349072,49324] 0 2024-09-21T10:41:06.112 INFO:tasks.workunit.client.0.smithi060.stdout:9/636: creat d3/d16/d42/d7e/fd8 x:0 0 0 2024-09-21T10:41:06.112 INFO:tasks.workunit.client.0.smithi060.stdout:9/637: truncate d3/d16/d5f/fbe 409368 0 2024-09-21T10:41:06.116 INFO:tasks.workunit.client.0.smithi060.stdout:9/638: rename d3/d16/c63 to d3/d15/d58/cd9 0 2024-09-21T10:41:06.121 INFO:tasks.workunit.client.0.smithi060.stdout:9/639: unlink d3/d5e/d60/d2f/f68 0 2024-09-21T10:41:06.121 INFO:tasks.workunit.client.0.smithi060.stdout:9/640: creat d3/d15/d53/dc8/fda x:0 0 0 2024-09-21T10:41:06.121 INFO:tasks.workunit.client.0.smithi060.stdout:9/641: read - d3/d15/d53/dc8/fda zero size 2024-09-21T10:41:06.126 INFO:tasks.workunit.client.0.smithi060.stdout:5/740: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/f8c [0,4194304] 0 2024-09-21T10:41:06.126 INFO:tasks.workunit.client.0.smithi060.stdout:5/741: write d5/d45/d6d/d10/d19/f37 [1057280,96550] 0 2024-09-21T10:41:06.126 INFO:tasks.workunit.client.0.smithi060.stdout:5/742: stat d5/d45/d5a/lcd 0 2024-09-21T10:41:06.126 INFO:tasks.workunit.client.0.smithi060.stdout:9/642: mkdir d3/d15/d5a/d64/d9e/ddb 0 2024-09-21T10:41:06.126 INFO:tasks.workunit.client.0.smithi060.stdout:5/743: read d5/d45/d6d/d10/d19/f72 [40482,63885] 0 2024-09-21T10:41:06.129 INFO:tasks.workunit.client.0.smithi060.stdout:9/643: creat d3/d15/d5a/d64/fdc x:0 0 0 2024-09-21T10:41:06.129 INFO:tasks.workunit.client.0.smithi060.stdout:9/644: chown d3/d5e/fbd 1975849686 1 2024-09-21T10:41:06.132 INFO:tasks.workunit.client.0.smithi060.stdout:9/645: creat d3/d16/d1a/fdd x:0 0 0 2024-09-21T10:41:06.138 INFO:tasks.workunit.client.0.smithi060.stdout:8/694: creat d2/d26/d37/d62/d74/d83/fe5 x:0 0 0 2024-09-21T10:41:06.140 INFO:tasks.workunit.client.0.smithi060.stdout:8/695: truncate d2/d26/d37/d62/d74/d83/da2/f7e 3319331 0 2024-09-21T10:41:06.140 INFO:tasks.workunit.client.0.smithi060.stdout:8/696: fdatasync d2/f47 0 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:3/737: sync 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:1/647: sync 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:4/683: sync 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:6/870: sync 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:2/494: sync 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:7/720: sync 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:4/684: chown d0/d83/d6a/d6b/d32/dd6 85592 1 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:2/495: truncate d3/d7/f6d 1348555 0 2024-09-21T10:41:06.141 INFO:tasks.workunit.client.0.smithi060.stdout:2/496: write d3/d20/d17/f4a [4960596,66657] 0 2024-09-21T10:41:06.142 INFO:tasks.workunit.client.0.smithi060.stdout:4/685: dread d0/d5/d12/d3d/dd5/f98 [0,4194304] 0 2024-09-21T10:41:06.146 INFO:tasks.workunit.client.0.smithi060.stdout:3/738: truncate d0/d1/d11/d2a/d85/fa8 3334694 0 2024-09-21T10:41:06.149 INFO:tasks.workunit.client.0.smithi060.stdout:7/721: mkdir da/d14/d35/d79/db0/df0/df5 0 2024-09-21T10:41:06.150 INFO:tasks.workunit.client.0.smithi060.stdout:2/497: rmdir d3/d20/d15/d30/d43 39 2024-09-21T10:41:06.151 INFO:tasks.workunit.client.0.smithi060.stdout:4/686: truncate d0/f41 2586482 0 2024-09-21T10:41:06.151 INFO:tasks.workunit.client.0.smithi060.stdout:4/687: write d0/d83/d6a/d6b/d32/d57/d90/fc3 [734063,2725] 0 2024-09-21T10:41:06.152 INFO:tasks.workunit.client.0.smithi060.stdout:8/697: mknod d2/d26/d37/d62/d74/ce6 0 2024-09-21T10:41:06.152 INFO:tasks.workunit.client.0.smithi060.stdout:8/698: truncate d2/d18/d4b/fda 569544 0 2024-09-21T10:41:06.153 INFO:tasks.workunit.client.0.smithi060.stdout:1/648: getdents d6/d24/da/db/d79/d86/d9f 0 2024-09-21T10:41:06.157 INFO:tasks.workunit.client.0.smithi060.stdout:7/722: creat da/d14/d35/d79/db0/dd7/ff6 x:0 0 0 2024-09-21T10:41:06.158 INFO:tasks.workunit.client.0.smithi060.stdout:8/699: mkdir d2/d26/d37/d64/d65/dd5/de7 0 2024-09-21T10:41:06.159 INFO:tasks.workunit.client.0.smithi060.stdout:2/498: dread d3/d20/d17/f50 [0,4194304] 0 2024-09-21T10:41:06.161 INFO:tasks.workunit.client.0.smithi060.stdout:7/723: creat da/d60/d6e/ff7 x:0 0 0 2024-09-21T10:41:06.163 INFO:tasks.workunit.client.0.smithi060.stdout:9/646: dwrite d3/d16/d5f/fbb [0,4194304] 0 2024-09-21T10:41:06.163 INFO:tasks.workunit.client.0.smithi060.stdout:3/739: write d0/d1/d11/d2a/fbc [2613741,100487] 0 2024-09-21T10:41:06.163 INFO:tasks.workunit.client.0.smithi060.stdout:9/647: write d3/d16/d42/d7e/fa1 [577873,123362] 0 2024-09-21T10:41:06.163 INFO:tasks.workunit.client.0.smithi060.stdout:6/871: dwrite d3/d12/d65/d66/fa2 [0,4194304] 0 2024-09-21T10:41:06.164 INFO:tasks.workunit.client.0.smithi060.stdout:2/499: mknod d3/d7/d23/ca1 0 2024-09-21T10:41:06.165 INFO:tasks.workunit.client.0.smithi060.stdout:9/648: dread d3/d16/d5f/fbe [0,4194304] 0 2024-09-21T10:41:06.171 INFO:tasks.workunit.client.0.smithi060.stdout:6/872: rmdir d3/d12/d65/d7f 39 2024-09-21T10:41:06.171 INFO:tasks.workunit.client.0.smithi060.stdout:6/873: chown d3/d54/da8/fd8 146946 1 2024-09-21T10:41:06.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/740: read d0/d1/d1e/f35 [223674,70472] 0 2024-09-21T10:41:06.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/741: chown d0/d1/d9e/fb6 5 1 2024-09-21T10:41:06.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/742: creat d0/d1/d5c/dc4/ff5 x:0 0 0 2024-09-21T10:41:06.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/743: truncate d0/d1/d11/d53/da2/fe4 655265 0 2024-09-21T10:41:06.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/744: write d0/d1/d11/d2a/f5d [1481009,87740] 0 2024-09-21T10:41:06.173 INFO:tasks.workunit.client.0.smithi060.stdout:3/745: readlink d0/d1/d11/d2a/d43/l79 0 2024-09-21T10:41:06.177 INFO:tasks.workunit.client.0.smithi060.stdout:9/649: read d3/d16/d42/f9f [884653,105590] 0 2024-09-21T10:41:06.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/874: creat d3/d12/d38/d9e/dcf/f112 x:0 0 0 2024-09-21T10:41:06.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/875: fdatasync d3/d12/d16/f18 0 2024-09-21T10:41:06.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/876: stat d3/d12/d16/d5b/l78 0 2024-09-21T10:41:06.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/877: write d3/d12/d16/d25/d27/f5a [2063056,79164] 0 2024-09-21T10:41:06.178 INFO:tasks.workunit.client.0.smithi060.stdout:6/878: write d3/d12/d65/d7f/db5/fee [1040584,12804] 0 2024-09-21T10:41:06.180 INFO:tasks.workunit.client.0.smithi060.stdout:3/746: mkdir d0/d1/d11/d46/df6 0 2024-09-21T10:41:06.181 INFO:tasks.workunit.client.0.smithi060.stdout:9/650: mkdir d3/d15/d53/dc8/dde 0 2024-09-21T10:41:06.183 INFO:tasks.workunit.client.0.smithi060.stdout:3/747: mknod d0/d1/d11/d46/cf7 0 2024-09-21T10:41:06.184 INFO:tasks.workunit.client.0.smithi060.stdout:9/651: creat d3/d15/d92/fdf x:0 0 0 2024-09-21T10:41:06.184 INFO:tasks.workunit.client.0.smithi060.stdout:7/724: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/fae [0,4194304] 0 2024-09-21T10:41:06.184 INFO:tasks.workunit.client.0.smithi060.stdout:7/725: dread - da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f8f zero size 2024-09-21T10:41:06.185 INFO:tasks.workunit.client.0.smithi060.stdout:8/700: dwrite d2/d18/f5c [0,4194304] 0 2024-09-21T10:41:06.186 INFO:tasks.workunit.client.0.smithi060.stdout:2/500: dread d3/d79/f7b [0,4194304] 0 2024-09-21T10:41:06.188 INFO:tasks.workunit.client.0.smithi060.stdout:3/748: rmdir d0/d1/d11/d2a/d43/de0 0 2024-09-21T10:41:06.189 INFO:tasks.workunit.client.0.smithi060.stdout:9/652: dread d3/d16/d1f/f49 [0,4194304] 0 2024-09-21T10:41:06.191 INFO:tasks.workunit.client.0.smithi060.stdout:3/749: truncate d0/d1/d1e/f4b 1316872 0 2024-09-21T10:41:06.192 INFO:tasks.workunit.client.0.smithi060.stdout:3/750: symlink d0/d1/d24/d81/lf8 0 2024-09-21T10:41:06.193 INFO:tasks.workunit.client.0.smithi060.stdout:3/751: rmdir d0/d1/d1e 39 2024-09-21T10:41:06.193 INFO:tasks.workunit.client.0.smithi060.stdout:3/752: chown d0/d1/db0/dba 120 1 2024-09-21T10:41:06.193 INFO:tasks.workunit.client.0.smithi060.stdout:3/753: write d0/d1/d11/d2a/d43/f88 [1182813,103378] 0 2024-09-21T10:41:06.196 INFO:tasks.workunit.client.0.smithi060.stdout:3/754: creat d0/d1/db0/dba/ff9 x:0 0 0 2024-09-21T10:41:06.198 INFO:tasks.workunit.client.0.smithi060.stdout:6/879: rename d3/f4b to d3/d12/f113 0 2024-09-21T10:41:06.199 INFO:tasks.workunit.client.0.smithi060.stdout:0/789: symlink d5/d10/da/d4b/da4/d40/lf9 0 2024-09-21T10:41:06.200 INFO:tasks.workunit.client.0.smithi060.stdout:3/755: creat d0/d1/d11/d53/d98/db8/ffa x:0 0 0 2024-09-21T10:41:06.202 INFO:tasks.workunit.client.0.smithi060.stdout:2/501: rename d3/d7/d24/d25/l5e to d3/d20/d15/d30/d5c/la2 0 2024-09-21T10:41:06.202 INFO:tasks.workunit.client.0.smithi060.stdout:2/502: creat d3/d7/d24/d25/fa3 x:0 0 0 2024-09-21T10:41:06.203 INFO:tasks.workunit.client.0.smithi060.stdout:0/790: mkdir d5/d10/da/d15/dfa 0 2024-09-21T10:41:06.205 INFO:tasks.workunit.client.0.smithi060.stdout:7/726: dwrite da/fc [0,4194304] 0 2024-09-21T10:41:06.208 INFO:tasks.workunit.client.0.smithi060.stdout:9/653: rename d3/d15/d5a/lce to d3/d15/d5a/d64/d9e/le0 0 2024-09-21T10:41:06.210 INFO:tasks.workunit.client.0.smithi060.stdout:0/791: rename d5/d10/da/d4b/da4/d40/d48/d63/d96/fe3 to d5/d10/da/d4b/da4/d40/d75/dbb/ffb 0 2024-09-21T10:41:06.210 INFO:tasks.workunit.client.0.smithi060.stdout:8/701: dwrite d2/d26/d37/d62/d74/d83/d89/fa1 [0,4194304] 0 2024-09-21T10:41:06.211 INFO:tasks.workunit.client.0.smithi060.stdout:8/702: fdatasync d2/f46 0 2024-09-21T10:41:06.211 INFO:tasks.workunit.client.0.smithi060.stdout:8/703: chown d2/d26/d37/d62/d74/d83/da2 1642946 1 2024-09-21T10:41:06.213 INFO:tasks.workunit.client.0.smithi060.stdout:7/727: rename da/d14/l5a to da/d60/de4/de9/lf8 0 2024-09-21T10:41:06.216 INFO:tasks.workunit.client.0.smithi060.stdout:0/792: creat d5/d10/d43/dde/ffc x:0 0 0 2024-09-21T10:41:06.217 INFO:tasks.workunit.client.0.smithi060.stdout:2/503: dwrite d3/d20/d17/f4a [4194304,4194304] 0 2024-09-21T10:41:06.217 INFO:tasks.workunit.client.0.smithi060.stdout:8/704: symlink d2/d26/le8 0 2024-09-21T10:41:06.220 INFO:tasks.workunit.client.0.smithi060.stdout:7/728: mkdir da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9 0 2024-09-21T10:41:06.220 INFO:tasks.workunit.client.0.smithi060.stdout:7/729: fdatasync da/d14/d35/d79/db0/dd7/d8b/fb7 0 2024-09-21T10:41:06.222 INFO:tasks.workunit.client.0.smithi060.stdout:0/793: mknod d5/d10/d43/dde/cfd 0 2024-09-21T10:41:06.222 INFO:tasks.workunit.client.0.smithi060.stdout:2/504: creat d3/d20/d15/d30/d8b/fa4 x:0 0 0 2024-09-21T10:41:06.224 INFO:tasks.workunit.client.0.smithi060.stdout:7/730: symlink da/d14/d35/d79/db0/dd7/lfa 0 2024-09-21T10:41:06.229 INFO:tasks.workunit.client.0.smithi060.stdout:5/744: write d5/d45/d6d/d10/f90 [1424564,99236] 0 2024-09-21T10:41:06.243 INFO:tasks.workunit.client.0.smithi060.stdout:9/654: dwrite d3/d15/d5a/f67 [0,4194304] 0 2024-09-21T10:41:06.243 INFO:tasks.workunit.client.0.smithi060.stdout:8/705: dwrite d2/d26/d37/d62/d74/d83/d89/fd9 [0,4194304] 0 2024-09-21T10:41:06.243 INFO:tasks.workunit.client.0.smithi060.stdout:5/745: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/fb5 [0,4194304] 0 2024-09-21T10:41:06.256 INFO:tasks.workunit.client.0.smithi060.stdout:8/706: dwrite d2/d26/d37/d62/d74/d83/d89/d9a/fab [0,4194304] 0 2024-09-21T10:41:06.271 INFO:tasks.workunit.client.0.smithi060.stdout:8/707: dwrite d2/d26/d37/d64/d65/f9c [0,4194304] 0 2024-09-21T10:41:06.271 INFO:tasks.workunit.client.0.smithi060.stdout:8/708: chown d2/d26/d37/d62/d74/d83/fe5 226 1 2024-09-21T10:41:06.329 INFO:tasks.workunit.client.0.smithi060.stdout:2/505: unlink d3/d7/d23/f71 0 2024-09-21T10:41:06.331 INFO:tasks.workunit.client.0.smithi060.stdout:7/731: creat da/d60/de4/de9/ffb x:0 0 0 2024-09-21T10:41:06.335 INFO:tasks.workunit.client.0.smithi060.stdout:9/655: mknod d3/d15/d92/ce1 0 2024-09-21T10:41:06.339 INFO:tasks.workunit.client.0.smithi060.stdout:5/746: rmdir d5/d45/d6d/d10/d19/d8d/d60/d61 39 2024-09-21T10:41:06.343 INFO:tasks.workunit.client.0.smithi060.stdout:8/709: rename d2/d26/da4/daa/fdc to d2/d18/d4b/fe9 0 2024-09-21T10:41:06.344 INFO:tasks.workunit.client.0.smithi060.stdout:7/732: unlink da/d14/d35/d79/db0/dd7/ff6 0 2024-09-21T10:41:06.345 INFO:tasks.workunit.client.0.smithi060.stdout:9/656: creat d3/d16/d42/d7e/d85/dd6/fe2 x:0 0 0 2024-09-21T10:41:06.346 INFO:tasks.workunit.client.0.smithi060.stdout:5/747: mkdir d5/d45/d5a/d3a/df7 0 2024-09-21T10:41:06.348 INFO:tasks.workunit.client.0.smithi060.stdout:2/506: rename d3/d7/d18/d75 to d3/d7/d23/da5 0 2024-09-21T10:41:06.349 INFO:tasks.workunit.client.0.smithi060.stdout:8/710: chown d2/d26/d37/d62/d74/lb8 7 1 2024-09-21T10:41:06.352 INFO:tasks.workunit.client.0.smithi060.stdout:7/733: dread da/f59 [0,4194304] 0 2024-09-21T10:41:06.353 INFO:tasks.workunit.client.0.smithi060.stdout:9/657: symlink d3/d15/d53/le3 0 2024-09-21T10:41:06.354 INFO:tasks.workunit.client.0.smithi060.stdout:4/688: read d0/f41 [2270454,80801] 0 2024-09-21T10:41:06.358 INFO:tasks.workunit.client.0.smithi060.stdout:2/507: creat d3/d20/d15/d30/d6a/fa6 x:0 0 0 2024-09-21T10:41:06.359 INFO:tasks.workunit.client.0.smithi060.stdout:5/748: dread d5/d45/d6d/d10/d19/d21/d7f/d89/fe9 [0,4194304] 0 2024-09-21T10:41:06.360 INFO:tasks.workunit.client.0.smithi060.stdout:8/711: mkdir d2/d26/d37/d62/d74/d83/d89/dea 0 2024-09-21T10:41:06.361 INFO:tasks.workunit.client.0.smithi060.stdout:5/749: dread d5/d45/d5a/d3a/fba [0,4194304] 0 2024-09-21T10:41:06.361 INFO:tasks.workunit.client.0.smithi060.stdout:5/750: chown d5/d45/d77/d8f/d91 1 1 2024-09-21T10:41:06.363 INFO:tasks.workunit.client.0.smithi060.stdout:9/658: read d3/d16/f4b [1979050,98530] 0 2024-09-21T10:41:06.377 INFO:tasks.workunit.client.0.smithi060.stdout:3/756: dwrite d0/d1/d11/d2a/d43/fca [0,4194304] 0 2024-09-21T10:41:06.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/734: dwrite da/d60/d6e/f93 [0,4194304] 0 2024-09-21T10:41:06.386 INFO:tasks.workunit.client.0.smithi060.stdout:6/880: link d3/d12/f113 d3/d12/d16/d22/d58/f114 0 2024-09-21T10:41:06.387 INFO:tasks.workunit.client.0.smithi060.stdout:4/689: link d0/d5/d12/d3d/lbf d0/d59/lea 0 2024-09-21T10:41:06.387 INFO:tasks.workunit.client.0.smithi060.stdout:4/690: truncate d0/d5/d3a/f5d 2409695 0 2024-09-21T10:41:06.388 INFO:tasks.workunit.client.0.smithi060.stdout:2/508: creat d3/fa7 x:0 0 0 2024-09-21T10:41:06.388 INFO:tasks.workunit.client.0.smithi060.stdout:2/509: dread - d3/d7/d23/f7c zero size 2024-09-21T10:41:06.388 INFO:tasks.workunit.client.0.smithi060.stdout:2/510: chown d3/d20/d15/d30/d8b/d69 5730340 1 2024-09-21T10:41:06.390 INFO:tasks.workunit.client.0.smithi060.stdout:8/712: mkdir d2/d26/d37/d62/deb 0 2024-09-21T10:41:06.392 INFO:tasks.workunit.client.0.smithi060.stdout:5/751: unlink d5/d45/d6d/d10/d19/d21/c55 0 2024-09-21T10:41:06.393 INFO:tasks.workunit.client.0.smithi060.stdout:6/881: dread d3/d12/d16/d1a/d83/ddd/f68 [0,4194304] 0 2024-09-21T10:41:06.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/659: link d3/d15/d78/f8c d3/d15/d78/fe4 0 2024-09-21T10:41:06.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/660: dread - d3/d16/d42/d7e/f94 zero size 2024-09-21T10:41:06.394 INFO:tasks.workunit.client.0.smithi060.stdout:9/661: readlink d3/d16/d9c/lb2 0 2024-09-21T10:41:06.396 INFO:tasks.workunit.client.0.smithi060.stdout:3/757: link d0/d1/d11/fd3 d0/d1/d11/d53/da2/ffb 0 2024-09-21T10:41:06.397 INFO:tasks.workunit.client.0.smithi060.stdout:7/735: symlink da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9/lfc 0 2024-09-21T10:41:06.399 INFO:tasks.workunit.client.0.smithi060.stdout:4/691: creat d0/d5/d12/feb x:0 0 0 2024-09-21T10:41:06.400 INFO:tasks.workunit.client.0.smithi060.stdout:8/713: rename d2/d26/d37/d62/d77/da8 to d2/d26/d37/d62/d74/d83/d89/dec 0 2024-09-21T10:41:06.401 INFO:tasks.workunit.client.0.smithi060.stdout:5/752: symlink d5/d45/d6d/d10/d19/d8d/d60/d61/lf8 0 2024-09-21T10:41:06.402 INFO:tasks.workunit.client.0.smithi060.stdout:6/882: symlink d3/d12/d16/d22/d58/l115 0 2024-09-21T10:41:06.403 INFO:tasks.workunit.client.0.smithi060.stdout:9/662: symlink d3/d16/d5f/le5 0 2024-09-21T10:41:06.403 INFO:tasks.workunit.client.0.smithi060.stdout:9/663: dread - d3/d16/d42/fd2 zero size 2024-09-21T10:41:06.405 INFO:tasks.workunit.client.0.smithi060.stdout:7/736: unlink da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/fef 0 2024-09-21T10:41:06.408 INFO:tasks.workunit.client.0.smithi060.stdout:4/692: unlink d0/d5/d12/d15/d4d/fb2 0 2024-09-21T10:41:06.408 INFO:tasks.workunit.client.0.smithi060.stdout:2/511: dwrite d3/d7/d23/f2f [0,4194304] 0 2024-09-21T10:41:06.410 INFO:tasks.workunit.client.0.smithi060.stdout:8/714: rename d2/d26/d37/d62/d77/fae to d2/da7/fed 0 2024-09-21T10:41:06.413 INFO:tasks.workunit.client.0.smithi060.stdout:5/753: link d5/d45/d5a/f7e d5/d45/d77/ff9 0 2024-09-21T10:41:06.415 INFO:tasks.workunit.client.0.smithi060.stdout:6/883: creat d3/d12/d16/f116 x:0 0 0 2024-09-21T10:41:06.416 INFO:tasks.workunit.client.0.smithi060.stdout:9/664: symlink d3/d16/d42/d7e/d85/le6 0 2024-09-21T10:41:06.417 INFO:tasks.workunit.client.0.smithi060.stdout:9/665: creat d3/d15/d53/dc8/fe7 x:0 0 0 2024-09-21T10:41:06.417 INFO:tasks.workunit.client.0.smithi060.stdout:9/666: stat d3/d16/d42/d7e/f94 0 2024-09-21T10:41:06.420 INFO:tasks.workunit.client.0.smithi060.stdout:2/512: mkdir d3/d20/d15/d30/d8b/d69/d83/da8 0 2024-09-21T10:41:06.421 INFO:tasks.workunit.client.0.smithi060.stdout:8/715: rename d2/c3b to d2/d26/d37/d64/d65/cee 0 2024-09-21T10:41:06.423 INFO:tasks.workunit.client.0.smithi060.stdout:5/754: mkdir d5/d45/d6d/d10/d19/d21/d7f/d89/dfa 0 2024-09-21T10:41:06.424 INFO:tasks.workunit.client.0.smithi060.stdout:7/737: dwrite da/d14/d35/f1d [0,4194304] 0 2024-09-21T10:41:06.424 INFO:tasks.workunit.client.0.smithi060.stdout:5/755: dread d5/d45/d6d/d10/d19/d8d/d60/fee [0,4194304] 0 2024-09-21T10:41:06.425 INFO:tasks.workunit.client.0.smithi060.stdout:5/756: chown d5/d45/d6d/d10/d19/d21/d7f 24 1 2024-09-21T10:41:06.425 INFO:tasks.workunit.client.0.smithi060.stdout:7/738: creat da/d14/d35/de7/ffd x:0 0 0 2024-09-21T10:41:06.425 INFO:tasks.workunit.client.0.smithi060.stdout:6/884: mkdir d3/d12/d65/d7f/db5/d117 0 2024-09-21T10:41:06.425 INFO:tasks.workunit.client.0.smithi060.stdout:7/739: read - da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/feb zero size 2024-09-21T10:41:06.426 INFO:tasks.workunit.client.0.smithi060.stdout:4/693: dwrite d0/d83/d6a/d6b/d32/f75 [0,4194304] 0 2024-09-21T10:41:06.428 INFO:tasks.workunit.client.0.smithi060.stdout:2/513: link d3/d20/d15/d4c/d82/c96 d3/d79/ca9 0 2024-09-21T10:41:06.429 INFO:tasks.workunit.client.0.smithi060.stdout:8/716: unlink d2/d18/d4b/d61/f78 0 2024-09-21T10:41:06.434 INFO:tasks.workunit.client.0.smithi060.stdout:2/514: creat d3/d20/d15/d4c/d82/faa x:0 0 0 2024-09-21T10:41:06.436 INFO:tasks.workunit.client.0.smithi060.stdout:2/515: getdents d3/d7/d24/d33 0 2024-09-21T10:41:06.436 INFO:tasks.workunit.client.0.smithi060.stdout:2/516: fsync d3/d20/d15/d30/d8b/fa4 0 2024-09-21T10:41:06.436 INFO:tasks.workunit.client.0.smithi060.stdout:2/517: write d3/d20/d17/f92 [230610,60965] 0 2024-09-21T10:41:06.438 INFO:tasks.workunit.client.0.smithi060.stdout:2/518: mknod d3/d20/d15/d30/cab 0 2024-09-21T10:41:06.440 INFO:tasks.workunit.client.0.smithi060.stdout:2/519: symlink d3/d20/d15/d30/d8b/d69/d83/lac 0 2024-09-21T10:41:06.441 INFO:tasks.workunit.client.0.smithi060.stdout:2/520: symlink d3/d20/d15/d30/d5c/lad 0 2024-09-21T10:41:06.442 INFO:tasks.workunit.client.0.smithi060.stdout:2/521: symlink d3/d7/d18/lae 0 2024-09-21T10:41:06.443 INFO:tasks.workunit.client.0.smithi060.stdout:2/522: getdents d3/d20/d15/d30/d8b/d69 0 2024-09-21T10:41:06.443 INFO:tasks.workunit.client.0.smithi060.stdout:2/523: dread - d3/d20/d15/d30/d8b/fa4 zero size 2024-09-21T10:41:06.444 INFO:tasks.workunit.client.0.smithi060.stdout:2/524: dread - d3/d20/d15/d30/d8b/fa4 zero size 2024-09-21T10:41:06.450 INFO:tasks.workunit.client.0.smithi060.stdout:8/717: dread d2/f1e [0,4194304] 0 2024-09-21T10:41:06.451 INFO:tasks.workunit.client.0.smithi060.stdout:2/525: write d3/d7/d24/f2a [6945865,115606] 0 2024-09-21T10:41:06.451 INFO:tasks.workunit.client.0.smithi060.stdout:2/526: readlink d3/d20/d15/l1d 0 2024-09-21T10:41:06.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/527: creat d3/d20/d15/d30/d6a/d9a/faf x:0 0 0 2024-09-21T10:41:06.456 INFO:tasks.workunit.client.0.smithi060.stdout:2/528: truncate d3/f38 1183993 0 2024-09-21T10:41:06.456 INFO:tasks.workunit.client.0.smithi060.stdout:2/529: fsync d3/d7/d23/f7c 0 2024-09-21T10:41:06.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/530: fdatasync d3/d7/f34 0 2024-09-21T10:41:06.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/531: fsync f2 0 2024-09-21T10:41:06.458 INFO:tasks.workunit.client.0.smithi060.stdout:5/757: dwrite d5/f8 [4194304,4194304] 0 2024-09-21T10:41:06.458 INFO:tasks.workunit.client.0.smithi060.stdout:4/694: dwrite d0/d5/d12/fd2 [0,4194304] 0 2024-09-21T10:41:06.459 INFO:tasks.workunit.client.0.smithi060.stdout:2/532: rename d3/d7/d24/d25/f51 to d3/d20/d15/d30/d6a/d9a/fb0 0 2024-09-21T10:41:06.459 INFO:tasks.workunit.client.0.smithi060.stdout:2/533: creat d3/d7/d24/fb1 x:0 0 0 2024-09-21T10:41:06.459 INFO:tasks.workunit.client.0.smithi060.stdout:6/885: dwrite d3/d12/d16/d22/dd2/fa0 [0,4194304] 0 2024-09-21T10:41:06.467 INFO:tasks.workunit.client.0.smithi060.stdout:5/758: dread d5/d45/d6d/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:41:06.467 INFO:tasks.workunit.client.0.smithi060.stdout:5/759: write d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/fc2 [612369,40853] 0 2024-09-21T10:41:06.541 INFO:tasks.workunit.client.0.smithi060.stdout:4/695: mkdir d0/d83/dec 0 2024-09-21T10:41:06.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/758: fsync d0/d1/d11/fd3 0 2024-09-21T10:41:06.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/759: fdatasync d0/d1/d11/d2a/d87/f9d 0 2024-09-21T10:41:06.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/760: write d0/d1/ff3 [506225,48017] 0 2024-09-21T10:41:06.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/761: readlink d0/d1/d11/d2a/d87/lac 0 2024-09-21T10:41:06.546 INFO:tasks.workunit.client.0.smithi060.stdout:3/762: chown d0/d1/d11/d2a/d43/c99 0 1 2024-09-21T10:41:06.548 INFO:tasks.workunit.client.0.smithi060.stdout:6/886: link d3/d12/d65/d7f/lf5 d3/d12/d16/d1a/d60/dac/l118 0 2024-09-21T10:41:06.550 INFO:tasks.workunit.client.0.smithi060.stdout:5/760: rename d5/d45/d6d/d10/d19/c73 to d5/d45/d5a/cfb 0 2024-09-21T10:41:06.550 INFO:tasks.workunit.client.0.smithi060.stdout:5/761: chown d5/d45/d6d/d10/d19/d21/d7f/d89 72 1 2024-09-21T10:41:06.551 INFO:tasks.workunit.client.0.smithi060.stdout:5/762: dread - d5/d45/faa zero size 2024-09-21T10:41:06.553 INFO:tasks.workunit.client.0.smithi060.stdout:3/763: getdents d0/d1/d11/d2a/d43 0 2024-09-21T10:41:06.554 INFO:tasks.workunit.client.0.smithi060.stdout:6/887: getdents d3/d12/d16/d25 0 2024-09-21T10:41:06.556 INFO:tasks.workunit.client.0.smithi060.stdout:4/696: rename d0/d83/d6a/d6b/d32/d57/d90/fc3 to d0/d83/d6a/d6b/fed 0 2024-09-21T10:41:06.557 INFO:tasks.workunit.client.0.smithi060.stdout:5/763: mknod d5/d45/d77/d8f/cfc 0 2024-09-21T10:41:06.558 INFO:tasks.workunit.client.0.smithi060.stdout:5/764: write d5/d45/d6d/fd7 [928871,39985] 0 2024-09-21T10:41:06.558 INFO:tasks.workunit.client.0.smithi060.stdout:3/764: mkdir d0/d1/d11/d46/dfc 0 2024-09-21T10:41:06.559 INFO:tasks.workunit.client.0.smithi060.stdout:6/888: creat d3/d12/d65/d7f/db5/f119 x:0 0 0 2024-09-21T10:41:06.560 INFO:tasks.workunit.client.0.smithi060.stdout:4/697: dread d0/d5/d12/f95 [0,4194304] 0 2024-09-21T10:41:06.561 INFO:tasks.workunit.client.0.smithi060.stdout:6/889: rename d3/d12/d16/d22/dd2/fa0 to d3/d12/d16/d1a/d9a/f11a 0 2024-09-21T10:41:06.564 INFO:tasks.workunit.client.0.smithi060.stdout:4/698: symlink d0/d3c/lee 0 2024-09-21T10:41:06.565 INFO:tasks.workunit.client.0.smithi060.stdout:3/765: dread d0/d1/d11/d2a/f2e [0,4194304] 0 2024-09-21T10:41:06.565 INFO:tasks.workunit.client.0.smithi060.stdout:3/766: chown d0/d1/d11/d2a/de3 282184399 1 2024-09-21T10:41:06.568 INFO:tasks.workunit.client.0.smithi060.stdout:3/767: mknod d0/cfd 0 2024-09-21T10:41:06.568 INFO:tasks.workunit.client.0.smithi060.stdout:5/765: dread d5/d45/d6d/d10/d19/d21/d7f/d89/f74 [0,4194304] 0 2024-09-21T10:41:06.572 INFO:tasks.workunit.client.0.smithi060.stdout:3/768: rename d0/d1/d11/d2a/d64/f72 to d0/d1/d5c/ffe 0 2024-09-21T10:41:06.572 INFO:tasks.workunit.client.0.smithi060.stdout:3/769: chown d0/d1/d9e/cef 0 1 2024-09-21T10:41:06.572 INFO:tasks.workunit.client.0.smithi060.stdout:3/770: dread - d0/d1/d52/f7c zero size 2024-09-21T10:41:06.572 INFO:tasks.workunit.client.0.smithi060.stdout:6/890: read d3/d12/d16/d25/fcc [587441,27372] 0 2024-09-21T10:41:06.572 INFO:tasks.workunit.client.0.smithi060.stdout:6/891: chown d3/dd/l101 1761779588 1 2024-09-21T10:41:06.573 INFO:tasks.workunit.client.0.smithi060.stdout:5/766: rename d5/cb2 to d5/d45/d6d/ddf/de4/cfd 0 2024-09-21T10:41:06.573 INFO:tasks.workunit.client.0.smithi060.stdout:5/767: readlink d5/d45/d6d/d10/d19/d8d/l6c 0 2024-09-21T10:41:06.575 INFO:tasks.workunit.client.0.smithi060.stdout:6/892: symlink d3/d12/d38/l11b 0 2024-09-21T10:41:06.575 INFO:tasks.workunit.client.0.smithi060.stdout:6/893: read d3/d12/d16/d1a/d83/ddd/f68 [696935,49816] 0 2024-09-21T10:41:06.576 INFO:tasks.workunit.client.0.smithi060.stdout:5/768: mknod d5/d45/cfe 0 2024-09-21T10:41:06.577 INFO:tasks.workunit.client.0.smithi060.stdout:6/894: mkdir d3/d12/d38/d9e/d11c 0 2024-09-21T10:41:06.578 INFO:tasks.workunit.client.0.smithi060.stdout:5/769: getdents d5/d45/d6d/d10/d19/d21/d7f/d89/dbe 0 2024-09-21T10:41:06.579 INFO:tasks.workunit.client.0.smithi060.stdout:6/895: truncate d3/d12/d38/f8d 3900262 0 2024-09-21T10:41:06.580 INFO:tasks.workunit.client.0.smithi060.stdout:4/699: dwrite d0/d83/d6a/d6b/d65/fd7 [0,4194304] 0 2024-09-21T10:41:06.581 INFO:tasks.workunit.client.0.smithi060.stdout:5/770: creat d5/d45/d6d/ddf/fff x:0 0 0 2024-09-21T10:41:06.585 INFO:tasks.workunit.client.0.smithi060.stdout:6/896: creat d3/d12/d4e/f11d x:0 0 0 2024-09-21T10:41:06.591 INFO:tasks.workunit.client.0.smithi060.stdout:5/771: creat d5/d7a/f100 x:0 0 0 2024-09-21T10:41:06.592 INFO:tasks.workunit.client.0.smithi060.stdout:5/772: mknod d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/c101 0 2024-09-21T10:41:06.595 INFO:tasks.workunit.client.0.smithi060.stdout:4/700: dwrite d0/d5/f4b [0,4194304] 0 2024-09-21T10:41:06.601 INFO:tasks.workunit.client.0.smithi060.stdout:6/897: dwrite d3/d12/d16/f116 [0,4194304] 0 2024-09-21T10:41:06.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/701: read d0/d83/d6a/d6b/d32/d57/f77 [185071,81834] 0 2024-09-21T10:41:06.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/702: chown d0/d83/d6a/d6b/d32/d57/d90/f97 1 1 2024-09-21T10:41:06.604 INFO:tasks.workunit.client.0.smithi060.stdout:4/703: fsync d0/d83/d6a/d6b/d65/d51/f99 0 2024-09-21T10:41:06.605 INFO:tasks.workunit.client.0.smithi060.stdout:5/773: dread d5/d45/d77/ff9 [0,4194304] 0 2024-09-21T10:41:06.609 INFO:tasks.workunit.client.0.smithi060.stdout:3/771: getdents d0/d1/d5c 0 2024-09-21T10:41:06.611 INFO:tasks.workunit.client.0.smithi060.stdout:3/772: link d0/d1/d1e/d34/la5 d0/d1/d11/d2a/de3/lff 0 2024-09-21T10:41:06.612 INFO:tasks.workunit.client.0.smithi060.stdout:5/774: dread d5/d45/d6d/d10/d19/d8d/d60/fb7 [0,4194304] 0 2024-09-21T10:41:06.613 INFO:tasks.workunit.client.0.smithi060.stdout:3/773: link d0/d1/db0/ce5 d0/d1/d11/d2a/d85/c100 0 2024-09-21T10:41:06.613 INFO:tasks.workunit.client.0.smithi060.stdout:3/774: readlink d0/d1/d52/lad 0 2024-09-21T10:41:06.613 INFO:tasks.workunit.client.0.smithi060.stdout:5/775: mkdir d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102 0 2024-09-21T10:41:06.615 INFO:tasks.workunit.client.0.smithi060.stdout:3/775: mkdir d0/d1/d24/d101 0 2024-09-21T10:41:06.615 INFO:tasks.workunit.client.0.smithi060.stdout:3/776: chown d0/d1/d1e/c6a 1038 1 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/776: creat d5/d7a/d84/dcc/f103 x:0 0 0 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/777: creat d5/d71/f104 x:0 0 0 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/778: creat d5/f105 x:0 0 0 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/779: read - d5/d45/d6d/d10/d19/d21/d30/d49/ff4 zero size 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/780: fsync d5/d7a/d84/fc1 0 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/781: stat d5/d45/d6d/d10/d19/d21/d7f/d89 0 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/782: truncate d5/d45/d6d/d10/d19/d21/d7f/d89/fb5 5176102 0 2024-09-21T10:41:06.616 INFO:tasks.workunit.client.0.smithi060.stdout:3/777: creat d0/d1/d24/f102 x:0 0 0 2024-09-21T10:41:06.620 INFO:tasks.workunit.client.0.smithi060.stdout:3/778: rename d0/d1/d11/d53/da2/ffb to d0/d1/d24/d81/f103 0 2024-09-21T10:41:06.627 INFO:tasks.workunit.client.0.smithi060.stdout:5/783: write d5/d45/d6d/d10/d19/f4e [3834627,125943] 0 2024-09-21T10:41:06.627 INFO:tasks.workunit.client.0.smithi060.stdout:5/784: chown d5/d45/d77/l8e 338022194 1 2024-09-21T10:41:06.628 INFO:tasks.workunit.client.0.smithi060.stdout:5/785: rename d5/d45/c81 to d5/d7a/d84/dcc/db6/c106 0 2024-09-21T10:41:06.630 INFO:tasks.workunit.client.0.smithi060.stdout:4/704: dwrite d0/d5/f10 [0,4194304] 0 2024-09-21T10:41:06.630 INFO:tasks.workunit.client.0.smithi060.stdout:4/705: read d0/d83/d6a/d6b/d32/d57/fbc [156389,38702] 0 2024-09-21T10:41:06.632 INFO:tasks.workunit.client.0.smithi060.stdout:4/706: creat d0/d5/d12/d3d/dd5/fef x:0 0 0 2024-09-21T10:41:06.633 INFO:tasks.workunit.client.0.smithi060.stdout:4/707: symlink d0/d5/d3a/lf0 0 2024-09-21T10:41:06.633 INFO:tasks.workunit.client.0.smithi060.stdout:4/708: creat d0/d5/d12/d15/d4d/ff1 x:0 0 0 2024-09-21T10:41:06.633 INFO:tasks.workunit.client.0.smithi060.stdout:4/709: creat d0/d3c/d67/d7d/d87/ff2 x:0 0 0 2024-09-21T10:41:06.635 INFO:tasks.workunit.client.0.smithi060.stdout:3/779: dread d0/d1/f14 [0,4194304] 0 2024-09-21T10:41:06.636 INFO:tasks.workunit.client.0.smithi060.stdout:4/710: mknod d0/d5/d3a/dbe/cf3 0 2024-09-21T10:41:06.646 INFO:tasks.workunit.client.0.smithi060.stdout:4/711: dread d0/d3c/f91 [0,4194304] 0 2024-09-21T10:41:06.646 INFO:tasks.workunit.client.0.smithi060.stdout:4/712: creat d0/d5/d3a/ff4 x:0 0 0 2024-09-21T10:41:06.647 INFO:tasks.workunit.client.0.smithi060.stdout:4/713: stat d0/d5/d12/d3d/dd5/l38 0 2024-09-21T10:41:06.647 INFO:tasks.workunit.client.0.smithi060.stdout:4/714: write d0/d5/f1a [216121,109741] 0 2024-09-21T10:41:06.650 INFO:tasks.workunit.client.0.smithi060.stdout:5/786: dwrite d5/d45/d6d/d10/d19/d8d/d50/fb1 [0,4194304] 0 2024-09-21T10:41:06.651 INFO:tasks.workunit.client.0.smithi060.stdout:3/780: dwrite d0/d1/d1e/d34/fc5 [0,4194304] 0 2024-09-21T10:41:06.655 INFO:tasks.workunit.client.0.smithi060.stdout:3/781: mkdir d0/d1/d11/d2a/d45/d104 0 2024-09-21T10:41:06.657 INFO:tasks.workunit.client.0.smithi060.stdout:3/782: link d0/d1/db0/lc1 d0/d1/d11/d2a/d45/d104/l105 0 2024-09-21T10:41:06.657 INFO:tasks.workunit.client.0.smithi060.stdout:3/783: write d0/d1/d11/d2a/dd4/fee [492405,77055] 0 2024-09-21T10:41:06.661 INFO:tasks.workunit.client.0.smithi060.stdout:5/787: write d5/d45/d6d/d10/d19/d8d/d50/fb1 [594660,98799] 0 2024-09-21T10:41:06.661 INFO:tasks.workunit.client.0.smithi060.stdout:4/715: dwrite d0/d5/d12/d15/f9b [0,4194304] 0 2024-09-21T10:41:06.662 INFO:tasks.workunit.client.0.smithi060.stdout:4/716: chown d0/d5/d12/d15/d4d/f54 20 1 2024-09-21T10:41:06.662 INFO:tasks.workunit.client.0.smithi060.stdout:5/788: dread d5/d45/d5a/d3a/fba [0,4194304] 0 2024-09-21T10:41:06.662 INFO:tasks.workunit.client.0.smithi060.stdout:5/789: getdents d5/d45/d5a/dbd/de1 0 2024-09-21T10:41:06.667 INFO:tasks.workunit.client.0.smithi060.stdout:4/717: rename d0/d3c/d67/f68 to d0/df/d88/ff5 0 2024-09-21T10:41:06.669 INFO:tasks.workunit.client.0.smithi060.stdout:3/784: rmdir d0/d1/d11/d2a/d45 39 2024-09-21T10:41:06.669 INFO:tasks.workunit.client.0.smithi060.stdout:3/785: write d0/d1/d11/d2a/dd4/fdd [890299,49133] 0 2024-09-21T10:41:06.671 INFO:tasks.workunit.client.0.smithi060.stdout:4/718: creat d0/d83/d6a/d6b/d32/dd6/ff6 x:0 0 0 2024-09-21T10:41:06.672 INFO:tasks.workunit.client.0.smithi060.stdout:4/719: stat d0/d3c 0 2024-09-21T10:41:06.672 INFO:tasks.workunit.client.0.smithi060.stdout:4/720: truncate d0/f41 3071718 0 2024-09-21T10:41:06.672 INFO:tasks.workunit.client.0.smithi060.stdout:4/721: write d0/d5/d12/d15/da6/fae [418323,125516] 0 2024-09-21T10:41:06.676 INFO:tasks.workunit.client.0.smithi060.stdout:5/790: rmdir d5/d45/d77/d8f 39 2024-09-21T10:41:06.678 INFO:tasks.workunit.client.0.smithi060.stdout:4/722: mknod d0/d83/d6a/d6b/d32/cf7 0 2024-09-21T10:41:06.679 INFO:tasks.workunit.client.0.smithi060.stdout:5/791: mkdir d5/d45/d6d/d107 0 2024-09-21T10:41:06.679 INFO:tasks.workunit.client.0.smithi060.stdout:5/792: write d5/d45/d6d/d10/d19/d21/fe7 [145689,60688] 0 2024-09-21T10:41:06.680 INFO:tasks.workunit.client.0.smithi060.stdout:4/723: link d0/d5/d12/d15/caa d0/d83/d6a/cf8 0 2024-09-21T10:41:06.681 INFO:tasks.workunit.client.0.smithi060.stdout:3/786: dwrite d0/d1/d11/d46/f31 [4194304,4194304] 0 2024-09-21T10:41:06.682 INFO:tasks.workunit.client.0.smithi060.stdout:5/793: link d5/d45/d6d/d10/d19/d21/d7f/cd1 d5/d45/d6d/d10/d19/d8d/d60/d61/c108 0 2024-09-21T10:41:06.682 INFO:tasks.workunit.client.0.smithi060.stdout:5/794: write d5/d45/d6d/d10/d19/d21/d30/d49/f75 [119670,122475] 0 2024-09-21T10:41:06.683 INFO:tasks.workunit.client.0.smithi060.stdout:4/724: creat d0/ff9 x:0 0 0 2024-09-21T10:41:06.684 INFO:tasks.workunit.client.0.smithi060.stdout:3/787: truncate d0/d1/d11/f15 3974780 0 2024-09-21T10:41:06.686 INFO:tasks.workunit.client.0.smithi060.stdout:4/725: symlink d0/df/d88/lfa 0 2024-09-21T10:41:06.687 INFO:tasks.workunit.client.0.smithi060.stdout:3/788: symlink d0/d1/d11/d53/d98/db8/de9/l106 0 2024-09-21T10:41:06.687 INFO:tasks.workunit.client.0.smithi060.stdout:3/789: chown d0/d1/d1e/d34/l6f 31196187 1 2024-09-21T10:41:06.691 INFO:tasks.workunit.client.0.smithi060.stdout:4/726: mknod d0/d5/d12/d15/d4d/cfb 0 2024-09-21T10:41:06.693 INFO:tasks.workunit.client.0.smithi060.stdout:1/649: sync 2024-09-21T10:41:06.693 INFO:tasks.workunit.client.0.smithi060.stdout:0/794: sync 2024-09-21T10:41:06.693 INFO:tasks.workunit.client.0.smithi060.stdout:9/667: sync 2024-09-21T10:41:06.693 INFO:tasks.workunit.client.0.smithi060.stdout:0/795: chown d5/d10/da/f13 8818 1 2024-09-21T10:41:06.693 INFO:tasks.workunit.client.0.smithi060.stdout:1/650: read - d6/d24/da/db/dd/fa6 zero size 2024-09-21T10:41:06.693 INFO:tasks.workunit.client.0.smithi060.stdout:0/796: fdatasync d5/d10/da/d15/f4c 0 2024-09-21T10:41:06.694 INFO:tasks.workunit.client.0.smithi060.stdout:9/668: creat d3/d16/d95/fe8 x:0 0 0 2024-09-21T10:41:06.700 INFO:tasks.workunit.client.0.smithi060.stdout:9/669: rmdir d3/d16/d42/d7e/d85 39 2024-09-21T10:41:06.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/670: chown d3/d15/d58/c75 880729634 1 2024-09-21T10:41:06.701 INFO:tasks.workunit.client.0.smithi060.stdout:9/671: stat d3/d5e/d60/d2f/fd7 0 2024-09-21T10:41:06.707 INFO:tasks.workunit.client.0.smithi060.stdout:1/651: dread d6/d24/da/db/f85 [0,4194304] 0 2024-09-21T10:41:06.707 INFO:tasks.workunit.client.0.smithi060.stdout:1/652: dread - d6/d4a/d5a/db0/fba zero size 2024-09-21T10:41:06.711 INFO:tasks.workunit.client.0.smithi060.stdout:5/795: dwrite d5/d45/faa [0,4194304] 0 2024-09-21T10:41:06.712 INFO:tasks.workunit.client.0.smithi060.stdout:3/790: dwrite d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:41:06.712 INFO:tasks.workunit.client.0.smithi060.stdout:3/791: write d0/d1/d11/d46/f31 [1964119,22549] 0 2024-09-21T10:41:06.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/672: getdents d3/d15/d92 0 2024-09-21T10:41:06.717 INFO:tasks.workunit.client.0.smithi060.stdout:1/653: dread d6/d24/fc [0,4194304] 0 2024-09-21T10:41:06.723 INFO:tasks.workunit.client.0.smithi060.stdout:4/727: truncate d0/d5/d12/d3d/dd5/f2d 1004020 0 2024-09-21T10:41:06.723 INFO:tasks.workunit.client.0.smithi060.stdout:4/728: fdatasync d0/d5/fc5 0 2024-09-21T10:41:06.727 INFO:tasks.workunit.client.0.smithi060.stdout:5/796: creat d5/d45/d6d/d107/f109 x:0 0 0 2024-09-21T10:41:06.728 INFO:tasks.workunit.client.0.smithi060.stdout:3/792: symlink d0/d1/d11/l107 0 2024-09-21T10:41:06.728 INFO:tasks.workunit.client.0.smithi060.stdout:3/793: fdatasync d0/d1/d11/f77 0 2024-09-21T10:41:06.728 INFO:tasks.workunit.client.0.smithi060.stdout:3/794: readlink d0/d1/d11/d2a/d45/d104/l105 0 2024-09-21T10:41:06.728 INFO:tasks.workunit.client.0.smithi060.stdout:3/795: chown d0/d1/d11/d46/fbf 2074471655 1 2024-09-21T10:41:06.730 INFO:tasks.workunit.client.0.smithi060.stdout:9/673: creat d3/d15/d58/fe9 x:0 0 0 2024-09-21T10:41:06.730 INFO:tasks.workunit.client.0.smithi060.stdout:9/674: fsync d3/d16/d1a/f72 0 2024-09-21T10:41:06.731 INFO:tasks.workunit.client.0.smithi060.stdout:1/654: creat d6/d24/da/db/de/d7c/fe6 x:0 0 0 2024-09-21T10:41:06.737 INFO:tasks.workunit.client.0.smithi060.stdout:4/729: rename d0/ff9 to d0/d3c/d67/d7d/ffc 0 2024-09-21T10:41:06.738 INFO:tasks.workunit.client.0.smithi060.stdout:5/797: symlink d5/l10a 0 2024-09-21T10:41:06.738 INFO:tasks.workunit.client.0.smithi060.stdout:5/798: fsync d5/d45/d6d/d10/d19/d21/d7f/f9b 0 2024-09-21T10:41:06.740 INFO:tasks.workunit.client.0.smithi060.stdout:3/796: mkdir d0/d1/d24/d81/d108 0 2024-09-21T10:41:06.740 INFO:tasks.workunit.client.0.smithi060.stdout:3/797: read - d0/d1/db0/dba/ff9 zero size 2024-09-21T10:41:06.740 INFO:tasks.workunit.client.0.smithi060.stdout:3/798: write d0/d1/d24/f102 [39619,43370] 0 2024-09-21T10:41:06.741 INFO:tasks.workunit.client.0.smithi060.stdout:9/675: creat d3/d16/d1f/fea x:0 0 0 2024-09-21T10:41:06.746 INFO:tasks.workunit.client.0.smithi060.stdout:1/655: rename d6/d4a/d5a/l74 to d6/d4a/d5a/db0/dd0/le7 0 2024-09-21T10:41:06.748 INFO:tasks.workunit.client.0.smithi060.stdout:4/730: creat d0/d83/d6a/ffd x:0 0 0 2024-09-21T10:41:06.752 INFO:tasks.workunit.client.0.smithi060.stdout:9/676: rmdir d3/d15/d92 39 2024-09-21T10:41:06.752 INFO:tasks.workunit.client.0.smithi060.stdout:9/677: creat d3/d16/d5f/feb x:0 0 0 2024-09-21T10:41:06.752 INFO:tasks.workunit.client.0.smithi060.stdout:9/678: readlink d3/d16/d5f/l98 0 2024-09-21T10:41:06.752 INFO:tasks.workunit.client.0.smithi060.stdout:9/679: write d3/d16/d5f/f88 [820684,91673] 0 2024-09-21T10:41:06.756 INFO:tasks.workunit.client.0.smithi060.stdout:1/656: link d6/d4a/d5a/db0/d97/le2 d6/d24/da/d45/d76/le8 0 2024-09-21T10:41:06.756 INFO:tasks.workunit.client.0.smithi060.stdout:1/657: creat d6/d24/da/db/dd/fe9 x:0 0 0 2024-09-21T10:41:06.758 INFO:tasks.workunit.client.0.smithi060.stdout:4/731: mknod d0/d3c/d67/d7d/cfe 0 2024-09-21T10:41:06.760 INFO:tasks.workunit.client.0.smithi060.stdout:3/799: dwrite d0/d1/d24/f5f [0,4194304] 0 2024-09-21T10:41:06.760 INFO:tasks.workunit.client.0.smithi060.stdout:3/800: stat d0/d1/f3f 0 2024-09-21T10:41:06.764 INFO:tasks.workunit.client.0.smithi060.stdout:5/799: dwrite d5/d45/d6d/d10/d19/f72 [0,4194304] 0 2024-09-21T10:41:06.765 INFO:tasks.workunit.client.0.smithi060.stdout:1/658: rename d6/d24/da/db/dc2 to d6/d24/da/dea 0 2024-09-21T10:41:06.770 INFO:tasks.workunit.client.0.smithi060.stdout:9/680: dwrite d3/d16/d42/d7e/f94 [0,4194304] 0 2024-09-21T10:41:06.772 INFO:tasks.workunit.client.0.smithi060.stdout:5/800: creat d5/d7a/d84/d88/f10b x:0 0 0 2024-09-21T10:41:06.773 INFO:tasks.workunit.client.0.smithi060.stdout:1/659: creat d6/d24/da/dea/feb x:0 0 0 2024-09-21T10:41:06.777 INFO:tasks.workunit.client.0.smithi060.stdout:5/801: mknod d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/c10c 0 2024-09-21T10:41:06.779 INFO:tasks.workunit.client.0.smithi060.stdout:1/660: link d6/d4a/d5a/db0/fb1 d6/d24/da/db/d79/d86/d9f/fec 0 2024-09-21T10:41:06.779 INFO:tasks.workunit.client.0.smithi060.stdout:1/661: chown d6/d24/da/db/d79/d86/d9f/dcd 908 1 2024-09-21T10:41:06.781 INFO:tasks.workunit.client.0.smithi060.stdout:5/802: unlink d5/d71/fce 0 2024-09-21T10:41:06.782 INFO:tasks.workunit.client.0.smithi060.stdout:4/732: dwrite d0/d3c/fb7 [0,4194304] 0 2024-09-21T10:41:06.786 INFO:tasks.workunit.client.0.smithi060.stdout:1/662: creat d6/d24/da/db/d79/d86/d9f/daa/fed x:0 0 0 2024-09-21T10:41:06.786 INFO:tasks.workunit.client.0.smithi060.stdout:1/663: chown d6/d24/da/db/dd/fe9 7741 1 2024-09-21T10:41:06.786 INFO:tasks.workunit.client.0.smithi060.stdout:1/664: write d6/d24/da/db/d79/d86/d9f/fc0 [641220,26781] 0 2024-09-21T10:41:06.790 INFO:tasks.workunit.client.0.smithi060.stdout:4/733: link d0/d83/d6a/d6b/d65/d51/f99 d0/d5/d12/d15/d72/fff 0 2024-09-21T10:41:06.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/801: dwrite d0/d1/d11/d2a/d43/fca [0,4194304] 0 2024-09-21T10:41:06.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/802: dread - d0/d1/d5c/dc4/fda zero size 2024-09-21T10:41:06.790 INFO:tasks.workunit.client.0.smithi060.stdout:3/803: fsync d0/d1/f3f 0 2024-09-21T10:41:06.790 INFO:tasks.workunit.client.0.smithi060.stdout:9/681: dwrite d3/d15/d92/fdf [0,4194304] 0 2024-09-21T10:41:06.790 INFO:tasks.workunit.client.0.smithi060.stdout:9/682: stat d3/d5e/d60/f91 0 2024-09-21T10:41:06.791 INFO:tasks.workunit.client.0.smithi060.stdout:9/683: creat d3/d16/d1a/d71/fec x:0 0 0 2024-09-21T10:41:06.791 INFO:tasks.workunit.client.0.smithi060.stdout:1/665: symlink d6/d24/da/db/d7e/lee 0 2024-09-21T10:41:06.791 INFO:tasks.workunit.client.0.smithi060.stdout:1/666: write d6/d24/da/db/de/fe4 [812732,55966] 0 2024-09-21T10:41:06.791 INFO:tasks.workunit.client.0.smithi060.stdout:1/667: creat d6/d24/da/db/d79/d86/fef x:0 0 0 2024-09-21T10:41:06.791 INFO:tasks.workunit.client.0.smithi060.stdout:1/668: stat d6/d4a/d5a/ca7 0 2024-09-21T10:41:06.792 INFO:tasks.workunit.client.0.smithi060.stdout:1/669: chown d6/d24/da/db/d79/d86/d9f/daa 35456814 1 2024-09-21T10:41:06.792 INFO:tasks.workunit.client.0.smithi060.stdout:1/670: write d6/d24/fa3 [746970,69352] 0 2024-09-21T10:41:06.792 INFO:tasks.workunit.client.0.smithi060.stdout:4/734: rename d0/d5/d12/d15/d4d/f54 to d0/d83/d6a/d6b/d65/d51/f100 0 2024-09-21T10:41:06.794 INFO:tasks.workunit.client.0.smithi060.stdout:5/803: dwrite d5/f24 [0,4194304] 0 2024-09-21T10:41:06.795 INFO:tasks.workunit.client.0.smithi060.stdout:3/804: unlink d0/d1/d11/d2a/d87/fb1 0 2024-09-21T10:41:06.795 INFO:tasks.workunit.client.0.smithi060.stdout:3/805: write d0/d1/ff3 [1286484,81879] 0 2024-09-21T10:41:06.801 INFO:tasks.workunit.client.0.smithi060.stdout:3/806: dread d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:41:06.802 INFO:tasks.workunit.client.0.smithi060.stdout:9/684: mknod d3/d5e/d60/d2f/ced 0 2024-09-21T10:41:06.809 INFO:tasks.workunit.client.0.smithi060.stdout:1/671: link d6/d24/da/d45/ld9 d6/d24/da/db/d79/lf0 0 2024-09-21T10:41:06.810 INFO:tasks.workunit.client.0.smithi060.stdout:9/685: write d3/d16/d5f/fbb [2493312,16633] 0 2024-09-21T10:41:06.811 INFO:tasks.workunit.client.0.smithi060.stdout:4/735: symlink d0/d8b/l101 0 2024-09-21T10:41:06.811 INFO:tasks.workunit.client.0.smithi060.stdout:4/736: truncate d0/d83/d6a/d6b/f45 814226 0 2024-09-21T10:41:06.818 INFO:tasks.workunit.client.0.smithi060.stdout:5/804: mknod d5/d45/d5a/c10d 0 2024-09-21T10:41:06.818 INFO:tasks.workunit.client.0.smithi060.stdout:5/805: chown d5/d45/d77/d8f/d91/fea 3061 1 2024-09-21T10:41:06.818 INFO:tasks.workunit.client.0.smithi060.stdout:5/806: truncate d5/d71/f104 237205 0 2024-09-21T10:41:06.819 INFO:tasks.workunit.client.0.smithi060.stdout:9/686: dread d3/d15/f2b [0,4194304] 0 2024-09-21T10:41:06.820 INFO:tasks.workunit.client.0.smithi060.stdout:4/737: dread d0/d5/d12/d15/f9b [0,4194304] 0 2024-09-21T10:41:06.821 INFO:tasks.workunit.client.0.smithi060.stdout:3/807: link d0/d1/d11/d2a/d85/fa8 d0/d1/d11/d46/dfc/f109 0 2024-09-21T10:41:06.829 INFO:tasks.workunit.client.0.smithi060.stdout:1/672: mknod d6/d4a/d5a/cf1 0 2024-09-21T10:41:06.830 INFO:tasks.workunit.client.0.smithi060.stdout:1/673: stat d6/d24/lc3 0 2024-09-21T10:41:06.832 INFO:tasks.workunit.client.0.smithi060.stdout:5/807: truncate d5/d45/d77/d8f/f96 552811 0 2024-09-21T10:41:06.834 INFO:tasks.workunit.client.0.smithi060.stdout:9/687: creat d3/d15/fee x:0 0 0 2024-09-21T10:41:06.835 INFO:tasks.workunit.client.0.smithi060.stdout:4/738: rename d0/d5/d3a/f5d to d0/d83/dec/f102 0 2024-09-21T10:41:06.837 INFO:tasks.workunit.client.0.smithi060.stdout:3/808: symlink d0/d1/d11/d2a/d43/d4e/l10a 0 2024-09-21T10:41:06.839 INFO:tasks.workunit.client.0.smithi060.stdout:1/674: truncate d6/d4a/d5a/db0/f78 3709515 0 2024-09-21T10:41:06.841 INFO:tasks.workunit.client.0.smithi060.stdout:9/688: dread d3/d16/d42/d7e/f94 [0,4194304] 0 2024-09-21T10:41:06.841 INFO:tasks.workunit.client.0.smithi060.stdout:8/718: sync 2024-09-21T10:41:06.842 INFO:tasks.workunit.client.0.smithi060.stdout:7/740: sync 2024-09-21T10:41:06.844 INFO:tasks.workunit.client.0.smithi060.stdout:8/719: write d2/d26/d37/d62/d74/d83/d89/fa1 [4806176,29470] 0 2024-09-21T10:41:06.844 INFO:tasks.workunit.client.0.smithi060.stdout:5/808: creat d5/d45/d77/d8f/f10e x:0 0 0 2024-09-21T10:41:06.844 INFO:tasks.workunit.client.0.smithi060.stdout:5/809: write d5/d45/d6d/f2b [4004262,73316] 0 2024-09-21T10:41:06.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/810: chown d5/d45/d5a/cfb 6946 1 2024-09-21T10:41:06.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/811: creat d5/d7a/d84/d88/f10f x:0 0 0 2024-09-21T10:41:06.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/812: dread - d5/d45/d6d/d10/d19/d21/d30/d49/ff4 zero size 2024-09-21T10:41:06.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/813: write d5/d45/d6d/d10/d19/d21/d7f/fd2 [292685,42948] 0 2024-09-21T10:41:06.845 INFO:tasks.workunit.client.0.smithi060.stdout:5/814: write d5/f7 [2062244,7457] 0 2024-09-21T10:41:06.850 INFO:tasks.workunit.client.0.smithi060.stdout:4/739: mknod d0/d3c/d67/d7d/c103 0 2024-09-21T10:41:06.850 INFO:tasks.workunit.client.0.smithi060.stdout:4/740: fdatasync d0/d59/f5c 0 2024-09-21T10:41:06.852 INFO:tasks.workunit.client.0.smithi060.stdout:3/809: link d0/d1/db0/lc1 d0/d1/d11/d53/d98/db8/l10b 0 2024-09-21T10:41:06.855 INFO:tasks.workunit.client.0.smithi060.stdout:7/741: creat da/d14/d35/d79/ffe x:0 0 0 2024-09-21T10:41:06.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/742: write da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/f7b [5315220,128136] 0 2024-09-21T10:41:06.857 INFO:tasks.workunit.client.0.smithi060.stdout:7/743: dread - da/d14/d35/d79/db0/df0/ff2 zero size 2024-09-21T10:41:06.858 INFO:tasks.workunit.client.0.smithi060.stdout:5/815: getdents d5/d45/d6d/d10/d19 0 2024-09-21T10:41:06.860 INFO:tasks.workunit.client.0.smithi060.stdout:3/810: creat d0/d1/d11/d2a/d93/f10c x:0 0 0 2024-09-21T10:41:06.860 INFO:tasks.workunit.client.0.smithi060.stdout:3/811: dread - d0/d1/d24/d81/f95 zero size 2024-09-21T10:41:06.860 INFO:tasks.workunit.client.0.smithi060.stdout:9/689: mknod d3/cef 0 2024-09-21T10:41:06.860 INFO:tasks.workunit.client.0.smithi060.stdout:9/690: chown d3/d5e/d60/d2f/d5b/lc9 460 1 2024-09-21T10:41:06.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/691: chown d3/d16/d42/d7e 3152411 1 2024-09-21T10:41:06.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/692: dread - d3/d5e/d60/d2f/fd7 zero size 2024-09-21T10:41:06.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/693: fdatasync d3/d5e/d60/f91 0 2024-09-21T10:41:06.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/694: chown d3/d15/d5a/d64/d9e/le0 12100 1 2024-09-21T10:41:06.863 INFO:tasks.workunit.client.0.smithi060.stdout:7/744: unlink da/d14/d25/cce 0 2024-09-21T10:41:06.865 INFO:tasks.workunit.client.0.smithi060.stdout:5/816: creat d5/d7a/d84/dc3/df3/f110 x:0 0 0 2024-09-21T10:41:06.868 INFO:tasks.workunit.client.0.smithi060.stdout:3/812: rename d0/d1/d11/f32 to d0/d1/d11/d53/da2/dc8/f10d 0 2024-09-21T10:41:06.870 INFO:tasks.workunit.client.0.smithi060.stdout:7/745: truncate da/d60/fc9 473663 0 2024-09-21T10:41:06.871 INFO:tasks.workunit.client.0.smithi060.stdout:7/746: creat da/d14/d35/d32/fff x:0 0 0 2024-09-21T10:41:06.871 INFO:tasks.workunit.client.0.smithi060.stdout:5/817: mknod d5/d7a/d84/d88/de0/c111 0 2024-09-21T10:41:06.872 INFO:tasks.workunit.client.0.smithi060.stdout:3/813: rename d0/c2f to d0/d1/d24/d81/c10e 0 2024-09-21T10:41:06.875 INFO:tasks.workunit.client.0.smithi060.stdout:7/747: unlink da/d14/d35/d79/ffe 0 2024-09-21T10:41:06.880 INFO:tasks.workunit.client.0.smithi060.stdout:8/720: dwrite d2/f97 [0,4194304] 0 2024-09-21T10:41:06.880 INFO:tasks.workunit.client.0.smithi060.stdout:8/721: chown d2/f97 504 1 2024-09-21T10:41:06.883 INFO:tasks.workunit.client.0.smithi060.stdout:5/818: dread d5/d45/d6d/d10/d19/d8d/d50/f58 [0,4194304] 0 2024-09-21T10:41:06.883 INFO:tasks.workunit.client.0.smithi060.stdout:5/819: fsync d5/d45/d6d/d10/d19/d21/f44 0 2024-09-21T10:41:06.884 INFO:tasks.workunit.client.0.smithi060.stdout:5/820: fsync d5/d45/d6d/d10/d19/d21/f83 0 2024-09-21T10:41:06.884 INFO:tasks.workunit.client.0.smithi060.stdout:3/814: dread d0/d1/d24/f40 [0,4194304] 0 2024-09-21T10:41:06.885 INFO:tasks.workunit.client.0.smithi060.stdout:4/741: dwrite d0/d5/d12/d15/da6/fae [0,4194304] 0 2024-09-21T10:41:06.885 INFO:tasks.workunit.client.0.smithi060.stdout:4/742: chown d0/d83/d6a/d6b/d32/d57/fbc 342990212 1 2024-09-21T10:41:06.885 INFO:tasks.workunit.client.0.smithi060.stdout:5/821: write d5/d45/d6d/fd7 [575512,60413] 0 2024-09-21T10:41:06.887 INFO:tasks.workunit.client.0.smithi060.stdout:8/722: symlink d2/d26/d37/d64/d65/dd5/de7/lef 0 2024-09-21T10:41:06.888 INFO:tasks.workunit.client.0.smithi060.stdout:7/748: write da/d14/d35/d79/db0/dd7/d8b/da7/dcd/db6/fba [536062,122276] 0 2024-09-21T10:41:06.892 INFO:tasks.workunit.client.0.smithi060.stdout:8/723: mknod d2/d26/d37/d62/cf0 0 2024-09-21T10:41:06.892 INFO:tasks.workunit.client.0.smithi060.stdout:8/724: chown d2/d26/d37/d62/d74/d83/d89/fd4 0 1 2024-09-21T10:41:06.898 INFO:tasks.workunit.client.0.smithi060.stdout:8/725: read d2/d26/d37/d62/d74/d83/d89/fd4 [309849,4137] 0 2024-09-21T10:41:06.902 INFO:tasks.workunit.client.0.smithi060.stdout:4/743: dread d0/d5/f1a [4194304,4194304] 0 2024-09-21T10:41:06.905 INFO:tasks.workunit.client.0.smithi060.stdout:4/744: rename d0/d3c/d67/fc6 to d0/d83/dda/f104 0 2024-09-21T10:41:06.905 INFO:tasks.workunit.client.0.smithi060.stdout:4/745: read - d0/d5/d3a/ff4 zero size 2024-09-21T10:41:06.910 INFO:tasks.workunit.client.0.smithi060.stdout:5/822: dread d5/d45/d77/fe5 [0,4194304] 0 2024-09-21T10:41:06.910 INFO:tasks.workunit.client.0.smithi060.stdout:3/815: dwrite d0/f16 [4194304,4194304] 0 2024-09-21T10:41:06.910 INFO:tasks.workunit.client.0.smithi060.stdout:3/816: stat d0/d1/ca4 0 2024-09-21T10:41:06.916 INFO:tasks.workunit.client.0.smithi060.stdout:5/823: dread d5/d45/d5a/f17 [0,4194304] 0 2024-09-21T10:41:06.918 INFO:tasks.workunit.client.0.smithi060.stdout:3/817: unlink d0/d1/d1e/d34/fc5 0 2024-09-21T10:41:06.918 INFO:tasks.workunit.client.0.smithi060.stdout:3/818: readlink d0/d1/d11/d2a/d45/l4c 0 2024-09-21T10:41:06.922 INFO:tasks.workunit.client.0.smithi060.stdout:9/695: dwrite d3/d5e/f6a [0,4194304] 0 2024-09-21T10:41:06.925 INFO:tasks.workunit.client.0.smithi060.stdout:9/696: mknod d3/d16/d1f/cf0 0 2024-09-21T10:41:06.925 INFO:tasks.workunit.client.0.smithi060.stdout:9/697: readlink d3/d5e/d60/d2f/d5b/l77 0 2024-09-21T10:41:06.925 INFO:tasks.workunit.client.0.smithi060.stdout:9/698: stat d3/d16/d5f/fbb 0 2024-09-21T10:41:06.934 INFO:tasks.workunit.client.0.smithi060.stdout:3/819: dread d0/d1/d11/f47 [0,4194304] 0 2024-09-21T10:41:06.935 INFO:tasks.workunit.client.0.smithi060.stdout:7/749: dwrite da/f24 [0,4194304] 0 2024-09-21T10:41:06.939 INFO:tasks.workunit.client.0.smithi060.stdout:7/750: rename da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/fca to da/d14/d35/d79/f100 0 2024-09-21T10:41:06.940 INFO:tasks.workunit.client.0.smithi060.stdout:8/726: dwrite d2/d26/d37/d62/d74/d83/da2/fc6 [0,4194304] 0 2024-09-21T10:41:06.943 INFO:tasks.workunit.client.0.smithi060.stdout:5/824: dwrite d5/d45/d77/d8f/f10e [0,4194304] 0 2024-09-21T10:41:06.944 INFO:tasks.workunit.client.0.smithi060.stdout:9/699: dwrite d3/f47 [0,4194304] 0 2024-09-21T10:41:06.947 INFO:tasks.workunit.client.0.smithi060.stdout:3/820: write d0/d1/d11/d2a/d45/f97 [5691173,101830] 0 2024-09-21T10:41:06.947 INFO:tasks.workunit.client.0.smithi060.stdout:3/821: creat d0/d1/d11/d2a/d93/f10f x:0 0 0 2024-09-21T10:41:06.948 INFO:tasks.workunit.client.0.smithi060.stdout:8/727: rename d2/c42 to d2/d26/d37/d62/d74/d83/d89/dec/cf1 0 2024-09-21T10:41:06.955 INFO:tasks.workunit.client.0.smithi060.stdout:7/751: dread da/d14/d35/d79/db0/dd7/f82 [0,4194304] 0 2024-09-21T10:41:06.955 INFO:tasks.workunit.client.0.smithi060.stdout:7/752: write da/d14/f48 [833844,82725] 0 2024-09-21T10:41:06.959 INFO:tasks.workunit.client.0.smithi060.stdout:8/728: write d2/d26/d37/d62/d74/d83/d89/fa1 [641201,28713] 0 2024-09-21T10:41:06.959 INFO:tasks.workunit.client.0.smithi060.stdout:8/729: fdatasync d2/d26/d37/f3d 0 2024-09-21T10:41:06.961 INFO:tasks.workunit.client.0.smithi060.stdout:9/700: rename d3/d5e/d60/d2f/dac to d3/d16/d42/d7e/d85/dd6/df1 0 2024-09-21T10:41:06.961 INFO:tasks.workunit.client.0.smithi060.stdout:9/701: fsync d3/d16/d1a/d71/fec 0 2024-09-21T10:41:06.962 INFO:tasks.workunit.client.0.smithi060.stdout:8/730: dread d2/d26/d37/d62/f8d [0,4194304] 0 2024-09-21T10:41:06.962 INFO:tasks.workunit.client.0.smithi060.stdout:8/731: chown d2/d26/f38 1455 1 2024-09-21T10:41:06.970 INFO:tasks.workunit.client.0.smithi060.stdout:7/753: getdents da/d14/d35/d79/db0/dd7/d8b/da7 0 2024-09-21T10:41:06.970 INFO:tasks.workunit.client.0.smithi060.stdout:7/754: write da/d60/d6e/ff7 [196154,63299] 0 2024-09-21T10:41:06.970 INFO:tasks.workunit.client.0.smithi060.stdout:5/825: dwrite d5/d45/d77/d8f/d91/fea [0,4194304] 0 2024-09-21T10:41:06.970 INFO:tasks.workunit.client.0.smithi060.stdout:3/822: dwrite d0/d1/d11/f47 [4194304,4194304] 0 2024-09-21T10:41:06.971 INFO:tasks.workunit.client.0.smithi060.stdout:9/702: getdents d3/d16/d7f 0 2024-09-21T10:41:06.971 INFO:tasks.workunit.client.0.smithi060.stdout:9/703: write d3/d15/d53/f74 [521930,130513] 0 2024-09-21T10:41:06.971 INFO:tasks.workunit.client.0.smithi060.stdout:9/704: truncate d3/d16/d1a/fa0 3205593 0 2024-09-21T10:41:06.974 INFO:tasks.workunit.client.0.smithi060.stdout:7/755: mkdir da/d14/d35/de7/d101 0 2024-09-21T10:41:06.974 INFO:tasks.workunit.client.0.smithi060.stdout:7/756: stat da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/l21 0 2024-09-21T10:41:06.975 INFO:tasks.workunit.client.0.smithi060.stdout:5/826: mknod d5/d45/d5a/d3a/df7/c112 0 2024-09-21T10:41:06.975 INFO:tasks.workunit.client.0.smithi060.stdout:8/732: write d2/d26/d37/d62/d74/d83/da2/fc6 [3803874,91729] 0 2024-09-21T10:41:06.985 INFO:tasks.workunit.client.0.smithi060.stdout:3/823: creat d0/d1/d11/d46/dfc/f110 x:0 0 0 2024-09-21T10:41:06.987 INFO:tasks.workunit.client.0.smithi060.stdout:9/705: rename d3/d15/d58/l59 to d3/d5e/d60/d2f/lf2 0 2024-09-21T10:41:06.988 INFO:tasks.workunit.client.0.smithi060.stdout:5/827: dwrite d5/d45/d5a/f5d [0,4194304] 0 2024-09-21T10:41:06.991 INFO:tasks.workunit.client.0.smithi060.stdout:7/757: rmdir da 39 2024-09-21T10:41:06.991 INFO:tasks.workunit.client.0.smithi060.stdout:7/758: readlink da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/la2 0 2024-09-21T10:41:06.992 INFO:tasks.workunit.client.0.smithi060.stdout:7/759: creat da/d14/d35/d79/f102 x:0 0 0 2024-09-21T10:41:06.994 INFO:tasks.workunit.client.0.smithi060.stdout:8/733: mknod d2/d26/d37/d64/cf2 0 2024-09-21T10:41:06.994 INFO:tasks.workunit.client.0.smithi060.stdout:8/734: fsync d2/f3 0 2024-09-21T10:41:06.998 INFO:tasks.workunit.client.0.smithi060.stdout:5/828: rename d5/d45/d6d/d10/d19/d8d/d60/d61/fdb to d5/d45/d6d/d10/f113 0 2024-09-21T10:41:07.002 INFO:tasks.workunit.client.0.smithi060.stdout:5/829: rename d5/d45/d6d/d10/d19/d21/d7f/d89/f41 to d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/f114 0 2024-09-21T10:41:07.002 INFO:tasks.workunit.client.0.smithi060.stdout:5/830: stat d5/d45/d6d/d10/d19/d21/d30/d49/l4d 0 2024-09-21T10:41:07.003 INFO:tasks.workunit.client.0.smithi060.stdout:8/735: symlink d2/d26/d37/d62/d74/lf3 0 2024-09-21T10:41:07.003 INFO:tasks.workunit.client.0.smithi060.stdout:8/736: fsync d2/d26/d37/f93 0 2024-09-21T10:41:07.004 INFO:tasks.workunit.client.0.smithi060.stdout:7/760: write da/d60/d6e/dd5/fde [2793001,11770] 0 2024-09-21T10:41:07.004 INFO:tasks.workunit.client.0.smithi060.stdout:5/831: mkdir d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:3/824: dwrite d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:9/706: dwrite d3/d16/d7f/f8d [0,4194304] 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:9/707: creat d3/d16/d5f/ff3 x:0 0 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:9/708: write d3/d15/d53/dc8/fe7 [392968,123199] 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:7/761: creat da/d14/f103 x:0 0 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:7/762: readlink da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/la2 0 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:7/763: dread - da/d60/de4/de9/ffb zero size 2024-09-21T10:41:07.008 INFO:tasks.workunit.client.0.smithi060.stdout:7/764: truncate da/d14/d35/d79/db0/dd7/d8b/da7/fe0 405163 0 2024-09-21T10:41:07.009 INFO:tasks.workunit.client.0.smithi060.stdout:5/832: rmdir d5/d45/d6d/d10/d19/d8d/d60 39 2024-09-21T10:41:07.015 INFO:tasks.workunit.client.0.smithi060.stdout:3/825: unlink d0/d1/d11/d2a/d85/c100 0 2024-09-21T10:41:07.015 INFO:tasks.workunit.client.0.smithi060.stdout:8/737: dread d2/d26/d37/d62/d74/d83/d89/d9a/fab [0,4194304] 0 2024-09-21T10:41:07.022 INFO:tasks.workunit.client.0.smithi060.stdout:9/709: mknod d3/d15/d78/cf4 0 2024-09-21T10:41:07.022 INFO:tasks.workunit.client.0.smithi060.stdout:9/710: truncate d3/d15/d53/dc8/fda 301344 0 2024-09-21T10:41:07.022 INFO:tasks.workunit.client.0.smithi060.stdout:7/765: dwrite da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f94 [4194304,4194304] 0 2024-09-21T10:41:07.022 INFO:tasks.workunit.client.0.smithi060.stdout:7/766: fsync da/d14/d35/d79/db0/dd7/fd3 0 2024-09-21T10:41:07.023 INFO:tasks.workunit.client.0.smithi060.stdout:5/833: mkdir d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116 0 2024-09-21T10:41:07.025 INFO:tasks.workunit.client.0.smithi060.stdout:3/826: creat d0/d1/d11/d2a/d43/d4e/f111 x:0 0 0 2024-09-21T10:41:07.025 INFO:tasks.workunit.client.0.smithi060.stdout:3/827: dread - d0/d1/d11/d2a/d43/ff1 zero size 2024-09-21T10:41:07.027 INFO:tasks.workunit.client.0.smithi060.stdout:8/738: symlink d2/d26/d37/d62/d74/d83/dac/lf4 0 2024-09-21T10:41:07.032 INFO:tasks.workunit.client.0.smithi060.stdout:7/767: mknod da/d14/d35/d79/db0/df0/df5/c104 0 2024-09-21T10:41:07.034 INFO:tasks.workunit.client.0.smithi060.stdout:5/834: rename d5/ff1 to d5/d45/d6d/d10/d19/f117 0 2024-09-21T10:41:07.034 INFO:tasks.workunit.client.0.smithi060.stdout:5/835: truncate d5/d45/d5a/dbd/fe3 741420 0 2024-09-21T10:41:07.036 INFO:tasks.workunit.client.0.smithi060.stdout:3/828: creat d0/d1/d11/d53/d98/f112 x:0 0 0 2024-09-21T10:41:07.037 INFO:tasks.workunit.client.0.smithi060.stdout:8/739: symlink d2/d26/lf5 0 2024-09-21T10:41:07.039 INFO:tasks.workunit.client.0.smithi060.stdout:9/711: dread d3/d16/d1a/fa0 [0,4194304] 0 2024-09-21T10:41:07.039 INFO:tasks.workunit.client.0.smithi060.stdout:9/712: dread - d3/d16/d5f/ff3 zero size 2024-09-21T10:41:07.039 INFO:tasks.workunit.client.0.smithi060.stdout:9/713: creat d3/d15/d5a/d64/ff5 x:0 0 0 2024-09-21T10:41:07.040 INFO:tasks.workunit.client.0.smithi060.stdout:7/768: rename da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f8f to da/d14/d35/d79/db0/df0/df5/f105 0 2024-09-21T10:41:07.042 INFO:tasks.workunit.client.0.smithi060.stdout:5/836: symlink d5/d45/d6d/ddf/l118 0 2024-09-21T10:41:07.042 INFO:tasks.workunit.client.0.smithi060.stdout:5/837: chown d5/d45/d6d/cd 0 1 2024-09-21T10:41:07.043 INFO:tasks.workunit.client.0.smithi060.stdout:3/829: mknod d0/d1/d11/d46/c113 0 2024-09-21T10:41:07.046 INFO:tasks.workunit.client.0.smithi060.stdout:7/769: dread da/d14/d35/d79/db0/dd7/f82 [0,4194304] 0 2024-09-21T10:41:07.048 INFO:tasks.workunit.client.0.smithi060.stdout:5/838: rmdir d5/d45/d6d/d10/d19/d8d/d60/d9e 39 2024-09-21T10:41:07.050 INFO:tasks.workunit.client.0.smithi060.stdout:3/830: truncate d0/d1/d11/f42 574836 0 2024-09-21T10:41:07.050 INFO:tasks.workunit.client.0.smithi060.stdout:3/831: write d0/d1/d11/d2a/d93/f10f [868168,33500] 0 2024-09-21T10:41:07.050 INFO:tasks.workunit.client.0.smithi060.stdout:2/534: sync 2024-09-21T10:41:07.050 INFO:tasks.workunit.client.0.smithi060.stdout:6/898: sync 2024-09-21T10:41:07.053 INFO:tasks.workunit.client.0.smithi060.stdout:7/770: creat da/d14/d35/d79/db0/dd7/d8b/da7/f106 x:0 0 0 2024-09-21T10:41:07.053 INFO:tasks.workunit.client.0.smithi060.stdout:3/832: dread d0/d1/d11/d46/fbf [0,4194304] 0 2024-09-21T10:41:07.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/535: mknod d3/d7/d24/d25/cb2 0 2024-09-21T10:41:07.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/536: truncate d3/d7/f34 113720 0 2024-09-21T10:41:07.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/537: write d3/d20/d17/f50 [3447518,33868] 0 2024-09-21T10:41:07.056 INFO:tasks.workunit.client.0.smithi060.stdout:6/899: creat d3/d12/d16/d1a/dca/f11e x:0 0 0 2024-09-21T10:41:07.056 INFO:tasks.workunit.client.0.smithi060.stdout:6/900: dread - d3/d54/da8/f108 zero size 2024-09-21T10:41:07.056 INFO:tasks.workunit.client.0.smithi060.stdout:6/901: chown d3/d12/d16/d1a/fc0 31733 1 2024-09-21T10:41:07.058 INFO:tasks.workunit.client.0.smithi060.stdout:3/833: mkdir d0/d1/d11/d2a/de3/d114 0 2024-09-21T10:41:07.059 INFO:tasks.workunit.client.0.smithi060.stdout:2/538: mkdir d3/d7/d23/db3 0 2024-09-21T10:41:07.060 INFO:tasks.workunit.client.0.smithi060.stdout:8/740: dwrite d2/d18/d4b/fda [0,4194304] 0 2024-09-21T10:41:07.061 INFO:tasks.workunit.client.0.smithi060.stdout:9/714: dwrite d3/d16/fb9 [0,4194304] 0 2024-09-21T10:41:07.062 INFO:tasks.workunit.client.0.smithi060.stdout:9/715: dread d3/d15/d5a/d64/fae [0,4194304] 0 2024-09-21T10:41:07.071 INFO:tasks.workunit.client.0.smithi060.stdout:6/902: rmdir d3/d12/d4e 39 2024-09-21T10:41:07.076 INFO:tasks.workunit.client.0.smithi060.stdout:2/539: rename d3/d20/d15/d30 to d3/d79/db4 0 2024-09-21T10:41:07.077 INFO:tasks.workunit.client.0.smithi060.stdout:9/716: dread d3/d5e/f82 [0,4194304] 0 2024-09-21T10:41:07.078 INFO:tasks.workunit.client.0.smithi060.stdout:8/741: rename d2/d26/d37/d62/fc2 to d2/d26/d37/d64/d65/ff6 0 2024-09-21T10:41:07.078 INFO:tasks.workunit.client.0.smithi060.stdout:8/742: truncate d2/d18/d4b/d61/d6e/fca 4796197 0 2024-09-21T10:41:07.078 INFO:tasks.workunit.client.0.smithi060.stdout:8/743: fsync d2/d26/d37/f3d 0 2024-09-21T10:41:07.078 INFO:tasks.workunit.client.0.smithi060.stdout:8/744: chown d2/d26/d37/d62/d74/d83/lce 327786169 1 2024-09-21T10:41:07.078 INFO:tasks.workunit.client.0.smithi060.stdout:2/540: truncate d3/d7/d23/f5a 7939470 0 2024-09-21T10:41:07.080 INFO:tasks.workunit.client.0.smithi060.stdout:9/717: symlink d3/d15/d5a/dc7/lf6 0 2024-09-21T10:41:07.083 INFO:tasks.workunit.client.0.smithi060.stdout:9/718: readlink d3/d5e/d60/d2f/l87 0 2024-09-21T10:41:07.083 INFO:tasks.workunit.client.0.smithi060.stdout:9/719: creat d3/d16/d1f/ff7 x:0 0 0 2024-09-21T10:41:07.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/541: creat d3/d20/d15/d3b/fb5 x:0 0 0 2024-09-21T10:41:07.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/542: fdatasync d3/d7/d24/f9e 0 2024-09-21T10:41:07.083 INFO:tasks.workunit.client.0.smithi060.stdout:2/543: symlink d3/d7/lb6 0 2024-09-21T10:41:07.085 INFO:tasks.workunit.client.0.smithi060.stdout:2/544: rename d3/c21 to d3/d20/d15/d4c/cb7 0 2024-09-21T10:41:07.086 INFO:tasks.workunit.client.0.smithi060.stdout:2/545: rename d3/d79/db4/d5c/lad to d3/d79/db4/lb8 0 2024-09-21T10:41:07.086 INFO:tasks.workunit.client.0.smithi060.stdout:2/546: mkdir d3/d79/db4/db9 0 2024-09-21T10:41:07.093 INFO:tasks.workunit.client.0.smithi060.stdout:7/771: dwrite da/d14/d35/d79/db0/dd7/f82 [0,4194304] 0 2024-09-21T10:41:07.094 INFO:tasks.workunit.client.0.smithi060.stdout:5/839: dwrite d5/d45/d6d/d10/d19/f4e [0,4194304] 0 2024-09-21T10:41:07.094 INFO:tasks.workunit.client.0.smithi060.stdout:6/903: dread d3/d12/d16/d1a/fc0 [0,4194304] 0 2024-09-21T10:41:07.098 INFO:tasks.workunit.client.0.smithi060.stdout:7/772: chown da/l7a 0 1 2024-09-21T10:41:07.100 INFO:tasks.workunit.client.0.smithi060.stdout:5/840: creat d5/d7a/d84/dc3/f119 x:0 0 0 2024-09-21T10:41:07.101 INFO:tasks.workunit.client.0.smithi060.stdout:6/904: creat d3/d12/d16/d22/d58/f11f x:0 0 0 2024-09-21T10:41:07.101 INFO:tasks.workunit.client.0.smithi060.stdout:7/773: creat da/d14/d35/de7/d101/f107 x:0 0 0 2024-09-21T10:41:07.102 INFO:tasks.workunit.client.0.smithi060.stdout:7/774: truncate da/d14/d25/d56/ff4 36906 0 2024-09-21T10:41:07.102 INFO:tasks.workunit.client.0.smithi060.stdout:3/834: dwrite d0/d1/fc7 [0,4194304] 0 2024-09-21T10:41:07.102 INFO:tasks.workunit.client.0.smithi060.stdout:3/835: creat d0/d1/d11/d2a/d87/f115 x:0 0 0 2024-09-21T10:41:07.102 INFO:tasks.workunit.client.0.smithi060.stdout:3/836: fsync d0/d1/d11/d2a/d43/f88 0 2024-09-21T10:41:07.103 INFO:tasks.workunit.client.0.smithi060.stdout:5/841: link d5/d45/d6d/d10/d19/d21/d7f/d89/l79 d5/d7a/d84/dc3/df3/l11a 0 2024-09-21T10:41:07.103 INFO:tasks.workunit.client.0.smithi060.stdout:8/745: dwrite d2/d26/d37/d64/fd2 [0,4194304] 0 2024-09-21T10:41:07.104 INFO:tasks.workunit.client.0.smithi060.stdout:6/905: rmdir d3/d12/d16/d5b 39 2024-09-21T10:41:07.105 INFO:tasks.workunit.client.0.smithi060.stdout:9/720: dwrite d3/d15/f3c [4194304,4194304] 0 2024-09-21T10:41:07.110 INFO:tasks.workunit.client.0.smithi060.stdout:6/906: dread d3/d12/d65/d7f/db5/fee [0,4194304] 0 2024-09-21T10:41:07.112 INFO:tasks.workunit.client.0.smithi060.stdout:5/842: creat d5/d45/d77/d8f/d91/f11b x:0 0 0 2024-09-21T10:41:07.112 INFO:tasks.workunit.client.0.smithi060.stdout:5/843: fdatasync d5/d45/d6d/d10/d19/f33 0 2024-09-21T10:41:07.112 INFO:tasks.workunit.client.0.smithi060.stdout:2/547: truncate d3/d20/d17/f50 3371487 0 2024-09-21T10:41:07.119 INFO:tasks.workunit.client.0.smithi060.stdout:9/721: unlink d3/d16/d1a/f26 0 2024-09-21T10:41:07.122 INFO:tasks.workunit.client.0.smithi060.stdout:7/775: dwrite da/d14/fb4 [0,4194304] 0 2024-09-21T10:41:07.122 INFO:tasks.workunit.client.0.smithi060.stdout:3/837: dwrite d0/d1/d11/d46/f31 [4194304,4194304] 0 2024-09-21T10:41:07.122 INFO:tasks.workunit.client.0.smithi060.stdout:6/907: creat d3/d12/d16/d22/d5d/f120 x:0 0 0 2024-09-21T10:41:07.123 INFO:tasks.workunit.client.0.smithi060.stdout:6/908: write d3/fb [4305371,123626] 0 2024-09-21T10:41:07.123 INFO:tasks.workunit.client.0.smithi060.stdout:6/909: write d3/d12/d16/d25/d27/f5a [2899060,9042] 0 2024-09-21T10:41:07.125 INFO:tasks.workunit.client.0.smithi060.stdout:5/844: unlink d5/d45/d6d/d10/d19/d8d/f57 0 2024-09-21T10:41:07.128 INFO:tasks.workunit.client.0.smithi060.stdout:2/548: rename d3/d20/d15/c3e to d3/d20/d15/d4c/d82/cba 0 2024-09-21T10:41:07.128 INFO:tasks.workunit.client.0.smithi060.stdout:2/549: truncate d3/d7/d24/d25/fa3 214775 0 2024-09-21T10:41:07.129 INFO:tasks.workunit.client.0.smithi060.stdout:9/722: mknod d3/d16/d5f/cf8 0 2024-09-21T10:41:07.129 INFO:tasks.workunit.client.0.smithi060.stdout:9/723: readlink d3/d16/d42/d7e/d85/le6 0 2024-09-21T10:41:07.129 INFO:tasks.workunit.client.0.smithi060.stdout:9/724: readlink d3/d5e/d60/d2f/la7 0 2024-09-21T10:41:07.131 INFO:tasks.workunit.client.0.smithi060.stdout:3/838: dread d0/f21 [0,4194304] 0 2024-09-21T10:41:07.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/746: dwrite d2/d18/d4b/d61/d6e/fca [0,4194304] 0 2024-09-21T10:41:07.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/747: dread - d2/d26/d37/d64/d65/fde zero size 2024-09-21T10:41:07.136 INFO:tasks.workunit.client.0.smithi060.stdout:7/776: symlink da/d14/d35/d79/db0/dd7/l108 0 2024-09-21T10:41:07.137 INFO:tasks.workunit.client.0.smithi060.stdout:7/777: truncate da/d60/d6e/dd5/fde 4226743 0 2024-09-21T10:41:07.139 INFO:tasks.workunit.client.0.smithi060.stdout:8/748: write d2/d26/d37/d62/d74/d83/d89/d9a/fab [3745978,60033] 0 2024-09-21T10:41:07.139 INFO:tasks.workunit.client.0.smithi060.stdout:8/749: chown d2/d26/d37/d62/d74/d83/d89/dec 1981620953 1 2024-09-21T10:41:07.140 INFO:tasks.workunit.client.0.smithi060.stdout:6/910: symlink d3/dea/l121 0 2024-09-21T10:41:07.141 INFO:tasks.workunit.client.0.smithi060.stdout:5/845: creat d5/d45/d77/f11c x:0 0 0 2024-09-21T10:41:07.141 INFO:tasks.workunit.client.0.smithi060.stdout:5/846: readlink d5/d45/d6d/d10/d19/d8d/d50/l63 0 2024-09-21T10:41:07.141 INFO:tasks.workunit.client.0.smithi060.stdout:5/847: chown d5/d7a/d84/dcc 9319 1 2024-09-21T10:41:07.141 INFO:tasks.workunit.client.0.smithi060.stdout:5/848: fdatasync d5/d45/d6d/d10/d19/d21/d7f/f9b 0 2024-09-21T10:41:07.144 INFO:tasks.workunit.client.0.smithi060.stdout:2/550: mknod d3/d7/d23/da5/cbb 0 2024-09-21T10:41:07.145 INFO:tasks.workunit.client.0.smithi060.stdout:3/839: dwrite d0/d1/d9e/fcf [0,4194304] 0 2024-09-21T10:41:07.145 INFO:tasks.workunit.client.0.smithi060.stdout:3/840: write d0/d1/d52/faf [5163551,7218] 0 2024-09-21T10:41:07.153 INFO:tasks.workunit.client.0.smithi060.stdout:7/778: link da/d14/d35/d79/db0/dd7/d8b/da7/dcd/d49/d27/f64 da/d14/d25/f109 0 2024-09-21T10:41:07.156 INFO:tasks.workunit.client.0.smithi060.stdout:8/750: dwrite d2/d18/f22 [4194304,4194304] 0 2024-09-21T10:41:07.158 INFO:tasks.workunit.client.0.smithi060.stdout:6/911: link d3/l69 d3/dea/l122 0 2024-09-21T10:41:07.160 INFO:tasks.workunit.client.0.smithi060.stdout:2/551: unlink d3/d79/db4/d6a/c6b 0 2024-09-21T10:41:07.167 INFO:tasks.workunit.client.0.smithi060.stdout:3/841: dwrite d0/d1/d11/d2a/d87/fea [0,4194304] 0 2024-09-21T10:41:07.167 INFO:tasks.workunit.client.0.smithi060.stdout:5/849: dwrite d5/d45/d6d/d10/d19/f117 [0,4194304] 0 2024-09-21T10:41:07.169 INFO:tasks.workunit.client.0.smithi060.stdout:9/725: getdents d3/d15/d53/dc8 0 2024-09-21T10:41:07.169 INFO:tasks.workunit.client.0.smithi060.stdout:9/726: read - d3/d5e/d60/fcb zero size 2024-09-21T10:41:07.174 INFO:tasks.workunit.client.0.smithi060.stdout:7/779: mkdir da/d14/d10a 0 2024-09-21T10:41:07.176 INFO:tasks.workunit.client.0.smithi060.stdout:3/842: write d0/d1/d9e/fb6 [926729,33799] 0 2024-09-21T10:41:07.179 INFO:tasks.workunit.client.0.smithi060.stdout:8/751: symlink d2/d18/d4b/lf7 0 2024-09-21T10:41:07.181 INFO:tasks.workunit.client.0.smithi060.stdout:6/912: symlink d3/d12/d16/d22/dd2/l123 0 2024-09-21T10:41:07.182 INFO:tasks.workunit.client.0.smithi060.stdout:2/552: mknod d3/d20/d15/d4c/cbc 0 2024-09-21T10:41:07.186 INFO:tasks.workunit.client.0.smithi060.stdout:5/850: dwrite d5/d71/f104 [0,4194304] 0 2024-09-21T10:41:07.191 INFO:tasks.workunit.client.0.smithi060.stdout:3/843: mkdir d0/d1/d11/d2a/d85/d116 0 2024-09-21T10:41:07.191 INFO:tasks.workunit.client.0.smithi060.stdout:3/844: creat d0/d1/d11/d53/d98/db8/f117 x:0 0 0 2024-09-21T10:41:07.194 INFO:tasks.workunit.client.0.smithi060.stdout:6/913: mknod d3/d54/c124 0 2024-09-21T10:41:07.194 INFO:tasks.workunit.client.0.smithi060.stdout:6/914: chown d3/d12/d16/d1a/d83/ddd/fd9 115893259 1 2024-09-21T10:41:07.195 INFO:tasks.workunit.client.0.smithi060.stdout:2/553: creat d3/d7/d23/db3/fbd x:0 0 0 2024-09-21T10:41:07.196 INFO:tasks.workunit.client.0.smithi060.stdout:2/554: creat d3/d7/d24/fbe x:0 0 0 2024-09-21T10:41:07.197 INFO:tasks.workunit.client.0.smithi060.stdout:9/727: dwrite d3/d16/d5f/fbb [0,4194304] 0 2024-09-21T10:41:07.201 INFO:tasks.workunit.client.0.smithi060.stdout:8/752: dwrite d2/d5a/f8b [0,4194304] 0 2024-09-21T10:41:07.201 INFO:tasks.workunit.client.0.smithi060.stdout:8/753: write d2/d26/d37/d62/d74/d83/d89/fd4 [1118880,93254] 0 2024-09-21T10:41:07.204 INFO:tasks.workunit.client.0.smithi060.stdout:5/851: mkdir d5/d7a/d84/d88/d11d 0 2024-09-21T10:41:07.206 INFO:tasks.workunit.client.0.smithi060.stdout:2/555: dread d3/d7/d23/f2f [0,4194304] 0 2024-09-21T10:41:07.207 INFO:tasks.workunit.client.0.smithi060.stdout:2/556: readlink d3/d20/d15/l80 0 2024-09-21T10:41:07.207 INFO:tasks.workunit.client.0.smithi060.stdout:2/557: dread - d3/d20/d15/d4c/d82/faa zero size 2024-09-21T10:41:07.208 INFO:tasks.workunit.client.0.smithi060.stdout:3/845: link d0/d1/d24/f102 d0/d1/d11/d46/f118 0 2024-09-21T10:41:07.208 INFO:tasks.workunit.client.0.smithi060.stdout:3/846: read - d0/d1/d11/d53/d98/db8/ffa zero size 2024-09-21T10:41:07.209 INFO:tasks.workunit.client.0.smithi060.stdout:6/915: link d3/d12/d16/d22/dd2/cf3 d3/d12/d38/d9e/dcf/c125 0 2024-09-21T10:41:07.214 INFO:tasks.workunit.client.0.smithi060.stdout:9/728: mkdir d3/d16/d95/df9 0 2024-09-21T10:41:07.218 INFO:tasks.workunit.client.0.smithi060.stdout:8/754: unlink d2/la 0 2024-09-21T10:41:07.218 INFO:tasks.workunit.client.0.smithi060.stdout:0/797: sync 2024-09-21T10:41:07.218 INFO:tasks.workunit.client.0.smithi060.stdout:1/675: sync 2024-09-21T10:41:07.218 INFO:tasks.workunit.client.0.smithi060.stdout:4/746: sync 2024-09-21T10:41:07.218 INFO:tasks.workunit.client.0.smithi060.stdout:1/676: dread - d6/d24/da/db/dd/fe9 zero size 2024-09-21T10:41:07.218 INFO:tasks.workunit.client.0.smithi060.stdout:0/798: write d5/d10/da/d4b/da4/d76/f95 [687007,30369] 0 2024-09-21T10:41:07.219 INFO:tasks.workunit.client.0.smithi060.stdout:1/677: write d6/f65 [283276,10320] 0 2024-09-21T10:41:07.220 INFO:tasks.workunit.client.0.smithi060.stdout:3/847: creat d0/d1/d11/d2a/d43/f119 x:0 0 0 2024-09-21T10:41:07.220 INFO:tasks.workunit.client.0.smithi060.stdout:3/848: write d0/d1/d11/d2a/d64/f9c [1992420,13095] 0 2024-09-21T10:41:07.220 INFO:tasks.workunit.client.0.smithi060.stdout:3/849: write d0/d1/d5c/dc4/fda [364450,70508] 0 2024-09-21T10:41:07.222 INFO:tasks.workunit.client.0.smithi060.stdout:6/916: mkdir d3/dea/d126 0 2024-09-21T10:41:07.223 INFO:tasks.workunit.client.0.smithi060.stdout:9/729: mkdir d3/d16/d1f/dd1/dfa 0 2024-09-21T10:41:07.225 INFO:tasks.workunit.client.0.smithi060.stdout:8/755: mkdir d2/d26/d37/d62/d74/d83/d89/dec/df8 0 2024-09-21T10:41:07.225 INFO:tasks.workunit.client.0.smithi060.stdout:0/799: rmdir d5 39 2024-09-21T10:41:07.227 INFO:tasks.workunit.client.0.smithi060.stdout:1/678: mkdir d6/d24/da/dea/dd8/df2 0 2024-09-21T10:41:07.231 INFO:tasks.workunit.client.0.smithi060.stdout:3/850: mkdir d0/d11a 0 2024-09-21T10:41:07.234 INFO:tasks.workunit.client.0.smithi060.stdout:6/917: mkdir d3/d12/d16/d1a/d60/dac/d127 0 2024-09-21T10:41:07.236 INFO:tasks.workunit.client.0.smithi060.stdout:5/852: dwrite d5/d45/f46 [0,4194304] 0 2024-09-21T10:41:07.237 INFO:tasks.workunit.client.0.smithi060.stdout:2/558: dwrite d3/d7/d23/f7c [0,4194304] 0 2024-09-21T10:41:07.239 INFO:tasks.workunit.client.0.smithi060.stdout:9/730: rename d3/d16/d7f/f8d to d3/d16/d95/df9/ffb 0 2024-09-21T10:41:07.239 INFO:tasks.workunit.client.0.smithi060.stdout:0/800: write d5/d10/da/d4b/da4/d40/d48/fc7 [3658637,15556] 0 2024-09-21T10:41:07.239 INFO:tasks.workunit.client.0.smithi060.stdout:4/747: dwrite d0/d83/d6a/d6b/d32/d57/d90/f97 [0,4194304] 0 2024-09-21T10:41:07.239 INFO:tasks.workunit.client.0.smithi060.stdout:4/748: chown d0/d83/d6a/d6b/d65/d51/l82 0 1 2024-09-21T10:41:07.240 INFO:tasks.workunit.client.0.smithi060.stdout:8/756: dread d2/d26/d37/d62/d74/d83/da2/fc6 [0,4194304] 0 2024-09-21T10:41:07.245 INFO:tasks.workunit.client.0.smithi060.stdout:3/851: read d0/d1/d11/d53/da2/dc8/fc9 [1980156,49028] 0 2024-09-21T10:41:07.247 INFO:tasks.workunit.client.0.smithi060.stdout:5/853: rmdir d5/d45/d6d/d10/d19/d8d/d60/d9e 39 2024-09-21T10:41:07.247 INFO:tasks.workunit.client.0.smithi060.stdout:5/854: write d5/d45/d6d/fd7 [473473,538] 0 2024-09-21T10:41:07.248 INFO:tasks.workunit.client.0.smithi060.stdout:0/801: dread d5/d10/da/d2d/fa2 [4194304,4194304] 0 2024-09-21T10:41:07.249 INFO:tasks.workunit.client.0.smithi060.stdout:2/559: dread d3/d79/db4/d6a/d9a/fb0 [0,4194304] 0 2024-09-21T10:41:07.255 INFO:tasks.workunit.client.0.smithi060.stdout:9/731: symlink d3/d5e/d60/d2f/lfc 0 2024-09-21T10:41:07.258 INFO:tasks.workunit.client.0.smithi060.stdout:6/918: dwrite d3/d12/d16/d1a/d83/ddd/f46 [0,4194304] 0 2024-09-21T10:41:07.259 INFO:tasks.workunit.client.0.smithi060.stdout:4/749: creat d0/d8b/dd8/f105 x:0 0 0 2024-09-21T10:41:07.263 INFO:tasks.workunit.client.0.smithi060.stdout:1/679: getdents d6/d24/da/db/d79/d86/d9f/daa 0 2024-09-21T10:41:07.266 INFO:tasks.workunit.client.0.smithi060.stdout:3/852: rename d0/c50 to d0/d1/c11b 0 2024-09-21T10:41:07.268 INFO:tasks.workunit.client.0.smithi060.stdout:9/732: write d3/d16/d5f/f84 [2782454,110521] 0 2024-09-21T10:41:07.268 INFO:tasks.workunit.client.0.smithi060.stdout:9/733: readlink d3/d16/d42/d7e/d85/le6 0 2024-09-21T10:41:07.268 INFO:tasks.workunit.client.0.smithi060.stdout:2/560: dwrite d3/d7/d18/f81 [4194304,4194304] 0 2024-09-21T10:41:07.268 INFO:tasks.workunit.client.0.smithi060.stdout:2/561: chown d3/d7/d18/lae 344213 1 2024-09-21T10:41:07.270 INFO:tasks.workunit.client.0.smithi060.stdout:0/802: creat d5/ffe x:0 0 0 2024-09-21T10:41:07.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/919: mkdir d3/d12/d38/d9e/dcf/d128 0 2024-09-21T10:41:07.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/750: mknod d0/d5/d12/d3d/c106 0 2024-09-21T10:41:07.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/751: truncate d0/d3c/d67/d7d/d87/fde 225648 0 2024-09-21T10:41:07.276 INFO:tasks.workunit.client.0.smithi060.stdout:8/757: getdents d2/d18/d4b/dbe 0 2024-09-21T10:41:07.278 INFO:tasks.workunit.client.0.smithi060.stdout:1/680: creat d6/d24/da/db/d79/d86/d9f/dcd/ff3 x:0 0 0 2024-09-21T10:41:07.278 INFO:tasks.workunit.client.0.smithi060.stdout:1/681: creat d6/d24/da/db/d79/d86/d9f/dcd/ff4 x:0 0 0 2024-09-21T10:41:07.278 INFO:tasks.workunit.client.0.smithi060.stdout:1/682: fsync d6/d24/da/db/d79/d86/fb7 0 2024-09-21T10:41:07.278 INFO:tasks.workunit.client.0.smithi060.stdout:1/683: write d6/d4a/d5a/fda [4357166,51273] 0 2024-09-21T10:41:07.282 INFO:tasks.workunit.client.0.smithi060.stdout:3/853: creat d0/f11c x:0 0 0 2024-09-21T10:41:07.283 INFO:tasks.workunit.client.0.smithi060.stdout:5/855: rmdir d5/d45/d5a/d3a 39 2024-09-21T10:41:07.285 INFO:tasks.workunit.client.0.smithi060.stdout:0/803: dwrite d5/d10/da/d4b/da4/d40/d75/dca/fd6 [0,4194304] 0 2024-09-21T10:41:07.287 INFO:tasks.workunit.client.0.smithi060.stdout:2/562: creat d3/d79/db4/d6a/d9a/fbf x:0 0 0 2024-09-21T10:41:07.288 INFO:tasks.workunit.client.0.smithi060.stdout:2/563: creat d3/d20/d15/d3b/fc0 x:0 0 0 2024-09-21T10:41:07.291 INFO:tasks.workunit.client.0.smithi060.stdout:6/920: symlink d3/d54/da8/l129 0 2024-09-21T10:41:07.291 INFO:tasks.workunit.client.0.smithi060.stdout:6/921: write d3/d12/d16/d25/fcc [1680823,129103] 0 2024-09-21T10:41:07.291 INFO:tasks.workunit.client.0.smithi060.stdout:6/922: truncate d3/d12/d16/d1a/d83/ddd/fd9 992334 0 2024-09-21T10:41:07.291 INFO:tasks.workunit.client.0.smithi060.stdout:6/923: chown d3/d12/d16/d1a/d83/ddd/fd9 0 1 2024-09-21T10:41:07.291 INFO:tasks.workunit.client.0.smithi060.stdout:4/752: mknod d0/d5/d12/c107 0 2024-09-21T10:41:07.292 INFO:tasks.workunit.client.0.smithi060.stdout:8/758: truncate d2/d18/f30 3292839 0 2024-09-21T10:41:07.294 INFO:tasks.workunit.client.0.smithi060.stdout:1/684: dwrite d6/d24/da/db/d79/d86/fef [0,4194304] 0 2024-09-21T10:41:07.294 INFO:tasks.workunit.client.0.smithi060.stdout:1/685: truncate d6/d24/da/db/d1c/d4b/fdb 400268 0 2024-09-21T10:41:07.294 INFO:tasks.workunit.client.0.smithi060.stdout:1/686: write d6/d4a/d5a/db0/d97/fb9 [946227,65700] 0 2024-09-21T10:41:07.294 INFO:tasks.workunit.client.0.smithi060.stdout:1/687: write d6/d24/f59 [3153981,43088] 0 2024-09-21T10:41:07.296 INFO:tasks.workunit.client.0.smithi060.stdout:3/854: creat d0/d1/d24/d81/f11d x:0 0 0 2024-09-21T10:41:07.296 INFO:tasks.workunit.client.0.smithi060.stdout:3/855: chown d0/d1/d11/d2a/d45/cbe 88 1 2024-09-21T10:41:07.297 INFO:tasks.workunit.client.0.smithi060.stdout:5/856: truncate d5/d45/d6d/f15 1033865 0 2024-09-21T10:41:07.297 INFO:tasks.workunit.client.0.smithi060.stdout:5/857: stat d5/d45/d6d/d10/d19/d21/d30/c69 0 2024-09-21T10:41:07.304 INFO:tasks.workunit.client.0.smithi060.stdout:4/753: dwrite d0/d83/d6a/d6b/d32/d57/fe6 [0,4194304] 0 2024-09-21T10:41:07.304 INFO:tasks.workunit.client.0.smithi060.stdout:4/754: write d0/d3c/d67/d7d/d87/fde [1185179,9060] 0 2024-09-21T10:41:07.305 INFO:tasks.workunit.client.0.smithi060.stdout:0/804: creat d5/d10/da/d4b/da4/d40/d48/dab/fff x:0 0 0 2024-09-21T10:41:07.305 INFO:tasks.workunit.client.0.smithi060.stdout:0/805: readlink d5/d10/da/da7/led 0 2024-09-21T10:41:07.308 INFO:tasks.workunit.client.0.smithi060.stdout:9/734: rename d3/d16/d95/fd3 to d3/ffd 0 2024-09-21T10:41:07.308 INFO:tasks.workunit.client.0.smithi060.stdout:9/735: write d3/d15/d5a/d64/fdc [85676,50680] 0 2024-09-21T10:41:07.309 INFO:tasks.workunit.client.0.smithi060.stdout:9/736: chown d3/d15/d5a/dc7/lcf 41729818 1 2024-09-21T10:41:07.309 INFO:tasks.workunit.client.0.smithi060.stdout:9/737: getdents d3/d16/d1f/dd1/dfa 0 2024-09-21T10:41:07.312 INFO:tasks.workunit.client.0.smithi060.stdout:2/564: mkdir d3/d7/d23/da5/dc1 0 2024-09-21T10:41:07.315 INFO:tasks.workunit.client.0.smithi060.stdout:6/924: mknod d3/dd/df4/c12a 0 2024-09-21T10:41:07.317 INFO:tasks.workunit.client.0.smithi060.stdout:8/759: symlink d2/d26/d37/d62/d74/d83/d89/dec/lf9 0 2024-09-21T10:41:07.319 INFO:tasks.workunit.client.0.smithi060.stdout:3/856: dwrite d0/d1/d9e/fb6 [0,4194304] 0 2024-09-21T10:41:07.320 INFO:tasks.workunit.client.0.smithi060.stdout:8/760: dread d2/d26/f29 [0,4194304] 0 2024-09-21T10:41:07.321 INFO:tasks.workunit.client.0.smithi060.stdout:1/688: symlink d6/d24/da/db/d1c/d4b/lf5 0 2024-09-21T10:41:07.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/858: creat d5/d45/d6d/d10/d19/d21/d30/f11e x:0 0 0 2024-09-21T10:41:07.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/859: fsync d5/d45/d6d/d10/d19/f33 0 2024-09-21T10:41:07.323 INFO:tasks.workunit.client.0.smithi060.stdout:5/860: chown d5/d45/d5a/d3a/df7 849932 1 2024-09-21T10:41:07.324 INFO:tasks.workunit.client.0.smithi060.stdout:5/861: creat d5/d45/d77/d8f/d91/f11f x:0 0 0 2024-09-21T10:41:07.324 INFO:tasks.workunit.client.0.smithi060.stdout:5/862: write d5/f24 [4335869,48756] 0 2024-09-21T10:41:07.324 INFO:tasks.workunit.client.0.smithi060.stdout:5/863: chown d5/d45/d6d/d10/d19/d8d/d60/d9e/fd4 107 1 2024-09-21T10:41:07.327 INFO:tasks.workunit.client.0.smithi060.stdout:4/755: unlink d0/d83/d6a/d6b/d32/d57/lb8 0 2024-09-21T10:41:07.328 INFO:tasks.workunit.client.0.smithi060.stdout:0/806: truncate d5/f3e 8156948 0 2024-09-21T10:41:07.329 INFO:tasks.workunit.client.0.smithi060.stdout:9/738: rmdir d3/d16/d42/d7e/d85/d8f 39 2024-09-21T10:41:07.330 INFO:tasks.workunit.client.0.smithi060.stdout:2/565: creat d3/d7/fc2 x:0 0 0 2024-09-21T10:41:07.333 INFO:tasks.workunit.client.0.smithi060.stdout:6/925: rename d3/d12/d16/d1a/d21/c3f to d3/d12/d4e/df2/c12b 0 2024-09-21T10:41:07.333 INFO:tasks.workunit.client.0.smithi060.stdout:6/926: fsync d3/d12/d16/d22/f63 0 2024-09-21T10:41:07.333 INFO:tasks.workunit.client.0.smithi060.stdout:6/927: write d3/d12/d16/d25/fcc [1135192,98793] 0 2024-09-21T10:41:07.333 INFO:tasks.workunit.client.0.smithi060.stdout:6/928: write d3/d12/d16/d1a/d21/f23 [5378471,96326] 0 2024-09-21T10:41:07.341 INFO:tasks.workunit.client.0.smithi060.stdout:8/761: creat d2/d26/d37/d64/ffa x:0 0 0 2024-09-21T10:41:07.341 INFO:tasks.workunit.client.0.smithi060.stdout:8/762: read d2/d26/d37/d62/d74/d83/da2/fd8 [1927045,2390] 0 2024-09-21T10:41:07.341 INFO:tasks.workunit.client.0.smithi060.stdout:8/763: chown d2/d5a/fcf 13432993 1 2024-09-21T10:41:07.344 INFO:tasks.workunit.client.0.smithi060.stdout:5/864: dread d5/d7a/d84/fc1 [0,4194304] 0 2024-09-21T10:41:07.344 INFO:tasks.workunit.client.0.smithi060.stdout:5/865: creat d5/d45/d6d/d10/d19/d21/d7f/d89/f120 x:0 0 0 2024-09-21T10:41:07.346 INFO:tasks.workunit.client.0.smithi060.stdout:1/689: mknod d6/d24/da/db/dd/cf6 0 2024-09-21T10:41:07.346 INFO:tasks.workunit.client.0.smithi060.stdout:1/690: stat d6/d24/da/f12 0 2024-09-21T10:41:07.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/756: dwrite d0/df/d84/faf [0,4194304] 0 2024-09-21T10:41:07.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/757: write d0/d3c/f48 [5216062,74427] 0 2024-09-21T10:41:07.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/758: creat d0/d5/d12/f108 x:0 0 0 2024-09-21T10:41:07.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/759: write d0/d83/d6a/d6b/fe5 [655749,113063] 0 2024-09-21T10:41:07.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/760: write d0/d5/d12/d3d/dd5/fef [140680,116117] 0 2024-09-21T10:41:07.356 INFO:tasks.workunit.client.0.smithi060.stdout:6/929: dwrite d3/d12/d16/d1a/f4c [0,4194304] 0 2024-09-21T10:41:07.360 INFO:tasks.workunit.client.0.smithi060.stdout:3/857: rename d0/d1/d11/d46/f118 to d0/d1/d11/d2a/d43/f11e 0 2024-09-21T10:41:07.360 INFO:tasks.workunit.client.0.smithi060.stdout:3/858: readlink d0/la3 0 2024-09-21T10:41:07.360 INFO:tasks.workunit.client.0.smithi060.stdout:3/859: write d0/d1/d11/d53/da2/dc8/fc9 [1241789,37773] 0 2024-09-21T10:41:07.360 INFO:tasks.workunit.client.0.smithi060.stdout:4/761: write d0/d5/d12/d15/d72/fff [1337018,86903] 0 2024-09-21T10:41:07.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/930: dread d3/d12/d38/f96 [0,4194304] 0 2024-09-21T10:41:07.361 INFO:tasks.workunit.client.0.smithi060.stdout:6/931: write d3/d12/d16/d1a/f10a [215794,112767] 0 2024-09-21T10:41:07.362 INFO:tasks.workunit.client.0.smithi060.stdout:6/932: write d3/d12/d16/d25/fcc [4958659,117249] 0 2024-09-21T10:41:07.363 INFO:tasks.workunit.client.0.smithi060.stdout:3/860: write d0/d1/d11/d2a/f5d [1163093,60542] 0 2024-09-21T10:41:07.365 INFO:tasks.workunit.client.0.smithi060.stdout:8/764: mknod d2/d18/d4b/d61/d6e/cfb 0 2024-09-21T10:41:07.365 INFO:tasks.workunit.client.0.smithi060.stdout:8/765: chown d2/d5a/f8b 14456 1 2024-09-21T10:41:07.368 INFO:tasks.workunit.client.0.smithi060.stdout:1/691: symlink d6/d24/da/db/d79/d86/d9f/dcd/lf7 0 2024-09-21T10:41:07.372 INFO:tasks.workunit.client.0.smithi060.stdout:0/807: getdents d5/d10/da/d4b/da4/d40/d48/dab/d4d 0 2024-09-21T10:41:07.373 INFO:tasks.workunit.client.0.smithi060.stdout:2/566: getdents d3/d7/d24 0 2024-09-21T10:41:07.376 INFO:tasks.workunit.client.0.smithi060.stdout:5/866: rename d5/d45/d6d/d10/d19/d8d/d50 to d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/d121 0 2024-09-21T10:41:07.376 INFO:tasks.workunit.client.0.smithi060.stdout:5/867: fdatasync d5/d45/d6d/d10/f90 0 2024-09-21T10:41:07.376 INFO:tasks.workunit.client.0.smithi060.stdout:0/808: dread d5/f25 [0,4194304] 0 2024-09-21T10:41:07.380 INFO:tasks.workunit.client.0.smithi060.stdout:6/933: mknod d3/d12/d16/d22/d5d/d70/d89/c12c 0 2024-09-21T10:41:07.380 INFO:tasks.workunit.client.0.smithi060.stdout:6/934: stat d3/d12/d16/d1a/d83/ddd/f44 0 2024-09-21T10:41:07.381 INFO:tasks.workunit.client.0.smithi060.stdout:8/766: dwrite d2/d18/d4b/fe9 [0,4194304] 0 2024-09-21T10:41:07.381 INFO:tasks.workunit.client.0.smithi060.stdout:3/861: unlink d0/d1/d52/lad 0 2024-09-21T10:41:07.388 INFO:tasks.workunit.client.0.smithi060.stdout:1/692: mkdir d6/d24/da/db/d79/d86/d9f/dcd/df8 0 2024-09-21T10:41:07.388 INFO:tasks.workunit.client.0.smithi060.stdout:1/693: creat d6/d24/da/d45/d47/ff9 x:0 0 0 2024-09-21T10:41:07.388 INFO:tasks.workunit.client.0.smithi060.stdout:1/694: creat d6/d24/da/ffa x:0 0 0 2024-09-21T10:41:07.389 INFO:tasks.workunit.client.0.smithi060.stdout:1/695: creat d6/d4a/d5a/ffb x:0 0 0 2024-09-21T10:41:07.389 INFO:tasks.workunit.client.0.smithi060.stdout:2/567: creat d3/d79/db4/d8b/d69/d83/fc3 x:0 0 0 2024-09-21T10:41:07.389 INFO:tasks.workunit.client.0.smithi060.stdout:2/568: chown d3/d7/d23/f5a 211 1 2024-09-21T10:41:07.389 INFO:tasks.workunit.client.0.smithi060.stdout:2/569: creat d3/d7/d23/fc4 x:0 0 0 2024-09-21T10:41:07.393 INFO:tasks.workunit.client.0.smithi060.stdout:6/935: unlink d3/d12/d16/d22/f7a 0 2024-09-21T10:41:07.393 INFO:tasks.workunit.client.0.smithi060.stdout:6/936: truncate d3/d12/d16/d22/f63 1334816 0 2024-09-21T10:41:07.393 INFO:tasks.workunit.client.0.smithi060.stdout:6/937: truncate d3/d12/d65/d7f/db5/f119 990552 0 2024-09-21T10:41:07.395 INFO:tasks.workunit.client.0.smithi060.stdout:8/767: truncate d2/f1c 24179 0 2024-09-21T10:41:07.395 INFO:tasks.workunit.client.0.smithi060.stdout:8/768: creat d2/d26/d37/d64/d65/ffc x:0 0 0 2024-09-21T10:41:07.396 INFO:tasks.workunit.client.0.smithi060.stdout:3/862: mkdir d0/d1/d11/d53/da2/d11f 0 2024-09-21T10:41:07.405 INFO:tasks.workunit.client.0.smithi060.stdout:0/809: rmdir d5/d10/da/d4b/da4/d40/d48/db3 39 2024-09-21T10:41:07.407 INFO:tasks.workunit.client.0.smithi060.stdout:6/938: creat d3/d12/d16/d5b/f12d x:0 0 0 2024-09-21T10:41:07.410 INFO:tasks.workunit.client.0.smithi060.stdout:8/769: mkdir d2/d26/d37/d62/d74/d83/da2/d75/dfd 0 2024-09-21T10:41:07.412 INFO:tasks.workunit.client.0.smithi060.stdout:1/696: rmdir d6/d4a/d5a 39 2024-09-21T10:41:07.414 INFO:tasks.workunit.client.0.smithi060.stdout:5/868: rename d5/d7a/d84/dc3 to d5/d122 0 2024-09-21T10:41:07.415 INFO:tasks.workunit.client.0.smithi060.stdout:0/810: chown d5/d10/da/d4b/da4/d40/d48/dab/l3c 45506 1 2024-09-21T10:41:07.417 INFO:tasks.workunit.client.0.smithi060.stdout:6/939: mkdir d3/d12/d38/d9e/dda/d12e 0 2024-09-21T10:41:07.417 INFO:tasks.workunit.client.0.smithi060.stdout:8/770: getdents d2/d26/d37/d62/d74 0 2024-09-21T10:41:07.418 INFO:tasks.workunit.client.0.smithi060.stdout:8/771: chown d2/d26/fb0 65851 1 2024-09-21T10:41:07.419 INFO:tasks.workunit.client.0.smithi060.stdout:3/863: getdents d0/d1/d11/d2a/d87 0 2024-09-21T10:41:07.421 INFO:tasks.workunit.client.0.smithi060.stdout:2/570: rename d3/d7/d24/d25/c7a to d3/d7/d24/d25/d8a/cc5 0 2024-09-21T10:41:07.422 INFO:tasks.workunit.client.0.smithi060.stdout:5/869: link d5/d45/fd0 d5/d7a/d84/dcc/f123 0 2024-09-21T10:41:07.423 INFO:tasks.workunit.client.0.smithi060.stdout:6/940: rmdir d3/d12/d65/d7f 39 2024-09-21T10:41:07.424 INFO:tasks.workunit.client.0.smithi060.stdout:8/772: mkdir d2/d26/d37/dfe 0 2024-09-21T10:41:07.424 INFO:tasks.workunit.client.0.smithi060.stdout:3/864: mknod d0/d1/d9e/c120 0 2024-09-21T10:41:07.426 INFO:tasks.workunit.client.0.smithi060.stdout:2/571: creat d3/d79/db4/d6a/fc6 x:0 0 0 2024-09-21T10:41:07.428 INFO:tasks.workunit.client.0.smithi060.stdout:5/870: creat d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/f124 x:0 0 0 2024-09-21T10:41:07.429 INFO:tasks.workunit.client.0.smithi060.stdout:6/941: rename d3/d12/d16/d1a/d83/ddd/f62 to d3/d12/d65/d7f/f12f 0 2024-09-21T10:41:07.431 INFO:tasks.workunit.client.0.smithi060.stdout:8/773: mkdir d2/d26/d37/d62/dff 0 2024-09-21T10:41:07.433 INFO:tasks.workunit.client.0.smithi060.stdout:3/865: creat d0/d1/d24/d101/f121 x:0 0 0 2024-09-21T10:41:07.434 INFO:tasks.workunit.client.0.smithi060.stdout:5/871: creat d5/d45/d5a/f125 x:0 0 0 2024-09-21T10:41:07.439 INFO:tasks.workunit.client.0.smithi060.stdout:3/866: link d0/d1/d52/faf d0/d1/d1e/d89/f122 0 2024-09-21T10:41:07.444 INFO:tasks.workunit.client.0.smithi060.stdout:8/774: rmdir d2/d18/d4b 39 2024-09-21T10:41:07.447 INFO:tasks.workunit.client.0.smithi060.stdout:3/867: truncate d0/f7d 3846293 0 2024-09-21T10:41:07.447 INFO:tasks.workunit.client.0.smithi060.stdout:3/868: dread - d0/d1/d11/d2a/d43/f119 zero size 2024-09-21T10:41:07.447 INFO:tasks.workunit.client.0.smithi060.stdout:1/697: dwrite d6/dd3/fd5 [0,4194304] 0 2024-09-21T10:41:07.447 INFO:tasks.workunit.client.0.smithi060.stdout:1/698: chown d6/d24/da/db/d79/d86/d9f 2005308 1 2024-09-21T10:41:07.448 INFO:tasks.workunit.client.0.smithi060.stdout:8/775: creat d2/d26/d37/f100 x:0 0 0 2024-09-21T10:41:07.450 INFO:tasks.workunit.client.0.smithi060.stdout:3/869: creat d0/d1/d11/d2a/d45/f123 x:0 0 0 2024-09-21T10:41:07.451 INFO:tasks.workunit.client.0.smithi060.stdout:1/699: dread d6/d24/da/db/f57 [0,4194304] 0 2024-09-21T10:41:07.452 INFO:tasks.workunit.client.0.smithi060.stdout:0/811: dwrite d5/d10/da/d4b/da4/d40/d75/dca/fcb [0,4194304] 0 2024-09-21T10:41:07.452 INFO:tasks.workunit.client.0.smithi060.stdout:0/812: chown d5/d10/da/d4b/da4/d76/caa 41991696 1 2024-09-21T10:41:07.452 INFO:tasks.workunit.client.0.smithi060.stdout:6/942: dwrite d3/dd/f64 [0,4194304] 0 2024-09-21T10:41:07.452 INFO:tasks.workunit.client.0.smithi060.stdout:0/813: chown d5/d10/da/d4b/da4/d40/c59 425985 1 2024-09-21T10:41:07.453 INFO:tasks.workunit.client.0.smithi060.stdout:3/870: link d0/d1/d1e/f35 d0/d1/d11/d2a/d45/d104/f124 0 2024-09-21T10:41:07.453 INFO:tasks.workunit.client.0.smithi060.stdout:2/572: dwrite d3/d79/db4/d6a/d9a/fbf [0,4194304] 0 2024-09-21T10:41:07.453 INFO:tasks.workunit.client.0.smithi060.stdout:3/871: read d0/d1/d11/d2a/d85/fc0 [258606,24596] 0 2024-09-21T10:41:07.453 INFO:tasks.workunit.client.0.smithi060.stdout:5/872: dwrite d5/d45/d77/f11c [0,4194304] 0 2024-09-21T10:41:07.453 INFO:tasks.workunit.client.0.smithi060.stdout:5/873: dread - d5/d7a/d84/dcc/f123 zero size 2024-09-21T10:41:07.454 INFO:tasks.workunit.client.0.smithi060.stdout:1/700: rename d6/d24/da/dea/dd8/ce0 to d6/d24/da/db/d79/cfc 0 2024-09-21T10:41:07.455 INFO:tasks.workunit.client.0.smithi060.stdout:1/701: write d6/d24/da/db/fc4 [761563,40234] 0 2024-09-21T10:41:07.455 INFO:tasks.workunit.client.0.smithi060.stdout:6/943: dread d3/d12/d16/d1a/d83/ddd/f46 [4194304,4194304] 0 2024-09-21T10:41:07.455 INFO:tasks.workunit.client.0.smithi060.stdout:6/944: write d3/d54/f71 [1184898,36552] 0 2024-09-21T10:41:07.462 INFO:tasks.workunit.client.0.smithi060.stdout:0/814: truncate d5/d10/da/d4b/da4/d76/f94 3981329 0 2024-09-21T10:41:07.462 INFO:tasks.workunit.client.0.smithi060.stdout:0/815: write d5/d10/da/d4b/da4/d76/f95 [978808,61201] 0 2024-09-21T10:41:07.465 INFO:tasks.workunit.client.0.smithi060.stdout:2/573: link d3/d7/d18/c88 d3/d20/d15/cc7 0 2024-09-21T10:41:07.466 INFO:tasks.workunit.client.0.smithi060.stdout:2/574: read f2 [493401,7510] 0 2024-09-21T10:41:07.466 INFO:tasks.workunit.client.0.smithi060.stdout:3/872: dwrite d0/d1/d11/d2a/d45/f91 [4194304,4194304] 0 2024-09-21T10:41:07.469 INFO:tasks.workunit.client.0.smithi060.stdout:5/874: mknod d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/c126 0 2024-09-21T10:41:07.469 INFO:tasks.workunit.client.0.smithi060.stdout:5/875: chown d5/d71 30 1 2024-09-21T10:41:07.471 INFO:tasks.workunit.client.0.smithi060.stdout:3/873: dread d0/d1/d11/d2a/f33 [0,4194304] 0 2024-09-21T10:41:07.471 INFO:tasks.workunit.client.0.smithi060.stdout:3/874: getdents d0/d1/d24/dde 0 2024-09-21T10:41:07.471 INFO:tasks.workunit.client.0.smithi060.stdout:1/702: rename d6/d24/da/db/f57 to d6/d24/da/dea/ffd 0 2024-09-21T10:41:07.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/816: symlink d5/d10/d4e/l100 0 2024-09-21T10:41:07.476 INFO:tasks.workunit.client.0.smithi060.stdout:5/876: dread d5/d45/d77/d8f/d91/fea [0,4194304] 0 2024-09-21T10:41:07.477 INFO:tasks.workunit.client.0.smithi060.stdout:3/875: rmdir d0/d1/d11/d53/dbb 39 2024-09-21T10:41:07.479 INFO:tasks.workunit.client.0.smithi060.stdout:5/877: dread d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/fc5 [0,4194304] 0 2024-09-21T10:41:07.479 INFO:tasks.workunit.client.0.smithi060.stdout:5/878: readlink d5/d45/d5a/l9a 0 2024-09-21T10:41:07.479 INFO:tasks.workunit.client.0.smithi060.stdout:6/945: rename d3/d12/d16/d1a/d60/f73 to d3/d12/d16/d1a/d60/dac/d127/f130 0 2024-09-21T10:41:07.480 INFO:tasks.workunit.client.0.smithi060.stdout:1/703: truncate d6/d24/da/db/d1c/f26 7109736 0 2024-09-21T10:41:07.484 INFO:tasks.workunit.client.0.smithi060.stdout:3/876: link d0/d1/d11/fd3 d0/d1/d5c/f125 0 2024-09-21T10:41:07.487 INFO:tasks.workunit.client.0.smithi060.stdout:5/879: symlink d5/d45/d6d/d10/d19/d21/l127 0 2024-09-21T10:41:07.490 INFO:tasks.workunit.client.0.smithi060.stdout:6/946: dread d3/d12/d16/d1a/d21/f88 [0,4194304] 0 2024-09-21T10:41:07.490 INFO:tasks.workunit.client.0.smithi060.stdout:6/947: fsync d3/d12/d38/f9f 0 2024-09-21T10:41:07.490 INFO:tasks.workunit.client.0.smithi060.stdout:2/575: rename d3/d20/d15/d4c/cb7 to d3/d79/cc8 0 2024-09-21T10:41:07.491 INFO:tasks.workunit.client.0.smithi060.stdout:1/704: truncate d6/d24/da/db/f5f 1774907 0 2024-09-21T10:41:07.493 INFO:tasks.workunit.client.0.smithi060.stdout:0/817: getdents d5/d10/da/d15 0 2024-09-21T10:41:07.495 INFO:tasks.workunit.client.0.smithi060.stdout:5/880: creat d5/d7a/d84/d88/de0/f128 x:0 0 0 2024-09-21T10:41:07.501 INFO:tasks.workunit.client.0.smithi060.stdout:3/877: rename d0/d1/l1f to d0/d1/d11/d2a/d45/d104/l126 0 2024-09-21T10:41:07.503 INFO:tasks.workunit.client.0.smithi060.stdout:2/576: creat d3/d79/db4/d43/d62/fc9 x:0 0 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:3/878: dread d0/d1/d5c/dc4/fda [0,4194304] 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:3/879: dread - d0/d1/d24/d81/f95 zero size 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:6/948: dread d3/d12/d16/d22/d5d/fe6 [0,4194304] 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:6/949: write d3/d12/d4e/f11d [566313,733] 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:1/705: creat d6/d24/da/db/d79/dad/ffe x:0 0 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:1/706: creat d6/d24/da/fff x:0 0 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:1/707: creat d6/d24/da/db/d79/d86/f100 x:0 0 0 2024-09-21T10:41:07.507 INFO:tasks.workunit.client.0.smithi060.stdout:0/818: mknod d5/d10/da/d4b/da4/d76/c101 0 2024-09-21T10:41:07.508 INFO:tasks.workunit.client.0.smithi060.stdout:5/881: dwrite d5/d45/d6d/fd7 [0,4194304] 0 2024-09-21T10:41:07.508 INFO:tasks.workunit.client.0.smithi060.stdout:5/882: truncate d5/d45/d6d/d10/d19/d21/ff2 5337 0 2024-09-21T10:41:07.510 INFO:tasks.workunit.client.0.smithi060.stdout:2/577: mkdir d3/d20/d15/d4c/d82/dca 0 2024-09-21T10:41:07.512 INFO:tasks.workunit.client.0.smithi060.stdout:6/950: creat d3/d12/d16/d1a/d60/dac/f131 x:0 0 0 2024-09-21T10:41:07.514 INFO:tasks.workunit.client.0.smithi060.stdout:3/880: dread d0/d1/d11/f15 [0,4194304] 0 2024-09-21T10:41:07.514 INFO:tasks.workunit.client.0.smithi060.stdout:3/881: chown d0/d1/d11/d46/c5a 3 1 2024-09-21T10:41:07.514 INFO:tasks.workunit.client.0.smithi060.stdout:3/882: truncate d0/d1/d11/d2a/f2e 5337078 0 2024-09-21T10:41:07.519 INFO:tasks.workunit.client.0.smithi060.stdout:0/819: read d5/d10/f3d [1759523,37317] 0 2024-09-21T10:41:07.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/708: mkdir d6/d24/da/db/d79/dad/d101 0 2024-09-21T10:41:07.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/709: chown d6/d24/da/db/f85 51297 1 2024-09-21T10:41:07.521 INFO:tasks.workunit.client.0.smithi060.stdout:3/883: read d0/d1/f20 [309515,38148] 0 2024-09-21T10:41:07.524 INFO:tasks.workunit.client.0.smithi060.stdout:2/578: rename d3/d20/d15/l3c to d3/d7/d18/lcb 0 2024-09-21T10:41:07.525 INFO:tasks.workunit.client.0.smithi060.stdout:6/951: truncate d3/d54/da8/fd8 4073099 0 2024-09-21T10:41:07.525 INFO:tasks.workunit.client.0.smithi060.stdout:5/883: dwrite d5/f105 [0,4194304] 0 2024-09-21T10:41:07.526 INFO:tasks.workunit.client.0.smithi060.stdout:0/820: symlink d5/d10/da/da7/l102 0 2024-09-21T10:41:07.526 INFO:tasks.workunit.client.0.smithi060.stdout:0/821: write d5/d10/da/d4b/da4/d40/d48/fc7 [2880300,62372] 0 2024-09-21T10:41:07.527 INFO:tasks.workunit.client.0.smithi060.stdout:1/710: rmdir d6/d4a 39 2024-09-21T10:41:07.528 INFO:tasks.workunit.client.0.smithi060.stdout:3/884: symlink d0/d1/d11/d2a/d93/l127 0 2024-09-21T10:41:07.528 INFO:tasks.workunit.client.0.smithi060.stdout:3/885: creat d0/d1/d11/d2a/d85/f128 x:0 0 0 2024-09-21T10:41:07.530 INFO:tasks.workunit.client.0.smithi060.stdout:2/579: creat d3/d20/d15/d4c/d82/dca/fcc x:0 0 0 2024-09-21T10:41:07.533 INFO:tasks.workunit.client.0.smithi060.stdout:6/952: mknod d3/d12/d16/d1a/d83/da3/c132 0 2024-09-21T10:41:07.536 INFO:tasks.workunit.client.0.smithi060.stdout:5/884: mknod d5/d45/d6d/d10/d19/d21/d30/d49/c129 0 2024-09-21T10:41:07.537 INFO:tasks.workunit.client.0.smithi060.stdout:2/580: write d3/d20/d17/f4a [7934145,60292] 0 2024-09-21T10:41:07.538 INFO:tasks.workunit.client.0.smithi060.stdout:2/581: creat d3/d20/d15/d3b/fcd x:0 0 0 2024-09-21T10:41:07.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/711: mkdir d6/d24/da/dea/d102 0 2024-09-21T10:41:07.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/885: dread d5/f7 [0,4194304] 0 2024-09-21T10:41:07.542 INFO:tasks.workunit.client.0.smithi060.stdout:5/886: chown d5/d45/d6d/d10/d19/d8d/c95 487146444 1 2024-09-21T10:41:07.542 INFO:tasks.workunit.client.0.smithi060.stdout:6/953: creat d3/dea/f133 x:0 0 0 2024-09-21T10:41:07.542 INFO:tasks.workunit.client.0.smithi060.stdout:6/954: chown d3/d12/d16/d25/de5 14042368 1 2024-09-21T10:41:07.546 INFO:tasks.workunit.client.0.smithi060.stdout:2/582: rename d3/d7/f34 to d3/d7/d23/db3/fce 0 2024-09-21T10:41:07.550 INFO:tasks.workunit.client.0.smithi060.stdout:3/886: dwrite d0/d1/db0/dba/ff9 [0,4194304] 0 2024-09-21T10:41:07.551 INFO:tasks.workunit.client.0.smithi060.stdout:0/822: rmdir d5/d10/da/d4b/da4/d40/d75 39 2024-09-21T10:41:07.555 INFO:tasks.workunit.client.0.smithi060.stdout:6/955: symlink d3/d12/d38/d9e/dcf/l134 0 2024-09-21T10:41:07.558 INFO:tasks.workunit.client.0.smithi060.stdout:2/583: symlink d3/d79/db4/lcf 0 2024-09-21T10:41:07.562 INFO:tasks.workunit.client.0.smithi060.stdout:3/887: creat d0/d1/d11/d53/f129 x:0 0 0 2024-09-21T10:41:07.563 INFO:tasks.workunit.client.0.smithi060.stdout:2/584: link d3/d20/d17/f50 d3/d79/db4/d8b/d69/fd0 0 2024-09-21T10:41:07.563 INFO:tasks.workunit.client.0.smithi060.stdout:2/585: chown d3/d20/d15/d4c/d82 32177 1 2024-09-21T10:41:07.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/586: creat d3/d79/db4/d43/d4b/fd1 x:0 0 0 2024-09-21T10:41:07.566 INFO:tasks.workunit.client.0.smithi060.stdout:2/587: mknod d3/d79/db4/d8b/d69/d83/da8/cd2 0 2024-09-21T10:41:07.566 INFO:tasks.workunit.client.0.smithi060.stdout:2/588: chown d3/d79/db4/d43/d4b/f6c 200 1 2024-09-21T10:41:07.567 INFO:tasks.workunit.client.0.smithi060.stdout:6/956: write d3/d12/d16/d1a/d9a/f11a [4023962,33787] 0 2024-09-21T10:41:07.568 INFO:tasks.workunit.client.0.smithi060.stdout:2/589: link d3/d7/c68 d3/d7/cd3 0 2024-09-21T10:41:07.568 INFO:tasks.workunit.client.0.smithi060.stdout:2/590: creat d3/d20/fd4 x:0 0 0 2024-09-21T10:41:07.570 INFO:tasks.workunit.client.0.smithi060.stdout:6/957: unlink d3/d12/d16/d22/ldf 0 2024-09-21T10:41:07.572 INFO:tasks.workunit.client.0.smithi060.stdout:2/591: unlink d3/f38 0 2024-09-21T10:41:07.575 INFO:tasks.workunit.client.0.smithi060.stdout:1/712: dwrite d6/d24/da/fff [0,4194304] 0 2024-09-21T10:41:07.575 INFO:tasks.workunit.client.0.smithi060.stdout:5/887: dwrite d5/d45/d6d/d10/d19/d21/d30/d49/f78 [0,4194304] 0 2024-09-21T10:41:07.576 INFO:tasks.workunit.client.0.smithi060.stdout:0/823: dwrite d5/d10/da/d4b/da4/fad [0,4194304] 0 2024-09-21T10:41:07.577 INFO:tasks.workunit.client.0.smithi060.stdout:3/888: dread d0/d1/d11/d2a/d87/fea [0,4194304] 0 2024-09-21T10:41:07.582 INFO:tasks.workunit.client.0.smithi060.stdout:1/713: mkdir d6/d24/da/db/d79/d103 0 2024-09-21T10:41:07.584 INFO:tasks.workunit.client.0.smithi060.stdout:5/888: creat d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/f12a x:0 0 0 2024-09-21T10:41:07.584 INFO:tasks.workunit.client.0.smithi060.stdout:5/889: read - d5/d7a/d84/dcc/f123 zero size 2024-09-21T10:41:07.584 INFO:tasks.workunit.client.0.smithi060.stdout:5/890: chown d5/d45/d6d/d10/f113 105416409 1 2024-09-21T10:41:07.584 INFO:tasks.workunit.client.0.smithi060.stdout:5/891: truncate d5/d7a/fa5 291919 0 2024-09-21T10:41:07.585 INFO:tasks.workunit.client.0.smithi060.stdout:2/592: write d3/d20/d15/f74 [1532733,16455] 0 2024-09-21T10:41:07.585 INFO:tasks.workunit.client.0.smithi060.stdout:2/593: write d3/d79/db4/d43/d4b/fd1 [942139,87418] 0 2024-09-21T10:41:07.586 INFO:tasks.workunit.client.0.smithi060.stdout:6/958: dwrite d3/d54/ff0 [0,4194304] 0 2024-09-21T10:41:07.589 INFO:tasks.workunit.client.0.smithi060.stdout:3/889: link d0/d1/d11/d2a/l4f d0/d1/l12a 0 2024-09-21T10:41:07.590 INFO:tasks.workunit.client.0.smithi060.stdout:0/824: dwrite d5/d10/d4e/f9c [0,4194304] 0 2024-09-21T10:41:07.591 INFO:tasks.workunit.client.0.smithi060.stdout:1/714: creat d6/d24/da/d45/f104 x:0 0 0 2024-09-21T10:41:07.593 INFO:tasks.workunit.client.0.smithi060.stdout:5/892: mkdir d5/d45/d6d/d10/d12b 0 2024-09-21T10:41:07.596 INFO:tasks.workunit.client.0.smithi060.stdout:6/959: dread d3/d54/f71 [0,4194304] 0 2024-09-21T10:41:07.603 INFO:tasks.workunit.client.0.smithi060.stdout:2/594: dwrite d3/d20/d15/d4c/d82/dca/fcc [0,4194304] 0 2024-09-21T10:41:07.604 INFO:tasks.workunit.client.0.smithi060.stdout:3/890: getdents d0/d1/d1e/d34 0 2024-09-21T10:41:07.605 INFO:tasks.workunit.client.0.smithi060.stdout:1/715: dread d6/d4a/d5a/fda [0,4194304] 0 2024-09-21T10:41:07.606 INFO:tasks.workunit.client.0.smithi060.stdout:0/825: dwrite d5/d10/da/d4b/da4/d40/f46 [0,4194304] 0 2024-09-21T10:41:07.606 INFO:tasks.workunit.client.0.smithi060.stdout:0/826: write d5/d10/f8 [324639,109437] 0 2024-09-21T10:41:07.607 INFO:tasks.workunit.client.0.smithi060.stdout:0/827: write d5/d10/da/da7/fb7 [497679,54403] 0 2024-09-21T10:41:07.615 INFO:tasks.workunit.client.0.smithi060.stdout:2/595: link d3/d20/d15/d4c/d82/c96 d3/d20/d15/d4c/cd5 0 2024-09-21T10:41:07.615 INFO:tasks.workunit.client.0.smithi060.stdout:2/596: chown d3/d7/lb6 103248265 1 2024-09-21T10:41:07.615 INFO:tasks.workunit.client.0.smithi060.stdout:3/891: mknod d0/d1/d11/d2a/d43/d4e/c12b 0 2024-09-21T10:41:07.618 INFO:tasks.workunit.client.0.smithi060.stdout:1/716: creat d6/d24/da/db/d1c/d4b/f105 x:0 0 0 2024-09-21T10:41:07.620 INFO:tasks.workunit.client.0.smithi060.stdout:0/828: mkdir d5/d10/da/d4b/da4/d40/d48/d103 0 2024-09-21T10:41:07.622 INFO:tasks.workunit.client.0.smithi060.stdout:2/597: rename d3/d79/db4/d8b/d69/d83/lac to d3/d79/ld6 0 2024-09-21T10:41:07.624 INFO:tasks.workunit.client.0.smithi060.stdout:1/717: mknod d6/d24/da/db/d79/d86/d9f/dcd/df8/c106 0 2024-09-21T10:41:07.624 INFO:tasks.workunit.client.0.smithi060.stdout:1/718: write d6/d24/da/db/d79/d86/d9f/fec [498571,94938] 0 2024-09-21T10:41:07.627 INFO:tasks.workunit.client.0.smithi060.stdout:0/829: rename d5/d10/d4e/l8e to d5/d10/d11/l104 0 2024-09-21T10:41:07.627 INFO:tasks.workunit.client.0.smithi060.stdout:0/830: chown d5/d10/da/d4b/da4/d40/d75/dbb/ffb 102 1 2024-09-21T10:41:07.632 INFO:tasks.workunit.client.0.smithi060.stdout:1/719: rmdir d6/d24/da/db/d79/d86/d95 39 2024-09-21T10:41:07.632 INFO:tasks.workunit.client.0.smithi060.stdout:1/720: truncate d6/d4a/d5a/db0/fac 571526 0 2024-09-21T10:41:07.637 INFO:tasks.workunit.client.0.smithi060.stdout:0/831: rename d5/d10/da/d4b/da4/d40/d48/dab to d5/d10/da/d4b/da4/d40/d48/d63/def/d105 0 2024-09-21T10:41:07.637 INFO:tasks.workunit.client.0.smithi060.stdout:0/832: write d5/d10/da/d2d/fa2 [9248189,72515] 0 2024-09-21T10:41:07.638 INFO:tasks.workunit.client.0.smithi060.stdout:1/721: rename d6/f20 to d6/d24/da/db/d7e/d90/f107 0 2024-09-21T10:41:07.639 INFO:tasks.workunit.client.0.smithi060.stdout:2/598: dwrite d3/d20/f98 [0,4194304] 0 2024-09-21T10:41:07.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/892: dwrite d0/d1/d11/d46/dfc/f110 [0,4194304] 0 2024-09-21T10:41:07.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/893: truncate d0/d1/d11/d53/f129 953150 0 2024-09-21T10:41:07.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/894: readlink d0/d1/d11/d53/d98/db8/l10b 0 2024-09-21T10:41:07.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/895: truncate d0/d1/d11/d2a/dd4/fdd 1779919 0 2024-09-21T10:41:07.641 INFO:tasks.workunit.client.0.smithi060.stdout:3/896: creat d0/d1/f12c x:0 0 0 2024-09-21T10:41:07.643 INFO:tasks.workunit.client.0.smithi060.stdout:2/599: truncate d3/d79/db4/f3f 5717673 0 2024-09-21T10:41:07.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/897: mknod d0/d1/d24/dde/c12d 0 2024-09-21T10:41:07.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/898: stat d0/d1/d11/d53/d98/f112 0 2024-09-21T10:41:07.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/899: chown d0/d1/d1e/c69 0 1 2024-09-21T10:41:07.648 INFO:tasks.workunit.client.0.smithi060.stdout:3/900: write d0/d1/d11/f77 [810359,31321] 0 2024-09-21T10:41:07.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/600: rename d3/d7/lb6 to d3/d7/d24/ld7 0 2024-09-21T10:41:07.658 INFO:tasks.workunit.client.0.smithi060.stdout:1/722: dwrite d6/d24/da/db/de/d32/f60 [0,4194304] 0 2024-09-21T10:41:07.662 INFO:tasks.workunit.client.0.smithi060.stdout:3/901: creat d0/d1/d11/d2a/f12e x:0 0 0 2024-09-21T10:41:07.670 INFO:tasks.workunit.client.0.smithi060.stdout:1/723: symlink d6/d24/da/db/d79/d86/d9f/dcd/df8/l108 0 2024-09-21T10:41:07.670 INFO:tasks.workunit.client.0.smithi060.stdout:1/724: chown d6/d4a/d5a/ca7 3008 1 2024-09-21T10:41:07.672 INFO:tasks.workunit.client.0.smithi060.stdout:2/601: getdents d3/d20 0 2024-09-21T10:41:07.676 INFO:tasks.workunit.client.0.smithi060.stdout:2/602: mknod d3/d7/d18/cd8 0 2024-09-21T10:41:07.676 INFO:tasks.workunit.client.0.smithi060.stdout:2/603: dread - d3/d7/d23/db3/fbd zero size 2024-09-21T10:41:07.678 INFO:tasks.workunit.client.0.smithi060.stdout:2/604: mkdir d3/d7/d18/dd9 0 2024-09-21T10:41:07.682 INFO:tasks.workunit.client.0.smithi060.stdout:3/902: dwrite d0/d1/d11/d53/d98/f112 [0,4194304] 0 2024-09-21T10:41:07.682 INFO:tasks.workunit.client.0.smithi060.stdout:3/903: fdatasync d0/d1/d5c/f125 0 2024-09-21T10:41:07.683 INFO:tasks.workunit.client.0.smithi060.stdout:1/725: dwrite d6/d24/da/db/d1c/d4b/f82 [0,4194304] 0 2024-09-21T10:41:07.701 INFO:tasks.workunit.client.0.smithi060.stdout:2/605: dwrite d3/d79/f7b [0,4194304] 0 2024-09-21T10:41:07.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/606: mknod d3/d20/d15/d3b/cda 0 2024-09-21T10:41:07.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/607: chown d3/d79/db4/d43/f67 26 1 2024-09-21T10:41:07.704 INFO:tasks.workunit.client.0.smithi060.stdout:3/904: dwrite d0/d1/d11/d2a/d64/f9c [0,4194304] 0 2024-09-21T10:41:07.705 INFO:tasks.workunit.client.0.smithi060.stdout:3/905: symlink d0/d1/d11/d46/df6/l12f 0 2024-09-21T10:41:07.705 INFO:tasks.workunit.client.0.smithi060.stdout:3/906: dread - d0/d1/d11/d2a/d87/f9d zero size 2024-09-21T10:41:07.707 INFO:tasks.workunit.client.0.smithi060.stdout:3/907: unlink d0/l3c 0 2024-09-21T10:41:07.707 INFO:tasks.workunit.client.0.smithi060.stdout:3/908: dread - d0/d1/d11/d2a/d87/f115 zero size 2024-09-21T10:41:07.712 INFO:tasks.workunit.client.0.smithi060.stdout:2/608: dread d3/d79/db4/d43/d4b/f8e [0,4194304] 0 2024-09-21T10:41:07.713 INFO:tasks.workunit.client.0.smithi060.stdout:2/609: readlink d3/d79/db4/d6a/l7d 0 2024-09-21T10:41:07.713 INFO:tasks.workunit.client.0.smithi060.stdout:2/610: rename d3/d79/db4/lcf to d3/d7/d23/db3/ldb 0 2024-09-21T10:41:07.715 INFO:tasks.workunit.client.0.smithi060.stdout:2/611: creat d3/d7/d24/d25/d8a/fdc x:0 0 0 2024-09-21T10:41:07.715 INFO:tasks.workunit.client.0.smithi060.stdout:2/612: chown d3/d20/d17/f50 1964854 1 2024-09-21T10:41:07.715 INFO:tasks.workunit.client.0.smithi060.stdout:2/613: dread - d3/d7/d23/db3/fbd zero size 2024-09-21T10:41:07.715 INFO:tasks.workunit.client.0.smithi060.stdout:2/614: chown d3/d20/d17/c1a 3 1 2024-09-21T10:41:07.716 INFO:tasks.workunit.client.0.smithi060.stdout:2/615: dread d3/d79/db4/d43/d4b/f6c [0,4194304] 0 2024-09-21T10:41:07.717 INFO:tasks.workunit.client.0.smithi060.stdout:2/616: creat d3/d20/d15/d4c/fdd x:0 0 0 2024-09-21T10:41:07.722 INFO:tasks.workunit.client.0.smithi060.stdout:3/909: dwrite d0/d1/d11/d2a/d87/f9d [0,4194304] 0 2024-09-21T10:41:07.724 INFO:tasks.workunit.client.0.smithi060.stdout:3/910: getdents d0/d1/d11/d53/d98/db8/de9 0 2024-09-21T10:41:07.745 INFO:tasks.workunit.client.0.smithi060.stdout:3/911: dwrite d0/d1/d11/d2a/d85/f128 [0,4194304] 0 2024-09-21T10:41:07.751 INFO:tasks.workunit.client.0.smithi060.stdout:7/780: sync 2024-09-21T10:41:07.770 INFO:tasks.workunit.client.0.smithi060.stdout:3/912: dwrite d0/d1/fb9 [0,4194304] 0 2024-09-21T10:41:07.770 INFO:tasks.workunit.client.0.smithi060.stdout:3/913: fsync d0/d1/d11/fd3 0 2024-09-21T10:41:07.770 INFO:tasks.workunit.client.0.smithi060.stdout:7/781: dwrite da/d60/d6e/dd5/fde [0,4194304] 0 2024-09-21T10:41:07.772 INFO:tasks.workunit.client.0.smithi060.stdout:3/914: truncate d0/d1/d11/d2a/d85/f128 3645314 0 2024-09-21T10:41:07.782 INFO:tasks.workunit.client.0.smithi060.stdout:3/915: dread d0/d1/d11/d53/d98/f112 [0,4194304] 0 2024-09-21T10:41:07.782 INFO:tasks.workunit.client.0.smithi060.stdout:3/916: write d0/d1/d11/d53/d98/db8/ffa [938063,72591] 0 2024-09-21T10:41:07.782 INFO:tasks.workunit.client.0.smithi060.stdout:3/917: readlink d0/le 0 2024-09-21T10:41:07.790 INFO:tasks.workunit.client.0.smithi060.stdout:7/782: rename da/d14/d35 to da/d60/d6e/dd5/d10b 0 2024-09-21T10:41:07.792 INFO:tasks.workunit.client.0.smithi060.stdout:3/918: rename d0/d1/d11/f47 to d0/d1/d11/d2a/d43/f130 0 2024-09-21T10:41:07.792 INFO:tasks.workunit.client.0.smithi060.stdout:3/919: stat d0/d1/d11/d2a/d87/f115 0 2024-09-21T10:41:07.793 INFO:tasks.workunit.client.0.smithi060.stdout:7/783: mkdir da/d60/d6e/dd5/d10b/d10c 0 2024-09-21T10:41:07.800 INFO:tasks.workunit.client.0.smithi060.stdout:3/920: write d0/d1/d9e/fcf [1189229,60030] 0 2024-09-21T10:41:07.806 INFO:tasks.workunit.client.0.smithi060.stdout:3/921: rename d0/d1/d11/d2a/d43 to d0/d1/d24/d81/d131 0 2024-09-21T10:41:07.806 INFO:tasks.workunit.client.0.smithi060.stdout:3/922: creat d0/d1/d11/d46/f132 x:0 0 0 2024-09-21T10:41:07.808 INFO:tasks.workunit.client.0.smithi060.stdout:7/784: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/fc0 [0,4194304] 0 2024-09-21T10:41:07.810 INFO:tasks.workunit.client.0.smithi060.stdout:3/923: rename d0/d1/d24/d81/d108 to d0/d1/d11/d46/d133 0 2024-09-21T10:41:07.810 INFO:tasks.workunit.client.0.smithi060.stdout:3/924: write d0/d1/d11/d2a/d45/fe1 [386162,105260] 0 2024-09-21T10:41:07.811 INFO:tasks.workunit.client.0.smithi060.stdout:3/925: creat d0/d1/d11/d2a/de3/d114/f134 x:0 0 0 2024-09-21T10:41:07.816 INFO:tasks.workunit.client.0.smithi060.stdout:7/785: write da/d14/d25/f4a [852903,127936] 0 2024-09-21T10:41:07.819 INFO:tasks.workunit.client.0.smithi060.stdout:3/926: write d0/d1/fc7 [3999987,32715] 0 2024-09-21T10:41:07.820 INFO:tasks.workunit.client.0.smithi060.stdout:7/786: creat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/f10d x:0 0 0 2024-09-21T10:41:07.821 INFO:tasks.workunit.client.0.smithi060.stdout:3/927: link d0/d1/d11/d46/c5a d0/d1/d11/d2a/d45/d104/c135 0 2024-09-21T10:41:07.822 INFO:tasks.workunit.client.0.smithi060.stdout:7/787: write da/d60/f84 [1525702,127390] 0 2024-09-21T10:41:07.823 INFO:tasks.workunit.client.0.smithi060.stdout:7/788: creat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9/f10e x:0 0 0 2024-09-21T10:41:07.824 INFO:tasks.workunit.client.0.smithi060.stdout:3/928: dread d0/d1/d1e/f4b [0,4194304] 0 2024-09-21T10:41:07.825 INFO:tasks.workunit.client.0.smithi060.stdout:7/789: rename da/d60/d6e/dd5/d10b/d10c to da/d60/d6e/dd5/d10b/d79/db0/df0/d10f 0 2024-09-21T10:41:07.825 INFO:tasks.workunit.client.0.smithi060.stdout:7/790: fdatasync da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/f86 0 2024-09-21T10:41:07.830 INFO:tasks.workunit.client.0.smithi060.stdout:3/929: write d0/d1/d11/d53/d98/f112 [247021,124056] 0 2024-09-21T10:41:07.830 INFO:tasks.workunit.client.0.smithi060.stdout:3/930: chown d0/d1/d11/d2a/d93/f10f 2 1 2024-09-21T10:41:07.834 INFO:tasks.workunit.client.0.smithi060.stdout:3/931: symlink d0/d1/db0/dba/l136 0 2024-09-21T10:41:07.834 INFO:tasks.workunit.client.0.smithi060.stdout:3/932: chown d0/d1/d1e/l6e 260709 1 2024-09-21T10:41:07.837 INFO:tasks.workunit.client.0.smithi060.stdout:3/933: rmdir d0/d1/d11/d46/d133 0 2024-09-21T10:41:07.842 INFO:tasks.workunit.client.0.smithi060.stdout:7/791: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/ff [0,4194304] 0 2024-09-21T10:41:07.844 INFO:tasks.workunit.client.0.smithi060.stdout:7/792: dread da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f98 [0,4194304] 0 2024-09-21T10:41:07.844 INFO:tasks.workunit.client.0.smithi060.stdout:7/793: chown da/d14/d25/c42 4307442 1 2024-09-21T10:41:07.847 INFO:tasks.workunit.client.0.smithi060.stdout:7/794: rename da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/f6c to da/d60/d6e/f110 0 2024-09-21T10:41:07.847 INFO:tasks.workunit.client.0.smithi060.stdout:7/795: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/f7b 6617609 0 2024-09-21T10:41:07.851 INFO:tasks.workunit.client.0.smithi060.stdout:3/934: dwrite d0/d1/d9e/fb6 [4194304,4194304] 0 2024-09-21T10:41:07.859 INFO:tasks.workunit.client.0.smithi060.stdout:3/935: mknod d0/d1/d24/dde/c137 0 2024-09-21T10:41:07.867 INFO:tasks.workunit.client.0.smithi060.stdout:7/796: dwrite da/d14/d25/d56/fa6 [0,4194304] 0 2024-09-21T10:41:07.869 INFO:tasks.workunit.client.0.smithi060.stdout:7/797: getdents da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9 0 2024-09-21T10:41:07.869 INFO:tasks.workunit.client.0.smithi060.stdout:7/798: creat da/d60/de4/de9/f111 x:0 0 0 2024-09-21T10:41:07.871 INFO:tasks.workunit.client.0.smithi060.stdout:3/936: dread d0/d1/db0/dba/ff9 [0,4194304] 0 2024-09-21T10:41:07.871 INFO:tasks.workunit.client.0.smithi060.stdout:3/937: getdents d0/d1/d1e/d34 0 2024-09-21T10:41:07.871 INFO:tasks.workunit.client.0.smithi060.stdout:3/938: write d0/d1/d11/d2a/f33 [1025670,30474] 0 2024-09-21T10:41:07.876 INFO:tasks.workunit.client.0.smithi060.stdout:3/939: dread d0/d1/d11/d53/d98/db8/ffa [0,4194304] 0 2024-09-21T10:41:07.877 INFO:tasks.workunit.client.0.smithi060.stdout:3/940: write d0/d1/ff3 [940932,61778] 0 2024-09-21T10:41:07.882 INFO:tasks.workunit.client.0.smithi060.stdout:7/799: write da/d14/f19 [333447,60500] 0 2024-09-21T10:41:07.891 INFO:tasks.workunit.client.0.smithi060.stdout:3/941: dwrite d0/d1/d11/d2a/fc6 [0,4194304] 0 2024-09-21T10:41:07.891 INFO:tasks.workunit.client.0.smithi060.stdout:3/942: fsync d0/d1/f12c 0 2024-09-21T10:41:07.891 INFO:tasks.workunit.client.0.smithi060.stdout:3/943: creat d0/d1/d11/d2a/d45/f138 x:0 0 0 2024-09-21T10:41:07.896 INFO:tasks.workunit.client.0.smithi060.stdout:3/944: mknod d0/d1/d5c/c139 0 2024-09-21T10:41:07.897 INFO:tasks.workunit.client.0.smithi060.stdout:3/945: readlink d0/d1/d5c/l92 0 2024-09-21T10:41:07.898 INFO:tasks.workunit.client.0.smithi060.stdout:7/800: dwrite da/d60/d6e/dd5/d10b/d79/db0/fc2 [0,4194304] 0 2024-09-21T10:41:07.898 INFO:tasks.workunit.client.0.smithi060.stdout:7/801: getdents da/d60/d6e/dd5/d10b/d79/db0/dd7/de1 0 2024-09-21T10:41:07.898 INFO:tasks.workunit.client.0.smithi060.stdout:3/946: getdents d0/d1/d11/d2a/d45/d104 0 2024-09-21T10:41:07.898 INFO:tasks.workunit.client.0.smithi060.stdout:3/947: fdatasync d0/d1/d1e/d89/ff0 0 2024-09-21T10:41:07.900 INFO:tasks.workunit.client.0.smithi060.stdout:3/948: mkdir d0/d1/d11/d53/d98/db8/d13a 0 2024-09-21T10:41:07.902 INFO:tasks.workunit.client.0.smithi060.stdout:3/949: mkdir d0/d1/d11/d46/dfc/d13b 0 2024-09-21T10:41:07.902 INFO:tasks.workunit.client.0.smithi060.stdout:3/950: dread - d0/d1/d11/d2a/f12e zero size 2024-09-21T10:41:07.911 INFO:tasks.workunit.client.0.smithi060.stdout:3/951: dread d0/d1/d11/d2a/d85/fa8 [0,4194304] 0 2024-09-21T10:41:07.911 INFO:tasks.workunit.client.0.smithi060.stdout:3/952: stat d0/d1/d11/d46 0 2024-09-21T10:41:07.911 INFO:tasks.workunit.client.0.smithi060.stdout:3/953: dread - d0/d1/d24/d81/d131/f119 zero size 2024-09-21T10:41:07.924 INFO:tasks.workunit.client.0.smithi060.stdout:3/954: dwrite d0/d1/d11/d2a/fbc [0,4194304] 0 2024-09-21T10:41:07.925 INFO:tasks.workunit.client.0.smithi060.stdout:3/955: symlink d0/d1/d24/d101/l13c 0 2024-09-21T10:41:07.925 INFO:tasks.workunit.client.0.smithi060.stdout:3/956: chown d0/d1/d11/d2a/d45/f138 210633093 1 2024-09-21T10:41:07.925 INFO:tasks.workunit.client.0.smithi060.stdout:3/957: truncate d0/d1/d24/d81/f11d 88432 0 2024-09-21T10:41:07.925 INFO:tasks.workunit.client.0.smithi060.stdout:3/958: dread - d0/d1/d24/d81/f103 zero size 2024-09-21T10:41:07.925 INFO:tasks.workunit.client.0.smithi060.stdout:3/959: write d0/d1/f20 [3457319,113088] 0 2024-09-21T10:41:07.926 INFO:tasks.workunit.client.0.smithi060.stdout:3/960: symlink d0/d1/d1e/l13d 0 2024-09-21T10:41:07.927 INFO:tasks.workunit.client.0.smithi060.stdout:3/961: unlink d0/d1/d24/d81/d131/d4e/c12b 0 2024-09-21T10:41:07.928 INFO:tasks.workunit.client.0.smithi060.stdout:3/962: mknod d0/d1/d24/d81/d131/c13e 0 2024-09-21T10:41:07.937 INFO:tasks.workunit.client.0.smithi060.stdout:3/963: dread d0/d1/f70 [0,4194304] 0 2024-09-21T10:41:07.938 INFO:tasks.workunit.client.0.smithi060.stdout:3/964: rmdir d0/d1/d24/dde 39 2024-09-21T10:41:07.939 INFO:tasks.workunit.client.0.smithi060.stdout:3/965: dread d0/d1/d5c/dc4/fda [0,4194304] 0 2024-09-21T10:41:07.939 INFO:tasks.workunit.client.0.smithi060.stdout:3/966: chown d0/d1/d1e/d89/f122 6895 1 2024-09-21T10:41:07.939 INFO:tasks.workunit.client.0.smithi060.stdout:3/967: write d0/d1/d11/d53/d98/db8/f117 [510591,98061] 0 2024-09-21T10:41:07.940 INFO:tasks.workunit.client.0.smithi060.stdout:3/968: mkdir d0/d1/d11/d46/dfc/d13f 0 2024-09-21T10:41:07.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:07 smithi060 ceph-mon[28215]: pgmap v20: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 168 MiB/s rd, 216 MiB/s wr, 343 op/s 2024-09-21T10:41:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:07 smithi112 ceph-mon[35117]: pgmap v20: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 168 MiB/s rd, 216 MiB/s wr, 343 op/s 2024-09-21T10:41:07.957 INFO:tasks.workunit.client.0.smithi060.stdout:3/969: dwrite d0/d1/d24/d81/d131/f130 [0,4194304] 0 2024-09-21T10:41:07.957 INFO:tasks.workunit.client.0.smithi060.stdout:3/970: fdatasync d0/d1/d11/d2a/d45/f9a 0 2024-09-21T10:41:07.961 INFO:tasks.workunit.client.0.smithi060.stdout:3/971: rename d0/d1/d1e/d89 to d0/d1/d1e/d140 0 2024-09-21T10:41:07.961 INFO:tasks.workunit.client.0.smithi060.stdout:3/972: write d0/d1/d11/d2a/d93/f10f [1695466,46737] 0 2024-09-21T10:41:07.961 INFO:tasks.workunit.client.0.smithi060.stdout:3/973: write d0/f16 [1268131,30548] 0 2024-09-21T10:41:07.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/739: sync 2024-09-21T10:41:07.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/740: chown d3/f47 5 1 2024-09-21T10:41:07.976 INFO:tasks.workunit.client.0.smithi060.stdout:9/741: read - d3/d16/d1a/d71/fca zero size 2024-09-21T10:41:07.979 INFO:tasks.workunit.client.0.smithi060.stdout:3/974: dwrite d0/d1/d11/d53/dbb/fc3 [0,4194304] 0 2024-09-21T10:41:07.979 INFO:tasks.workunit.client.0.smithi060.stdout:9/742: dread d3/d16/d1a/fa0 [0,4194304] 0 2024-09-21T10:41:07.984 INFO:tasks.workunit.client.0.smithi060.stdout:3/975: rename d0/d1/d11/d2a/d93 to d0/d1/d5c/dc4/d141 0 2024-09-21T10:41:07.988 INFO:tasks.workunit.client.0.smithi060.stdout:3/976: dread d0/d1/d11/d2a/fbc [4194304,4194304] 0 2024-09-21T10:41:07.988 INFO:tasks.workunit.client.0.smithi060.stdout:3/977: chown d0/d1/d9e 22243 1 2024-09-21T10:41:07.994 INFO:tasks.workunit.client.0.smithi060.stdout:9/743: dwrite d3/f4f [0,4194304] 0 2024-09-21T10:41:08.005 INFO:tasks.workunit.client.0.smithi060.stdout:9/744: write d3/f4f [1164304,20061] 0 2024-09-21T10:41:08.006 INFO:tasks.workunit.client.0.smithi060.stdout:3/978: dwrite d0/d1/d11/f51 [0,4194304] 0 2024-09-21T10:41:08.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/979: link d0/d1/d11/d2a/l4f d0/d1/d9e/l142 0 2024-09-21T10:41:08.016 INFO:tasks.workunit.client.0.smithi060.stdout:3/980: readlink d0/d1/d11/l107 0 2024-09-21T10:41:08.018 INFO:tasks.workunit.client.0.smithi060.stdout:3/981: symlink d0/d1/d1e/d34/l143 0 2024-09-21T10:41:08.031 INFO:tasks.workunit.client.0.smithi060.stdout:3/982: dwrite d0/d1/f12c [0,4194304] 0 2024-09-21T10:41:08.031 INFO:tasks.workunit.client.0.smithi060.stdout:3/983: chown d0/d1/d24/dde/c12d 3112697 1 2024-09-21T10:41:08.035 INFO:tasks.workunit.client.0.smithi060.stdout:3/984: mknod d0/d1/d11/d53/da2/d11f/c144 0 2024-09-21T10:41:08.036 INFO:tasks.workunit.client.0.smithi060.stdout:3/985: write d0/d1/d11/d2a/d45/f97 [7324427,109167] 0 2024-09-21T10:41:08.036 INFO:tasks.workunit.client.0.smithi060.stdout:3/986: fsync d0/d1/d11/fd3 0 2024-09-21T10:41:08.036 INFO:tasks.workunit.client.0.smithi060.stdout:3/987: creat d0/d1/d24/d81/f145 x:0 0 0 2024-09-21T10:41:08.055 INFO:tasks.workunit.client.0.smithi060.stdout:3/988: dwrite d0/f11c [0,4194304] 0 2024-09-21T10:41:08.061 INFO:tasks.workunit.client.0.smithi060.stdout:3/989: dread d0/d1/d24/d81/d131/fca [0,4194304] 0 2024-09-21T10:41:08.062 INFO:tasks.workunit.client.0.smithi060.stdout:3/990: dread - d0/d1/d11/d2a/f12e zero size 2024-09-21T10:41:08.063 INFO:tasks.workunit.client.0.smithi060.stdout:3/991: rename d0/d1/c19 to d0/d1/d11/d53/d98/db8/c146 0 2024-09-21T10:41:08.081 INFO:tasks.workunit.client.0.smithi060.stdout:3/992: dwrite d0/d1/d52/faf [0,4194304] 0 2024-09-21T10:41:08.083 INFO:tasks.workunit.client.0.smithi060.stdout:3/993: truncate d0/d1/d11/d46/dfc/f110 3121484 0 2024-09-21T10:41:08.083 INFO:tasks.workunit.client.0.smithi060.stdout:3/994: chown d0/d1/db0/ce5 3 1 2024-09-21T10:41:08.100 INFO:tasks.workunit.client.0.smithi060.stdout:3/995: dwrite d0/d1/d11/d2a/d64/f9c [0,4194304] 0 2024-09-21T10:41:08.100 INFO:tasks.workunit.client.0.smithi060.stdout:3/996: write d0/d1/d24/d81/d131/ff1 [5698,123953] 0 2024-09-21T10:41:08.101 INFO:tasks.workunit.client.0.smithi060.stdout:3/997: rename d0/la3 to d0/l147 0 2024-09-21T10:41:08.103 INFO:tasks.workunit.client.0.smithi060.stdout:3/998: mknod d0/d1/d11/d53/dbb/c148 0 2024-09-21T10:41:08.119 INFO:tasks.workunit.client.0.smithi060.stdout:3/999: dwrite d0/d1/f3f [0,4194304] 0 2024-09-21T10:41:08.154 INFO:tasks.workunit.client.0.smithi060.stdout:4/762: sync 2024-09-21T10:41:08.154 INFO:tasks.workunit.client.0.smithi060.stdout:4/763: chown d0/df/d84/la3 13327234 1 2024-09-21T10:41:08.154 INFO:tasks.workunit.client.0.smithi060.stdout:4/764: truncate d0/d83/d6a/d6b/d32/f75 757473 0 2024-09-21T10:41:08.157 INFO:tasks.workunit.client.0.smithi060.stdout:4/765: creat d0/df/d9c/f109 x:0 0 0 2024-09-21T10:41:08.157 INFO:tasks.workunit.client.0.smithi060.stdout:4/766: getdents d0/df/d88 0 2024-09-21T10:41:08.160 INFO:tasks.workunit.client.0.smithi060.stdout:4/767: getdents d0/d83/d6a 0 2024-09-21T10:41:08.181 INFO:tasks.workunit.client.0.smithi060.stdout:4/768: dwrite d0/d8b/fad [0,4194304] 0 2024-09-21T10:41:08.181 INFO:tasks.workunit.client.0.smithi060.stdout:4/769: write d0/d83/f9f [4791141,2482] 0 2024-09-21T10:41:08.189 INFO:tasks.workunit.client.0.smithi060.stdout:4/770: rmdir d0/d83/d6a/d6b/d32 39 2024-09-21T10:41:08.191 INFO:tasks.workunit.client.0.smithi060.stdout:4/771: creat d0/d83/dec/f10a x:0 0 0 2024-09-21T10:41:08.193 INFO:tasks.workunit.client.0.smithi060.stdout:8/776: sync 2024-09-21T10:41:08.193 INFO:tasks.workunit.client.0.smithi060.stdout:6/960: sync 2024-09-21T10:41:08.194 INFO:tasks.workunit.client.0.smithi060.stdout:6/961: creat d3/d12/d16/d1a/d60/f135 x:0 0 0 2024-09-21T10:41:08.194 INFO:tasks.workunit.client.0.smithi060.stdout:6/962: chown d3/d12/d16/d25/de5 1 1 2024-09-21T10:41:08.196 INFO:tasks.workunit.client.0.smithi060.stdout:6/963: symlink d3/d12/d38/d9e/l136 0 2024-09-21T10:41:08.196 INFO:tasks.workunit.client.0.smithi060.stdout:6/964: dread - d3/d12/d16/d1a/d9a/f10d zero size 2024-09-21T10:41:08.196 INFO:tasks.workunit.client.0.smithi060.stdout:8/777: dread d2/d5a/fcf [0,4194304] 0 2024-09-21T10:41:08.197 INFO:tasks.workunit.client.0.smithi060.stdout:6/965: link d3/d12/d38/d9e/dcf/f112 d3/d12/d16/d22/d58/d75/df8/f137 0 2024-09-21T10:41:08.201 INFO:tasks.workunit.client.0.smithi060.stdout:4/772: dread d0/d83/d6a/d6b/d32/d57/fe6 [0,4194304] 0 2024-09-21T10:41:08.203 INFO:tasks.workunit.client.0.smithi060.stdout:4/773: getdents d0/d59/d9d 0 2024-09-21T10:41:08.206 INFO:tasks.workunit.client.0.smithi060.stdout:4/774: creat d0/d83/d6a/d6b/d32/dd6/f10b x:0 0 0 2024-09-21T10:41:08.206 INFO:tasks.workunit.client.0.smithi060.stdout:4/775: chown d0/df/d88/lfa 0 1 2024-09-21T10:41:08.206 INFO:tasks.workunit.client.0.smithi060.stdout:4/776: chown d0/d83/d6a/d6b/d32/d57/fbc 3242 1 2024-09-21T10:41:08.209 INFO:tasks.workunit.client.0.smithi060.stdout:4/777: rename d0/d83/d6a/d6b/d32/l3f to d0/d8b/dd8/l10c 0 2024-09-21T10:41:08.209 INFO:tasks.workunit.client.0.smithi060.stdout:4/778: symlink d0/d59/l10d 0 2024-09-21T10:41:08.211 INFO:tasks.workunit.client.0.smithi060.stdout:6/966: dread d3/d12/d16/f18 [4194304,4194304] 0 2024-09-21T10:41:08.211 INFO:tasks.workunit.client.0.smithi060.stdout:4/779: rename d0/d3c/l42 to d0/l10e 0 2024-09-21T10:41:08.211 INFO:tasks.workunit.client.0.smithi060.stdout:4/780: dread - d0/d5/d12/d15/f7b zero size 2024-09-21T10:41:08.211 INFO:tasks.workunit.client.0.smithi060.stdout:8/778: dwrite d2/d26/d37/d64/d65/fde [0,4194304] 0 2024-09-21T10:41:08.212 INFO:tasks.workunit.client.0.smithi060.stdout:8/779: chown d2/d26/d37/d62/d74/lf3 1 1 2024-09-21T10:41:08.212 INFO:tasks.workunit.client.0.smithi060.stdout:6/967: truncate d3/d12/d16/d1a/d83/ddd/f4d 21072 0 2024-09-21T10:41:08.222 INFO:tasks.workunit.client.0.smithi060.stdout:4/781: rename d0/d83/d6a to d0/d8b/dd8/d10f 0 2024-09-21T10:41:08.222 INFO:tasks.workunit.client.0.smithi060.stdout:4/782: readlink d0/d3c/lee 0 2024-09-21T10:41:08.225 INFO:tasks.workunit.client.0.smithi060.stdout:6/968: unlink d3/d12/d65/d66/c8a 0 2024-09-21T10:41:08.225 INFO:tasks.workunit.client.0.smithi060.stdout:6/969: truncate d3/d12/d16/d25/f28 4856740 0 2024-09-21T10:41:08.225 INFO:tasks.workunit.client.0.smithi060.stdout:8/780: dwrite d2/da7/fed [0,4194304] 0 2024-09-21T10:41:08.234 INFO:tasks.workunit.client.0.smithi060.stdout:8/781: symlink d2/l101 0 2024-09-21T10:41:08.235 INFO:tasks.workunit.client.0.smithi060.stdout:8/782: symlink d2/d26/d37/d64/d65/dd5/l102 0 2024-09-21T10:41:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:8/783: link d2/f14 d2/d26/d37/d62/d74/d83/f103 0 2024-09-21T10:41:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:6/970: dwrite d3/d12/d16/d22/d58/f114 [4194304,4194304] 0 2024-09-21T10:41:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:6/971: dread - d3/d12/d16/d22/d5d/d70/d89/daa/fb2 zero size 2024-09-21T10:41:08.239 INFO:tasks.workunit.client.0.smithi060.stdout:6/972: fdatasync d3/fb 0 2024-09-21T10:41:08.241 INFO:tasks.workunit.client.0.smithi060.stdout:8/784: mkdir d2/d26/d37/d62/dff/d104 0 2024-09-21T10:41:08.244 INFO:tasks.workunit.client.0.smithi060.stdout:6/973: creat d3/d12/d16/d25/d27/dd4/f138 x:0 0 0 2024-09-21T10:41:08.244 INFO:tasks.workunit.client.0.smithi060.stdout:6/974: write d3/d12/d16/d25/fcc [740667,112466] 0 2024-09-21T10:41:08.244 INFO:tasks.workunit.client.0.smithi060.stdout:6/975: fdatasync d3/d12/d16/d25/d27/fcd 0 2024-09-21T10:41:08.244 INFO:tasks.workunit.client.0.smithi060.stdout:6/976: write d3/d12/d16/d25/d27/f29 [4688283,106411] 0 2024-09-21T10:41:08.245 INFO:tasks.workunit.client.0.smithi060.stdout:8/785: symlink d2/d26/d37/d64/d65/dd5/de7/l105 0 2024-09-21T10:41:08.246 INFO:tasks.workunit.client.0.smithi060.stdout:6/977: creat d3/d12/d4e/f139 x:0 0 0 2024-09-21T10:41:08.249 INFO:tasks.workunit.client.0.smithi060.stdout:8/786: rename d2/d26/d37/l6a to d2/d26/da4/daa/l106 0 2024-09-21T10:41:08.249 INFO:tasks.workunit.client.0.smithi060.stdout:8/787: chown d2/d26/d37/d62/d74/d83/da2/c91 477 1 2024-09-21T10:41:08.252 INFO:tasks.workunit.client.0.smithi060.stdout:6/978: rename d3/d54/f71 to d3/d12/d65/d7f/db5/d117/f13a 0 2024-09-21T10:41:08.253 INFO:tasks.workunit.client.0.smithi060.stdout:6/979: getdents d3/d12/d16/def 0 2024-09-21T10:41:08.254 INFO:tasks.workunit.client.0.smithi060.stdout:6/980: write d3/d54/fc6 [1577935,9330] 0 2024-09-21T10:41:08.254 INFO:tasks.workunit.client.0.smithi060.stdout:6/981: truncate d3/d12/d16/d1a/d9a/f100 871127 0 2024-09-21T10:41:08.256 INFO:tasks.workunit.client.0.smithi060.stdout:6/982: creat d3/d12/d16/d22/d5d/d70/f13b x:0 0 0 2024-09-21T10:41:08.256 INFO:tasks.workunit.client.0.smithi060.stdout:8/788: dread d2/d26/d37/d64/d65/fde [0,4194304] 0 2024-09-21T10:41:08.256 INFO:tasks.workunit.client.0.smithi060.stdout:8/789: chown d2/d26/f38 13995 1 2024-09-21T10:41:08.258 INFO:tasks.workunit.client.0.smithi060.stdout:8/790: creat d2/d18/d4b/dbe/f107 x:0 0 0 2024-09-21T10:41:08.262 INFO:tasks.workunit.client.0.smithi060.stdout:8/791: getdents d2/d26/d37 0 2024-09-21T10:41:08.269 INFO:tasks.workunit.client.0.smithi060.stdout:6/983: write d3/d12/d38/f8d [2244062,64942] 0 2024-09-21T10:41:08.270 INFO:tasks.workunit.client.0.smithi060.stdout:6/984: mkdir d3/d12/d16/d13c 0 2024-09-21T10:41:08.270 INFO:tasks.workunit.client.0.smithi060.stdout:6/985: chown d3/d12/d16/d1a/d83/fe7 136 1 2024-09-21T10:41:08.273 INFO:tasks.workunit.client.0.smithi060.stdout:6/986: unlink d3/d12/d16/d1a/d60/cdb 0 2024-09-21T10:41:08.275 INFO:tasks.workunit.client.0.smithi060.stdout:6/987: mkdir d3/dea/d13d 0 2024-09-21T10:41:08.275 INFO:tasks.workunit.client.0.smithi060.stdout:6/988: truncate d3/d12/d4e/f139 913404 0 2024-09-21T10:41:08.277 INFO:tasks.workunit.client.0.smithi060.stdout:6/989: creat d3/d12/d65/d66/f13e x:0 0 0 2024-09-21T10:41:08.278 INFO:tasks.workunit.client.0.smithi060.stdout:8/792: dwrite d2/d18/d4b/d61/d6e/fca [4194304,4194304] 0 2024-09-21T10:41:08.278 INFO:tasks.workunit.client.0.smithi060.stdout:6/990: getdents d3/d54/da8 0 2024-09-21T10:41:08.279 INFO:tasks.workunit.client.0.smithi060.stdout:6/991: fsync d3/fb 0 2024-09-21T10:41:08.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/793: dread d2/f3 [0,4194304] 0 2024-09-21T10:41:08.289 INFO:tasks.workunit.client.0.smithi060.stdout:8/794: chown d2/d26/d37/d64/d65/f57 326935297 1 2024-09-21T10:41:08.290 INFO:tasks.workunit.client.0.smithi060.stdout:8/795: getdents d2/d26/d37/d62/d74/d83/dac 0 2024-09-21T10:41:08.292 INFO:tasks.workunit.client.0.smithi060.stdout:8/796: link d2/d18/d4b/dbe/ce1 d2/d26/d37/d64/d65/dd5/de7/c108 0 2024-09-21T10:41:08.292 INFO:tasks.workunit.client.0.smithi060.stdout:8/797: symlink d2/d26/d37/d62/d74/d83/l109 0 2024-09-21T10:41:08.298 INFO:tasks.workunit.client.0.smithi060.stdout:6/992: dwrite d3/d12/d65/f6c [0,4194304] 0 2024-09-21T10:41:08.299 INFO:tasks.workunit.client.0.smithi060.stdout:6/993: creat d3/d12/d16/d22/d58/d75/df8/f13f x:0 0 0 2024-09-21T10:41:08.310 INFO:tasks.workunit.client.0.smithi060.stdout:8/798: dwrite d2/d26/f29 [0,4194304] 0 2024-09-21T10:41:08.311 INFO:tasks.workunit.client.0.smithi060.stdout:8/799: fsync d2/d26/d37/d64/fd2 0 2024-09-21T10:41:08.327 INFO:tasks.workunit.client.0.smithi060.stdout:6/994: dwrite d3/d12/d38/f8d [0,4194304] 0 2024-09-21T10:41:08.328 INFO:tasks.workunit.client.0.smithi060.stdout:6/995: symlink d3/d12/d38/d9e/dcf/d128/l140 0 2024-09-21T10:41:08.328 INFO:tasks.workunit.client.0.smithi060.stdout:6/996: creat d3/d12/d16/d25/d27/f141 x:0 0 0 2024-09-21T10:41:08.331 INFO:tasks.workunit.client.0.smithi060.stdout:8/800: dwrite d2/d26/d37/d64/d65/ffc [0,4194304] 0 2024-09-21T10:41:08.331 INFO:tasks.workunit.client.0.smithi060.stdout:8/801: fdatasync d2/d18/d4b/dbe/fc9 0 2024-09-21T10:41:08.331 INFO:tasks.workunit.client.0.smithi060.stdout:6/997: dread d3/d12/d16/d1a/d60/fb4 [0,4194304] 0 2024-09-21T10:41:08.331 INFO:tasks.workunit.client.0.smithi060.stdout:6/998: dread - d3/d12/d16/d1a/d60/f135 zero size 2024-09-21T10:41:08.331 INFO:tasks.workunit.client.0.smithi060.stdout:6/999: truncate d3/d12/d16/d22/d58/d75/df8/f13f 967195 0 2024-09-21T10:41:08.334 INFO:tasks.workunit.client.0.smithi060.stdout:8/802: rmdir d2/d26/d37/d64/d65 39 2024-09-21T10:41:08.335 INFO:tasks.workunit.client.0.smithi060.stdout:8/803: truncate d2/d26/d37/d62/d74/d83/d89/fb2 161858 0 2024-09-21T10:41:08.336 INFO:tasks.workunit.client.0.smithi060.stdout:8/804: mknod d2/d18/d4b/d61/c10a 0 2024-09-21T10:41:08.337 INFO:tasks.workunit.client.0.smithi060.stdout:8/805: mknod d2/d26/d37/d64/d65/dd5/de7/c10b 0 2024-09-21T10:41:08.337 INFO:tasks.workunit.client.0.smithi060.stdout:8/806: stat d2/d26/d37/d62/d74/d83/dac 0 2024-09-21T10:41:08.342 INFO:tasks.workunit.client.0.smithi060.stdout:8/807: rename d2/d26/d37/d62/d74/d83/da2 to d2/d26/d37/d64/d65/dd5/d10c 0 2024-09-21T10:41:08.350 INFO:tasks.workunit.client.0.smithi060.stdout:8/808: dread d2/d18/d4b/d61/d6e/f85 [0,4194304] 0 2024-09-21T10:41:08.350 INFO:tasks.workunit.client.0.smithi060.stdout:8/809: write d2/f14 [3969089,20117] 0 2024-09-21T10:41:08.371 INFO:tasks.workunit.client.0.smithi060.stdout:8/810: dwrite d2/fb9 [8388608,4194304] 0 2024-09-21T10:41:08.371 INFO:tasks.workunit.client.0.smithi060.stdout:8/811: dread - d2/d26/d37/d62/d74/f9b zero size 2024-09-21T10:41:08.372 INFO:tasks.workunit.client.0.smithi060.stdout:8/812: mknod d2/d26/d37/d62/d74/d83/d89/c10d 0 2024-09-21T10:41:08.384 INFO:tasks.workunit.client.0.smithi060.stdout:8/813: dwrite d2/fe [4194304,4194304] 0 2024-09-21T10:41:08.390 INFO:tasks.workunit.client.0.smithi060.stdout:8/814: dread d2/d26/d37/d64/d65/dd5/d10c/fc6 [0,4194304] 0 2024-09-21T10:41:08.390 INFO:tasks.workunit.client.0.smithi060.stdout:8/815: readlink d2/l20 0 2024-09-21T10:41:08.396 INFO:tasks.workunit.client.0.smithi060.stdout:8/816: dread d2/d26/d37/f45 [0,4194304] 0 2024-09-21T10:41:08.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/893: sync 2024-09-21T10:41:08.405 INFO:tasks.workunit.client.0.smithi060.stdout:2/617: sync 2024-09-21T10:41:08.405 INFO:tasks.workunit.client.0.smithi060.stdout:7/802: sync 2024-09-21T10:41:08.405 INFO:tasks.workunit.client.0.smithi060.stdout:1/726: sync 2024-09-21T10:41:08.405 INFO:tasks.workunit.client.0.smithi060.stdout:5/894: fdatasync d5/d45/d6d/d10/d19/f33 0 2024-09-21T10:41:08.405 INFO:tasks.workunit.client.0.smithi060.stdout:2/618: fdatasync d3/d79/db4/d8b/fa4 0 2024-09-21T10:41:08.406 INFO:tasks.workunit.client.0.smithi060.stdout:9/745: sync 2024-09-21T10:41:08.406 INFO:tasks.workunit.client.0.smithi060.stdout:9/746: chown d3/d16/d42/l56 24633192 1 2024-09-21T10:41:08.406 INFO:tasks.workunit.client.0.smithi060.stdout:0/833: sync 2024-09-21T10:41:08.406 INFO:tasks.workunit.client.0.smithi060.stdout:2/619: mknod d3/d79/db4/db9/cde 0 2024-09-21T10:41:08.408 INFO:tasks.workunit.client.0.smithi060.stdout:2/620: write d3/d79/db4/d43/d4b/f6c [375573,103150] 0 2024-09-21T10:41:08.409 INFO:tasks.workunit.client.0.smithi060.stdout:5/895: rename d5/d7a/d84/ca9 to d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/c12c 0 2024-09-21T10:41:08.410 INFO:tasks.workunit.client.0.smithi060.stdout:5/896: mkdir d5/d45/d5a/dbd/d12d 0 2024-09-21T10:41:08.412 INFO:tasks.workunit.client.0.smithi060.stdout:9/747: rename d3/d15/d92/fa8 to d3/d15/d53/dc8/dde/ffe 0 2024-09-21T10:41:08.412 INFO:tasks.workunit.client.0.smithi060.stdout:7/803: dread da/d60/f84 [0,4194304] 0 2024-09-21T10:41:08.413 INFO:tasks.workunit.client.0.smithi060.stdout:7/804: stat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e 0 2024-09-21T10:41:08.416 INFO:tasks.workunit.client.0.smithi060.stdout:0/834: rename d5/d10/d4e/l100 to d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/l106 0 2024-09-21T10:41:08.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/727: dread d6/d24/da/db/de/f77 [0,4194304] 0 2024-09-21T10:41:08.418 INFO:tasks.workunit.client.0.smithi060.stdout:7/805: mkdir da/d14/d10a/d112 0 2024-09-21T10:41:08.419 INFO:tasks.workunit.client.0.smithi060.stdout:0/835: mknod d5/d10/da/d4b/da4/d40/d48/db3/c107 0 2024-09-21T10:41:08.419 INFO:tasks.workunit.client.0.smithi060.stdout:0/836: chown d5/d10/da/d4b/da4/fd3 52386126 1 2024-09-21T10:41:08.420 INFO:tasks.workunit.client.0.smithi060.stdout:1/728: creat d6/d24/da/db/d79/d86/d95/dce/f109 x:0 0 0 2024-09-21T10:41:08.420 INFO:tasks.workunit.client.0.smithi060.stdout:1/729: stat d6/d24/da/db/c6d 0 2024-09-21T10:41:08.420 INFO:tasks.workunit.client.0.smithi060.stdout:1/730: fsync d6/d24/da/db/d7e/d90/f107 0 2024-09-21T10:41:08.421 INFO:tasks.workunit.client.0.smithi060.stdout:7/806: creat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9/f113 x:0 0 0 2024-09-21T10:41:08.423 INFO:tasks.workunit.client.0.smithi060.stdout:7/807: write da/fc6 [378299,120851] 0 2024-09-21T10:41:08.423 INFO:tasks.workunit.client.0.smithi060.stdout:7/808: dread - da/d60/d6e/dd5/d10b/d79/db0/dd7/f5e zero size 2024-09-21T10:41:08.423 INFO:tasks.workunit.client.0.smithi060.stdout:7/809: chown da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/db6 1957472 1 2024-09-21T10:41:08.423 INFO:tasks.workunit.client.0.smithi060.stdout:7/810: dread - da/d60/de4/de9/f111 zero size 2024-09-21T10:41:08.423 INFO:tasks.workunit.client.0.smithi060.stdout:7/811: fdatasync da/d60/d6e/ff7 0 2024-09-21T10:41:08.426 INFO:tasks.workunit.client.0.smithi060.stdout:7/812: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/faf 440013 0 2024-09-21T10:41:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:8/817: dwrite d2/d26/d37/d62/d74/d83/d89/fb2 [0,4194304] 0 2024-09-21T10:41:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:7/813: chown da/d60/d6e/dd5/d10b/d32 62476 1 2024-09-21T10:41:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:5/897: dread d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/fe2 [0,4194304] 0 2024-09-21T10:41:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:5/898: creat d5/d45/d77/d8f/d91/f12e x:0 0 0 2024-09-21T10:41:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:5/899: chown d5/d45/d77/d8f/d91/f11f 515427 1 2024-09-21T10:41:08.427 INFO:tasks.workunit.client.0.smithi060.stdout:5/900: dread - d5/d45/d77/fa7 zero size 2024-09-21T10:41:08.430 INFO:tasks.workunit.client.0.smithi060.stdout:9/748: dread d3/d16/f44 [0,4194304] 0 2024-09-21T10:41:08.430 INFO:tasks.workunit.client.0.smithi060.stdout:0/837: write d5/d10/d4e/f9c [606544,76763] 0 2024-09-21T10:41:08.434 INFO:tasks.workunit.client.0.smithi060.stdout:7/814: stat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/c66 0 2024-09-21T10:41:08.436 INFO:tasks.workunit.client.0.smithi060.stdout:2/621: dwrite d3/d7/d24/f2a [0,4194304] 0 2024-09-21T10:41:08.436 INFO:tasks.workunit.client.0.smithi060.stdout:2/622: creat d3/d79/db4/d6a/d9a/fdf x:0 0 0 2024-09-21T10:41:08.439 INFO:tasks.workunit.client.0.smithi060.stdout:5/901: mkdir d5/d45/d6d/d10/d19/d21/d30/d12f 0 2024-09-21T10:41:08.439 INFO:tasks.workunit.client.0.smithi060.stdout:5/902: chown d5/f105 0 1 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/749: mkdir d3/d16/d1f/dd1/dfa/dff 0 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/750: fsync d3/d16/d1a/fdd 0 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/751: dread - d3/d15/d53/f97 zero size 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/752: write d3/d15/d53/f74 [584569,35594] 0 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/753: fdatasync d3/d16/d7f/fba 0 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/754: chown d3/d16/d42/d7e/d85/dd6/fe2 651 1 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/755: write d3/d15/d53/dc8/fda [904813,88090] 0 2024-09-21T10:41:08.444 INFO:tasks.workunit.client.0.smithi060.stdout:9/756: truncate d3/d16/d42/d7e/f94 4282053 0 2024-09-21T10:41:08.445 INFO:tasks.workunit.client.0.smithi060.stdout:0/838: mknod d5/d10/da/d4b/da4/d40/d48/c108 0 2024-09-21T10:41:08.446 INFO:tasks.workunit.client.0.smithi060.stdout:7/815: mkdir da/d14/d25/d56/d114 0 2024-09-21T10:41:08.456 INFO:tasks.workunit.client.0.smithi060.stdout:1/731: dwrite d6/d24/da/db/de/fe4 [0,4194304] 0 2024-09-21T10:41:08.465 INFO:tasks.workunit.client.0.smithi060.stdout:2/623: dwrite d3/d7/d23/d55/f9f [0,4194304] 0 2024-09-21T10:41:08.465 INFO:tasks.workunit.client.0.smithi060.stdout:2/624: chown d3/d79/db4/d8b/d69/d83/da8/cd2 102 1 2024-09-21T10:41:08.466 INFO:tasks.workunit.client.0.smithi060.stdout:2/625: write d3/d7/fc2 [837150,49073] 0 2024-09-21T10:41:08.467 INFO:tasks.workunit.client.0.smithi060.stdout:5/903: dwrite d5/d45/faa [4194304,4194304] 0 2024-09-21T10:41:08.469 INFO:tasks.workunit.client.0.smithi060.stdout:2/626: rename d3/d20/d15/d3b/fc0 to d3/d7/d24/d25/d8a/fe0 0 2024-09-21T10:41:08.470 INFO:tasks.workunit.client.0.smithi060.stdout:5/904: mknod d5/d45/d5a/d3a/df7/c130 0 2024-09-21T10:41:08.471 INFO:tasks.workunit.client.0.smithi060.stdout:5/905: truncate d5/d45/d77/d8f/d91/f11b 856069 0 2024-09-21T10:41:08.471 INFO:tasks.workunit.client.0.smithi060.stdout:0/839: dread d5/d10/da/d2f/f6b [0,4194304] 0 2024-09-21T10:41:08.472 INFO:tasks.workunit.client.0.smithi060.stdout:5/906: mknod d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/c131 0 2024-09-21T10:41:08.473 INFO:tasks.workunit.client.0.smithi060.stdout:0/840: symlink d5/d10/da/l109 0 2024-09-21T10:41:08.473 INFO:tasks.workunit.client.0.smithi060.stdout:5/907: symlink d5/d7a/l132 0 2024-09-21T10:41:08.474 INFO:tasks.workunit.client.0.smithi060.stdout:5/908: stat d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/d121 0 2024-09-21T10:41:08.474 INFO:tasks.workunit.client.0.smithi060.stdout:5/909: fsync d5/d45/d6d/d10/d19/d21/ff2 0 2024-09-21T10:41:08.474 INFO:tasks.workunit.client.0.smithi060.stdout:0/841: rmdir d5/d10/da 39 2024-09-21T10:41:08.475 INFO:tasks.workunit.client.0.smithi060.stdout:5/910: symlink d5/d45/d6d/d10/d19/d21/d7f/ddc/l133 0 2024-09-21T10:41:08.475 INFO:tasks.workunit.client.0.smithi060.stdout:8/818: dwrite d2/d18/f5c [4194304,4194304] 0 2024-09-21T10:41:08.476 INFO:tasks.workunit.client.0.smithi060.stdout:5/911: write d5/d45/d5a/f62 [2606293,37300] 0 2024-09-21T10:41:08.476 INFO:tasks.workunit.client.0.smithi060.stdout:5/912: fdatasync d5/d45/d6d/d10/d19/fb8 0 2024-09-21T10:41:08.476 INFO:tasks.workunit.client.0.smithi060.stdout:5/913: truncate d5/d45/d6d/d10/d19/d21/d30/f11e 941302 0 2024-09-21T10:41:08.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/842: rename d5/d10/da/d4b/fa6 to d5/d10/da/d4b/da4/d40/d48/f10a 0 2024-09-21T10:41:08.478 INFO:tasks.workunit.client.0.smithi060.stdout:2/627: write d3/d7/d18/f3a [3756946,62736] 0 2024-09-21T10:41:08.480 INFO:tasks.workunit.client.0.smithi060.stdout:8/819: rename d2/d26/d37/f93 to d2/f10e 0 2024-09-21T10:41:08.481 INFO:tasks.workunit.client.0.smithi060.stdout:0/843: creat d5/d10/da/d2f/f10b x:0 0 0 2024-09-21T10:41:08.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/844: dread d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/f6e [0,4194304] 0 2024-09-21T10:41:08.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/845: chown d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d79 959545215 1 2024-09-21T10:41:08.485 INFO:tasks.workunit.client.0.smithi060.stdout:0/846: chown d5/d10/da/f13 3211932 1 2024-09-21T10:41:08.485 INFO:tasks.workunit.client.0.smithi060.stdout:1/732: dwrite d6/f44 [4194304,4194304] 0 2024-09-21T10:41:08.485 INFO:tasks.workunit.client.0.smithi060.stdout:9/757: dwrite d3/ffd [0,4194304] 0 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/758: truncate d3/d16/d1a/f4c 1503419 0 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/759: chown d3/d15/d5a/d64/d9e/daf/fcc 25425128 1 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/760: chown d3/d16/d1a/f1d 0 1 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/761: fdatasync d3/d15/d5a/d64/ff5 0 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/762: read - d3/d15/d78/f8c zero size 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:9/763: dread - d3/d5e/d60/fcb zero size 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:7/816: dwrite da/f90 [8388608,4194304] 0 2024-09-21T10:41:08.486 INFO:tasks.workunit.client.0.smithi060.stdout:8/820: rmdir d2/d26/d37/d64/d65 39 2024-09-21T10:41:08.487 INFO:tasks.workunit.client.0.smithi060.stdout:9/764: dread d3/d15/d5a/d64/fdc [0,4194304] 0 2024-09-21T10:41:08.489 INFO:tasks.workunit.client.0.smithi060.stdout:5/914: rename d5/d45/d6d/d10/d19/d21/d30/d49/c129 to d5/d45/d77/d8f/c134 0 2024-09-21T10:41:08.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/733: mknod d6/d4a/d5a/db0/c10a 0 2024-09-21T10:41:08.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/734: dread - d6/d24/da/db/d7e/f9a zero size 2024-09-21T10:41:08.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/735: chown d6/d24/da/db/d1c/d4b/c8b 81727 1 2024-09-21T10:41:08.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/736: readlink d6/d4a/d5a/db0/d97/le2 0 2024-09-21T10:41:08.494 INFO:tasks.workunit.client.0.smithi060.stdout:8/821: dread d2/fe [4194304,4194304] 0 2024-09-21T10:41:08.495 INFO:tasks.workunit.client.0.smithi060.stdout:8/822: fdatasync d2/f15 0 2024-09-21T10:41:08.501 INFO:tasks.workunit.client.0.smithi060.stdout:2/628: truncate d3/d7/d23/d55/f9f 1240768 0 2024-09-21T10:41:08.527 INFO:tasks.workunit.client.0.smithi060.stdout:7/817: mknod da/d14/d25/d56/c115 0 2024-09-21T10:41:08.528 INFO:tasks.workunit.client.0.smithi060.stdout:7/818: dread - da/d60/d6e/dd5/d10b/de7/fec zero size 2024-09-21T10:41:08.528 INFO:tasks.workunit.client.0.smithi060.stdout:7/819: readlink da/d14/l29 0 2024-09-21T10:41:08.529 INFO:tasks.workunit.client.0.smithi060.stdout:9/765: mknod d3/d15/d78/c100 0 2024-09-21T10:41:08.530 INFO:tasks.workunit.client.0.smithi060.stdout:0/847: rename d5/d10/d43/l49 to d5/d10/da/d4b/de6/l10c 0 2024-09-21T10:41:08.531 INFO:tasks.workunit.client.0.smithi060.stdout:5/915: mknod d5/d7a/d84/dcc/c135 0 2024-09-21T10:41:08.531 INFO:tasks.workunit.client.0.smithi060.stdout:5/916: creat d5/d45/d77/d8f/f136 x:0 0 0 2024-09-21T10:41:08.531 INFO:tasks.workunit.client.0.smithi060.stdout:1/737: mkdir d6/d24/da/db/de/d10b 0 2024-09-21T10:41:08.534 INFO:tasks.workunit.client.0.smithi060.stdout:8/823: creat d2/d26/d37/d64/d65/dd5/de7/f10f x:0 0 0 2024-09-21T10:41:08.534 INFO:tasks.workunit.client.0.smithi060.stdout:1/738: dread d6/d4a/d5a/db0/fb1 [0,4194304] 0 2024-09-21T10:41:08.534 INFO:tasks.workunit.client.0.smithi060.stdout:1/739: creat d6/d24/da/d45/d76/f10c x:0 0 0 2024-09-21T10:41:08.534 INFO:tasks.workunit.client.0.smithi060.stdout:1/740: readlink d6/d24/l67 0 2024-09-21T10:41:08.536 INFO:tasks.workunit.client.0.smithi060.stdout:2/629: rmdir d3/d7/d23/da5/dc1 0 2024-09-21T10:41:08.536 INFO:tasks.workunit.client.0.smithi060.stdout:2/630: fdatasync d3/fa7 0 2024-09-21T10:41:08.536 INFO:tasks.workunit.client.0.smithi060.stdout:2/631: fdatasync d3/d79/db4/d43/f67 0 2024-09-21T10:41:08.537 INFO:tasks.workunit.client.0.smithi060.stdout:0/848: truncate d5/d10/f8 4402735 0 2024-09-21T10:41:08.539 INFO:tasks.workunit.client.0.smithi060.stdout:9/766: write d3/d16/fb9 [1400051,71222] 0 2024-09-21T10:41:08.540 INFO:tasks.workunit.client.0.smithi060.stdout:2/632: write d3/d79/db4/d8b/d69/fd0 [3331541,55474] 0 2024-09-21T10:41:08.542 INFO:tasks.workunit.client.0.smithi060.stdout:8/824: mknod d2/d26/d37/d64/d65/dd5/d10c/c110 0 2024-09-21T10:41:08.543 INFO:tasks.workunit.client.0.smithi060.stdout:7/820: dread da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/fb3 [0,4194304] 0 2024-09-21T10:41:08.544 INFO:tasks.workunit.client.0.smithi060.stdout:1/741: symlink d6/d24/da/db/l10d 0 2024-09-21T10:41:08.545 INFO:tasks.workunit.client.0.smithi060.stdout:0/849: symlink d5/d10/d4e/l10d 0 2024-09-21T10:41:08.551 INFO:tasks.workunit.client.0.smithi060.stdout:5/917: dwrite d5/d45/d6d/d10/d19/d21/d7f/d89/fe9 [0,4194304] 0 2024-09-21T10:41:08.553 INFO:tasks.workunit.client.0.smithi060.stdout:1/742: symlink d6/d24/da/db/d79/d86/d95/l10e 0 2024-09-21T10:41:08.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/850: creat d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d79/f10e x:0 0 0 2024-09-21T10:41:08.560 INFO:tasks.workunit.client.0.smithi060.stdout:0/851: creat d5/d10/f10f x:0 0 0 2024-09-21T10:41:08.560 INFO:tasks.workunit.client.0.smithi060.stdout:0/852: write d5/d10/da/d4b/da4/d40/d48/d63/def/d105/f9a [827961,128115] 0 2024-09-21T10:41:08.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/633: getdents d3/d79/db4/d43/d62 0 2024-09-21T10:41:08.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/634: dread - d3/d20/d15/d4c/fdd zero size 2024-09-21T10:41:08.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/635: creat d3/d79/db4/d6a/fe1 x:0 0 0 2024-09-21T10:41:08.566 INFO:tasks.workunit.client.0.smithi060.stdout:9/767: dwrite d3/d5e/d60/d2f/f62 [0,4194304] 0 2024-09-21T10:41:08.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/743: dread d6/d24/da/db/de/d32/f60 [0,4194304] 0 2024-09-21T10:41:08.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/744: chown d6/d24/da/db/d1c/c5d 1697 1 2024-09-21T10:41:08.569 INFO:tasks.workunit.client.0.smithi060.stdout:5/918: unlink d5/d45/l92 0 2024-09-21T10:41:08.574 INFO:tasks.workunit.client.0.smithi060.stdout:0/853: creat d5/d10/da/d4b/da4/d40/d48/d63/d96/f110 x:0 0 0 2024-09-21T10:41:08.577 INFO:tasks.workunit.client.0.smithi060.stdout:7/821: dwrite da/d60/fa1 [0,4194304] 0 2024-09-21T10:41:08.577 INFO:tasks.workunit.client.0.smithi060.stdout:8/825: dwrite d2/d18/d4b/d61/d6e/f85 [0,4194304] 0 2024-09-21T10:41:08.578 INFO:tasks.workunit.client.0.smithi060.stdout:8/826: creat d2/d26/d37/d64/f111 x:0 0 0 2024-09-21T10:41:08.583 INFO:tasks.workunit.client.0.smithi060.stdout:2/636: dwrite d3/d7/fc2 [0,4194304] 0 2024-09-21T10:41:08.583 INFO:tasks.workunit.client.0.smithi060.stdout:9/768: rename d3/d15/d58/fe9 to d3/d16/d1f/dd1/dfa/f101 0 2024-09-21T10:41:08.584 INFO:tasks.workunit.client.0.smithi060.stdout:1/745: mknod d6/d24/da/dea/dd8/c10f 0 2024-09-21T10:41:08.584 INFO:tasks.workunit.client.0.smithi060.stdout:1/746: chown d6/d24/da/db/d1c/fdc 2 1 2024-09-21T10:41:08.584 INFO:tasks.workunit.client.0.smithi060.stdout:1/747: dread - d6/d4a/d5a/db0/fba zero size 2024-09-21T10:41:08.587 INFO:tasks.workunit.client.0.smithi060.stdout:5/919: creat d5/d45/d5a/d3a/df7/f137 x:0 0 0 2024-09-21T10:41:08.587 INFO:tasks.workunit.client.0.smithi060.stdout:5/920: chown d5/f7 29908 1 2024-09-21T10:41:08.591 INFO:tasks.workunit.client.0.smithi060.stdout:0/854: unlink d5/d10/da/d4b/da4/d40/d48/fac 0 2024-09-21T10:41:08.597 INFO:tasks.workunit.client.0.smithi060.stdout:7/822: getdents da/d60/d6e/dd5/d10b/d79/db0/df0/df5 0 2024-09-21T10:41:08.601 INFO:tasks.workunit.client.0.smithi060.stdout:8/827: mknod d2/d18/d4b/dbe/c112 0 2024-09-21T10:41:08.606 INFO:tasks.workunit.client.0.smithi060.stdout:9/769: rmdir d3/d16/d1f/dd1/dfa 39 2024-09-21T10:41:08.610 INFO:tasks.workunit.client.0.smithi060.stdout:5/921: mknod d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/c138 0 2024-09-21T10:41:08.613 INFO:tasks.workunit.client.0.smithi060.stdout:0/855: creat d5/d10/da/d4b/da4/d40/d48/d103/f111 x:0 0 0 2024-09-21T10:41:08.617 INFO:tasks.workunit.client.0.smithi060.stdout:7/823: unlink da/d14/d25/d56/c115 0 2024-09-21T10:41:08.621 INFO:tasks.workunit.client.0.smithi060.stdout:8/828: rename d2/d26/d37/d62/d77/c9e to d2/d18/d4b/dbe/c113 0 2024-09-21T10:41:08.622 INFO:tasks.workunit.client.0.smithi060.stdout:1/748: write d6/d24/da/db/d1c/f55 [1277663,57484] 0 2024-09-21T10:41:08.622 INFO:tasks.workunit.client.0.smithi060.stdout:1/749: truncate d6/d24/da/db/de/d32/f3b 86883 0 2024-09-21T10:41:08.623 INFO:tasks.workunit.client.0.smithi060.stdout:2/637: getdents d3/d7 0 2024-09-21T10:41:08.624 INFO:tasks.workunit.client.0.smithi060.stdout:9/770: truncate d3/d15/d5a/d64/f99 921276 0 2024-09-21T10:41:08.627 INFO:tasks.workunit.client.0.smithi060.stdout:0/856: dwrite d5/d10/da/d2f/fc3 [0,4194304] 0 2024-09-21T10:41:08.627 INFO:tasks.workunit.client.0.smithi060.stdout:0/857: dread - d5/d10/da/d4b/da4/d40/d75/dbb/ffb zero size 2024-09-21T10:41:08.627 INFO:tasks.workunit.client.0.smithi060.stdout:5/922: unlink d5/l6a 0 2024-09-21T10:41:08.632 INFO:tasks.workunit.client.0.smithi060.stdout:7/824: rename da/d60/d6e/dd5/d10b/d79/db0/dd7/f18 to da/d60/d6e/dd5/d10b/de7/d101/f116 0 2024-09-21T10:41:08.634 INFO:tasks.workunit.client.0.smithi060.stdout:4/783: sync 2024-09-21T10:41:08.639 INFO:tasks.workunit.client.0.smithi060.stdout:8/829: creat d2/d26/d37/d62/d74/d83/dac/f114 x:0 0 0 2024-09-21T10:41:08.643 INFO:tasks.workunit.client.0.smithi060.stdout:2/638: unlink d3/d20/d15/d4c/d82/faa 0 2024-09-21T10:41:08.644 INFO:tasks.workunit.client.0.smithi060.stdout:2/639: stat d3/d79/db4/d6a/d9a/faf 0 2024-09-21T10:41:08.644 INFO:tasks.workunit.client.0.smithi060.stdout:2/640: readlink d3/d20/d15/l80 0 2024-09-21T10:41:08.644 INFO:tasks.workunit.client.0.smithi060.stdout:9/771: rmdir d3/d5e 39 2024-09-21T10:41:08.645 INFO:tasks.workunit.client.0.smithi060.stdout:5/923: dread d5/d45/d6d/d10/d19/d21/d7f/d89/f74 [0,4194304] 0 2024-09-21T10:41:08.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/750: dwrite d6/d24/da/db/f29 [0,4194304] 0 2024-09-21T10:41:08.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/751: chown d6/d24/fe1 2429 1 2024-09-21T10:41:08.650 INFO:tasks.workunit.client.0.smithi060.stdout:1/752: fsync d6/d24/da/ffa 0 2024-09-21T10:41:08.656 INFO:tasks.workunit.client.0.smithi060.stdout:0/858: rmdir d5/d10/da/d15/dfa 0 2024-09-21T10:41:08.656 INFO:tasks.workunit.client.0.smithi060.stdout:2/641: rename d3/d7/d24/d25/cb2 to d3/d7/d24/d33/ce2 0 2024-09-21T10:41:08.660 INFO:tasks.workunit.client.0.smithi060.stdout:5/924: unlink d5/d45/d77/d8f/d91/f11b 0 2024-09-21T10:41:08.660 INFO:tasks.workunit.client.0.smithi060.stdout:5/925: fsync d5/d45/d77/d8f/f96 0 2024-09-21T10:41:08.660 INFO:tasks.workunit.client.0.smithi060.stdout:5/926: chown d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/feb 1768747 1 2024-09-21T10:41:08.664 INFO:tasks.workunit.client.0.smithi060.stdout:4/784: dwrite d0/d5/f36 [0,4194304] 0 2024-09-21T10:41:08.665 INFO:tasks.workunit.client.0.smithi060.stdout:0/859: mknod d5/d10/da/d4b/c112 0 2024-09-21T10:41:08.667 INFO:tasks.workunit.client.0.smithi060.stdout:8/830: dwrite d2/d5a/f67 [0,4194304] 0 2024-09-21T10:41:08.668 INFO:tasks.workunit.client.0.smithi060.stdout:8/831: fsync d2/d26/d37/f58 0 2024-09-21T10:41:08.671 INFO:tasks.workunit.client.0.smithi060.stdout:9/772: dwrite d3/d5e/d60/fcb [0,4194304] 0 2024-09-21T10:41:08.671 INFO:tasks.workunit.client.0.smithi060.stdout:9/773: truncate d3/d5e/d60/f8e 290236 0 2024-09-21T10:41:08.673 INFO:tasks.workunit.client.0.smithi060.stdout:1/753: dwrite d6/d24/da/db/d1c/d4b/f72 [0,4194304] 0 2024-09-21T10:41:08.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/832: dread d2/d5a/f67 [0,4194304] 0 2024-09-21T10:41:08.677 INFO:tasks.workunit.client.0.smithi060.stdout:8/833: creat d2/d26/d37/d62/d74/d83/f115 x:0 0 0 2024-09-21T10:41:08.682 INFO:tasks.workunit.client.0.smithi060.stdout:5/927: rename d5/d45/d6d/d10/d19/d21/d7f/d89/f120 to d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/f139 0 2024-09-21T10:41:08.683 INFO:tasks.workunit.client.0.smithi060.stdout:5/928: readlink d5/d45/d5a/lcd 0 2024-09-21T10:41:08.683 INFO:tasks.workunit.client.0.smithi060.stdout:5/929: write d5/d45/d6d/d10/d19/d8d/d60/fb7 [401739,82560] 0 2024-09-21T10:41:08.692 INFO:tasks.workunit.client.0.smithi060.stdout:4/785: creat d0/d5/d12/d3d/d94/f110 x:0 0 0 2024-09-21T10:41:08.692 INFO:tasks.workunit.client.0.smithi060.stdout:4/786: getdents d0/df/d88 0 2024-09-21T10:41:08.692 INFO:tasks.workunit.client.0.smithi060.stdout:4/787: stat d0/df/cd9 0 2024-09-21T10:41:08.692 INFO:tasks.workunit.client.0.smithi060.stdout:4/788: creat d0/d5/d12/d3d/dd5/f111 x:0 0 0 2024-09-21T10:41:08.696 INFO:tasks.workunit.client.0.smithi060.stdout:0/860: unlink d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/l106 0 2024-09-21T10:41:08.698 INFO:tasks.workunit.client.0.smithi060.stdout:5/930: dread d5/d7a/d84/fc1 [0,4194304] 0 2024-09-21T10:41:08.702 INFO:tasks.workunit.client.0.smithi060.stdout:1/754: dwrite d6/d4a/d5a/db0/d97/fb9 [0,4194304] 0 2024-09-21T10:41:08.702 INFO:tasks.workunit.client.0.smithi060.stdout:8/834: dwrite d2/f10e [0,4194304] 0 2024-09-21T10:41:08.702 INFO:tasks.workunit.client.0.smithi060.stdout:8/835: chown d2/d18/d4b/lbb 67072 1 2024-09-21T10:41:08.706 INFO:tasks.workunit.client.0.smithi060.stdout:1/755: dread d6/d24/da/db/de/f18 [0,4194304] 0 2024-09-21T10:41:08.711 INFO:tasks.workunit.client.0.smithi060.stdout:9/774: creat d3/d16/d7f/f102 x:0 0 0 2024-09-21T10:41:08.711 INFO:tasks.workunit.client.0.smithi060.stdout:9/775: chown d3/d16/d1a 240 1 2024-09-21T10:41:08.725 INFO:tasks.workunit.client.0.smithi060.stdout:4/789: getdents d0/d8b/dd8/d10f/d6b 0 2024-09-21T10:41:08.725 INFO:tasks.workunit.client.0.smithi060.stdout:4/790: getdents d0/d3c/dab 0 2024-09-21T10:41:08.725 INFO:tasks.workunit.client.0.smithi060.stdout:4/791: write d0/df/d9c/f109 [563711,16549] 0 2024-09-21T10:41:08.728 INFO:tasks.workunit.client.0.smithi060.stdout:9/776: dwrite d3/d15/d53/dc8/fe7 [0,4194304] 0 2024-09-21T10:41:08.730 INFO:tasks.workunit.client.0.smithi060.stdout:0/861: truncate d5/d10/da/d4b/da4/f5c 2058460 0 2024-09-21T10:41:08.731 INFO:tasks.workunit.client.0.smithi060.stdout:5/931: mknod d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/c13a 0 2024-09-21T10:41:08.731 INFO:tasks.workunit.client.0.smithi060.stdout:5/932: chown d5/d45/d77/d8f/d91/fea 347 1 2024-09-21T10:41:08.740 INFO:tasks.workunit.client.0.smithi060.stdout:8/836: rename d2/d26/d37/d62/d74/d83/d89/fd4 to d2/d18/d4b/d61/d6e/f116 0 2024-09-21T10:41:08.743 INFO:tasks.workunit.client.0.smithi060.stdout:5/933: write d5/d45/faa [5671784,17760] 0 2024-09-21T10:41:08.743 INFO:tasks.workunit.client.0.smithi060.stdout:1/756: link d6/d24/da/d45/d47/lbc d6/d24/da/db/l110 0 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/792: symlink d0/d8b/dd8/d10f/d6b/d32/d57/d90/l112 0 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/793: truncate d0/d5/d12/d15/f7b 929068 0 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/794: creat d0/d5/d12/d15/d72/f113 x:0 0 0 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/795: creat d0/d8b/dd8/f114 x:0 0 0 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/796: dread - d0/d5/d12/d15/fc8 zero size 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/797: creat d0/d5/d12/d15/d4d/f115 x:0 0 0 2024-09-21T10:41:08.747 INFO:tasks.workunit.client.0.smithi060.stdout:4/798: write d0/d83/dda/f104 [678956,90140] 0 2024-09-21T10:41:08.749 INFO:tasks.workunit.client.0.smithi060.stdout:9/777: dwrite d3/d16/d42/d7e/fa9 [0,4194304] 0 2024-09-21T10:41:08.749 INFO:tasks.workunit.client.0.smithi060.stdout:9/778: chown d3/d16/d42/l52 64922606 1 2024-09-21T10:41:08.753 INFO:tasks.workunit.client.0.smithi060.stdout:0/862: mknod d5/d10/da/d4b/da4/d40/c113 0 2024-09-21T10:41:08.754 INFO:tasks.workunit.client.0.smithi060.stdout:1/757: dread d6/d24/da/f1f [0,4194304] 0 2024-09-21T10:41:08.754 INFO:tasks.workunit.client.0.smithi060.stdout:1/758: chown d6/d24/da/db/de/d7c/l96 680643 1 2024-09-21T10:41:08.761 INFO:tasks.workunit.client.0.smithi060.stdout:9/779: symlink d3/d5e/d60/d2f/d5b/l103 0 2024-09-21T10:41:08.764 INFO:tasks.workunit.client.0.smithi060.stdout:5/934: dwrite d5/d45/d5a/d3a/fba [0,4194304] 0 2024-09-21T10:41:08.764 INFO:tasks.workunit.client.0.smithi060.stdout:8/837: dwrite d2/d26/d37/f55 [0,4194304] 0 2024-09-21T10:41:08.766 INFO:tasks.workunit.client.0.smithi060.stdout:1/759: creat d6/d4a/d5a/db0/d97/f111 x:0 0 0 2024-09-21T10:41:08.766 INFO:tasks.workunit.client.0.smithi060.stdout:0/863: dread d5/f3e [4194304,4194304] 0 2024-09-21T10:41:08.773 INFO:tasks.workunit.client.0.smithi060.stdout:5/935: creat d5/d122/f13b x:0 0 0 2024-09-21T10:41:08.773 INFO:tasks.workunit.client.0.smithi060.stdout:5/936: write d5/d71/f104 [4759817,115839] 0 2024-09-21T10:41:08.773 INFO:tasks.workunit.client.0.smithi060.stdout:5/937: creat d5/d7a/d84/d88/f13c x:0 0 0 2024-09-21T10:41:08.773 INFO:tasks.workunit.client.0.smithi060.stdout:5/938: fdatasync d5/d45/d6d/d10/d19/f37 0 2024-09-21T10:41:08.774 INFO:tasks.workunit.client.0.smithi060.stdout:1/760: dread d6/d24/da/db/f85 [0,4194304] 0 2024-09-21T10:41:08.775 INFO:tasks.workunit.client.0.smithi060.stdout:1/761: creat d6/d24/da/db/d79/dad/f112 x:0 0 0 2024-09-21T10:41:08.775 INFO:tasks.workunit.client.0.smithi060.stdout:9/780: dwrite d3/f76 [4194304,4194304] 0 2024-09-21T10:41:08.775 INFO:tasks.workunit.client.0.smithi060.stdout:9/781: dread - d3/d16/d42/fd2 zero size 2024-09-21T10:41:08.776 INFO:tasks.workunit.client.0.smithi060.stdout:9/782: truncate d3/d15/d5a/d64/ff5 545078 0 2024-09-21T10:41:08.776 INFO:tasks.workunit.client.0.smithi060.stdout:9/783: dread - d3/d16/d1a/fdd zero size 2024-09-21T10:41:08.776 INFO:tasks.workunit.client.0.smithi060.stdout:9/784: dread - d3/d15/d78/f8c zero size 2024-09-21T10:41:08.776 INFO:tasks.workunit.client.0.smithi060.stdout:9/785: chown d3/d15/d53/dc8/dde 1913846 1 2024-09-21T10:41:08.776 INFO:tasks.workunit.client.0.smithi060.stdout:8/838: rename d2/d26/d37/d62/d74/f9b to d2/d26/d37/dfe/f117 0 2024-09-21T10:41:08.776 INFO:tasks.workunit.client.0.smithi060.stdout:0/864: rmdir d5/d10/da/d4b/da4/d40/d75/dbb 39 2024-09-21T10:41:08.778 INFO:tasks.workunit.client.0.smithi060.stdout:5/939: creat d5/d122/df3/f13d x:0 0 0 2024-09-21T10:41:08.787 INFO:tasks.workunit.client.0.smithi060.stdout:9/786: creat d3/d5e/d60/d2f/d5b/f104 x:0 0 0 2024-09-21T10:41:08.789 INFO:tasks.workunit.client.0.smithi060.stdout:4/799: getdents d0/d5/d12/d3d/dd5 0 2024-09-21T10:41:08.792 INFO:tasks.workunit.client.0.smithi060.stdout:8/839: creat d2/d26/d37/f118 x:0 0 0 2024-09-21T10:41:08.795 INFO:tasks.workunit.client.0.smithi060.stdout:0/865: fsync d5/d10/da/d4b/da4/d40/d48/d63/d96/fdc 0 2024-09-21T10:41:08.797 INFO:tasks.workunit.client.0.smithi060.stdout:5/940: unlink d5/d45/d6d/ddf/de4/cfd 0 2024-09-21T10:41:08.799 INFO:tasks.workunit.client.0.smithi060.stdout:1/762: getdents d6/d24/da/d45/d76 0 2024-09-21T10:41:08.801 INFO:tasks.workunit.client.0.smithi060.stdout:4/800: mknod d0/d5/d12/c116 0 2024-09-21T10:41:08.806 INFO:tasks.workunit.client.0.smithi060.stdout:8/840: dwrite d2/d26/d37/d62/d74/d83/fe5 [0,4194304] 0 2024-09-21T10:41:08.808 INFO:tasks.workunit.client.0.smithi060.stdout:8/841: dread d2/d26/d37/d62/f8d [0,4194304] 0 2024-09-21T10:41:08.811 INFO:tasks.workunit.client.0.smithi060.stdout:0/866: rmdir d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d45 39 2024-09-21T10:41:08.813 INFO:tasks.workunit.client.0.smithi060.stdout:0/867: dread d5/d10/da/f13 [0,4194304] 0 2024-09-21T10:41:08.815 INFO:tasks.workunit.client.0.smithi060.stdout:1/763: creat d6/d4a/d5a/f113 x:0 0 0 2024-09-21T10:41:08.816 INFO:tasks.workunit.client.0.smithi060.stdout:4/801: symlink d0/df/d9c/l117 0 2024-09-21T10:41:08.817 INFO:tasks.workunit.client.0.smithi060.stdout:0/868: dread d5/d10/da/d4b/da4/d76/fa8 [0,4194304] 0 2024-09-21T10:41:08.817 INFO:tasks.workunit.client.0.smithi060.stdout:8/842: dread d2/d5a/f8b [0,4194304] 0 2024-09-21T10:41:08.817 INFO:tasks.workunit.client.0.smithi060.stdout:8/843: readlink d2/d26/d37/d64/l6c 0 2024-09-21T10:41:08.818 INFO:tasks.workunit.client.0.smithi060.stdout:8/844: creat d2/d26/d37/d64/f119 x:0 0 0 2024-09-21T10:41:08.818 INFO:tasks.workunit.client.0.smithi060.stdout:8/845: truncate d2/d26/d37/d62/d74/d83/dac/fc4 4345410 0 2024-09-21T10:41:08.818 INFO:tasks.workunit.client.0.smithi060.stdout:8/846: chown d2/d26/fb0 5011748 1 2024-09-21T10:41:08.822 INFO:tasks.workunit.client.0.smithi060.stdout:1/764: symlink d6/d24/da/db/de/d10b/l114 0 2024-09-21T10:41:08.825 INFO:tasks.workunit.client.0.smithi060.stdout:0/869: symlink d5/d10/d43/dee/l114 0 2024-09-21T10:41:08.825 INFO:tasks.workunit.client.0.smithi060.stdout:8/847: dread d2/da7/fed [0,4194304] 0 2024-09-21T10:41:08.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/802: getdents d0/d5/d12/d3d 0 2024-09-21T10:41:08.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/803: stat d0/l35 0 2024-09-21T10:41:08.831 INFO:tasks.workunit.client.0.smithi060.stdout:4/804: dread - d0/d5/d12/d3d/dd5/f111 zero size 2024-09-21T10:41:08.832 INFO:tasks.workunit.client.0.smithi060.stdout:0/870: creat d5/d10/da/d4b/da4/d76/df1/f115 x:0 0 0 2024-09-21T10:41:08.832 INFO:tasks.workunit.client.0.smithi060.stdout:0/871: dread - d5/d10/d43/ff2 zero size 2024-09-21T10:41:08.832 INFO:tasks.workunit.client.0.smithi060.stdout:0/872: chown d5/d10/da/d2d 973760 1 2024-09-21T10:41:08.833 INFO:tasks.workunit.client.0.smithi060.stdout:0/873: chown d5/d10/da/d4b/da4/d40/d48/d63/def/d105 71998 1 2024-09-21T10:41:08.833 INFO:tasks.workunit.client.0.smithi060.stdout:0/874: creat d5/d10/da/d2d/f116 x:0 0 0 2024-09-21T10:41:08.833 INFO:tasks.workunit.client.0.smithi060.stdout:0/875: stat d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/fe9 0 2024-09-21T10:41:08.834 INFO:tasks.workunit.client.0.smithi060.stdout:8/848: link d2/d26/d37/d64/d65/dd5/de7/lef d2/d26/l11a 0 2024-09-21T10:41:08.836 INFO:tasks.workunit.client.0.smithi060.stdout:4/805: symlink d0/d8b/dd8/d10f/d6b/d65/d51/l118 0 2024-09-21T10:41:08.836 INFO:tasks.workunit.client.0.smithi060.stdout:4/806: dread - d0/d5/d3a/ff4 zero size 2024-09-21T10:41:08.836 INFO:tasks.workunit.client.0.smithi060.stdout:4/807: write d0/d8b/dd8/d10f/d6b/d32/f7e [4928716,52292] 0 2024-09-21T10:41:08.838 INFO:tasks.workunit.client.0.smithi060.stdout:0/876: mknod d5/d10/d43/c117 0 2024-09-21T10:41:08.838 INFO:tasks.workunit.client.0.smithi060.stdout:0/877: rename d5/d10/da/d4b/da4 to d5/d10/da/d4b/da4/d118 22 2024-09-21T10:41:08.838 INFO:tasks.workunit.client.0.smithi060.stdout:4/808: getdents d0/d83 0 2024-09-21T10:41:08.839 INFO:tasks.workunit.client.0.smithi060.stdout:0/878: rename d5/d10/da/d4b/da4/d40/d48/d63/def/l8c to d5/d10/da/d4b/da4/d40/d48/db3/l119 0 2024-09-21T10:41:08.840 INFO:tasks.workunit.client.0.smithi060.stdout:4/809: fsync d0/d5/d12/d15/d4d/f115 0 2024-09-21T10:41:08.840 INFO:tasks.workunit.client.0.smithi060.stdout:4/810: dread - d0/d5/d3a/ff4 zero size 2024-09-21T10:41:08.842 INFO:tasks.workunit.client.0.smithi060.stdout:8/849: write d2/d5a/f8b [157611,7833] 0 2024-09-21T10:41:08.860 INFO:tasks.workunit.client.0.smithi060.stdout:8/850: dwrite d2/d26/d37/d62/f88 [0,4194304] 0 2024-09-21T10:41:08.865 INFO:tasks.workunit.client.0.smithi060.stdout:8/851: symlink d2/d5a/l11b 0 2024-09-21T10:41:08.877 INFO:tasks.workunit.client.0.smithi060.stdout:8/852: write d2/d26/d37/d62/faf [849235,90598] 0 2024-09-21T10:41:08.885 INFO:tasks.workunit.client.0.smithi060.stdout:8/853: dread d2/f1c [0,4194304] 0 2024-09-21T10:41:08.906 INFO:tasks.workunit.client.0.smithi060.stdout:8/854: dwrite d2/d18/d4b/d61/d6e/f85 [4194304,4194304] 0 2024-09-21T10:41:08.906 INFO:tasks.workunit.client.0.smithi060.stdout:8/855: fsync d2/d26/d37/dfe/f117 0 2024-09-21T10:41:08.912 INFO:tasks.workunit.client.0.smithi060.stdout:8/856: mkdir d2/d26/d37/d64/d65/dd5/d11c 0 2024-09-21T10:41:08.912 INFO:tasks.workunit.client.0.smithi060.stdout:8/857: chown d2/d5a/f8b 21407 1 2024-09-21T10:41:08.936 INFO:tasks.workunit.client.0.smithi060.stdout:8/858: dwrite d2/d26/d37/d62/d74/d83/d89/d9a/fab [0,4194304] 0 2024-09-21T10:41:08.951 INFO:tasks.workunit.client.0.smithi060.stdout:8/859: read d2/fb9 [4376167,41742] 0 2024-09-21T10:41:08.951 INFO:tasks.workunit.client.0.smithi060.stdout:8/860: fsync d2/d26/d37/d64/d65/ffc 0 2024-09-21T10:41:08.952 INFO:tasks.workunit.client.0.smithi060.stdout:8/861: mkdir d2/d18/d4b/d61/d6e/d11d 0 2024-09-21T10:41:08.953 INFO:tasks.workunit.client.0.smithi060.stdout:8/862: truncate d2/d5a/fcf 180548 0 2024-09-21T10:41:08.970 INFO:tasks.workunit.client.0.smithi060.stdout:8/863: dwrite d2/d18/d4b/dbe/fcd [0,4194304] 0 2024-09-21T10:41:08.970 INFO:tasks.workunit.client.0.smithi060.stdout:8/864: chown d2/d26/d37/d64/d65/dd5/d10c 6 1 2024-09-21T10:41:08.970 INFO:tasks.workunit.client.0.smithi060.stdout:8/865: write d2/da7/fc3 [817493,111642] 0 2024-09-21T10:41:08.970 INFO:tasks.workunit.client.0.smithi060.stdout:8/866: write d2/d26/d37/d64/fc1 [1729974,23650] 0 2024-09-21T10:41:08.972 INFO:tasks.workunit.client.0.smithi060.stdout:8/867: mkdir d2/d26/d37/d11e 0 2024-09-21T10:41:08.973 INFO:tasks.workunit.client.0.smithi060.stdout:8/868: fdatasync d2/d18/d4b/fda 0 2024-09-21T10:41:08.974 INFO:tasks.workunit.client.0.smithi060.stdout:8/869: mkdir d2/d26/d37/d62/d74/d83/d89/dec/df8/d11f 0 2024-09-21T10:41:08.982 INFO:tasks.workunit.client.0.smithi060.stdout:8/870: dread d2/d26/d37/d62/d74/d83/f103 [4194304,4194304] 0 2024-09-21T10:41:08.984 INFO:tasks.workunit.client.0.smithi060.stdout:8/871: link d2/d26/f29 d2/d26/f120 0 2024-09-21T10:41:08.984 INFO:tasks.workunit.client.0.smithi060.stdout:8/872: fsync d2/d26/d37/d62/d74/d83/fe5 0 2024-09-21T10:41:08.985 INFO:tasks.workunit.client.0.smithi060.stdout:8/873: mknod d2/d26/d37/c121 0 2024-09-21T10:41:09.003 INFO:tasks.workunit.client.0.smithi060.stdout:8/874: dwrite d2/d18/d4b/dbe/fcd [0,4194304] 0 2024-09-21T10:41:09.019 INFO:tasks.workunit.client.0.smithi060.stdout:8/875: dwrite d2/d18/d4b/d61/d6e/f116 [0,4194304] 0 2024-09-21T10:41:09.022 INFO:tasks.workunit.client.0.smithi060.stdout:8/876: symlink d2/d26/d37/dfe/l122 0 2024-09-21T10:41:09.031 INFO:tasks.workunit.client.0.smithi060.stdout:8/877: write d2/d18/f5e [7886565,22279] 0 2024-09-21T10:41:09.049 INFO:tasks.workunit.client.0.smithi060.stdout:8/878: dwrite d2/d26/d37/d62/d74/d83/d89/fb2 [0,4194304] 0 2024-09-21T10:41:09.049 INFO:tasks.workunit.client.0.smithi060.stdout:8/879: chown d2/d26/d37/f58 14756 1 2024-09-21T10:41:09.064 INFO:tasks.workunit.client.0.smithi060.stdout:8/880: dwrite d2/d26/d37/f118 [0,4194304] 0 2024-09-21T10:41:09.072 INFO:tasks.workunit.client.0.smithi060.stdout:8/881: rename d2/c4e to d2/d26/c123 0 2024-09-21T10:41:09.072 INFO:tasks.workunit.client.0.smithi060.stdout:8/882: fsync d2/d26/f44 0 2024-09-21T10:41:09.072 INFO:tasks.workunit.client.0.smithi060.stdout:8/883: truncate d2/f97 4715290 0 2024-09-21T10:41:09.072 INFO:tasks.workunit.client.0.smithi060.stdout:8/884: read d2/d18/f36 [557625,38954] 0 2024-09-21T10:41:09.073 INFO:tasks.workunit.client.0.smithi060.stdout:8/885: symlink d2/d18/d4b/l124 0 2024-09-21T10:41:09.074 INFO:tasks.workunit.client.0.smithi060.stdout:8/886: symlink d2/d26/d37/d62/dff/d104/l125 0 2024-09-21T10:41:09.075 INFO:tasks.workunit.client.0.smithi060.stdout:8/887: dread d2/f1c [0,4194304] 0 2024-09-21T10:41:09.076 INFO:tasks.workunit.client.0.smithi060.stdout:8/888: mkdir d2/d26/d37/d64/d65/dd5/d10c/d75/d126 0 2024-09-21T10:41:09.078 INFO:tasks.workunit.client.0.smithi060.stdout:8/889: rename d2/d26/d37/d62/d77/f96 to d2/d26/d37/d62/dff/f127 0 2024-09-21T10:41:09.086 INFO:tasks.workunit.client.0.smithi060.stdout:8/890: write d2/d26/d37/d62/dff/f127 [3060187,125644] 0 2024-09-21T10:41:09.086 INFO:tasks.workunit.client.0.smithi060.stdout:8/891: chown d2/d18/l9f 64877873 1 2024-09-21T10:41:09.088 INFO:tasks.workunit.client.0.smithi060.stdout:8/892: mkdir d2/d26/d37/d64/d65/dd5/d128 0 2024-09-21T10:41:09.096 INFO:tasks.workunit.client.0.smithi060.stdout:8/893: write d2/d26/d37/d64/d65/f81 [1667346,64896] 0 2024-09-21T10:41:09.106 INFO:tasks.workunit.client.0.smithi060.stdout:8/894: dread d2/d26/d37/d62/faf [0,4194304] 0 2024-09-21T10:41:09.106 INFO:tasks.workunit.client.0.smithi060.stdout:8/895: fsync d2/d26/f120 0 2024-09-21T10:41:09.107 INFO:tasks.workunit.client.0.smithi060.stdout:8/896: truncate d2/f10e 3727569 0 2024-09-21T10:41:09.108 INFO:tasks.workunit.client.0.smithi060.stdout:8/897: unlink d2/d18/f5e 0 2024-09-21T10:41:09.108 INFO:tasks.workunit.client.0.smithi060.stdout:8/898: symlink d2/d26/d37/d62/d77/l129 0 2024-09-21T10:41:09.115 INFO:tasks.workunit.client.0.smithi060.stdout:8/899: truncate d2/da7/fc3 845954 0 2024-09-21T10:41:09.121 INFO:tasks.workunit.client.0.smithi060.stdout:8/900: mkdir d2/d26/d37/d62/d74/d83/d89/d9a/d12a 0 2024-09-21T10:41:09.124 INFO:tasks.workunit.client.0.smithi060.stdout:8/901: creat d2/d26/d37/d62/dff/d104/f12b x:0 0 0 2024-09-21T10:41:09.133 INFO:tasks.workunit.client.0.smithi060.stdout:8/902: read d2/d26/d37/d62/d74/d83/d89/d9a/fab [1889816,45077] 0 2024-09-21T10:41:09.134 INFO:tasks.workunit.client.0.smithi060.stdout:8/903: rmdir d2/d26/d37/d64/d65/dd5 39 2024-09-21T10:41:09.134 INFO:tasks.workunit.client.0.smithi060.stdout:8/904: chown d2/d26/d37/d64/d65/fde 95 1 2024-09-21T10:41:09.134 INFO:tasks.workunit.client.0.smithi060.stdout:8/905: readlink d2/l2a 0 2024-09-21T10:41:09.135 INFO:tasks.workunit.client.0.smithi060.stdout:8/906: unlink d2/d26/d37/d64/d65/dd5/d10c/l4f 0 2024-09-21T10:41:09.137 INFO:tasks.workunit.client.0.smithi060.stdout:8/907: mknod d2/d26/d37/d11e/c12c 0 2024-09-21T10:41:09.138 INFO:tasks.workunit.client.0.smithi060.stdout:8/908: mkdir d2/d26/d37/d62/d74/d83/dac/d12d 0 2024-09-21T10:41:09.141 INFO:tasks.workunit.client.0.smithi060.stdout:8/909: mkdir d2/d18/d4b/d61/d6e/d12e 0 2024-09-21T10:41:09.142 INFO:tasks.workunit.client.0.smithi060.stdout:8/910: unlink d2/d18/d4b/d61/cc5 0 2024-09-21T10:41:09.142 INFO:tasks.workunit.client.0.smithi060.stdout:8/911: truncate d2/f47 1669290 0 2024-09-21T10:41:09.143 INFO:tasks.workunit.client.0.smithi060.stdout:8/912: rename d2/d26/d37/d64/f111 to d2/d18/f12f 0 2024-09-21T10:41:09.144 INFO:tasks.workunit.client.0.smithi060.stdout:8/913: mkdir d2/d26/d37/d62/dff/d104/d130 0 2024-09-21T10:41:09.146 INFO:tasks.workunit.client.0.smithi060.stdout:8/914: unlink d2/d26/d37/d62/d77/cd0 0 2024-09-21T10:41:09.162 INFO:tasks.workunit.client.0.smithi060.stdout:8/915: dwrite d2/f47 [0,4194304] 0 2024-09-21T10:41:09.166 INFO:tasks.workunit.client.0.smithi060.stdout:8/916: symlink d2/d26/d37/d64/d65/dd5/d10c/d75/d126/l131 0 2024-09-21T10:41:09.185 INFO:tasks.workunit.client.0.smithi060.stdout:8/917: dwrite d2/f14 [4194304,4194304] 0 2024-09-21T10:41:09.187 INFO:tasks.workunit.client.0.smithi060.stdout:8/918: mkdir d2/d26/d37/d62/d74/d83/d89/dec/df8/d11f/d132 0 2024-09-21T10:41:09.189 INFO:tasks.workunit.client.0.smithi060.stdout:8/919: mkdir d2/d18/d133 0 2024-09-21T10:41:09.191 INFO:tasks.workunit.client.0.smithi060.stdout:8/920: creat d2/d26/d37/d62/d74/d83/d89/dec/df8/f134 x:0 0 0 2024-09-21T10:41:09.191 INFO:tasks.workunit.client.0.smithi060.stdout:8/921: dread - d2/d26/d37/f100 zero size 2024-09-21T10:41:09.198 INFO:tasks.workunit.client.0.smithi060.stdout:8/922: dread d2/d26/d37/f118 [0,4194304] 0 2024-09-21T10:41:09.198 INFO:tasks.workunit.client.0.smithi060.stdout:8/923: chown d2/d26/d37/d62/d77/l129 10 1 2024-09-21T10:41:09.198 INFO:tasks.workunit.client.0.smithi060.stdout:8/924: fdatasync d2/d18/f36 0 2024-09-21T10:41:09.199 INFO:tasks.workunit.client.0.smithi060.stdout:8/925: mknod d2/d26/d37/c135 0 2024-09-21T10:41:09.219 INFO:tasks.workunit.client.0.smithi060.stdout:8/926: dwrite d2/f1e [0,4194304] 0 2024-09-21T10:41:09.220 INFO:tasks.workunit.client.0.smithi060.stdout:8/927: write d2/d5a/fcf [846744,109041] 0 2024-09-21T10:41:09.221 INFO:tasks.workunit.client.0.smithi060.stdout:8/928: write d2/da7/fc3 [902145,32561] 0 2024-09-21T10:41:09.221 INFO:tasks.workunit.client.0.smithi060.stdout:8/929: write d2/d26/d37/f100 [467042,91495] 0 2024-09-21T10:41:09.222 INFO:tasks.workunit.client.0.smithi060.stdout:8/930: chown d2/da7/fd6 3968 1 2024-09-21T10:41:09.229 INFO:tasks.workunit.client.0.smithi060.stdout:8/931: dread d2/f14 [0,4194304] 0 2024-09-21T10:41:09.229 INFO:tasks.workunit.client.0.smithi060.stdout:8/932: write d2/d18/f12f [530091,76027] 0 2024-09-21T10:41:09.229 INFO:tasks.workunit.client.0.smithi060.stdout:8/933: write d2/d18/f36 [539661,7939] 0 2024-09-21T10:41:09.229 INFO:tasks.workunit.client.0.smithi060.stdout:8/934: fdatasync d2/d26/d37/d64/d65/dd5/d10c/fe3 0 2024-09-21T10:41:09.232 INFO:tasks.workunit.client.0.smithi060.stdout:8/935: unlink d2/c72 0 2024-09-21T10:41:09.232 INFO:tasks.workunit.client.0.smithi060.stdout:8/936: chown d2/d26/d37/d62/d74/d83/d89/f8a 522451 1 2024-09-21T10:41:09.232 INFO:tasks.workunit.client.0.smithi060.stdout:8/937: write d2/d26/d37/d64/d65/f57 [717872,4685] 0 2024-09-21T10:41:09.233 INFO:tasks.workunit.client.0.smithi060.stdout:8/938: creat d2/da7/f136 x:0 0 0 2024-09-21T10:41:09.234 INFO:tasks.workunit.client.0.smithi060.stdout:8/939: getdents d2/d26/da4 0 2024-09-21T10:41:09.235 INFO:tasks.workunit.client.0.smithi060.stdout:8/940: rename d2/d26/d37/d64/d65/dd5/d10c/c91 to d2/d26/d37/c137 0 2024-09-21T10:41:09.238 INFO:tasks.workunit.client.0.smithi060.stdout:8/941: write d2/f12 [294888,23695] 0 2024-09-21T10:41:09.242 INFO:tasks.workunit.client.0.smithi060.stdout:8/942: getdents d2/d18 0 2024-09-21T10:41:09.246 INFO:tasks.workunit.client.0.smithi060.stdout:8/943: mkdir d2/d26/d37/d64/d65/dd5/d10c/d138 0 2024-09-21T10:41:09.255 INFO:tasks.workunit.client.0.smithi060.stdout:8/944: dread d2/d18/d4b/fe9 [0,4194304] 0 2024-09-21T10:41:09.257 INFO:tasks.workunit.client.0.smithi060.stdout:8/945: creat d2/d26/d37/d64/d65/dd5/d128/f139 x:0 0 0 2024-09-21T10:41:09.257 INFO:tasks.workunit.client.0.smithi060.stdout:8/946: readlink d2/d18/l54 0 2024-09-21T10:41:09.258 INFO:tasks.workunit.client.0.smithi060.stdout:8/947: symlink d2/d26/l13a 0 2024-09-21T10:41:09.259 INFO:tasks.workunit.client.0.smithi060.stdout:8/948: stat d2/d26/d37/d62/d74/lf3 0 2024-09-21T10:41:09.264 INFO:tasks.workunit.client.0.smithi060.stdout:8/949: rename d2/d26/d37/d62/dff/d104 to d2/d26/d37/d62/d74/d83/dac/d12d/d13b 0 2024-09-21T10:41:09.268 INFO:tasks.workunit.client.0.smithi060.stdout:8/950: creat d2/d26/d37/d62/d74/d83/d89/dec/df8/d11f/d132/f13c x:0 0 0 2024-09-21T10:41:09.268 INFO:tasks.workunit.client.0.smithi060.stdout:8/951: fdatasync d2/d26/fb0 0 2024-09-21T10:41:09.268 INFO:tasks.workunit.client.0.smithi060.stdout:8/952: chown d2/d26/d37/d62/d74/c84 17958 1 2024-09-21T10:41:09.271 INFO:tasks.workunit.client.0.smithi060.stdout:8/953: creat d2/d26/d37/dfe/f13d x:0 0 0 2024-09-21T10:41:09.294 INFO:tasks.workunit.client.0.smithi060.stdout:8/954: dwrite d2/d5a/fcf [0,4194304] 0 2024-09-21T10:41:09.297 INFO:tasks.workunit.client.0.smithi060.stdout:8/955: creat d2/f13e x:0 0 0 2024-09-21T10:41:09.299 INFO:tasks.workunit.client.0.smithi060.stdout:8/956: creat d2/d26/d37/d62/d74/d83/d89/dec/f13f x:0 0 0 2024-09-21T10:41:09.300 INFO:tasks.workunit.client.0.smithi060.stdout:8/957: stat d2/l3a 0 2024-09-21T10:41:09.302 INFO:tasks.workunit.client.0.smithi060.stdout:8/958: link d2/d18/d4b/fe9 d2/d26/d37/d62/d74/d83/d89/dea/f140 0 2024-09-21T10:41:09.304 INFO:tasks.workunit.client.0.smithi060.stdout:8/959: symlink d2/d26/d37/d62/deb/l141 0 2024-09-21T10:41:09.305 INFO:tasks.workunit.client.0.smithi060.stdout:8/960: mkdir d2/d26/d37/d64/d65/dd5/d10c/d142 0 2024-09-21T10:41:09.329 INFO:tasks.workunit.client.0.smithi060.stdout:8/961: dwrite d2/f97 [0,4194304] 0 2024-09-21T10:41:09.347 INFO:tasks.workunit.client.0.smithi060.stdout:8/962: dwrite d2/f3 [0,4194304] 0 2024-09-21T10:41:09.347 INFO:tasks.workunit.client.0.smithi060.stdout:8/963: chown d2/d26/d37/d64/d65/fa5 129 1 2024-09-21T10:41:09.359 INFO:tasks.workunit.client.0.smithi060.stdout:8/964: read d2/f10e [729597,68156] 0 2024-09-21T10:41:09.359 INFO:tasks.workunit.client.0.smithi060.stdout:8/965: write d2/d18/f30 [3598976,126906] 0 2024-09-21T10:41:09.368 INFO:tasks.workunit.client.0.smithi060.stdout:8/966: mknod d2/c143 0 2024-09-21T10:41:09.372 INFO:tasks.workunit.client.0.smithi060.stdout:8/967: mknod d2/d26/da4/dd7/c144 0 2024-09-21T10:41:09.372 INFO:tasks.workunit.client.0.smithi060.stdout:8/968: chown d2/da7/ldd 3307 1 2024-09-21T10:41:09.372 INFO:tasks.workunit.client.0.smithi060.stdout:8/969: chown d2/d5a/f67 41 1 2024-09-21T10:41:09.377 INFO:tasks.workunit.client.0.smithi060.stdout:8/970: fsync d2/f47 0 2024-09-21T10:41:09.383 INFO:tasks.workunit.client.0.smithi060.stdout:8/971: dread d2/d26/f120 [0,4194304] 0 2024-09-21T10:41:09.383 INFO:tasks.workunit.client.0.smithi060.stdout:8/972: chown d2/d26/d37/f55 12 1 2024-09-21T10:41:09.387 INFO:tasks.workunit.client.0.smithi060.stdout:8/973: rename d2/d26/d37/d62/d74/d83/d89/dec/lf9 to d2/l145 0 2024-09-21T10:41:09.396 INFO:tasks.workunit.client.0.smithi060.stdout:8/974: rename d2/d18/d4b/d61/d6e/d11d to d2/d26/d37/d64/d65/dd5/d128/d146 0 2024-09-21T10:41:09.405 INFO:tasks.workunit.client.0.smithi060.stdout:8/975: dread d2/f1e [0,4194304] 0 2024-09-21T10:41:09.420 INFO:tasks.workunit.client.0.smithi060.stdout:8/976: dwrite d2/d26/d37/d62/dff/f127 [0,4194304] 0 2024-09-21T10:41:09.420 INFO:tasks.workunit.client.0.smithi060.stdout:8/977: chown d2/d26/d37/d62/dff 495977821 1 2024-09-21T10:41:09.421 INFO:tasks.workunit.client.0.smithi060.stdout:8/978: fdatasync d2/f1c 0 2024-09-21T10:41:09.423 INFO:tasks.workunit.client.0.smithi060.stdout:8/979: chown d2/d18/d4b/d61/d6e/fca 839288200 1 2024-09-21T10:41:09.439 INFO:tasks.workunit.client.0.smithi060.stdout:8/980: dwrite d2/d26/d37/d64/f119 [0,4194304] 0 2024-09-21T10:41:09.444 INFO:tasks.workunit.client.0.smithi060.stdout:8/981: creat d2/d26/d37/d62/f147 x:0 0 0 2024-09-21T10:41:09.449 INFO:tasks.workunit.client.0.smithi060.stdout:8/982: dread d2/d18/d4b/fe9 [0,4194304] 0 2024-09-21T10:41:09.449 INFO:tasks.workunit.client.0.smithi060.stdout:8/983: write d2/d18/d4b/dbe/f107 [19657,106709] 0 2024-09-21T10:41:09.451 INFO:tasks.workunit.client.0.smithi060.stdout:8/984: getdents d2/da7 0 2024-09-21T10:41:09.454 INFO:tasks.workunit.client.0.smithi060.stdout:8/985: rename d2/d18/c4a to d2/d18/d4b/d61/d6e/d12e/c148 0 2024-09-21T10:41:09.456 INFO:tasks.workunit.client.0.smithi060.stdout:8/986: rename d2/d26/d37/d62/d74/c84 to d2/d26/d37/d62/c149 0 2024-09-21T10:41:09.456 INFO:tasks.workunit.client.0.smithi060.stdout:8/987: chown d2/d5a/cbc 1979 1 2024-09-21T10:41:09.457 INFO:tasks.workunit.client.0.smithi060.stdout:8/988: truncate d2/d18/d4b/d61/d6e/f116 3897979 0 2024-09-21T10:41:09.460 INFO:tasks.workunit.client.0.smithi060.stdout:8/989: unlink d2/d18/l31 0 2024-09-21T10:41:09.460 INFO:tasks.workunit.client.0.smithi060.stdout:8/990: chown d2/d26/d37/d64/d65/ff6 664391 1 2024-09-21T10:41:09.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/825: sync 2024-09-21T10:41:09.463 INFO:tasks.workunit.client.0.smithi060.stdout:2/642: sync 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:4/811: sync 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:5/941: sync 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:5/942: creat d5/d122/df3/f13e x:0 0 0 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:4/812: creat d0/d5/d3a/dbe/f119 x:0 0 0 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:5/943: readlink d5/d45/d6d/d10/d19/d21/d7f/d89/l5b 0 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:4/813: read - d0/d8b/dd8/d10f/d6b/d32/dd6/f10b zero size 2024-09-21T10:41:09.470 INFO:tasks.workunit.client.0.smithi060.stdout:4/814: truncate d0/d5/d12/d3d/dd5/fef 376170 0 2024-09-21T10:41:09.471 INFO:tasks.workunit.client.0.smithi060.stdout:5/944: write d5/d45/d6d/d10/f113 [244522,130223] 0 2024-09-21T10:41:09.471 INFO:tasks.workunit.client.0.smithi060.stdout:5/945: creat d5/d7a/d84/d88/f13f x:0 0 0 2024-09-21T10:41:09.471 INFO:tasks.workunit.client.0.smithi060.stdout:1/765: sync 2024-09-21T10:41:09.471 INFO:tasks.workunit.client.0.smithi060.stdout:0/879: sync 2024-09-21T10:41:09.471 INFO:tasks.workunit.client.0.smithi060.stdout:9/787: sync 2024-09-21T10:41:09.476 INFO:tasks.workunit.client.0.smithi060.stdout:8/991: link d2/f47 d2/d26/d37/d62/d74/d83/d89/d9a/d12a/f14a 0 2024-09-21T10:41:09.477 INFO:tasks.workunit.client.0.smithi060.stdout:2/643: dread d3/d7/d18/f81 [0,4194304] 0 2024-09-21T10:41:09.484 INFO:tasks.workunit.client.0.smithi060.stdout:7/826: dwrite da/f24 [0,4194304] 0 2024-09-21T10:41:09.484 INFO:tasks.workunit.client.0.smithi060.stdout:7/827: fsync da/d60/d6e/dd5/d10b/f1d 0 2024-09-21T10:41:09.484 INFO:tasks.workunit.client.0.smithi060.stdout:8/992: dread d2/d26/d37/f118 [0,4194304] 0 2024-09-21T10:41:09.485 INFO:tasks.workunit.client.0.smithi060.stdout:5/946: symlink d5/d45/d77/d8f/d91/l140 0 2024-09-21T10:41:09.485 INFO:tasks.workunit.client.0.smithi060.stdout:7/828: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/f3d [562587,43393] 0 2024-09-21T10:41:09.485 INFO:tasks.workunit.client.0.smithi060.stdout:7/829: creat da/d60/de4/de9/f117 x:0 0 0 2024-09-21T10:41:09.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/766: link d6/f89 d6/d24/da/db/de/d10b/f115 0 2024-09-21T10:41:09.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/767: dread - d6/d4a/d5a/f113 zero size 2024-09-21T10:41:09.488 INFO:tasks.workunit.client.0.smithi060.stdout:0/880: unlink d5/d10/da/d4b/da4/d40/d48/d63/d96/fe1 0 2024-09-21T10:41:09.488 INFO:tasks.workunit.client.0.smithi060.stdout:0/881: write d5/d10/f3d [201378,28581] 0 2024-09-21T10:41:09.490 INFO:tasks.workunit.client.0.smithi060.stdout:1/768: dread d6/d24/da/db/d1c/f55 [0,4194304] 0 2024-09-21T10:41:09.490 INFO:tasks.workunit.client.0.smithi060.stdout:4/815: dwrite d0/d83/fd1 [0,4194304] 0 2024-09-21T10:41:09.490 INFO:tasks.workunit.client.0.smithi060.stdout:4/816: stat d0/d5/d12/d15/d72 0 2024-09-21T10:41:09.490 INFO:tasks.workunit.client.0.smithi060.stdout:4/817: dread - d0/d5/d12/d3d/dd5/f111 zero size 2024-09-21T10:41:09.491 INFO:tasks.workunit.client.0.smithi060.stdout:8/993: rename d2/d26/d37/d64/d65/dd5/d10c/d138 to d2/d26/d37/d62/d14b 0 2024-09-21T10:41:09.499 INFO:tasks.workunit.client.0.smithi060.stdout:1/769: dread d6/d24/da/db/de/fe4 [0,4194304] 0 2024-09-21T10:41:09.500 INFO:tasks.workunit.client.0.smithi060.stdout:7/830: mkdir da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/d118 0 2024-09-21T10:41:09.501 INFO:tasks.workunit.client.0.smithi060.stdout:7/831: creat da/d14/d25/f119 x:0 0 0 2024-09-21T10:41:09.504 INFO:tasks.workunit.client.0.smithi060.stdout:0/882: creat d5/d10/da/d15/f11a x:0 0 0 2024-09-21T10:41:09.504 INFO:tasks.workunit.client.0.smithi060.stdout:0/883: truncate d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/f6e 1637543 0 2024-09-21T10:41:09.508 INFO:tasks.workunit.client.0.smithi060.stdout:9/788: getdents d3/d16/d7f 0 2024-09-21T10:41:09.510 INFO:tasks.workunit.client.0.smithi060.stdout:8/994: dwrite d2/d18/d4b/dbe/fcd [0,4194304] 0 2024-09-21T10:41:09.510 INFO:tasks.workunit.client.0.smithi060.stdout:9/789: write d3/d5e/d60/d2f/f31 [52663,30036] 0 2024-09-21T10:41:09.514 INFO:tasks.workunit.client.0.smithi060.stdout:4/818: getdents d0/d83/dda 0 2024-09-21T10:41:09.515 INFO:tasks.workunit.client.0.smithi060.stdout:2/644: rmdir d3/d79/db4/d6a/d9a 39 2024-09-21T10:41:09.515 INFO:tasks.workunit.client.0.smithi060.stdout:2/645: getdents d3/d20 0 2024-09-21T10:41:09.519 INFO:tasks.workunit.client.0.smithi060.stdout:5/947: rename d5/d45/d6d/d10/d19/fc4 to d5/d45/d6d/d10/d19/d21/d30/d12f/f141 0 2024-09-21T10:41:09.519 INFO:tasks.workunit.client.0.smithi060.stdout:5/948: dread - d5/d45/d77/d8f/d91/fad zero size 2024-09-21T10:41:09.519 INFO:tasks.workunit.client.0.smithi060.stdout:5/949: creat d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/f142 x:0 0 0 2024-09-21T10:41:09.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/770: mknod d6/d24/da/dea/dd8/df2/c116 0 2024-09-21T10:41:09.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/771: stat d6/d24/da/db/d1c/f26 0 2024-09-21T10:41:09.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/772: write d6/d24/da/fff [4875527,107065] 0 2024-09-21T10:41:09.520 INFO:tasks.workunit.client.0.smithi060.stdout:1/773: fsync d6/d24/da/db/d79/d86/fa0 0 2024-09-21T10:41:09.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/884: dwrite d5/d10/da/d4b/da4/d76/f95 [0,4194304] 0 2024-09-21T10:41:09.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/885: chown d5/d10/da/d15 977472 1 2024-09-21T10:41:09.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/886: chown d5/d10/da/d15/f7d 48 1 2024-09-21T10:41:09.521 INFO:tasks.workunit.client.0.smithi060.stdout:0/887: write f2 [2171389,21539] 0 2024-09-21T10:41:09.530 INFO:tasks.workunit.client.0.smithi060.stdout:7/832: rmdir da/d60/d6e/dd5/d10b/d79/db0/dd7 39 2024-09-21T10:41:09.531 INFO:tasks.workunit.client.0.smithi060.stdout:7/833: chown da/d14/l20 13545 1 2024-09-21T10:41:09.531 INFO:tasks.workunit.client.0.smithi060.stdout:8/995: mknod d2/d26/d37/d64/d65/dd5/d10c/d75/dfd/c14c 0 2024-09-21T10:41:09.531 INFO:tasks.workunit.client.0.smithi060.stdout:8/996: stat d2/f14 0 2024-09-21T10:41:09.532 INFO:tasks.workunit.client.0.smithi060.stdout:9/790: dwrite d3/f4f [4194304,4194304] 0 2024-09-21T10:41:09.535 INFO:tasks.workunit.client.0.smithi060.stdout:4/819: symlink d0/d5/d12/d15/d72/l11a 0 2024-09-21T10:41:09.535 INFO:tasks.workunit.client.0.smithi060.stdout:2/646: unlink d3/d20/f98 0 2024-09-21T10:41:09.539 INFO:tasks.workunit.client.0.smithi060.stdout:0/888: dread d5/d10/da/f84 [0,4194304] 0 2024-09-21T10:41:09.539 INFO:tasks.workunit.client.0.smithi060.stdout:5/950: rename d5/d45/d77/d8f/d91/f11f to d5/d7a/d84/f143 0 2024-09-21T10:41:09.539 INFO:tasks.workunit.client.0.smithi060.stdout:5/951: stat d5/d45/d6d/d107/f109 0 2024-09-21T10:41:09.539 INFO:tasks.workunit.client.0.smithi060.stdout:5/952: chown d5/ld8 84988 1 2024-09-21T10:41:09.540 INFO:tasks.workunit.client.0.smithi060.stdout:1/774: symlink d6/d24/da/db/d79/l117 0 2024-09-21T10:41:09.541 INFO:tasks.workunit.client.0.smithi060.stdout:1/775: dread - d6/d24/da/db/d1c/fdc zero size 2024-09-21T10:41:09.541 INFO:tasks.workunit.client.0.smithi060.stdout:0/889: read d5/d10/da/d4b/fd4 [950231,94682] 0 2024-09-21T10:41:09.543 INFO:tasks.workunit.client.0.smithi060.stdout:7/834: symlink da/d14/d10a/d112/l11a 0 2024-09-21T10:41:09.544 INFO:tasks.workunit.client.0.smithi060.stdout:9/791: mkdir d3/d16/d42/d7e/d105 0 2024-09-21T10:41:09.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/647: truncate d3/d7/d23/f5a 6445050 0 2024-09-21T10:41:09.549 INFO:tasks.workunit.client.0.smithi060.stdout:2/648: truncate d3/d7/d24/f2a 6017370 0 2024-09-21T10:41:09.558 INFO:tasks.workunit.client.0.smithi060.stdout:0/890: creat d5/d10/d43/dee/f11b x:0 0 0 2024-09-21T10:41:09.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/835: getdents da/d60/d6e/db1 0 2024-09-21T10:41:09.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/836: chown da/d14 9728 1 2024-09-21T10:41:09.561 INFO:tasks.workunit.client.0.smithi060.stdout:7/837: fsync da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/f64 0 2024-09-21T10:41:09.565 INFO:tasks.workunit.client.0.smithi060.stdout:7/838: symlink da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/d118/l11b 0 2024-09-21T10:41:09.567 INFO:tasks.workunit.client.0.smithi060.stdout:7/839: rename da/d60/d6e/dd5/d10b/ff1 to da/d14/d25/d56/d114/f11c 0 2024-09-21T10:41:09.567 INFO:tasks.workunit.client.0.smithi060.stdout:7/840: write da/d60/d6e/dd5/d10b/d79/db0/dd7/fd3 [861450,2039] 0 2024-09-21T10:41:09.573 INFO:tasks.workunit.client.0.smithi060.stdout:2/649: dread d3/d7/d23/f2f [0,4194304] 0 2024-09-21T10:41:09.573 INFO:tasks.workunit.client.0.smithi060.stdout:2/650: read d3/d7/d18/f81 [2451447,24526] 0 2024-09-21T10:41:09.573 INFO:tasks.workunit.client.0.smithi060.stdout:2/651: write d3/d7/d23/db3/fce [489004,20140] 0 2024-09-21T10:41:09.574 INFO:tasks.workunit.client.0.smithi060.stdout:2/652: mknod d3/d7/d23/ce3 0 2024-09-21T10:41:09.575 INFO:tasks.workunit.client.0.smithi060.stdout:2/653: getdents d3/d7/d24 0 2024-09-21T10:41:09.578 INFO:tasks.workunit.client.0.smithi060.stdout:2/654: rename d3/d79/cc8 to d3/d7/d18/dd9/ce4 0 2024-09-21T10:41:09.578 INFO:tasks.workunit.client.0.smithi060.stdout:2/655: creat d3/d7/d23/d55/fe5 x:0 0 0 2024-09-21T10:41:09.578 INFO:tasks.workunit.client.0.smithi060.stdout:2/656: truncate d3/d7/d24/d25/d8a/fdc 764324 0 2024-09-21T10:41:09.579 INFO:tasks.workunit.client.0.smithi060.stdout:2/657: truncate d3/d79/f7b 2215449 0 2024-09-21T10:41:09.581 INFO:tasks.workunit.client.0.smithi060.stdout:2/658: rmdir d3/d7/d24/d25/d8a 39 2024-09-21T10:41:09.581 INFO:tasks.workunit.client.0.smithi060.stdout:2/659: fsync d3/d20/d17/f4a 0 2024-09-21T10:41:09.582 INFO:tasks.workunit.client.0.smithi060.stdout:2/660: chown d3/d79/db4/d8b 1 1 2024-09-21T10:41:09.582 INFO:tasks.workunit.client.0.smithi060.stdout:2/661: chown d3/d7/d23/d55/fe5 47 1 2024-09-21T10:41:09.582 INFO:tasks.workunit.client.0.smithi060.stdout:5/953: dwrite d5/d45/d6d/d10/d19/d21/d30/f35 [4194304,4194304] 0 2024-09-21T10:41:09.582 INFO:tasks.workunit.client.0.smithi060.stdout:5/954: creat d5/d45/d77/f144 x:0 0 0 2024-09-21T10:41:09.583 INFO:tasks.workunit.client.0.smithi060.stdout:2/662: symlink d3/d20/d15/le6 0 2024-09-21T10:41:09.587 INFO:tasks.workunit.client.0.smithi060.stdout:2/663: rename d3/d20/d15/d4c/d82/dca/fcc to d3/d7/d23/fe7 0 2024-09-21T10:41:09.587 INFO:tasks.workunit.client.0.smithi060.stdout:2/664: chown d3/d7/d18/cd8 16552 1 2024-09-21T10:41:09.587 INFO:tasks.workunit.client.0.smithi060.stdout:2/665: chown d3/d79/db4/d43/c56 2 1 2024-09-21T10:41:09.587 INFO:tasks.workunit.client.0.smithi060.stdout:7/841: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/fb7 [0,4194304] 0 2024-09-21T10:41:09.587 INFO:tasks.workunit.client.0.smithi060.stdout:7/842: fdatasync da/d14/d25/d56/fdb 0 2024-09-21T10:41:09.588 INFO:tasks.workunit.client.0.smithi060.stdout:9/792: dwrite d3/d15/d53/dc8/fda [0,4194304] 0 2024-09-21T10:41:09.588 INFO:tasks.workunit.client.0.smithi060.stdout:1/776: dwrite d6/d24/da/db/dd/f92 [0,4194304] 0 2024-09-21T10:41:09.588 INFO:tasks.workunit.client.0.smithi060.stdout:1/777: readlink d6/d24/da/d45/l64 0 2024-09-21T10:41:09.596 INFO:tasks.workunit.client.0.smithi060.stdout:2/666: dread d3/d7/d23/f48 [0,4194304] 0 2024-09-21T10:41:09.601 INFO:tasks.workunit.client.0.smithi060.stdout:5/955: dwrite d5/d45/d6d/fd7 [0,4194304] 0 2024-09-21T10:41:09.604 INFO:tasks.workunit.client.0.smithi060.stdout:5/956: symlink d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/l145 0 2024-09-21T10:41:09.604 INFO:tasks.workunit.client.0.smithi060.stdout:5/957: fsync d5/d7a/d84/d88/de0/f128 0 2024-09-21T10:41:09.606 INFO:tasks.workunit.client.0.smithi060.stdout:9/793: rename d3/d5e/d60/d2f/d5b to d3/d16/d42/d7e/d85/d8f/d106 0 2024-09-21T10:41:09.606 INFO:tasks.workunit.client.0.smithi060.stdout:9/794: write d3/d15/d53/dc8/fd5 [1001856,113580] 0 2024-09-21T10:41:09.608 INFO:tasks.workunit.client.0.smithi060.stdout:5/958: mkdir d5/d45/d5a/d3a/df7/d146 0 2024-09-21T10:41:09.608 INFO:tasks.workunit.client.0.smithi060.stdout:5/959: fdatasync d5/d45/d5a/d3a/df7/f137 0 2024-09-21T10:41:09.608 INFO:tasks.workunit.client.0.smithi060.stdout:2/667: read d3/d7/d23/f7c [1606297,77728] 0 2024-09-21T10:41:09.612 INFO:tasks.workunit.client.0.smithi060.stdout:9/795: truncate d3/f47 449136 0 2024-09-21T10:41:09.616 INFO:tasks.workunit.client.0.smithi060.stdout:5/960: rename d5/d45/d6d/d10/d19/d21/d30/f11e to d5/f147 0 2024-09-21T10:41:09.616 INFO:tasks.workunit.client.0.smithi060.stdout:1/778: dwrite d6/f58 [0,4194304] 0 2024-09-21T10:41:09.616 INFO:tasks.workunit.client.0.smithi060.stdout:7/843: dwrite da/fc [0,4194304] 0 2024-09-21T10:41:09.617 INFO:tasks.workunit.client.0.smithi060.stdout:2/668: mkdir d3/d20/d15/d4c/d82/de8 0 2024-09-21T10:41:09.617 INFO:tasks.workunit.client.0.smithi060.stdout:2/669: fsync d3/d79/db4/d8b/d69/d83/fc3 0 2024-09-21T10:41:09.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/796: getdents d3/d15/d5a 0 2024-09-21T10:41:09.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/797: stat d3/d5e/f6c 0 2024-09-21T10:41:09.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/798: fsync d3/d16/d42/f9f 0 2024-09-21T10:41:09.626 INFO:tasks.workunit.client.0.smithi060.stdout:5/961: creat d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/f148 x:0 0 0 2024-09-21T10:41:09.627 INFO:tasks.workunit.client.0.smithi060.stdout:2/670: dread d3/d79/f7b [0,4194304] 0 2024-09-21T10:41:09.628 INFO:tasks.workunit.client.0.smithi060.stdout:7/844: mkdir da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/d11d 0 2024-09-21T10:41:09.628 INFO:tasks.workunit.client.0.smithi060.stdout:7/845: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/fb3 [4972917,39551] 0 2024-09-21T10:41:09.628 INFO:tasks.workunit.client.0.smithi060.stdout:7/846: stat da/d60/d6e/dd5/d10b/d79/db0/df0/d10f 0 2024-09-21T10:41:09.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/779: dread d6/d24/da/db/dd/f92 [0,4194304] 0 2024-09-21T10:41:09.635 INFO:tasks.workunit.client.0.smithi060.stdout:9/799: getdents d3/d15/d5a/d64/d9e/daf 0 2024-09-21T10:41:09.635 INFO:tasks.workunit.client.0.smithi060.stdout:9/800: dread - d3/d16/d42/d7e/d85/d8f/d106/f104 zero size 2024-09-21T10:41:09.639 INFO:tasks.workunit.client.0.smithi060.stdout:1/780: dread d6/dd3/fd5 [0,4194304] 0 2024-09-21T10:41:09.642 INFO:tasks.workunit.client.0.smithi060.stdout:5/962: getdents d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115 0 2024-09-21T10:41:09.653 INFO:tasks.workunit.client.0.smithi060.stdout:1/781: symlink d6/d24/da/db/d79/d86/d95/l118 0 2024-09-21T10:41:09.657 INFO:tasks.workunit.client.0.smithi060.stdout:1/782: write d6/d24/da/db/f5f [438679,83881] 0 2024-09-21T10:41:09.658 INFO:tasks.workunit.client.0.smithi060.stdout:1/783: chown d6/d24/da/db/d1c/f26 29997115 1 2024-09-21T10:41:09.658 INFO:tasks.workunit.client.0.smithi060.stdout:1/784: fdatasync d6/f65 0 2024-09-21T10:41:09.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/671: rename d3/d7/d23/d55 to d3/d7/de9 0 2024-09-21T10:41:09.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/672: creat d3/d20/d15/d4c/fea x:0 0 0 2024-09-21T10:41:09.658 INFO:tasks.workunit.client.0.smithi060.stdout:2/673: creat d3/d79/feb x:0 0 0 2024-09-21T10:41:09.659 INFO:tasks.workunit.client.0.smithi060.stdout:2/674: dread d3/d7/d23/db3/fce [0,4194304] 0 2024-09-21T10:41:09.665 INFO:tasks.workunit.client.0.smithi060.stdout:1/785: mkdir d6/d24/da/db/de/d119 0 2024-09-21T10:41:09.667 INFO:tasks.workunit.client.0.smithi060.stdout:9/801: rename d3/d16/d1a/d71/fec to d3/d16/d95/f107 0 2024-09-21T10:41:09.667 INFO:tasks.workunit.client.0.smithi060.stdout:9/802: truncate d3/d15/d5a/d64/d9e/fc0 629786 0 2024-09-21T10:41:09.667 INFO:tasks.workunit.client.0.smithi060.stdout:9/803: stat d3/d16/d42 0 2024-09-21T10:41:09.671 INFO:tasks.workunit.client.0.smithi060.stdout:1/786: rmdir d6/d24/da/db/d79/d86/d9f/daa 39 2024-09-21T10:41:09.671 INFO:tasks.workunit.client.0.smithi060.stdout:1/787: chown d6/f89 281238 1 2024-09-21T10:41:09.676 INFO:tasks.workunit.client.0.smithi060.stdout:2/675: dwrite d3/d79/db4/f5d [0,4194304] 0 2024-09-21T10:41:09.676 INFO:tasks.workunit.client.0.smithi060.stdout:2/676: chown d3/d79/db4/f5d 5526 1 2024-09-21T10:41:09.688 INFO:tasks.workunit.client.0.smithi060.stdout:1/788: creat d6/d24/da/d45/d76/f11a x:0 0 0 2024-09-21T10:41:09.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/804: dwrite d3/d5e/d60/d2f/f50 [0,4194304] 0 2024-09-21T10:41:09.693 INFO:tasks.workunit.client.0.smithi060.stdout:2/677: creat d3/d20/d15/fec x:0 0 0 2024-09-21T10:41:09.710 INFO:tasks.workunit.client.0.smithi060.stdout:9/805: dwrite d3/d15/d58/f9b [0,4194304] 0 2024-09-21T10:41:09.710 INFO:tasks.workunit.client.0.smithi060.stdout:1/789: dwrite d6/d24/f59 [0,4194304] 0 2024-09-21T10:41:09.710 INFO:tasks.workunit.client.0.smithi060.stdout:9/806: write d3/d15/d5a/f67 [5682060,38973] 0 2024-09-21T10:41:09.710 INFO:tasks.workunit.client.0.smithi060.stdout:9/807: fdatasync d3/d16/d5f/f88 0 2024-09-21T10:41:09.712 INFO:tasks.workunit.client.0.smithi060.stdout:2/678: creat d3/d79/db4/d43/fed x:0 0 0 2024-09-21T10:41:09.714 INFO:tasks.workunit.client.0.smithi060.stdout:1/790: creat d6/d24/da/db/de/d10b/f11b x:0 0 0 2024-09-21T10:41:09.714 INFO:tasks.workunit.client.0.smithi060.stdout:1/791: fsync d6/d24/da/db/de/f18 0 2024-09-21T10:41:09.714 INFO:tasks.workunit.client.0.smithi060.stdout:1/792: chown d6/d24/da/db/d7e/fc1 876 1 2024-09-21T10:41:09.715 INFO:tasks.workunit.client.0.smithi060.stdout:9/808: mkdir d3/d16/d42/d7e/d85/dd6/d108 0 2024-09-21T10:41:09.716 INFO:tasks.workunit.client.0.smithi060.stdout:1/793: creat d6/d24/da/dea/d102/f11c x:0 0 0 2024-09-21T10:41:09.733 INFO:tasks.workunit.client.0.smithi060.stdout:1/794: dwrite d6/d24/da/db/d7e/d90/f107 [4194304,4194304] 0 2024-09-21T10:41:09.733 INFO:tasks.workunit.client.0.smithi060.stdout:1/795: fdatasync d6/d24/da/d45/f104 0 2024-09-21T10:41:09.734 INFO:tasks.workunit.client.0.smithi060.stdout:2/679: dwrite d3/d79/db4/d6a/fa6 [0,4194304] 0 2024-09-21T10:41:09.736 INFO:tasks.workunit.client.0.smithi060.stdout:1/796: getdents d6/d24/da/dea 0 2024-09-21T10:41:09.738 INFO:tasks.workunit.client.0.smithi060.stdout:1/797: getdents d6/d24/da/db/d79/d86/d95/dce 0 2024-09-21T10:41:09.739 INFO:tasks.workunit.client.0.smithi060.stdout:1/798: symlink d6/d24/da/db/d79/d86/d95/l11d 0 2024-09-21T10:41:09.740 INFO:tasks.workunit.client.0.smithi060.stdout:1/799: mknod d6/d24/da/db/d79/d86/d9f/dcd/df8/c11e 0 2024-09-21T10:41:09.742 INFO:tasks.workunit.client.0.smithi060.stdout:1/800: link d6/d4a/d5a/db0/f8f d6/d24/da/d45/d76/f11f 0 2024-09-21T10:41:09.743 INFO:tasks.workunit.client.0.smithi060.stdout:2/680: write d3/d7/d23/f2f [3251853,1021] 0 2024-09-21T10:41:09.745 INFO:tasks.workunit.client.0.smithi060.stdout:2/681: mkdir d3/d79/db4/d8b/d69/d83/da8/dee 0 2024-09-21T10:41:09.749 INFO:tasks.workunit.client.0.smithi060.stdout:9/809: rmdir d3/d16/d42/d7e 39 2024-09-21T10:41:09.751 INFO:tasks.workunit.client.0.smithi060.stdout:9/810: mkdir d3/d16/d1a/d109 0 2024-09-21T10:41:09.752 INFO:tasks.workunit.client.0.smithi060.stdout:1/801: dread d6/d24/da/db/f29 [0,4194304] 0 2024-09-21T10:41:09.753 INFO:tasks.workunit.client.0.smithi060.stdout:9/811: mkdir d3/d16/d1f/dd1/dfa/dff/d10a 0 2024-09-21T10:41:09.766 INFO:tasks.workunit.client.0.smithi060.stdout:1/802: dwrite d6/d4a/d5a/f113 [0,4194304] 0 2024-09-21T10:41:09.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/803: dread d6/d24/da/db/d1c/d4b/fdb [0,4194304] 0 2024-09-21T10:41:09.767 INFO:tasks.workunit.client.0.smithi060.stdout:1/804: chown d6/lb3 67 1 2024-09-21T10:41:09.767 INFO:tasks.workunit.client.0.smithi060.stdout:2/682: dwrite d3/d7/d24/f2a [0,4194304] 0 2024-09-21T10:41:09.767 INFO:tasks.workunit.client.0.smithi060.stdout:2/683: readlink d3/d79/db4/d8b/l91 0 2024-09-21T10:41:09.768 INFO:tasks.workunit.client.0.smithi060.stdout:2/684: chown d3/d7/d24/d25/fa3 113429 1 2024-09-21T10:41:09.774 INFO:tasks.workunit.client.0.smithi060.stdout:2/685: getdents d3/d20/d15 0 2024-09-21T10:41:09.774 INFO:tasks.workunit.client.0.smithi060.stdout:2/686: getdents d3/d7/d24 0 2024-09-21T10:41:09.781 INFO:tasks.workunit.client.0.smithi060.stdout:2/687: dread d3/d7/d24/d25/f5b [0,4194304] 0 2024-09-21T10:41:09.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/812: rename d3/d16/d1f/dd1 to d3/d16/d42/d7e/d105/d10b 0 2024-09-21T10:41:09.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/813: readlink d3/d16/d42/l56 0 2024-09-21T10:41:09.801 INFO:tasks.workunit.client.0.smithi060.stdout:9/814: chown d3/d5e/f82 67571 1 2024-09-21T10:41:09.802 INFO:tasks.workunit.client.0.smithi060.stdout:1/805: rename d6/d24/da/d45/d47/ff9 to d6/d4a/d5a/db0/d97/f120 0 2024-09-21T10:41:09.803 INFO:tasks.workunit.client.0.smithi060.stdout:9/815: stat d3/c37 0 2024-09-21T10:41:09.803 INFO:tasks.workunit.client.0.smithi060.stdout:9/816: write d3/d15/fee [583618,129000] 0 2024-09-21T10:41:09.804 INFO:tasks.workunit.client.0.smithi060.stdout:9/817: write d3/d16/d5f/f88 [277750,40343] 0 2024-09-21T10:41:09.805 INFO:tasks.workunit.client.0.smithi060.stdout:2/688: rename d3/d79/db4/d8b/f6e to d3/d79/db4/d8b/d69/d83/fef 0 2024-09-21T10:41:09.806 INFO:tasks.workunit.client.0.smithi060.stdout:9/818: dread d3/d15/d5a/d64/ff5 [0,4194304] 0 2024-09-21T10:41:09.806 INFO:tasks.workunit.client.0.smithi060.stdout:9/819: write d3/d15/f2b [4639242,25862] 0 2024-09-21T10:41:09.806 INFO:tasks.workunit.client.0.smithi060.stdout:1/806: truncate d6/d24/da/db/dd/faf 246191 0 2024-09-21T10:41:09.806 INFO:tasks.workunit.client.0.smithi060.stdout:1/807: write d6/d24/da/d45/d76/f10c [864781,43059] 0 2024-09-21T10:41:09.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/689: link d3/d79/feb d3/d79/db4/d8b/d69/d83/da8/dee/ff0 0 2024-09-21T10:41:09.809 INFO:tasks.workunit.client.0.smithi060.stdout:2/690: readlink d3/d7/d18/lae 0 2024-09-21T10:41:09.812 INFO:tasks.workunit.client.0.smithi060.stdout:1/808: rename d6/d4a/d5a/db0/d97/le2 to d6/d4a/d5a/l121 0 2024-09-21T10:41:09.815 INFO:tasks.workunit.client.0.smithi060.stdout:2/691: stat d3/d7/cd3 0 2024-09-21T10:41:09.817 INFO:tasks.workunit.client.0.smithi060.stdout:9/820: unlink d3/f9d 0 2024-09-21T10:41:09.819 INFO:tasks.workunit.client.0.smithi060.stdout:9/821: dread d3/d15/d53/dc8/fd5 [0,4194304] 0 2024-09-21T10:41:09.819 INFO:tasks.workunit.client.0.smithi060.stdout:1/809: creat d6/d24/da/db/d79/d86/d9f/f122 x:0 0 0 2024-09-21T10:41:09.821 INFO:tasks.workunit.client.0.smithi060.stdout:2/692: mknod d3/d20/cf1 0 2024-09-21T10:41:09.825 INFO:tasks.workunit.client.0.smithi060.stdout:9/822: rename d3/d5e/d60/d2f/l3e to d3/d15/d5a/dc7/l10c 0 2024-09-21T10:41:09.825 INFO:tasks.workunit.client.0.smithi060.stdout:9/823: dread - d3/d5e/d60/d2f/fd7 zero size 2024-09-21T10:41:09.829 INFO:tasks.workunit.client.0.smithi060.stdout:1/810: creat d6/d24/da/db/de/d32/f123 x:0 0 0 2024-09-21T10:41:09.830 INFO:tasks.workunit.client.0.smithi060.stdout:9/824: mknod d3/d16/d7f/c10d 0 2024-09-21T10:41:09.832 INFO:tasks.workunit.client.0.smithi060.stdout:1/811: mknod d6/d4a/d5a/c124 0 2024-09-21T10:41:09.835 INFO:tasks.workunit.client.0.smithi060.stdout:9/825: creat d3/d15/d5a/d64/d9e/daf/f10e x:0 0 0 2024-09-21T10:41:09.835 INFO:tasks.workunit.client.0.smithi060.stdout:9/826: chown d3/c37 134 1 2024-09-21T10:41:09.835 INFO:tasks.workunit.client.0.smithi060.stdout:9/827: read - d3/d16/d42/d7e/d85/d8f/d106/f104 zero size 2024-09-21T10:41:09.835 INFO:tasks.workunit.client.0.smithi060.stdout:9/828: dread - d3/d16/d5f/ff3 zero size 2024-09-21T10:41:09.836 INFO:tasks.workunit.client.0.smithi060.stdout:9/829: symlink d3/d16/d1a/l10f 0 2024-09-21T10:41:09.836 INFO:tasks.workunit.client.0.smithi060.stdout:9/830: chown d3/d15/d78/cf4 432 1 2024-09-21T10:41:09.843 INFO:tasks.workunit.client.0.smithi060.stdout:2/693: dwrite d3/d20/d15/d4c/fea [0,4194304] 0 2024-09-21T10:41:09.845 INFO:tasks.workunit.client.0.smithi060.stdout:1/812: dread d6/d4a/d5a/db0/f78 [0,4194304] 0 2024-09-21T10:41:09.848 INFO:tasks.workunit.client.0.smithi060.stdout:9/831: dread d3/d5e/d60/f25 [0,4194304] 0 2024-09-21T10:41:09.857 INFO:tasks.workunit.client.0.smithi060.stdout:9/832: write d3/d16/d95/df9/ffb [2191701,122935] 0 2024-09-21T10:41:09.858 INFO:tasks.workunit.client.0.smithi060.stdout:2/694: symlink d3/d7/d18/lf2 0 2024-09-21T10:41:09.860 INFO:tasks.workunit.client.0.smithi060.stdout:1/813: mkdir d6/d24/da/db/d79/dad/d101/d125 0 2024-09-21T10:41:09.861 INFO:tasks.workunit.client.0.smithi060.stdout:9/833: symlink d3/d15/d53/dc8/dde/l110 0 2024-09-21T10:41:09.862 INFO:tasks.workunit.client.0.smithi060.stdout:2/695: mkdir d3/d79/db4/d8b/d69/d83/da8/dee/df3 0 2024-09-21T10:41:09.862 INFO:tasks.workunit.client.0.smithi060.stdout:9/834: read d3/d16/d1f/f49 [1306501,108033] 0 2024-09-21T10:41:09.863 INFO:tasks.workunit.client.0.smithi060.stdout:2/696: getdents d3/d7/d24/d33 0 2024-09-21T10:41:09.865 INFO:tasks.workunit.client.0.smithi060.stdout:2/697: creat d3/d7/ff4 x:0 0 0 2024-09-21T10:41:09.868 INFO:tasks.workunit.client.0.smithi060.stdout:2/698: mkdir d3/d7/d24/d33/df5 0 2024-09-21T10:41:09.870 INFO:tasks.workunit.client.0.smithi060.stdout:2/699: rename d3/d20/d15/fec to d3/d7/d24/ff6 0 2024-09-21T10:41:09.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/835: dwrite d3/f89 [0,4194304] 0 2024-09-21T10:41:09.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/836: creat d3/d15/f111 x:0 0 0 2024-09-21T10:41:09.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/837: creat d3/d5e/d60/f112 x:0 0 0 2024-09-21T10:41:09.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/838: truncate d3/d16/d1a/fdd 234355 0 2024-09-21T10:41:09.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/839: read d3/d16/d5f/f88 [833147,118766] 0 2024-09-21T10:41:09.890 INFO:tasks.workunit.client.0.smithi060.stdout:2/700: dwrite d3/d79/db4/d8b/fa4 [0,4194304] 0 2024-09-21T10:41:09.893 INFO:tasks.workunit.client.0.smithi060.stdout:9/840: dread d3/d5e/f66 [0,4194304] 0 2024-09-21T10:41:09.899 INFO:tasks.workunit.client.0.smithi060.stdout:2/701: mknod d3/d79/db4/db9/cf7 0 2024-09-21T10:41:09.903 INFO:tasks.workunit.client.0.smithi060.stdout:9/841: symlink d3/d16/d42/d7e/d105/d10b/dfa/dff/d10a/l113 0 2024-09-21T10:41:09.912 INFO:tasks.workunit.client.0.smithi060.stdout:2/702: write d3/d7/d18/f52 [4050993,41580] 0 2024-09-21T10:41:09.912 INFO:tasks.workunit.client.0.smithi060.stdout:2/703: dread - d3/d7/d23/f86 zero size 2024-09-21T10:41:09.912 INFO:tasks.workunit.client.0.smithi060.stdout:2/704: fdatasync d3/fa7 0 2024-09-21T10:41:09.912 INFO:tasks.workunit.client.0.smithi060.stdout:2/705: chown d3/d7/l64 1000622611 1 2024-09-21T10:41:09.923 INFO:tasks.workunit.client.0.smithi060.stdout:9/842: dwrite d3/d15/d78/fe4 [0,4194304] 0 2024-09-21T10:41:09.923 INFO:tasks.workunit.client.0.smithi060.stdout:4/820: sync 2024-09-21T10:41:09.923 INFO:tasks.workunit.client.0.smithi060.stdout:7/847: sync 2024-09-21T10:41:09.923 INFO:tasks.workunit.client.0.smithi060.stdout:4/821: creat d0/d5/d12/d15/d4d/f11b x:0 0 0 2024-09-21T10:41:09.923 INFO:tasks.workunit.client.0.smithi060.stdout:5/963: sync 2024-09-21T10:41:09.924 INFO:tasks.workunit.client.0.smithi060.stdout:5/964: fdatasync d5/d71/fc0 0 2024-09-21T10:41:09.924 INFO:tasks.workunit.client.0.smithi060.stdout:5/965: chown d5/d45/d6d/d10/d19/d21/d30 0 1 2024-09-21T10:41:09.924 INFO:tasks.workunit.client.0.smithi060.stdout:8/997: sync 2024-09-21T10:41:09.924 INFO:tasks.workunit.client.0.smithi060.stdout:8/998: write d2/d26/d37/f58 [3272281,105977] 0 2024-09-21T10:41:09.924 INFO:tasks.workunit.client.0.smithi060.stdout:0/891: sync 2024-09-21T10:41:09.937 INFO:tasks.workunit.client.0.smithi060.stdout:4/822: mkdir d0/d5/d12/d3d/dd5/d11c 0 2024-09-21T10:41:09.937 INFO:tasks.workunit.client.0.smithi060.stdout:4/823: readlink d0/d8b/dd8/d10f/d6b/d65/ld4 0 2024-09-21T10:41:09.938 INFO:tasks.workunit.client.0.smithi060.stdout:4/824: fdatasync d0/d5/d12/d3d/d94/f110 0 2024-09-21T10:41:09.938 INFO:tasks.workunit.client.0.smithi060.stdout:4/825: fsync d0/d83/dec/f102 0 2024-09-21T10:41:09.939 INFO:tasks.workunit.client.0.smithi060.stdout:1/814: write d6/d4a/d5a/db0/fac [73230,31985] 0 2024-09-21T10:41:09.940 INFO:tasks.workunit.client.0.smithi060.stdout:5/966: link d5/d45/d6d/f2b d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/f149 0 2024-09-21T10:41:09.944 INFO:tasks.workunit.client.0.smithi060.stdout:8/999: unlink d2/d26/d37/d64/d65/dd5/de7/f10f 0 2024-09-21T10:41:09.944 INFO:tasks.workunit.client.0.smithi060.stdout:1/815: dread d6/f89 [0,4194304] 0 2024-09-21T10:41:09.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:09 smithi060 ceph-mon[28215]: pgmap v21: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 168 MiB/s rd, 216 MiB/s wr, 343 op/s 2024-09-21T10:41:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:09 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:09 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:09 smithi112 ceph-mon[35117]: pgmap v21: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 168 MiB/s rd, 216 MiB/s wr, 343 op/s 2024-09-21T10:41:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:09 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:09 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:09.952 INFO:tasks.workunit.client.0.smithi060.stdout:0/892: creat d5/d10/da/d4b/da4/d40/d48/d63/def/d105/f11c x:0 0 0 2024-09-21T10:41:09.960 INFO:tasks.workunit.client.0.smithi060.stdout:4/826: mknod d0/d5/d12/d15/d4d/c11d 0 2024-09-21T10:41:09.963 INFO:tasks.workunit.client.0.smithi060.stdout:4/827: mkdir d0/df/d88/d11e 0 2024-09-21T10:41:09.969 INFO:tasks.workunit.client.0.smithi060.stdout:4/828: mknod d0/d8b/dd8/d10f/d6b/d32/d57/c11f 0 2024-09-21T10:41:09.973 INFO:tasks.workunit.client.0.smithi060.stdout:4/829: getdents d0/df/d9c 0 2024-09-21T10:41:09.974 INFO:tasks.workunit.client.0.smithi060.stdout:2/706: dwrite d3/d7/de9/fe5 [0,4194304] 0 2024-09-21T10:41:09.976 INFO:tasks.workunit.client.0.smithi060.stdout:4/830: symlink d0/d83/dda/l120 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/967: dwrite d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/d121/fb1 [4194304,4194304] 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/968: read d5/d45/d6d/d10/d19/d8d/d60/fb7 [1768907,76339] 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/969: readlink d5/d45/d6d/d10/d19/d21/d7f/d89/l5b 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:7/848: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/fb3 [0,4194304] 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/970: creat d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/f14a x:0 0 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/971: chown d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/feb 21309659 1 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:5/972: write d5/d45/d5a/d3a/fde [218725,116161] 0 2024-09-21T10:41:09.978 INFO:tasks.workunit.client.0.smithi060.stdout:9/843: dwrite d3/d16/d42/d7e/fd8 [0,4194304] 0 2024-09-21T10:41:09.979 INFO:tasks.workunit.client.0.smithi060.stdout:1/816: dwrite d6/d24/da/d45/f6a [0,4194304] 0 2024-09-21T10:41:09.980 INFO:tasks.workunit.client.0.smithi060.stdout:4/831: unlink d0/d8b/dd8/d10f/d6b/d32/cf7 0 2024-09-21T10:41:09.992 INFO:tasks.workunit.client.0.smithi060.stdout:2/707: write d3/d20/d15/d4c/fea [3206907,42873] 0 2024-09-21T10:41:09.992 INFO:tasks.workunit.client.0.smithi060.stdout:2/708: write d3/d79/db4/d43/d62/f70 [640943,115020] 0 2024-09-21T10:41:09.999 INFO:tasks.workunit.client.0.smithi060.stdout:7/849: mkdir da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d11e 0 2024-09-21T10:41:10.001 INFO:tasks.workunit.client.0.smithi060.stdout:5/973: truncate d5/d45/d6d/d10/d19/d8d/d60/fb7 500137 0 2024-09-21T10:41:10.002 INFO:tasks.workunit.client.0.smithi060.stdout:2/709: dread d3/d7/d24/d25/f5b [0,4194304] 0 2024-09-21T10:41:10.002 INFO:tasks.workunit.client.0.smithi060.stdout:2/710: chown d3/d7/d18/cd8 95 1 2024-09-21T10:41:10.011 INFO:tasks.workunit.client.0.smithi060.stdout:1/817: symlink d6/d24/da/db/de/d32/l126 0 2024-09-21T10:41:10.011 INFO:tasks.workunit.client.0.smithi060.stdout:1/818: write d6/d24/da/db/d1c/fdc [826667,100402] 0 2024-09-21T10:41:10.013 INFO:tasks.workunit.client.0.smithi060.stdout:4/832: rename d0/d8b/dd8/d10f/d6b/d65/d51/l82 to d0/d5/d12/d3d/l121 0 2024-09-21T10:41:10.013 INFO:tasks.workunit.client.0.smithi060.stdout:4/833: fsync d0/df/d84/faf 0 2024-09-21T10:41:10.015 INFO:tasks.workunit.client.0.smithi060.stdout:7/850: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/fb7 [501898,46960] 0 2024-09-21T10:41:10.018 INFO:tasks.workunit.client.0.smithi060.stdout:5/974: symlink d5/d45/d5a/l14b 0 2024-09-21T10:41:10.018 INFO:tasks.workunit.client.0.smithi060.stdout:5/975: creat d5/d45/d6d/d107/f14c x:0 0 0 2024-09-21T10:41:10.018 INFO:tasks.workunit.client.0.smithi060.stdout:1/819: mkdir d6/d24/d127 0 2024-09-21T10:41:10.019 INFO:tasks.workunit.client.0.smithi060.stdout:4/834: symlink d0/df/l122 0 2024-09-21T10:41:10.021 INFO:tasks.workunit.client.0.smithi060.stdout:9/844: dread d3/d5e/d60/d2f/f31 [0,4194304] 0 2024-09-21T10:41:10.024 INFO:tasks.workunit.client.0.smithi060.stdout:5/976: creat d5/d45/d6d/d10/d19/d8d/f14d x:0 0 0 2024-09-21T10:41:10.028 INFO:tasks.workunit.client.0.smithi060.stdout:1/820: mkdir d6/d24/da/db/d79/d86/d9f/dcd/d128 0 2024-09-21T10:41:10.030 INFO:tasks.workunit.client.0.smithi060.stdout:4/835: unlink d0/d5/d12/d15/d72/f113 0 2024-09-21T10:41:10.034 INFO:tasks.workunit.client.0.smithi060.stdout:9/845: mkdir d3/d16/d5f/d114 0 2024-09-21T10:41:10.034 INFO:tasks.workunit.client.0.smithi060.stdout:4/836: dread d0/d8b/dd8/d10f/d6b/d65/d51/f100 [0,4194304] 0 2024-09-21T10:41:10.037 INFO:tasks.workunit.client.0.smithi060.stdout:9/846: mkdir d3/d16/d1f/d115 0 2024-09-21T10:41:10.038 INFO:tasks.workunit.client.0.smithi060.stdout:5/977: rmdir d5/d7a/d84/dcc/db6 39 2024-09-21T10:41:10.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/837: rmdir d0/d5/d3a 39 2024-09-21T10:41:10.042 INFO:tasks.workunit.client.0.smithi060.stdout:4/838: chown d0/df/d84/l92 9086 1 2024-09-21T10:41:10.048 INFO:tasks.workunit.client.0.smithi060.stdout:4/839: dread d0/d5/f10 [0,4194304] 0 2024-09-21T10:41:10.053 INFO:tasks.workunit.client.0.smithi060.stdout:7/851: dwrite da/d60/d6e/f93 [4194304,4194304] 0 2024-09-21T10:41:10.053 INFO:tasks.workunit.client.0.smithi060.stdout:1/821: dwrite d6/d4a/d5a/fa4 [0,4194304] 0 2024-09-21T10:41:10.053 INFO:tasks.workunit.client.0.smithi060.stdout:1/822: read - d6/d24/da/db/d79/dad/ffe zero size 2024-09-21T10:41:10.054 INFO:tasks.workunit.client.0.smithi060.stdout:4/840: unlink d0/d5/d12/f108 0 2024-09-21T10:41:10.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/711: dwrite d3/d20/d15/f74 [4194304,4194304] 0 2024-09-21T10:41:10.056 INFO:tasks.workunit.client.0.smithi060.stdout:2/712: chown d3/d79/db4/d8b/d69/d83/da8/cd2 6567629 1 2024-09-21T10:41:10.061 INFO:tasks.workunit.client.0.smithi060.stdout:4/841: rename d0/d5/d12/c116 to d0/d5/d12/d3d/dd5/d11c/c123 0 2024-09-21T10:41:10.067 INFO:tasks.workunit.client.0.smithi060.stdout:9/847: dwrite d3/d15/d78/f8c [0,4194304] 0 2024-09-21T10:41:10.069 INFO:tasks.workunit.client.0.smithi060.stdout:2/713: dread d3/f5 [0,4194304] 0 2024-09-21T10:41:10.069 INFO:tasks.workunit.client.0.smithi060.stdout:5/978: dwrite d5/d45/d6d/d10/d19/d8d/d60/d61/d8a/f14a [0,4194304] 0 2024-09-21T10:41:10.069 INFO:tasks.workunit.client.0.smithi060.stdout:2/714: write d3/d7/d24/d25/d8a/fdc [418754,60573] 0 2024-09-21T10:41:10.070 INFO:tasks.workunit.client.0.smithi060.stdout:2/715: chown d3/d79/db4 40 1 2024-09-21T10:41:10.070 INFO:tasks.workunit.client.0.smithi060.stdout:2/716: chown d3/d79/db4/d5c/la0 2187390 1 2024-09-21T10:41:10.071 INFO:tasks.workunit.client.0.smithi060.stdout:5/979: write d5/d45/d6d/d10/f113 [19953,68000] 0 2024-09-21T10:41:10.071 INFO:tasks.workunit.client.0.smithi060.stdout:1/823: read d6/d24/da/db/de/f21 [2543250,92065] 0 2024-09-21T10:41:10.080 INFO:tasks.workunit.client.0.smithi060.stdout:7/852: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/fb3 4891857 0 2024-09-21T10:41:10.084 INFO:tasks.workunit.client.0.smithi060.stdout:1/824: write d6/f58 [2536745,39797] 0 2024-09-21T10:41:10.085 INFO:tasks.workunit.client.0.smithi060.stdout:7/853: symlink da/d14/d25/d56/d114/l11f 0 2024-09-21T10:41:10.092 INFO:tasks.workunit.client.0.smithi060.stdout:1/825: unlink d6/d24/da/db/d79/l117 0 2024-09-21T10:41:10.092 INFO:tasks.workunit.client.0.smithi060.stdout:1/826: readlink d6/d4a/d5a/db0/dd0/ldd 0 2024-09-21T10:41:10.092 INFO:tasks.workunit.client.0.smithi060.stdout:7/854: creat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/d118/f120 x:0 0 0 2024-09-21T10:41:10.092 INFO:tasks.workunit.client.0.smithi060.stdout:2/717: dwrite d3/d7/d24/fbe [0,4194304] 0 2024-09-21T10:41:10.093 INFO:tasks.workunit.client.0.smithi060.stdout:5/980: rename d5/d45/d5a/dbd to d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/d14e 0 2024-09-21T10:41:10.103 INFO:tasks.workunit.client.0.smithi060.stdout:7/855: getdents da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b 0 2024-09-21T10:41:10.103 INFO:tasks.workunit.client.0.smithi060.stdout:7/856: fsync da/d14/d25/f109 0 2024-09-21T10:41:10.108 INFO:tasks.workunit.client.0.smithi060.stdout:5/981: rename d5/d45/d6d/d10/d19/d21/d7f/d89/dbe/c101 to d5/d45/d6d/c14f 0 2024-09-21T10:41:10.108 INFO:tasks.workunit.client.0.smithi060.stdout:4/842: dwrite d0/d3c/fb7 [0,4194304] 0 2024-09-21T10:41:10.108 INFO:tasks.workunit.client.0.smithi060.stdout:1/827: write d6/d24/da/db/de/fe4 [1269800,48281] 0 2024-09-21T10:41:10.108 INFO:tasks.workunit.client.0.smithi060.stdout:1/828: read - d6/d4a/d5a/db0/fba zero size 2024-09-21T10:41:10.108 INFO:tasks.workunit.client.0.smithi060.stdout:1/829: readlink d6/d24/da/db/d1c/d4b/lf5 0 2024-09-21T10:41:10.109 INFO:tasks.workunit.client.0.smithi060.stdout:2/718: dread d3/d7/d23/fe7 [0,4194304] 0 2024-09-21T10:41:10.109 INFO:tasks.workunit.client.0.smithi060.stdout:2/719: chown d3/d79/db4/d6a/d9a/fb0 0 1 2024-09-21T10:41:10.127 INFO:tasks.workunit.client.0.smithi060.stdout:1/830: mknod d6/d24/da/db/d79/dad/c129 0 2024-09-21T10:41:10.129 INFO:tasks.workunit.client.0.smithi060.stdout:7/857: getdents da/d60/d6e/dd0 0 2024-09-21T10:41:10.129 INFO:tasks.workunit.client.0.smithi060.stdout:7/858: stat da/d60/fc9 0 2024-09-21T10:41:10.129 INFO:tasks.workunit.client.0.smithi060.stdout:7/859: readlink da/d60/d6e/dd5/d10b/d32/l57 0 2024-09-21T10:41:10.131 INFO:tasks.workunit.client.0.smithi060.stdout:1/831: mkdir d6/d24/da/db/de/d12a 0 2024-09-21T10:41:10.131 INFO:tasks.workunit.client.0.smithi060.stdout:7/860: mknod da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/c121 0 2024-09-21T10:41:10.131 INFO:tasks.workunit.client.0.smithi060.stdout:7/861: chown da/d14/f54 1426693 1 2024-09-21T10:41:10.137 INFO:tasks.workunit.client.0.smithi060.stdout:5/982: dwrite d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/f124 [0,4194304] 0 2024-09-21T10:41:10.140 INFO:tasks.workunit.client.0.smithi060.stdout:2/720: dwrite d3/d7/d24/d25/d8a/fe0 [0,4194304] 0 2024-09-21T10:41:10.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/843: dwrite d0/d5/fc5 [0,4194304] 0 2024-09-21T10:41:10.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/844: dread - d0/d8b/dd8/d10f/d6b/d32/dd6/ff6 zero size 2024-09-21T10:41:10.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/845: write d0/d5/f1a [2585419,78672] 0 2024-09-21T10:41:10.145 INFO:tasks.workunit.client.0.smithi060.stdout:4/846: chown d0/d5/d3a/dbe/cf3 718 1 2024-09-21T10:41:10.148 INFO:tasks.workunit.client.0.smithi060.stdout:5/983: mkdir d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/d150 0 2024-09-21T10:41:10.148 INFO:tasks.workunit.client.0.smithi060.stdout:5/984: dread - d5/d7a/d84/d88/f10b zero size 2024-09-21T10:41:10.148 INFO:tasks.workunit.client.0.smithi060.stdout:5/985: getdents d5/d45/d6d/d10/d19/d8d/d60/d61/dc8/d102/d115/d116/d150 0 2024-09-21T10:41:10.148 INFO:tasks.workunit.client.0.smithi060.stdout:5/986: fdatasync d5/d45/d6d/d10/d19/d8d/f43 0 2024-09-21T10:41:10.148 INFO:tasks.workunit.client.0.smithi060.stdout:5/987: write d5/d45/fb4 [4945661,29667] 0 2024-09-21T10:41:10.153 INFO:tasks.workunit.client.0.smithi060.stdout:2/721: link d3/d7/d24/l7f d3/d79/db4/d8b/d69/lf8 0 2024-09-21T10:41:10.153 INFO:tasks.workunit.client.0.smithi060.stdout:2/722: write d3/d20/fd4 [476787,54704] 0 2024-09-21T10:41:10.154 INFO:tasks.workunit.client.0.smithi060.stdout:7/862: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/feb [0,4194304] 0 2024-09-21T10:41:10.154 INFO:tasks.workunit.client.0.smithi060.stdout:7/863: fsync da/d60/d6e/dd5/d10b/f78 0 2024-09-21T10:41:10.160 INFO:tasks.workunit.client.0.smithi060.stdout:4/847: truncate d0/d83/fb0 3181362 0 2024-09-21T10:41:10.168 INFO:tasks.workunit.client.0.smithi060.stdout:2/723: creat d3/d7/d18/dd9/ff9 x:0 0 0 2024-09-21T10:41:10.168 INFO:tasks.workunit.client.0.smithi060.stdout:2/724: write d3/d20/d17/f4a [4833396,60568] 0 2024-09-21T10:41:10.168 INFO:tasks.workunit.client.0.smithi060.stdout:2/725: read - d3/d7/d24/ff6 zero size 2024-09-21T10:41:10.171 INFO:tasks.workunit.client.0.smithi060.stdout:4/848: creat d0/d5/d12/d3d/dd5/f124 x:0 0 0 2024-09-21T10:41:10.188 INFO:tasks.workunit.client.0.smithi060.stdout:5/988: rmdir d5/d45/d6d 39 2024-09-21T10:41:10.190 INFO:tasks.workunit.client.0.smithi060.stdout:2/726: mkdir d3/d7/d18/dfa 0 2024-09-21T10:41:10.191 INFO:tasks.workunit.client.0.smithi060.stdout:4/849: dwrite d0/d3c/d67/d7d/ffc [0,4194304] 0 2024-09-21T10:41:10.192 INFO:tasks.workunit.client.0.smithi060.stdout:7/864: getdents da/d14/d25/d56 0 2024-09-21T10:41:10.194 INFO:tasks.workunit.client.0.smithi060.stdout:5/989: rename d5/d45/d6d/d10/d19/d21/d7f/d89/fe9 to d5/d45/d6d/d10/d19/d8d/d60/d61/f151 0 2024-09-21T10:41:10.199 INFO:tasks.workunit.client.0.smithi060.stdout:7/865: mkdir da/d60/d6e/db1/d122 0 2024-09-21T10:41:10.200 INFO:tasks.workunit.client.0.smithi060.stdout:7/866: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/f86 [588317,104717] 0 2024-09-21T10:41:10.202 INFO:tasks.workunit.client.0.smithi060.stdout:4/850: write d0/df/d88/ff5 [1874672,13631] 0 2024-09-21T10:41:10.207 INFO:tasks.workunit.client.0.smithi060.stdout:4/851: link d0/df/d88/l58 d0/df/l125 0 2024-09-21T10:41:10.217 INFO:tasks.workunit.client.0.smithi060.stdout:4/852: dread d0/d83/f9f [0,4194304] 0 2024-09-21T10:41:10.231 INFO:tasks.workunit.client.0.smithi060.stdout:5/990: dwrite d5/d71/f104 [0,4194304] 0 2024-09-21T10:41:10.231 INFO:tasks.workunit.client.0.smithi060.stdout:5/991: write d5/d45/d77/fe5 [4576410,33274] 0 2024-09-21T10:41:10.231 INFO:tasks.workunit.client.0.smithi060.stdout:7/867: dwrite da/d14/d25/d56/f62 [4194304,4194304] 0 2024-09-21T10:41:10.231 INFO:tasks.workunit.client.0.smithi060.stdout:4/853: dread d0/d8b/dd8/d10f/d6b/d65/f4a [0,4194304] 0 2024-09-21T10:41:10.232 INFO:tasks.workunit.client.0.smithi060.stdout:2/727: dwrite d3/d7/d23/f5a [0,4194304] 0 2024-09-21T10:41:10.232 INFO:tasks.workunit.client.0.smithi060.stdout:2/728: readlink d3/d20/d15/l1d 0 2024-09-21T10:41:10.232 INFO:tasks.workunit.client.0.smithi060.stdout:5/992: rename d5/d45/d6d/d107 to d5/d152 0 2024-09-21T10:41:10.233 INFO:tasks.workunit.client.0.smithi060.stdout:5/993: creat d5/d7a/d84/d88/f153 x:0 0 0 2024-09-21T10:41:10.233 INFO:tasks.workunit.client.0.smithi060.stdout:7/868: mknod da/d60/d6e/c123 0 2024-09-21T10:41:10.233 INFO:tasks.workunit.client.0.smithi060.stdout:7/869: write da/d60/d6e/dd5/d10b/d79/db0/df0/df5/f105 [961179,66131] 0 2024-09-21T10:41:10.237 INFO:tasks.workunit.client.0.smithi060.stdout:2/729: mkdir d3/d20/d15/d4c/dfb 0 2024-09-21T10:41:10.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/994: mkdir d5/d152/d154 0 2024-09-21T10:41:10.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/995: chown d5/d122/f119 13866556 1 2024-09-21T10:41:10.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/996: chown d5/d45/d6d/d10/d19/d21/d30/d49/c99 1810160 1 2024-09-21T10:41:10.239 INFO:tasks.workunit.client.0.smithi060.stdout:5/997: fdatasync d5/d45/d5a/d3a/f6b 0 2024-09-21T10:41:10.240 INFO:tasks.workunit.client.0.smithi060.stdout:4/854: rename d0/l10e to d0/d83/dec/l126 0 2024-09-21T10:41:10.240 INFO:tasks.workunit.client.0.smithi060.stdout:4/855: creat d0/d3c/d67/f127 x:0 0 0 2024-09-21T10:41:10.247 INFO:tasks.workunit.client.0.smithi060.stdout:2/730: mkdir d3/d79/db4/d8b/d69/d83/da8/dee/df3/dfc 0 2024-09-21T10:41:10.248 INFO:tasks.workunit.client.0.smithi060.stdout:2/731: write d3/d79/db4/d8b/d69/d83/fc3 [553850,126634] 0 2024-09-21T10:41:10.249 INFO:tasks.workunit.client.0.smithi060.stdout:5/998: truncate d5/d45/faa 4852478 0 2024-09-21T10:41:10.250 INFO:tasks.workunit.client.0.smithi060.stdout:5/999: chown d5/d45/d5a/f7e 4 1 2024-09-21T10:41:10.251 INFO:tasks.workunit.client.0.smithi060.stdout:7/870: rename da/d60/d6e/dd5/d10b/d79/db0/dd7/l108 to da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/l124 0 2024-09-21T10:41:10.251 INFO:tasks.workunit.client.0.smithi060.stdout:7/871: stat da/d60/d6e/dd5/d10b/d79/db0/ld8 0 2024-09-21T10:41:10.254 INFO:tasks.workunit.client.0.smithi060.stdout:4/856: mkdir d0/d8b/dd8/d10f/d6b/d65/d51/d128 0 2024-09-21T10:41:10.255 INFO:tasks.workunit.client.0.smithi060.stdout:4/857: creat d0/d8b/dd8/f129 x:0 0 0 2024-09-21T10:41:10.259 INFO:tasks.workunit.client.0.smithi060.stdout:4/858: symlink d0/df/d88/l12a 0 2024-09-21T10:41:10.262 INFO:tasks.workunit.client.0.smithi060.stdout:4/859: rename d0/d3c/f91 to d0/d5/d12/d3d/d94/f12b 0 2024-09-21T10:41:10.271 INFO:tasks.workunit.client.0.smithi060.stdout:4/860: rmdir d0/d83/dec 39 2024-09-21T10:41:10.273 INFO:tasks.workunit.client.0.smithi060.stdout:2/732: dwrite d3/d79/db4/d8b/fa4 [0,4194304] 0 2024-09-21T10:41:10.273 INFO:tasks.workunit.client.0.smithi060.stdout:2/733: dread - d3/d79/db4/d43/d62/fc9 zero size 2024-09-21T10:41:10.273 INFO:tasks.workunit.client.0.smithi060.stdout:7/872: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/f64 [0,4194304] 0 2024-09-21T10:41:10.273 INFO:tasks.workunit.client.0.smithi060.stdout:4/861: symlink d0/d83/dec/l12c 0 2024-09-21T10:41:10.273 INFO:tasks.workunit.client.0.smithi060.stdout:4/862: creat d0/df/d84/f12d x:0 0 0 2024-09-21T10:41:10.280 INFO:tasks.workunit.client.0.smithi060.stdout:2/734: rename d3/d7/ff4 to d3/d20/d15/d3b/ffd 0 2024-09-21T10:41:10.280 INFO:tasks.workunit.client.0.smithi060.stdout:2/735: readlink d3/d7/d24/l60 0 2024-09-21T10:41:10.280 INFO:tasks.workunit.client.0.smithi060.stdout:2/736: chown d3/d79/db4/d5c/f76 1679360 1 2024-09-21T10:41:10.284 INFO:tasks.workunit.client.0.smithi060.stdout:7/873: symlink da/d60/d6e/dd5/l125 0 2024-09-21T10:41:10.288 INFO:tasks.workunit.client.0.smithi060.stdout:4/863: mkdir d0/d5/d12/d12e 0 2024-09-21T10:41:10.297 INFO:tasks.workunit.client.0.smithi060.stdout:4/864: dread d0/d8b/dd8/d10f/d6b/d32/d57/f77 [0,4194304] 0 2024-09-21T10:41:10.298 INFO:tasks.workunit.client.0.smithi060.stdout:4/865: fdatasync d0/d5/d12/d3d/dd5/f124 0 2024-09-21T10:41:10.298 INFO:tasks.workunit.client.0.smithi060.stdout:4/866: fsync d0/d3c/f48 0 2024-09-21T10:41:10.303 INFO:tasks.workunit.client.0.smithi060.stdout:7/874: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/f7b [0,4194304] 0 2024-09-21T10:41:10.307 INFO:tasks.workunit.client.0.smithi060.stdout:4/867: write d0/d8b/dd8/d10f/d6b/f2f [2435296,128610] 0 2024-09-21T10:41:10.307 INFO:tasks.workunit.client.0.smithi060.stdout:4/868: write d0/d5/d12/d3d/dd5/fef [645414,43847] 0 2024-09-21T10:41:10.308 INFO:tasks.workunit.client.0.smithi060.stdout:0/893: sync 2024-09-21T10:41:10.308 INFO:tasks.workunit.client.0.smithi060.stdout:9/848: sync 2024-09-21T10:41:10.312 INFO:tasks.workunit.client.0.smithi060.stdout:0/894: symlink d5/d10/da/d4b/l11d 0 2024-09-21T10:41:10.313 INFO:tasks.workunit.client.0.smithi060.stdout:7/875: dread da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/f88 [0,4194304] 0 2024-09-21T10:41:10.314 INFO:tasks.workunit.client.0.smithi060.stdout:0/895: creat d5/d10/da/d4b/da4/d40/d48/db3/f11e x:0 0 0 2024-09-21T10:41:10.314 INFO:tasks.workunit.client.0.smithi060.stdout:0/896: chown d5/d10/da/d15/cc2 60764630 1 2024-09-21T10:41:10.315 INFO:tasks.workunit.client.0.smithi060.stdout:7/876: mknod da/d60/d6e/dd5/d10b/d79/db0/df0/df5/c126 0 2024-09-21T10:41:10.315 INFO:tasks.workunit.client.0.smithi060.stdout:7/877: chown da/d60/d6e/dd5/d10b/d79/db0/df0/df5/c126 18416 1 2024-09-21T10:41:10.317 INFO:tasks.workunit.client.0.smithi060.stdout:9/849: write d3/d15/d5a/d64/d9e/fc0 [307561,76138] 0 2024-09-21T10:41:10.318 INFO:tasks.workunit.client.0.smithi060.stdout:0/897: unlink d5/d10/da/d4b/da4/d40/d48/d63/def/d105/f9a 0 2024-09-21T10:41:10.320 INFO:tasks.workunit.client.0.smithi060.stdout:9/850: mknod d3/d15/d5a/d64/c116 0 2024-09-21T10:41:10.320 INFO:tasks.workunit.client.0.smithi060.stdout:9/851: dread - d3/d16/d42/fd2 zero size 2024-09-21T10:41:10.321 INFO:tasks.workunit.client.0.smithi060.stdout:0/898: creat d5/d10/da/d4b/da4/f11f x:0 0 0 2024-09-21T10:41:10.323 INFO:tasks.workunit.client.0.smithi060.stdout:9/852: symlink d3/d16/d42/d7e/d105/l117 0 2024-09-21T10:41:10.325 INFO:tasks.workunit.client.0.smithi060.stdout:0/899: symlink d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d45/l120 0 2024-09-21T10:41:10.326 INFO:tasks.workunit.client.0.smithi060.stdout:7/878: write da/d60/d6e/dd5/d10b/d79/db0/dd7/ff [2848089,40395] 0 2024-09-21T10:41:10.326 INFO:tasks.workunit.client.0.smithi060.stdout:7/879: stat da/d14/d25/l3e 0 2024-09-21T10:41:10.326 INFO:tasks.workunit.client.0.smithi060.stdout:9/853: truncate d3/d16/f44 2089768 0 2024-09-21T10:41:10.326 INFO:tasks.workunit.client.0.smithi060.stdout:0/900: mknod d5/d10/d43/dee/c121 0 2024-09-21T10:41:10.330 INFO:tasks.workunit.client.0.smithi060.stdout:7/880: unlink da/d60/d6e/l51 0 2024-09-21T10:41:10.333 INFO:tasks.workunit.client.0.smithi060.stdout:0/901: symlink d5/d10/da/d4b/da4/d40/d75/dbb/l122 0 2024-09-21T10:41:10.333 INFO:tasks.workunit.client.0.smithi060.stdout:0/902: creat d5/d10/da/d4b/da4/d40/d48/db3/f123 x:0 0 0 2024-09-21T10:41:10.336 INFO:tasks.workunit.client.0.smithi060.stdout:4/869: dwrite d0/d8b/dd8/d10f/d6b/f2f [4194304,4194304] 0 2024-09-21T10:41:10.340 INFO:tasks.workunit.client.0.smithi060.stdout:9/854: dwrite d3/d5e/d60/f91 [0,4194304] 0 2024-09-21T10:41:10.344 INFO:tasks.workunit.client.0.smithi060.stdout:4/870: unlink d0/d5/d12/d3d/l86 0 2024-09-21T10:41:10.344 INFO:tasks.workunit.client.0.smithi060.stdout:4/871: write d0/d5/d12/f73 [1484999,12634] 0 2024-09-21T10:41:10.344 INFO:tasks.workunit.client.0.smithi060.stdout:4/872: write d0/d8b/dd8/d10f/d6b/d65/d51/fcc [406654,87424] 0 2024-09-21T10:41:10.347 INFO:tasks.workunit.client.0.smithi060.stdout:9/855: link d3/d5e/d60/c33 d3/d5e/db8/c118 0 2024-09-21T10:41:10.352 INFO:tasks.workunit.client.0.smithi060.stdout:9/856: link d3/d16/d1f/c5c d3/d15/d58/c119 0 2024-09-21T10:41:10.353 INFO:tasks.workunit.client.0.smithi060.stdout:0/903: dwrite d5/d10/da/d4b/da4/d40/d75/f7c [4194304,4194304] 0 2024-09-21T10:41:10.357 INFO:tasks.workunit.client.0.smithi060.stdout:9/857: dread d3/d16/d1f/f49 [0,4194304] 0 2024-09-21T10:41:10.360 INFO:tasks.workunit.client.0.smithi060.stdout:4/873: dwrite d0/d8b/dd8/d10f/d6b/f2f [0,4194304] 0 2024-09-21T10:41:10.363 INFO:tasks.workunit.client.0.smithi060.stdout:4/874: symlink d0/d8b/dd8/d10f/d6b/d65/l12f 0 2024-09-21T10:41:10.364 INFO:tasks.workunit.client.0.smithi060.stdout:0/904: write d5/d10/f60 [2985350,70370] 0 2024-09-21T10:41:10.364 INFO:tasks.workunit.client.0.smithi060.stdout:0/905: chown d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d45/c47 3841009 1 2024-09-21T10:41:10.365 INFO:tasks.workunit.client.0.smithi060.stdout:9/858: dread d3/d5e/d60/f39 [0,4194304] 0 2024-09-21T10:41:10.367 INFO:tasks.workunit.client.0.smithi060.stdout:4/875: rename d0/d5/f71 to d0/d5/f130 0 2024-09-21T10:41:10.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/906: symlink d5/d10/da/d4b/de6/l124 0 2024-09-21T10:41:10.370 INFO:tasks.workunit.client.0.smithi060.stdout:0/907: readlink d5/d10/da/d4b/da4/d40/d48/d63/la1 0 2024-09-21T10:41:10.383 INFO:tasks.workunit.client.0.smithi060.stdout:9/859: dwrite d3/d5e/d60/f91 [0,4194304] 0 2024-09-21T10:41:10.384 INFO:tasks.workunit.client.0.smithi060.stdout:4/876: dwrite d0/d5/fe3 [0,4194304] 0 2024-09-21T10:41:10.392 INFO:tasks.workunit.client.0.smithi060.stdout:9/860: write d3/d5e/f66 [2263752,3903] 0 2024-09-21T10:41:10.397 INFO:tasks.workunit.client.0.smithi060.stdout:0/908: dwrite d5/d10/da/d4b/da4/d40/d48/d63/d96/fcc [4194304,4194304] 0 2024-09-21T10:41:10.417 INFO:tasks.workunit.client.0.smithi060.stdout:0/909: dwrite d5/d10/da/d15/f4c [0,4194304] 0 2024-09-21T10:41:10.418 INFO:tasks.workunit.client.0.smithi060.stdout:0/910: chown d5/f21 0 1 2024-09-21T10:41:10.418 INFO:tasks.workunit.client.0.smithi060.stdout:0/911: fsync d5/d10/da/d4b/da4/d76/f95 0 2024-09-21T10:41:10.433 INFO:tasks.workunit.client.0.smithi060.stdout:4/877: unlink d0/d5/d12/f95 0 2024-09-21T10:41:10.438 INFO:tasks.workunit.client.0.smithi060.stdout:9/861: creat d3/d16/d42/d7e/f11a x:0 0 0 2024-09-21T10:41:10.444 INFO:tasks.workunit.client.0.smithi060.stdout:0/912: symlink d5/d10/da/d4b/da4/d76/df1/l125 0 2024-09-21T10:41:10.447 INFO:tasks.workunit.client.0.smithi060.stdout:9/862: mkdir d3/d16/d95/d11b 0 2024-09-21T10:41:10.449 INFO:tasks.workunit.client.0.smithi060.stdout:9/863: dread d3/d5e/d60/d2f/f31 [0,4194304] 0 2024-09-21T10:41:10.450 INFO:tasks.workunit.client.0.smithi060.stdout:0/913: creat d5/d10/da/d4b/da4/d76/f126 x:0 0 0 2024-09-21T10:41:10.450 INFO:tasks.workunit.client.0.smithi060.stdout:0/914: read d5/d10/f5a [817098,20273] 0 2024-09-21T10:41:10.452 INFO:tasks.workunit.client.0.smithi060.stdout:9/864: creat d3/d16/d1a/d109/f11c x:0 0 0 2024-09-21T10:41:10.453 INFO:tasks.workunit.client.0.smithi060.stdout:0/915: creat d5/d10/d4e/f127 x:0 0 0 2024-09-21T10:41:10.453 INFO:tasks.workunit.client.0.smithi060.stdout:0/916: read - d5/d10/da/d15/fd8 zero size 2024-09-21T10:41:10.453 INFO:tasks.workunit.client.0.smithi060.stdout:0/917: truncate d5/d10/da/d4b/da4/d40/d48/d103/f111 173295 0 2024-09-21T10:41:10.453 INFO:tasks.workunit.client.0.smithi060.stdout:0/918: truncate d5/d10/da/d4b/da4/d40/d48/db3/fd5 228075 0 2024-09-21T10:41:10.477 INFO:tasks.workunit.client.0.smithi060.stdout:9/865: dwrite d3/d5e/d60/f112 [0,4194304] 0 2024-09-21T10:41:10.477 INFO:tasks.workunit.client.0.smithi060.stdout:0/919: dwrite d5/d10/da/d2f/f6b [0,4194304] 0 2024-09-21T10:41:10.480 INFO:tasks.workunit.client.0.smithi060.stdout:0/920: stat d5/d10/d4e/l6a 0 2024-09-21T10:41:10.482 INFO:tasks.workunit.client.0.smithi060.stdout:0/921: mkdir d5/ddd/d128 0 2024-09-21T10:41:10.483 INFO:tasks.workunit.client.0.smithi060.stdout:0/922: mknod d5/c129 0 2024-09-21T10:41:10.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/832: sync 2024-09-21T10:41:10.488 INFO:tasks.workunit.client.0.smithi060.stdout:1/833: creat d6/d24/da/dea/dd8/f12b x:0 0 0 2024-09-21T10:41:10.488 INFO:tasks.workunit.client.0.smithi060.stdout:1/834: rename d6/d24/da to d6/d24/da/db/d79/d86/d9f/dcd/d12c 22 2024-09-21T10:41:10.488 INFO:tasks.workunit.client.0.smithi060.stdout:1/835: creat d6/d24/da/db/f12d x:0 0 0 2024-09-21T10:41:10.490 INFO:tasks.workunit.client.0.smithi060.stdout:9/866: dwrite d3/d16/d42/d7e/d85/d8f/d106/f104 [0,4194304] 0 2024-09-21T10:41:10.491 INFO:tasks.workunit.client.0.smithi060.stdout:1/836: mkdir d6/d24/da/db/d79/d86/d9f/dcd/df8/d12e 0 2024-09-21T10:41:10.493 INFO:tasks.workunit.client.0.smithi060.stdout:9/867: mknod d3/d16/d1f/d115/c11d 0 2024-09-21T10:41:10.495 INFO:tasks.workunit.client.0.smithi060.stdout:1/837: getdents d6/d24/da/db/d1c 0 2024-09-21T10:41:10.500 INFO:tasks.workunit.client.0.smithi060.stdout:9/868: dread d3/d15/d5a/f67 [0,4194304] 0 2024-09-21T10:41:10.501 INFO:tasks.workunit.client.0.smithi060.stdout:9/869: write d3/d15/d78/fe4 [4934293,73821] 0 2024-09-21T10:41:10.503 INFO:tasks.workunit.client.0.smithi060.stdout:9/870: link d3/d15/f4a d3/d16/d42/d7e/d85/f11e 0 2024-09-21T10:41:10.503 INFO:tasks.workunit.client.0.smithi060.stdout:9/871: fsync d3/d5e/d60/f39 0 2024-09-21T10:41:10.504 INFO:tasks.workunit.client.0.smithi060.stdout:9/872: fdatasync d3/f9 0 2024-09-21T10:41:10.506 INFO:tasks.workunit.client.0.smithi060.stdout:9/873: unlink d3/d15/d5a/d64/d9e/daf/f10e 0 2024-09-21T10:41:10.508 INFO:tasks.workunit.client.0.smithi060.stdout:9/874: unlink d3/d16/d42/d7e/fa9 0 2024-09-21T10:41:10.509 INFO:tasks.workunit.client.0.smithi060.stdout:9/875: mknod d3/d16/d1a/c11f 0 2024-09-21T10:41:10.509 INFO:tasks.workunit.client.0.smithi060.stdout:9/876: stat d3/d16/d5f/l98 0 2024-09-21T10:41:10.509 INFO:tasks.workunit.client.0.smithi060.stdout:9/877: write d3/d16/d1f/fea [253716,107959] 0 2024-09-21T10:41:10.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/923: dwrite d5/d10/da/d2d/fa2 [0,4194304] 0 2024-09-21T10:41:10.515 INFO:tasks.workunit.client.0.smithi060.stdout:0/924: dread - d5/d10/d43/fe0 zero size 2024-09-21T10:41:10.519 INFO:tasks.workunit.client.0.smithi060.stdout:0/925: rmdir d5/d10/da/d4b/da4/d40/d48 39 2024-09-21T10:41:10.519 INFO:tasks.workunit.client.0.smithi060.stdout:1/838: dwrite d6/d24/da/db/dd/f92 [0,4194304] 0 2024-09-21T10:41:10.521 INFO:tasks.workunit.client.0.smithi060.stdout:1/839: rename d6/d24/da/db/de/f21 to d6/f12f 0 2024-09-21T10:41:10.522 INFO:tasks.workunit.client.0.smithi060.stdout:1/840: write d6/d24/da/db/f85 [4411697,13146] 0 2024-09-21T10:41:10.538 INFO:tasks.workunit.client.0.smithi060.stdout:0/926: dwrite d5/d10/da/d4b/da4/d40/d75/dca/fd6 [0,4194304] 0 2024-09-21T10:41:10.538 INFO:tasks.workunit.client.0.smithi060.stdout:0/927: fsync d5/d10/da/d4b/da4/f11f 0 2024-09-21T10:41:10.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/841: dwrite d6/d24/da/db/d79/d86/d9f/dcd/ff3 [0,4194304] 0 2024-09-21T10:41:10.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/842: truncate d6/d24/da/db/dd/fe9 274638 0 2024-09-21T10:41:10.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/843: chown d6/d24/da/db/d79/d86/d9f/fc0 161 1 2024-09-21T10:41:10.547 INFO:tasks.workunit.client.0.smithi060.stdout:0/928: dread d5/d10/da/d4b/da4/fad [0,4194304] 0 2024-09-21T10:41:10.547 INFO:tasks.workunit.client.0.smithi060.stdout:0/929: fsync d5/d10/da/f81 0 2024-09-21T10:41:10.548 INFO:tasks.workunit.client.0.smithi060.stdout:0/930: mkdir d5/d10/da/d2d/d12a 0 2024-09-21T10:41:10.549 INFO:tasks.workunit.client.0.smithi060.stdout:0/931: rename d5/d10/da/f13 to d5/d10/da/d4b/de6/f12b 0 2024-09-21T10:41:10.552 INFO:tasks.workunit.client.0.smithi060.stdout:0/932: symlink d5/d10/da/d4b/da4/d40/l12c 0 2024-09-21T10:41:10.552 INFO:tasks.workunit.client.0.smithi060.stdout:0/933: chown d5/d10/da/d2d/f5b 1001496 1 2024-09-21T10:41:10.553 INFO:tasks.workunit.client.0.smithi060.stdout:0/934: mknod d5/d10/da/d4b/da4/d40/d48/d103/c12d 0 2024-09-21T10:41:10.555 INFO:tasks.workunit.client.0.smithi060.stdout:0/935: dread d5/d10/da/d4b/da4/d40/f70 [0,4194304] 0 2024-09-21T10:41:10.555 INFO:tasks.workunit.client.0.smithi060.stdout:0/936: readlink d5/d10/d11/lb4 0 2024-09-21T10:41:10.555 INFO:tasks.workunit.client.0.smithi060.stdout:0/937: readlink d5/d10/d4e/l6a 0 2024-09-21T10:41:10.555 INFO:tasks.workunit.client.0.smithi060.stdout:0/938: chown d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d79 0 1 2024-09-21T10:41:10.556 INFO:tasks.workunit.client.0.smithi060.stdout:0/939: rename d5/d10/da/c35 to d5/d10/d4e/dba/c12e 0 2024-09-21T10:41:10.556 INFO:tasks.workunit.client.0.smithi060.stdout:0/940: readlink d5/d10/da/d2d/lb2 0 2024-09-21T10:41:10.557 INFO:tasks.workunit.client.0.smithi060.stdout:0/941: truncate d5/d10/f3d 4833306 0 2024-09-21T10:41:10.558 INFO:tasks.workunit.client.0.smithi060.stdout:0/942: symlink d5/d10/da/d2d/l12f 0 2024-09-21T10:41:10.559 INFO:tasks.workunit.client.0.smithi060.stdout:0/943: mkdir d5/d10/da/d4b/de6/d130 0 2024-09-21T10:41:10.561 INFO:tasks.workunit.client.0.smithi060.stdout:1/844: dwrite d6/d24/da/db/d79/d86/d9f/fa9 [0,4194304] 0 2024-09-21T10:41:10.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/845: getdents d6/d24/da/db/de/d32 0 2024-09-21T10:41:10.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/846: chown d6/d24/da/db/d79/lf0 195701500 1 2024-09-21T10:41:10.567 INFO:tasks.workunit.client.0.smithi060.stdout:1/847: truncate d6/d24/da/db/f12d 174026 0 2024-09-21T10:41:10.570 INFO:tasks.workunit.client.0.smithi060.stdout:1/848: creat d6/d24/da/dea/dd8/df2/f130 x:0 0 0 2024-09-21T10:41:10.572 INFO:tasks.workunit.client.0.smithi060.stdout:1/849: mkdir d6/d24/da/db/d79/d86/d95/dce/d131 0 2024-09-21T10:41:10.572 INFO:tasks.workunit.client.0.smithi060.stdout:1/850: dread - d6/d4a/d5a/db0/d97/f111 zero size 2024-09-21T10:41:10.572 INFO:tasks.workunit.client.0.smithi060.stdout:1/851: stat d6/d24/da/db/d79/dad/ffe 0 2024-09-21T10:41:10.573 INFO:tasks.workunit.client.0.smithi060.stdout:0/944: dwrite d5/d10/da/fa5 [4194304,4194304] 0 2024-09-21T10:41:10.574 INFO:tasks.workunit.client.0.smithi060.stdout:0/945: fsync d5/d10/da/d4b/da4/d40/d48/d63/def/d105/f11c 0 2024-09-21T10:41:10.575 INFO:tasks.workunit.client.0.smithi060.stdout:1/852: rename d6/d24/da/db/de/d10b/f115 to d6/d24/da/db/d79/d86/d95/dce/d131/f132 0 2024-09-21T10:41:10.575 INFO:tasks.workunit.client.0.smithi060.stdout:1/853: creat d6/d24/da/db/d7e/f133 x:0 0 0 2024-09-21T10:41:10.577 INFO:tasks.workunit.client.0.smithi060.stdout:1/854: mkdir d6/d24/da/dea/d102/d134 0 2024-09-21T10:41:10.585 INFO:tasks.workunit.client.0.smithi060.stdout:1/855: rename d6/d24/da/db/de/d10b to d6/d24/da/dea/d102/d135 0 2024-09-21T10:41:10.585 INFO:tasks.workunit.client.0.smithi060.stdout:1/856: stat d6/d4a 0 2024-09-21T10:41:10.585 INFO:tasks.workunit.client.0.smithi060.stdout:0/946: read d5/d10/da/d4b/f71 [2802908,52230] 0 2024-09-21T10:41:10.587 INFO:tasks.workunit.client.0.smithi060.stdout:1/857: rename d6/d24/da/db/de/f18 to d6/d24/d127/f136 0 2024-09-21T10:41:10.587 INFO:tasks.workunit.client.0.smithi060.stdout:1/858: stat d6/d24/da/db/de/d7c 0 2024-09-21T10:41:10.589 INFO:tasks.workunit.client.0.smithi060.stdout:1/859: mknod d6/d24/da/dea/c137 0 2024-09-21T10:41:10.590 INFO:tasks.workunit.client.0.smithi060.stdout:1/860: unlink d6/d24/da/db/d7e/d90/ld6 0 2024-09-21T10:41:10.591 INFO:tasks.workunit.client.0.smithi060.stdout:1/861: mkdir d6/d24/da/dea/d102/d135/d138 0 2024-09-21T10:41:10.617 INFO:tasks.workunit.client.0.smithi060.stdout:1/862: dwrite d6/d24/da/db/de/f8d [0,4194304] 0 2024-09-21T10:41:10.617 INFO:tasks.workunit.client.0.smithi060.stdout:0/947: dwrite d5/d10/da/d4b/da4/f5c [0,4194304] 0 2024-09-21T10:41:10.629 INFO:tasks.workunit.client.0.smithi060.stdout:0/948: write d5/d10/da/d2f/f6b [1924778,106316] 0 2024-09-21T10:41:10.630 INFO:tasks.workunit.client.0.smithi060.stdout:0/949: mkdir d5/d10/da/d4b/de6/d130/d131 0 2024-09-21T10:41:10.631 INFO:tasks.workunit.client.0.smithi060.stdout:0/950: mkdir d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/d132 0 2024-09-21T10:41:10.632 INFO:tasks.workunit.client.0.smithi060.stdout:0/951: getdents d5/d10/da/d4b/da4/d40/d48/d63/def/d105 0 2024-09-21T10:41:10.646 INFO:tasks.workunit.client.0.smithi060.stdout:0/952: dwrite d5/d10/da/d4b/da4/fd3 [0,4194304] 0 2024-09-21T10:41:10.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/953: dread d5/d10/da/d2f/fc3 [0,4194304] 0 2024-09-21T10:41:10.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/954: creat d5/d10/da/d15/f133 x:0 0 0 2024-09-21T10:41:10.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/955: creat d5/d10/da/d15/f134 x:0 0 0 2024-09-21T10:41:10.654 INFO:tasks.workunit.client.0.smithi060.stdout:0/956: chown d5/d10/da/d4b/da4/d40/d48/db3/ff0 3576 1 2024-09-21T10:41:10.657 INFO:tasks.workunit.client.0.smithi060.stdout:0/957: symlink d5/d10/da/d4b/da4/d40/d48/d63/l135 0 2024-09-21T10:41:10.673 INFO:tasks.workunit.client.0.smithi060.stdout:0/958: dwrite d5/d10/da/d4b/da4/d40/d75/dbb/ffb [0,4194304] 0 2024-09-21T10:41:10.676 INFO:tasks.workunit.client.0.smithi060.stdout:0/959: truncate d5/d10/d4e/f51 24115 0 2024-09-21T10:41:10.676 INFO:tasks.workunit.client.0.smithi060.stdout:0/960: stat d5/d10/da/d4b/da4/d40/d48/fc7 0 2024-09-21T10:41:10.685 INFO:tasks.workunit.client.0.smithi060.stdout:0/961: write d5/d10/da/d4b/da4/d40/d48/d63/def/d105/fbe [706567,92113] 0 2024-09-21T10:41:10.687 INFO:tasks.workunit.client.0.smithi060.stdout:0/962: mkdir d5/d10/da/d4b/da4/d40/d48/d63/def/d136 0 2024-09-21T10:41:10.687 INFO:tasks.workunit.client.0.smithi060.stdout:0/963: write d5/d10/da/f81 [1791911,36533] 0 2024-09-21T10:41:10.687 INFO:tasks.workunit.client.0.smithi060.stdout:0/964: mkdir d5/d10/da/d15/d137 0 2024-09-21T10:41:10.696 INFO:tasks.workunit.client.0.smithi060.stdout:0/965: write d5/d10/da/d4b/da4/d40/d75/dca/fd6 [777810,34420] 0 2024-09-21T10:41:10.697 INFO:tasks.workunit.client.0.smithi060.stdout:0/966: mkdir d5/d10/d43/dde/d138 0 2024-09-21T10:41:10.699 INFO:tasks.workunit.client.0.smithi060.stdout:0/967: truncate d5/d10/da/f12 3844313 0 2024-09-21T10:41:10.699 INFO:tasks.workunit.client.0.smithi060.stdout:0/968: write d5/d10/f10f [317024,2295] 0 2024-09-21T10:41:10.699 INFO:tasks.workunit.client.0.smithi060.stdout:0/969: getdents d5/d10/d43/dde/d138 0 2024-09-21T10:41:10.700 INFO:tasks.workunit.client.0.smithi060.stdout:0/970: mknod d5/d10/da/d4b/de6/d130/c139 0 2024-09-21T10:41:10.700 INFO:tasks.workunit.client.0.smithi060.stdout:0/971: write d5/d10/da/d4b/da4/d40/d75/dbb/fda [1079268,74193] 0 2024-09-21T10:41:10.701 INFO:tasks.workunit.client.0.smithi060.stdout:0/972: symlink d5/d10/da/d4b/da4/d40/d48/l13a 0 2024-09-21T10:41:10.703 INFO:tasks.workunit.client.0.smithi060.stdout:0/973: mknod d5/d10/d43/dde/c13b 0 2024-09-21T10:41:10.708 INFO:tasks.workunit.client.0.smithi060.stdout:0/974: write d5/d10/da/d4b/da4/fad [3625849,72208] 0 2024-09-21T10:41:10.708 INFO:tasks.workunit.client.0.smithi060.stdout:0/975: write d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/fe9 [1028665,34031] 0 2024-09-21T10:41:10.709 INFO:tasks.workunit.client.0.smithi060.stdout:0/976: creat d5/d10/da/d2f/f13c x:0 0 0 2024-09-21T10:41:10.709 INFO:tasks.workunit.client.0.smithi060.stdout:0/977: stat d5/d10/da/da7/fb7 0 2024-09-21T10:41:10.712 INFO:tasks.workunit.client.0.smithi060.stdout:0/978: rename d5/d10/d43/c117 to d5/d10/d4e/c13d 0 2024-09-21T10:41:10.924 INFO:tasks.workunit.client.0.smithi060.stdout:2/737: sync 2024-09-21T10:41:10.924 INFO:tasks.workunit.client.0.smithi060.stdout:2/738: dread - d3/d7/d24/fb1 zero size 2024-09-21T10:41:10.924 INFO:tasks.workunit.client.0.smithi060.stdout:2/739: chown d3/d7 5 1 2024-09-21T10:41:10.944 INFO:tasks.workunit.client.0.smithi060.stdout:2/740: dwrite d3/d7/de9/f9f [0,4194304] 0 2024-09-21T10:41:10.946 INFO:tasks.workunit.client.0.smithi060.stdout:2/741: creat d3/d7/d24/d33/df5/ffe x:0 0 0 2024-09-21T10:41:10.947 INFO:tasks.workunit.client.0.smithi060.stdout:2/742: rename d3/d7/de9/f9f to d3/d79/db4/d8b/d69/d83/fff 0 2024-09-21T10:41:10.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:10 smithi060 ceph-mon[28215]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-09-21T10:41:10.948 INFO:tasks.workunit.client.0.smithi060.stdout:2/743: truncate d3/f12 2565789 0 2024-09-21T10:41:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:10 smithi112 ceph-mon[35117]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-09-21T10:41:11.268 INFO:tasks.workunit.client.0.smithi060.stdout:7/881: sync 2024-09-21T10:41:11.270 INFO:tasks.workunit.client.0.smithi060.stdout:7/882: symlink da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/l127 0 2024-09-21T10:41:11.270 INFO:tasks.workunit.client.0.smithi060.stdout:7/883: stat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/d118/f120 0 2024-09-21T10:41:11.270 INFO:tasks.workunit.client.0.smithi060.stdout:7/884: truncate da/d60/d6e/f38 378187 0 2024-09-21T10:41:11.287 INFO:tasks.workunit.client.0.smithi060.stdout:7/885: dwrite da/d60/d6e/f69 [0,4194304] 0 2024-09-21T10:41:11.301 INFO:tasks.workunit.client.0.smithi060.stdout:7/886: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/f86 [0,4194304] 0 2024-09-21T10:41:11.306 INFO:tasks.workunit.client.0.smithi060.stdout:7/887: link da/d14/d25/d56/cb5 da/d60/d6e/dd5/d10b/de7/d101/c128 0 2024-09-21T10:41:11.309 INFO:tasks.workunit.client.0.smithi060.stdout:7/888: link da/fc6 da/d60/d6e/dd5/d10b/d79/f129 0 2024-09-21T10:41:11.317 INFO:tasks.workunit.client.0.smithi060.stdout:7/889: dread da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/f64 [0,4194304] 0 2024-09-21T10:41:11.317 INFO:tasks.workunit.client.0.smithi060.stdout:7/890: chown da/d60/d6e/dd5/d10b/d79/db0/df0/df5 8463 1 2024-09-21T10:41:11.317 INFO:tasks.workunit.client.0.smithi060.stdout:7/891: fsync da/d60/d6e/dd5/d10b/f1d 0 2024-09-21T10:41:11.318 INFO:tasks.workunit.client.0.smithi060.stdout:7/892: creat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/db6/f12a x:0 0 0 2024-09-21T10:41:11.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/893: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/f10d [373299,111296] 0 2024-09-21T10:41:11.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/894: write da/f59 [1342675,38748] 0 2024-09-21T10:41:11.319 INFO:tasks.workunit.client.0.smithi060.stdout:7/895: chown da/d60/d6e/dd5/d10b/d79/db0/dd7/de1 13172364 1 2024-09-21T10:41:11.320 INFO:tasks.workunit.client.0.smithi060.stdout:7/896: creat da/d60/d6e/dd5/d10b/d79/f12b x:0 0 0 2024-09-21T10:41:11.321 INFO:tasks.workunit.client.0.smithi060.stdout:7/897: symlink da/d60/d6e/dd5/d10b/d79/db0/dd7/de1/l12c 0 2024-09-21T10:41:11.323 INFO:tasks.workunit.client.0.smithi060.stdout:7/898: mknod da/d14/c12d 0 2024-09-21T10:41:11.324 INFO:tasks.workunit.client.0.smithi060.stdout:7/899: unlink da/d14/d25/d56/d114/f11c 0 2024-09-21T10:41:11.324 INFO:tasks.workunit.client.0.smithi060.stdout:7/900: stat da/d60/d6e/dd5/d10b/d79/db0/dd7/f9f 0 2024-09-21T10:41:11.327 INFO:tasks.workunit.client.0.smithi060.stdout:7/901: rename da/f73 to da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/f12e 0 2024-09-21T10:41:11.329 INFO:tasks.workunit.client.0.smithi060.stdout:7/902: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d2e/feb 495699 0 2024-09-21T10:41:11.329 INFO:tasks.workunit.client.0.smithi060.stdout:7/903: read da/d60/d6e/dd5/d10b/f30 [1019385,99756] 0 2024-09-21T10:41:11.330 INFO:tasks.workunit.client.0.smithi060.stdout:7/904: chown da/d60/d6e/dd5/d10b/d79/db0/dd7/de1 207669978 1 2024-09-21T10:41:11.336 INFO:tasks.workunit.client.0.smithi060.stdout:7/905: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/f87 [2030093,82521] 0 2024-09-21T10:41:11.337 INFO:tasks.workunit.client.0.smithi060.stdout:7/906: truncate da/d60/d6e/dd5/d10b/de7/ffd 206275 0 2024-09-21T10:41:11.338 INFO:tasks.workunit.client.0.smithi060.stdout:4/878: sync 2024-09-21T10:41:11.339 INFO:tasks.workunit.client.0.smithi060.stdout:7/907: mknod da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/c12f 0 2024-09-21T10:41:11.352 INFO:tasks.workunit.client.0.smithi060.stdout:4/879: rename d0/d8b/dd8/d10f/d6b/d65/f4a to d0/d3c/d67/d7d/d87/f131 0 2024-09-21T10:41:11.354 INFO:tasks.workunit.client.0.smithi060.stdout:7/908: rename da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/db6/fba to da/d60/de4/f130 0 2024-09-21T10:41:11.362 INFO:tasks.workunit.client.0.smithi060.stdout:7/909: dread da/d14/d25/f4a [0,4194304] 0 2024-09-21T10:41:11.362 INFO:tasks.workunit.client.0.smithi060.stdout:7/910: dread - da/d60/d6e/dd5/d10b/d79/db0/dd7/f5e zero size 2024-09-21T10:41:11.363 INFO:tasks.workunit.client.0.smithi060.stdout:7/911: symlink da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/l131 0 2024-09-21T10:41:11.368 INFO:tasks.workunit.client.0.smithi060.stdout:4/880: dwrite d0/d3c/d67/d7d/d87/f8d [4194304,4194304] 0 2024-09-21T10:41:11.375 INFO:tasks.workunit.client.0.smithi060.stdout:2/744: sync 2024-09-21T10:41:11.375 INFO:tasks.workunit.client.0.smithi060.stdout:9/878: sync 2024-09-21T10:41:11.375 INFO:tasks.workunit.client.0.smithi060.stdout:1/863: sync 2024-09-21T10:41:11.375 INFO:tasks.workunit.client.0.smithi060.stdout:0/979: sync 2024-09-21T10:41:11.375 INFO:tasks.workunit.client.0.smithi060.stdout:0/980: read d5/d10/da/d4b/da4/d40/d48/d63/def/d105/fbe [2296537,114478] 0 2024-09-21T10:41:11.375 INFO:tasks.workunit.client.0.smithi060.stdout:0/981: write d5/d10/da/d15/f1b [1935600,44206] 0 2024-09-21T10:41:11.376 INFO:tasks.workunit.client.0.smithi060.stdout:0/982: chown d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d45/l120 6 1 2024-09-21T10:41:11.376 INFO:tasks.workunit.client.0.smithi060.stdout:9/879: read - d3/fb7 zero size 2024-09-21T10:41:11.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/912: dwrite da/d60/d6e/ff7 [0,4194304] 0 2024-09-21T10:41:11.377 INFO:tasks.workunit.client.0.smithi060.stdout:7/913: write da/d60/d6e/dd5/d10b/d79/db0/dd7/f13 [1838842,100082] 0 2024-09-21T10:41:11.377 INFO:tasks.workunit.client.0.smithi060.stdout:2/745: mkdir d3/d7/d24/d100 0 2024-09-21T10:41:11.377 INFO:tasks.workunit.client.0.smithi060.stdout:2/746: chown d3/d7/d18/l95 1545 1 2024-09-21T10:41:11.378 INFO:tasks.workunit.client.0.smithi060.stdout:2/747: readlink d3/d20/l40 0 2024-09-21T10:41:11.378 INFO:tasks.workunit.client.0.smithi060.stdout:4/881: write d0/d5/d12/fd2 [778145,125827] 0 2024-09-21T10:41:11.380 INFO:tasks.workunit.client.0.smithi060.stdout:1/864: symlink d6/d24/da/db/d79/d86/d95/dce/l139 0 2024-09-21T10:41:11.380 INFO:tasks.workunit.client.0.smithi060.stdout:1/865: readlink d6/d24/l30 0 2024-09-21T10:41:11.380 INFO:tasks.workunit.client.0.smithi060.stdout:1/866: truncate d6/d24/da/dea/ffd 492061 0 2024-09-21T10:41:11.380 INFO:tasks.workunit.client.0.smithi060.stdout:1/867: fdatasync d6/d24/da/fff 0 2024-09-21T10:41:11.381 INFO:tasks.workunit.client.0.smithi060.stdout:0/983: truncate d5/d10/f3d 175842 0 2024-09-21T10:41:11.381 INFO:tasks.workunit.client.0.smithi060.stdout:0/984: chown d5/d10/d43/ff2 233227 1 2024-09-21T10:41:11.382 INFO:tasks.workunit.client.0.smithi060.stdout:0/985: dread - d5/d10/da/d15/f134 zero size 2024-09-21T10:41:11.384 INFO:tasks.workunit.client.0.smithi060.stdout:7/914: mkdir da/d60/d6e/db1/d122/d132 0 2024-09-21T10:41:11.384 INFO:tasks.workunit.client.0.smithi060.stdout:7/915: truncate da/d60/d6e/dd5/d10b/de7/d101/f107 106044 0 2024-09-21T10:41:11.386 INFO:tasks.workunit.client.0.smithi060.stdout:1/868: dread d6/f58 [0,4194304] 0 2024-09-21T10:41:11.388 INFO:tasks.workunit.client.0.smithi060.stdout:2/748: creat d3/d20/f101 x:0 0 0 2024-09-21T10:41:11.393 INFO:tasks.workunit.client.0.smithi060.stdout:4/882: creat d0/d5/d12/d3d/f132 x:0 0 0 2024-09-21T10:41:11.396 INFO:tasks.workunit.client.0.smithi060.stdout:7/916: symlink da/d60/d6e/dd0/l133 0 2024-09-21T10:41:11.396 INFO:tasks.workunit.client.0.smithi060.stdout:7/917: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/f8a 1415211 0 2024-09-21T10:41:11.400 INFO:tasks.workunit.client.0.smithi060.stdout:2/749: link d3/d20/d15/d3b/fb5 d3/f102 0 2024-09-21T10:41:11.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/750: fdatasync d3/d79/f7b 0 2024-09-21T10:41:11.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/751: chown d3/d79/db4/d5c/l89 131440093 1 2024-09-21T10:41:11.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/752: dread - d3/d20/f101 zero size 2024-09-21T10:41:11.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/753: creat d3/d20/d15/d3b/f103 x:0 0 0 2024-09-21T10:41:11.401 INFO:tasks.workunit.client.0.smithi060.stdout:2/754: truncate d3/d20/d15/d3b/ffd 172564 0 2024-09-21T10:41:11.402 INFO:tasks.workunit.client.0.smithi060.stdout:4/883: creat d0/d5/d12/d3d/dd5/d11c/f133 x:0 0 0 2024-09-21T10:41:11.402 INFO:tasks.workunit.client.0.smithi060.stdout:0/986: dwrite d5/d10/da/d4b/da4/d40/d48/d63/def/d105/fbe [0,4194304] 0 2024-09-21T10:41:11.403 INFO:tasks.workunit.client.0.smithi060.stdout:1/869: dwrite d6/d24/da/f1f [0,4194304] 0 2024-09-21T10:41:11.404 INFO:tasks.workunit.client.0.smithi060.stdout:7/918: rmdir da/d60/d6e/dd5/d10b/d79/db0/dd7/de1 39 2024-09-21T10:41:11.406 INFO:tasks.workunit.client.0.smithi060.stdout:4/884: mknod d0/d8b/c134 0 2024-09-21T10:41:11.407 INFO:tasks.workunit.client.0.smithi060.stdout:2/755: read d3/d79/db4/d43/d4b/f8e [1570550,5731] 0 2024-09-21T10:41:11.408 INFO:tasks.workunit.client.0.smithi060.stdout:1/870: rmdir d6/d4a 39 2024-09-21T10:41:11.409 INFO:tasks.workunit.client.0.smithi060.stdout:4/885: dread d0/df/f17 [0,4194304] 0 2024-09-21T10:41:11.409 INFO:tasks.workunit.client.0.smithi060.stdout:4/886: dread - d0/d8b/dd8/d10f/d6b/d32/dd6/f10b zero size 2024-09-21T10:41:11.410 INFO:tasks.workunit.client.0.smithi060.stdout:4/887: fsync d0/d3c/d67/d7d/d87/f7a 0 2024-09-21T10:41:11.410 INFO:tasks.workunit.client.0.smithi060.stdout:4/888: fsync d0/d3c/d67/d7d/ffc 0 2024-09-21T10:41:11.410 INFO:tasks.workunit.client.0.smithi060.stdout:7/919: mknod da/d14/c134 0 2024-09-21T10:41:11.410 INFO:tasks.workunit.client.0.smithi060.stdout:7/920: fdatasync da/d60/de4/f130 0 2024-09-21T10:41:11.411 INFO:tasks.workunit.client.0.smithi060.stdout:7/921: dread da/d60/d6e/dd5/d10b/de7/d101/f107 [0,4194304] 0 2024-09-21T10:41:11.413 INFO:tasks.workunit.client.0.smithi060.stdout:2/756: rename d3/d79/db4/d43/d62/c72 to d3/d7/d23/da5/c104 0 2024-09-21T10:41:11.418 INFO:tasks.workunit.client.0.smithi060.stdout:1/871: dread d6/d24/da/fff [0,4194304] 0 2024-09-21T10:41:11.419 INFO:tasks.workunit.client.0.smithi060.stdout:4/889: dread d0/d8b/dd8/d10f/d6b/d32/d57/fe6 [0,4194304] 0 2024-09-21T10:41:11.419 INFO:tasks.workunit.client.0.smithi060.stdout:4/890: creat d0/d5/d12/d3d/dd5/d11c/f135 x:0 0 0 2024-09-21T10:41:11.419 INFO:tasks.workunit.client.0.smithi060.stdout:4/891: write d0/d3c/d67/f127 [779950,44825] 0 2024-09-21T10:41:11.419 INFO:tasks.workunit.client.0.smithi060.stdout:4/892: dread - d0/d8b/dd8/f105 zero size 2024-09-21T10:41:11.420 INFO:tasks.workunit.client.0.smithi060.stdout:2/757: rename d3/d79/ca9 to d3/d7/c105 0 2024-09-21T10:41:11.421 INFO:tasks.workunit.client.0.smithi060.stdout:7/922: getdents da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/db6 0 2024-09-21T10:41:11.422 INFO:tasks.workunit.client.0.smithi060.stdout:0/987: dwrite d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/f9f [0,4194304] 0 2024-09-21T10:41:11.424 INFO:tasks.workunit.client.0.smithi060.stdout:4/893: mknod d0/d3c/d67/d7d/c136 0 2024-09-21T10:41:11.427 INFO:tasks.workunit.client.0.smithi060.stdout:7/923: mkdir da/d60/d6e/dd5/d10b/de7/d135 0 2024-09-21T10:41:11.433 INFO:tasks.workunit.client.0.smithi060.stdout:4/894: creat d0/d8b/dd8/d10f/f137 x:0 0 0 2024-09-21T10:41:11.433 INFO:tasks.workunit.client.0.smithi060.stdout:2/758: getdents d3/d20 0 2024-09-21T10:41:11.436 INFO:tasks.workunit.client.0.smithi060.stdout:7/924: rename da/f59 to da/d60/d6e/dd5/d10b/f136 0 2024-09-21T10:41:11.438 INFO:tasks.workunit.client.0.smithi060.stdout:1/872: dwrite d6/d24/da/db/d79/d86/d95/dce/d131/f132 [0,4194304] 0 2024-09-21T10:41:11.438 INFO:tasks.workunit.client.0.smithi060.stdout:1/873: chown d6/d24/da/db/de/d32/l7a 101979744 1 2024-09-21T10:41:11.438 INFO:tasks.workunit.client.0.smithi060.stdout:1/874: dread - d6/d24/da/db/de/d7c/fe6 zero size 2024-09-21T10:41:11.440 INFO:tasks.workunit.client.0.smithi060.stdout:0/988: mknod d5/d10/da/d4b/da4/d40/d48/d63/d96/c13e 0 2024-09-21T10:41:11.441 INFO:tasks.workunit.client.0.smithi060.stdout:4/895: mkdir d0/d5/d12/d15/d4d/d138 0 2024-09-21T10:41:11.441 INFO:tasks.workunit.client.0.smithi060.stdout:4/896: getdents d0/d5/d12/d15/d4d/d138 0 2024-09-21T10:41:11.442 INFO:tasks.workunit.client.0.smithi060.stdout:7/925: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/fd3 692762 0 2024-09-21T10:41:11.442 INFO:tasks.workunit.client.0.smithi060.stdout:7/926: read - da/d60/d6e/dd5/d10b/d79/db0/df0/ff2 zero size 2024-09-21T10:41:11.443 INFO:tasks.workunit.client.0.smithi060.stdout:0/989: mknod d5/d10/c13f 0 2024-09-21T10:41:11.443 INFO:tasks.workunit.client.0.smithi060.stdout:0/990: readlink d5/d10/da/l109 0 2024-09-21T10:41:11.445 INFO:tasks.workunit.client.0.smithi060.stdout:4/897: unlink d0/d59/l10d 0 2024-09-21T10:41:11.446 INFO:tasks.workunit.client.0.smithi060.stdout:7/927: mkdir da/d14/d10a/d137 0 2024-09-21T10:41:11.447 INFO:tasks.workunit.client.0.smithi060.stdout:0/991: mknod d5/d10/da/d4b/da4/d40/d75/c140 0 2024-09-21T10:41:11.447 INFO:tasks.workunit.client.0.smithi060.stdout:0/992: stat d5/d10/da/d4b/fd4 0 2024-09-21T10:41:11.450 INFO:tasks.workunit.client.0.smithi060.stdout:4/898: unlink d0/l9 0 2024-09-21T10:41:11.450 INFO:tasks.workunit.client.0.smithi060.stdout:4/899: fdatasync d0/d8b/dd8/d10f/d6b/f22 0 2024-09-21T10:41:11.451 INFO:tasks.workunit.client.0.smithi060.stdout:0/993: creat d5/d10/da/d4b/da4/d40/d75/dae/f141 x:0 0 0 2024-09-21T10:41:11.453 INFO:tasks.workunit.client.0.smithi060.stdout:4/900: dread d0/d8b/dd8/d10f/d6b/d32/f75 [0,4194304] 0 2024-09-21T10:41:11.454 INFO:tasks.workunit.client.0.smithi060.stdout:0/994: truncate d5/d10/da/d4b/da4/d40/d48/fcd 8062532 0 2024-09-21T10:41:11.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/928: dread da/f90 [0,4194304] 0 2024-09-21T10:41:11.456 INFO:tasks.workunit.client.0.smithi060.stdout:7/929: read - da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9/f113 zero size 2024-09-21T10:41:11.456 INFO:tasks.workunit.client.0.smithi060.stdout:2/759: dwrite d3/d7/d24/d25/f5b [0,4194304] 0 2024-09-21T10:41:11.456 INFO:tasks.workunit.client.0.smithi060.stdout:2/760: truncate d3/d7/d24/d33/df5/ffe 594411 0 2024-09-21T10:41:11.458 INFO:tasks.workunit.client.0.smithi060.stdout:1/875: dwrite d6/d24/da/db/d79/dad/ffe [0,4194304] 0 2024-09-21T10:41:11.460 INFO:tasks.workunit.client.0.smithi060.stdout:0/995: symlink d5/d10/da/d4b/da4/d40/d48/db3/l142 0 2024-09-21T10:41:11.461 INFO:tasks.workunit.client.0.smithi060.stdout:2/761: mkdir d3/d79/db4/d8b/d69/d83/da8/d106 0 2024-09-21T10:41:11.462 INFO:tasks.workunit.client.0.smithi060.stdout:7/930: write da/d60/d6e/dd5/fde [2164223,87804] 0 2024-09-21T10:41:11.463 INFO:tasks.workunit.client.0.smithi060.stdout:7/931: truncate da/d60/de4/de9/f117 701779 0 2024-09-21T10:41:11.466 INFO:tasks.workunit.client.0.smithi060.stdout:1/876: unlink d6/d24/da/db/d1c/d4b/c8b 0 2024-09-21T10:41:11.468 INFO:tasks.workunit.client.0.smithi060.stdout:4/901: rename d0/d3c/d67/d7d/d87 to d0/d3c/dab/d139 0 2024-09-21T10:41:11.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/932: dread da/d60/d6e/f69 [0,4194304] 0 2024-09-21T10:41:11.475 INFO:tasks.workunit.client.0.smithi060.stdout:1/877: write d6/d24/da/db/d79/dad/ffe [967944,95349] 0 2024-09-21T10:41:11.480 INFO:tasks.workunit.client.0.smithi060.stdout:2/762: rmdir d3/d7/d23/db3 39 2024-09-21T10:41:11.482 INFO:tasks.workunit.client.0.smithi060.stdout:0/996: rename d5/d10/d4e/c9e to d5/d10/da/d4b/da4/d40/d75/dbb/c143 0 2024-09-21T10:41:11.483 INFO:tasks.workunit.client.0.smithi060.stdout:4/902: mkdir d0/d5/d12/d3d/d94/d13a 0 2024-09-21T10:41:11.483 INFO:tasks.workunit.client.0.smithi060.stdout:4/903: truncate d0/d5/d12/feb 944337 0 2024-09-21T10:41:11.485 INFO:tasks.workunit.client.0.smithi060.stdout:7/933: symlink da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/d118/l138 0 2024-09-21T10:41:11.485 INFO:tasks.workunit.client.0.smithi060.stdout:4/904: dread d0/d5/d12/f73 [0,4194304] 0 2024-09-21T10:41:11.485 INFO:tasks.workunit.client.0.smithi060.stdout:4/905: fdatasync d0/d8b/dd8/d10f/d6b/d32/d57/d90/fac 0 2024-09-21T10:41:11.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/878: creat d6/d24/da/db/d79/f13a x:0 0 0 2024-09-21T10:41:11.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/879: creat d6/d24/da/dea/dd8/f13b x:0 0 0 2024-09-21T10:41:11.486 INFO:tasks.workunit.client.0.smithi060.stdout:1/880: readlink d6/d24/da/db/de/d7c/l96 0 2024-09-21T10:41:11.488 INFO:tasks.workunit.client.0.smithi060.stdout:0/997: creat d5/d10/da/d4b/da4/d40/d75/dca/f144 x:0 0 0 2024-09-21T10:41:11.489 INFO:tasks.workunit.client.0.smithi060.stdout:7/934: stat da/d14/l29 0 2024-09-21T10:41:11.489 INFO:tasks.workunit.client.0.smithi060.stdout:7/935: dread - f8 zero size 2024-09-21T10:41:11.489 INFO:tasks.workunit.client.0.smithi060.stdout:7/936: chown da/d60/d6e/dd5/d10b/d79/db0/dd7 4269 1 2024-09-21T10:41:11.491 INFO:tasks.workunit.client.0.smithi060.stdout:4/906: unlink d0/df/d9c/fa5 0 2024-09-21T10:41:11.491 INFO:tasks.workunit.client.0.smithi060.stdout:4/907: fsync d0/df/d9c/f109 0 2024-09-21T10:41:11.495 INFO:tasks.workunit.client.0.smithi060.stdout:1/881: dread d6/f89 [0,4194304] 0 2024-09-21T10:41:11.497 INFO:tasks.workunit.client.0.smithi060.stdout:4/908: link d0/d83/c93 d0/d8b/dd8/d10f/d6b/c13b 0 2024-09-21T10:41:11.497 INFO:tasks.workunit.client.0.smithi060.stdout:4/909: write d0/d59/f5c [4748365,39508] 0 2024-09-21T10:41:11.500 INFO:tasks.workunit.client.0.smithi060.stdout:4/910: symlink d0/d8b/dd8/d10f/d6b/d32/dd6/l13c 0 2024-09-21T10:41:11.502 INFO:tasks.workunit.client.0.smithi060.stdout:0/998: dwrite d5/d10/da/d4b/da4/d40/d48/d63/def/d105/d4d/fe9 [0,4194304] 0 2024-09-21T10:41:11.503 INFO:tasks.workunit.client.0.smithi060.stdout:4/911: creat d0/d8b/dd8/d10f/d6b/d32/d57/d90/f13d x:0 0 0 2024-09-21T10:41:11.505 INFO:tasks.workunit.client.0.smithi060.stdout:0/999: truncate d5/d10/da/d4b/da4/d76/f95 3040075 0 2024-09-21T10:41:11.507 INFO:tasks.workunit.client.0.smithi060.stdout:4/912: symlink d0/d5/d12/d3d/d94/d13a/l13e 0 2024-09-21T10:41:11.509 INFO:tasks.workunit.client.0.smithi060.stdout:1/882: dwrite d6/d4a/d5a/ffb [0,4194304] 0 2024-09-21T10:41:11.509 INFO:tasks.workunit.client.0.smithi060.stdout:1/883: chown d6/d24/da/db/d79/d86/d9f/dcd/d128 0 1 2024-09-21T10:41:11.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/884: creat d6/d24/da/db/d79/dad/d101/f13c x:0 0 0 2024-09-21T10:41:11.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/885: fdatasync d6/d24/da/d45/d76/f11a 0 2024-09-21T10:41:11.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/886: stat d6/fc8 0 2024-09-21T10:41:11.517 INFO:tasks.workunit.client.0.smithi060.stdout:1/887: truncate d6/d24/fa3 1848747 0 2024-09-21T10:41:11.519 INFO:tasks.workunit.client.0.smithi060.stdout:1/888: symlink d6/d24/da/db/dd/l13d 0 2024-09-21T10:41:11.519 INFO:tasks.workunit.client.0.smithi060.stdout:4/913: dwrite d0/d5/d12/d3d/d94/f12b [0,4194304] 0 2024-09-21T10:41:11.520 INFO:tasks.workunit.client.0.smithi060.stdout:4/914: readlink d0/d5/d3a/lf0 0 2024-09-21T10:41:11.521 INFO:tasks.workunit.client.0.smithi060.stdout:1/889: mknod d6/d24/da/db/c13e 0 2024-09-21T10:41:11.523 INFO:tasks.workunit.client.0.smithi060.stdout:4/915: mknod d0/d5/d12/d3d/dd5/c13f 0 2024-09-21T10:41:11.526 INFO:tasks.workunit.client.0.smithi060.stdout:1/890: mkdir d6/d24/da/db/d79/d86/d9f/daa/de5/d13f 0 2024-09-21T10:41:11.527 INFO:tasks.workunit.client.0.smithi060.stdout:1/891: fsync d6/d24/da/db/d79/d86/fb7 0 2024-09-21T10:41:11.539 INFO:tasks.workunit.client.0.smithi060.stdout:1/892: dwrite d6/d24/da/dea/d102/d135/f11b [0,4194304] 0 2024-09-21T10:41:11.553 INFO:tasks.workunit.client.0.smithi060.stdout:1/893: dwrite d6/d24/da/db/dd/f1d [0,4194304] 0 2024-09-21T10:41:11.554 INFO:tasks.workunit.client.0.smithi060.stdout:1/894: unlink d6/d24/da/db/dd/l13d 0 2024-09-21T10:41:11.555 INFO:tasks.workunit.client.0.smithi060.stdout:1/895: mknod d6/d24/da/db/d79/d86/d9f/dcd/d128/c140 0 2024-09-21T10:41:11.556 INFO:tasks.workunit.client.0.smithi060.stdout:1/896: read d6/d24/da/db/d1c/d4b/fdb [380684,20680] 0 2024-09-21T10:41:11.735 INFO:tasks.workunit.client.0.smithi060.stdout:9/880: sync 2024-09-21T10:41:11.940 INFO:tasks.workunit.client.0.smithi060.stdout:2/763: sync 2024-09-21T10:41:11.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:11 smithi060 ceph-mon[28215]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-09-21T10:41:11.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:11 smithi060 ceph-mon[28215]: pgmap v22: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 227 MiB/s rd, 296 MiB/s wr, 482 op/s 2024-09-21T10:41:11.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:11 smithi112 ceph-mon[35117]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-09-21T10:41:11.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:11 smithi112 ceph-mon[35117]: pgmap v22: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 227 MiB/s rd, 296 MiB/s wr, 482 op/s 2024-09-21T10:41:11.958 INFO:tasks.workunit.client.0.smithi060.stdout:2/764: dwrite d3/fa7 [0,4194304] 0 2024-09-21T10:41:11.961 INFO:tasks.workunit.client.0.smithi060.stdout:2/765: symlink d3/d7/d23/db3/l107 0 2024-09-21T10:41:11.963 INFO:tasks.workunit.client.0.smithi060.stdout:2/766: creat d3/d79/db4/f108 x:0 0 0 2024-09-21T10:41:11.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/767: truncate d3/d79/f7b 1727247 0 2024-09-21T10:41:11.965 INFO:tasks.workunit.client.0.smithi060.stdout:2/768: write d3/d79/db4/f3f [4516913,41480] 0 2024-09-21T10:41:11.968 INFO:tasks.workunit.client.0.smithi060.stdout:2/769: unlink d3/d20/f101 0 2024-09-21T10:41:11.972 INFO:tasks.workunit.client.0.smithi060.stdout:2/770: rename d3/d20/d15/d4c/d82/cba to d3/d7/d18/dfa/c109 0 2024-09-21T10:41:11.977 INFO:tasks.workunit.client.0.smithi060.stdout:2/771: unlink d3/d20/d15/d4c/c78 0 2024-09-21T10:41:11.977 INFO:tasks.workunit.client.0.smithi060.stdout:2/772: truncate d3/d79/db4/d43/d62/fc9 515631 0 2024-09-21T10:41:11.979 INFO:tasks.workunit.client.0.smithi060.stdout:2/773: truncate d3/d7/d18/f81 5002547 0 2024-09-21T10:41:11.982 INFO:tasks.workunit.client.0.smithi060.stdout:2/774: mknod d3/d79/db4/d8b/c10a 0 2024-09-21T10:41:12.000 INFO:tasks.workunit.client.0.smithi060.stdout:2/775: dwrite d3/d79/db4/d6a/fa6 [0,4194304] 0 2024-09-21T10:41:12.003 INFO:tasks.workunit.client.0.smithi060.stdout:2/776: truncate d3/d7/d24/d25/f5b 3069825 0 2024-09-21T10:41:12.004 INFO:tasks.workunit.client.0.smithi060.stdout:2/777: write d3/d20/d17/f4a [4655597,111268] 0 2024-09-21T10:41:12.004 INFO:tasks.workunit.client.0.smithi060.stdout:2/778: write d3/d7/d24/d25/d8a/fe0 [4751576,77858] 0 2024-09-21T10:41:12.006 INFO:tasks.workunit.client.0.smithi060.stdout:2/779: mknod d3/d7/c10b 0 2024-09-21T10:41:12.006 INFO:tasks.workunit.client.0.smithi060.stdout:2/780: truncate d3/d20/d15/d3b/ffd 235280 0 2024-09-21T10:41:12.006 INFO:tasks.workunit.client.0.smithi060.stdout:2/781: fdatasync d3/d20/d15/d3b/fcd 0 2024-09-21T10:41:12.014 INFO:tasks.workunit.client.0.smithi060.stdout:2/782: dread d3/d7/de9/fe5 [0,4194304] 0 2024-09-21T10:41:12.028 INFO:tasks.workunit.client.0.smithi060.stdout:2/783: dwrite d3/d79/db4/d43/fed [0,4194304] 0 2024-09-21T10:41:12.031 INFO:tasks.workunit.client.0.smithi060.stdout:2/784: getdents d3/d7/d24 0 2024-09-21T10:41:12.045 INFO:tasks.workunit.client.0.smithi060.stdout:2/785: dwrite d3/d7/d23/fe7 [0,4194304] 0 2024-09-21T10:41:12.052 INFO:tasks.workunit.client.0.smithi060.stdout:2/786: dread d3/d7/d24/fbe [0,4194304] 0 2024-09-21T10:41:12.052 INFO:tasks.workunit.client.0.smithi060.stdout:2/787: chown d3/d7/d24/d25/c27 3 1 2024-09-21T10:41:12.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/788: chown d3/d79/db4/d6a/fc6 3656650 1 2024-09-21T10:41:12.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/789: mknod d3/d79/c10c 0 2024-09-21T10:41:12.053 INFO:tasks.workunit.client.0.smithi060.stdout:2/790: chown d3/d79/db4/d8b/d69/d83/fc3 325275 1 2024-09-21T10:41:12.054 INFO:tasks.workunit.client.0.smithi060.stdout:2/791: link d3/d79/db4/d8b/d69/d83/fff d3/d79/db4/d43/d4b/f10d 0 2024-09-21T10:41:12.055 INFO:tasks.workunit.client.0.smithi060.stdout:2/792: getdents d3/d7 0 2024-09-21T10:41:12.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/793: unlink d3/d79/l9c 0 2024-09-21T10:41:12.057 INFO:tasks.workunit.client.0.smithi060.stdout:2/794: dread - d3/d7/d23/db3/fbd zero size 2024-09-21T10:41:12.068 INFO:tasks.workunit.client.0.smithi060.stdout:2/795: dread d3/d20/d17/f4a [0,4194304] 0 2024-09-21T10:41:12.068 INFO:tasks.workunit.client.0.smithi060.stdout:2/796: dread - d3/d79/db4/d6a/d9a/fdf zero size 2024-09-21T10:41:12.068 INFO:tasks.workunit.client.0.smithi060.stdout:2/797: chown d3/d7/d24/d25 2214507 1 2024-09-21T10:41:12.076 INFO:tasks.workunit.client.0.smithi060.stdout:2/798: truncate d3/d20/d15/d3b/ffd 39023 0 2024-09-21T10:41:12.077 INFO:tasks.workunit.client.0.smithi060.stdout:2/799: link d3/d7/d23/db3/l107 d3/d79/db4/d8b/d69/d83/da8/dee/df3/l10e 0 2024-09-21T10:41:12.078 INFO:tasks.workunit.client.0.smithi060.stdout:2/800: mkdir d3/d20/d17/d10f 0 2024-09-21T10:41:12.080 INFO:tasks.workunit.client.0.smithi060.stdout:2/801: rename d3/d79/db4/d6a/fa6 to d3/d20/d15/d3b/f110 0 2024-09-21T10:41:12.081 INFO:tasks.workunit.client.0.smithi060.stdout:2/802: truncate d3/d79/db4/d8b/d69/d83/fc3 535360 0 2024-09-21T10:41:12.101 INFO:tasks.workunit.client.0.smithi060.stdout:2/803: dwrite d3/d7/d18/f3a [0,4194304] 0 2024-09-21T10:41:12.101 INFO:tasks.workunit.client.0.smithi060.stdout:2/804: truncate d3/d7/d24/d33/df5/ffe 1640932 0 2024-09-21T10:41:12.102 INFO:tasks.workunit.client.0.smithi060.stdout:2/805: rename d3/d79/db4/d6a/d9a/fb0 to d3/d79/db4/d43/d4b/f111 0 2024-09-21T10:41:12.103 INFO:tasks.workunit.client.0.smithi060.stdout:2/806: readlink d3/d7/d18/lae 0 2024-09-21T10:41:12.119 INFO:tasks.workunit.client.0.smithi060.stdout:2/807: dwrite d3/d7/d24/ff6 [0,4194304] 0 2024-09-21T10:41:12.125 INFO:tasks.workunit.client.0.smithi060.stdout:2/808: rename d3/d20/d15/d4c/dfb to d3/d7/d24/d112 0 2024-09-21T10:41:12.125 INFO:tasks.workunit.client.0.smithi060.stdout:2/809: write d3/d7/f6d [1886607,37807] 0 2024-09-21T10:41:12.133 INFO:tasks.workunit.client.0.smithi060.stdout:2/810: dread d3/d79/db4/d5c/f76 [0,4194304] 0 2024-09-21T10:41:12.133 INFO:tasks.workunit.client.0.smithi060.stdout:2/811: write d3/d79/db4/d6a/d9a/fdf [1045945,76159] 0 2024-09-21T10:41:12.146 INFO:tasks.workunit.client.0.smithi060.stdout:2/812: dwrite d3/d7/d24/d25/fa3 [0,4194304] 0 2024-09-21T10:41:12.147 INFO:tasks.workunit.client.0.smithi060.stdout:2/813: chown d3/d7/d24/d33/c39 1 1 2024-09-21T10:41:12.150 INFO:tasks.workunit.client.0.smithi060.stdout:2/814: mknod d3/d79/db4/d6a/d9a/c113 0 2024-09-21T10:41:12.151 INFO:tasks.workunit.client.0.smithi060.stdout:9/881: sync 2024-09-21T10:41:12.151 INFO:tasks.workunit.client.0.smithi060.stdout:4/916: sync 2024-09-21T10:41:12.151 INFO:tasks.workunit.client.0.smithi060.stdout:1/897: sync 2024-09-21T10:41:12.151 INFO:tasks.workunit.client.0.smithi060.stdout:1/898: chown d6/l9 75 1 2024-09-21T10:41:12.152 INFO:tasks.workunit.client.0.smithi060.stdout:7/937: sync 2024-09-21T10:41:12.152 INFO:tasks.workunit.client.0.smithi060.stdout:1/899: creat d6/d24/da/d45/d76/f141 x:0 0 0 2024-09-21T10:41:12.153 INFO:tasks.workunit.client.0.smithi060.stdout:2/815: dread d3/d79/db4/d43/d62/f70 [0,4194304] 0 2024-09-21T10:41:12.153 INFO:tasks.workunit.client.0.smithi060.stdout:2/816: readlink d3/d7/d24/l60 0 2024-09-21T10:41:12.155 INFO:tasks.workunit.client.0.smithi060.stdout:1/900: creat d6/d24/da/db/d79/d86/d9f/dcd/d128/f142 x:0 0 0 2024-09-21T10:41:12.156 INFO:tasks.workunit.client.0.smithi060.stdout:1/901: dread - d6/d24/da/dea/d102/f11c zero size 2024-09-21T10:41:12.156 INFO:tasks.workunit.client.0.smithi060.stdout:1/902: dread - d6/d24/da/dea/dd8/f13b zero size 2024-09-21T10:41:12.159 INFO:tasks.workunit.client.0.smithi060.stdout:7/938: rename da/d14/c74 to da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d11e/c139 0 2024-09-21T10:41:12.159 INFO:tasks.workunit.client.0.smithi060.stdout:7/939: readlink da/d60/d6e/l7f 0 2024-09-21T10:41:12.160 INFO:tasks.workunit.client.0.smithi060.stdout:9/882: truncate d3/f89 3760007 0 2024-09-21T10:41:12.163 INFO:tasks.workunit.client.0.smithi060.stdout:2/817: mknod d3/d79/db4/d6a/d9a/c114 0 2024-09-21T10:41:12.167 INFO:tasks.workunit.client.0.smithi060.stdout:1/903: rename d6/dd3/fd5 to d6/d24/da/dea/d102/d135/d138/f143 0 2024-09-21T10:41:12.167 INFO:tasks.workunit.client.0.smithi060.stdout:1/904: chown d6/d24/da/db/f29 24021678 1 2024-09-21T10:41:12.167 INFO:tasks.workunit.client.0.smithi060.stdout:1/905: chown d6/d24/da/db/d1c/f36 23 1 2024-09-21T10:41:12.169 INFO:tasks.workunit.client.0.smithi060.stdout:2/818: dread f2 [0,4194304] 0 2024-09-21T10:41:12.171 INFO:tasks.workunit.client.0.smithi060.stdout:9/883: truncate d3/d16/f44 1571803 0 2024-09-21T10:41:12.171 INFO:tasks.workunit.client.0.smithi060.stdout:2/819: dread d3/d79/db4/d43/f67 [0,4194304] 0 2024-09-21T10:41:12.171 INFO:tasks.workunit.client.0.smithi060.stdout:4/917: dwrite d0/d8b/dd8/d10f/d6b/d32/dd6/ff6 [0,4194304] 0 2024-09-21T10:41:12.173 INFO:tasks.workunit.client.0.smithi060.stdout:1/906: mknod d6/d24/da/d45/d47/c144 0 2024-09-21T10:41:12.173 INFO:tasks.workunit.client.0.smithi060.stdout:1/907: stat d6/d24/da/db/d79/d86/d9f/dcd/d128/c140 0 2024-09-21T10:41:12.175 INFO:tasks.workunit.client.0.smithi060.stdout:9/884: mkdir d3/d16/d42/d7e/d105/d10b/dfa/dff/d10a/d120 0 2024-09-21T10:41:12.175 INFO:tasks.workunit.client.0.smithi060.stdout:7/940: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/df9/f10e [0,4194304] 0 2024-09-21T10:41:12.181 INFO:tasks.workunit.client.0.smithi060.stdout:4/918: mkdir d0/d8b/dd8/d10f/d140 0 2024-09-21T10:41:12.182 INFO:tasks.workunit.client.0.smithi060.stdout:1/908: link d6/d24/da/db/de/d32/l41 d6/d24/da/db/d79/d86/d9f/daa/de5/d13f/l145 0 2024-09-21T10:41:12.187 INFO:tasks.workunit.client.0.smithi060.stdout:2/820: dwrite d3/d20/d15/d3b/ffd [0,4194304] 0 2024-09-21T10:41:12.190 INFO:tasks.workunit.client.0.smithi060.stdout:7/941: rename da/d60/de4/de9/lf8 to da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/l13a 0 2024-09-21T10:41:12.192 INFO:tasks.workunit.client.0.smithi060.stdout:4/919: mkdir d0/d8b/dd8/d10f/d6b/d65/d51/d128/d141 0 2024-09-21T10:41:12.192 INFO:tasks.workunit.client.0.smithi060.stdout:4/920: stat d0/d8b/dd8/d10f 0 2024-09-21T10:41:12.193 INFO:tasks.workunit.client.0.smithi060.stdout:9/885: dread d3/fe [0,4194304] 0 2024-09-21T10:41:12.197 INFO:tasks.workunit.client.0.smithi060.stdout:2/821: truncate d3/d7/de9/fe5 3840520 0 2024-09-21T10:41:12.197 INFO:tasks.workunit.client.0.smithi060.stdout:1/909: dwrite d6/d24/da/dea/d102/d135/f11b [0,4194304] 0 2024-09-21T10:41:12.198 INFO:tasks.workunit.client.0.smithi060.stdout:7/942: unlink da/d14/lb8 0 2024-09-21T10:41:12.202 INFO:tasks.workunit.client.0.smithi060.stdout:4/921: symlink d0/d5/d12/d3d/l142 0 2024-09-21T10:41:12.203 INFO:tasks.workunit.client.0.smithi060.stdout:9/886: creat d3/d5e/db8/f121 x:0 0 0 2024-09-21T10:41:12.203 INFO:tasks.workunit.client.0.smithi060.stdout:9/887: truncate d3/d15/d5a/d64/d9e/daf/fcc 60554 0 2024-09-21T10:41:12.206 INFO:tasks.workunit.client.0.smithi060.stdout:2/822: write d3/d7/d23/f5a [112986,75237] 0 2024-09-21T10:41:12.207 INFO:tasks.workunit.client.0.smithi060.stdout:1/910: unlink d6/d24/da/db/d79/d86/fa0 0 2024-09-21T10:41:12.207 INFO:tasks.workunit.client.0.smithi060.stdout:1/911: fdatasync d6/d24/da/db/de/d32/f123 0 2024-09-21T10:41:12.208 INFO:tasks.workunit.client.0.smithi060.stdout:7/943: truncate da/d60/d6e/dd5/fde 4222224 0 2024-09-21T10:41:12.208 INFO:tasks.workunit.client.0.smithi060.stdout:7/944: stat da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/f106 0 2024-09-21T10:41:12.210 INFO:tasks.workunit.client.0.smithi060.stdout:1/912: mknod d6/d24/da/db/d7e/c146 0 2024-09-21T10:41:12.213 INFO:tasks.workunit.client.0.smithi060.stdout:7/945: symlink da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d11e/l13b 0 2024-09-21T10:41:12.213 INFO:tasks.workunit.client.0.smithi060.stdout:7/946: truncate da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/fe0 1253426 0 2024-09-21T10:41:12.216 INFO:tasks.workunit.client.0.smithi060.stdout:7/947: link da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/c8c da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/c13c 0 2024-09-21T10:41:12.217 INFO:tasks.workunit.client.0.smithi060.stdout:2/823: rename d3/d7/d24/d33/df5 to d3/d79/db4/d5c/d115 0 2024-09-21T10:41:12.218 INFO:tasks.workunit.client.0.smithi060.stdout:1/913: getdents d6/d24/da/db/d79/d86/d9f/dcd/d128 0 2024-09-21T10:41:12.218 INFO:tasks.workunit.client.0.smithi060.stdout:1/914: fsync d6/d4a/d5a/db0/f8f 0 2024-09-21T10:41:12.220 INFO:tasks.workunit.client.0.smithi060.stdout:7/948: creat da/d14/f13d x:0 0 0 2024-09-21T10:41:12.220 INFO:tasks.workunit.client.0.smithi060.stdout:4/922: dwrite d0/d5/d3a/ff4 [0,4194304] 0 2024-09-21T10:41:12.225 INFO:tasks.workunit.client.0.smithi060.stdout:2/824: dread d3/d79/db4/d5c/f76 [0,4194304] 0 2024-09-21T10:41:12.228 INFO:tasks.workunit.client.0.smithi060.stdout:7/949: mkdir da/d60/d6e/dd5/d10b/d79/db0/df0/d13e 0 2024-09-21T10:41:12.228 INFO:tasks.workunit.client.0.smithi060.stdout:4/923: read d0/d8b/dd8/d10f/d6b/f2f [3584673,85223] 0 2024-09-21T10:41:12.228 INFO:tasks.workunit.client.0.smithi060.stdout:4/924: fdatasync d0/df/d84/f12d 0 2024-09-21T10:41:12.228 INFO:tasks.workunit.client.0.smithi060.stdout:4/925: write d0/d8b/dd8/d10f/d6b/d32/f7e [2167604,48513] 0 2024-09-21T10:41:12.231 INFO:tasks.workunit.client.0.smithi060.stdout:2/825: mknod d3/d79/db4/d8b/d69/d83/da8/c116 0 2024-09-21T10:41:12.234 INFO:tasks.workunit.client.0.smithi060.stdout:4/926: creat d0/df/d88/f143 x:0 0 0 2024-09-21T10:41:12.235 INFO:tasks.workunit.client.0.smithi060.stdout:2/826: rename d3/d7/d18/c59 to d3/d79/db4/db9/c117 0 2024-09-21T10:41:12.235 INFO:tasks.workunit.client.0.smithi060.stdout:2/827: chown d3/d79/db4/d43/c7e 442 1 2024-09-21T10:41:12.237 INFO:tasks.workunit.client.0.smithi060.stdout:4/927: mknod d0/df/c144 0 2024-09-21T10:41:12.237 INFO:tasks.workunit.client.0.smithi060.stdout:4/928: fdatasync d0/d5/d12/d15/d4d/f115 0 2024-09-21T10:41:12.238 INFO:tasks.workunit.client.0.smithi060.stdout:4/929: chown d0/ccf 221495720 1 2024-09-21T10:41:12.238 INFO:tasks.workunit.client.0.smithi060.stdout:4/930: fdatasync d0/d8b/dd8/d10f/d6b/d32/dd6/f10b 0 2024-09-21T10:41:12.238 INFO:tasks.workunit.client.0.smithi060.stdout:4/931: rmdir d0/d8b/dd8/d10f/d6b/d32/d57 39 2024-09-21T10:41:12.238 INFO:tasks.workunit.client.0.smithi060.stdout:2/828: dread d3/d7/f6d [0,4194304] 0 2024-09-21T10:41:12.242 INFO:tasks.workunit.client.0.smithi060.stdout:4/932: creat d0/d8b/dd8/d10f/d6b/d32/dd6/f145 x:0 0 0 2024-09-21T10:41:12.242 INFO:tasks.workunit.client.0.smithi060.stdout:2/829: mkdir d3/d79/db4/d8b/d69/d83/d118 0 2024-09-21T10:41:12.243 INFO:tasks.workunit.client.0.smithi060.stdout:4/933: write d0/d5/d12/d3d/dd5/fef [425831,43532] 0 2024-09-21T10:41:12.243 INFO:tasks.workunit.client.0.smithi060.stdout:2/830: mkdir d3/d7/d24/d33/d119 0 2024-09-21T10:41:12.273 INFO:tasks.workunit.client.0.smithi060.stdout:7/950: dwrite da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/faf [0,4194304] 0 2024-09-21T10:41:12.274 INFO:tasks.workunit.client.0.smithi060.stdout:7/951: read da/d60/d6e/dd5/d10b/d79/f100 [1680189,108075] 0 2024-09-21T10:41:12.274 INFO:tasks.workunit.client.0.smithi060.stdout:2/831: dwrite d3/d79/db4/d6a/fc6 [0,4194304] 0 2024-09-21T10:41:12.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/934: dwrite d0/d5/f5a [4194304,4194304] 0 2024-09-21T10:41:12.274 INFO:tasks.workunit.client.0.smithi060.stdout:4/935: write d0/d5/d12/d3d/dd5/fef [540043,108212] 0 2024-09-21T10:41:12.277 INFO:tasks.workunit.client.0.smithi060.stdout:7/952: mkdir da/d60/d6e/d13f 0 2024-09-21T10:41:12.278 INFO:tasks.workunit.client.0.smithi060.stdout:2/832: stat d3/d79/ld6 0 2024-09-21T10:41:12.278 INFO:tasks.workunit.client.0.smithi060.stdout:2/833: stat d3/d7/d23/f2f 0 2024-09-21T10:41:12.278 INFO:tasks.workunit.client.0.smithi060.stdout:2/834: creat d3/d20/d15/d4c/d82/f11a x:0 0 0 2024-09-21T10:41:12.280 INFO:tasks.workunit.client.0.smithi060.stdout:4/936: link d0/d83/f9f d0/d5/d12/d15/d72/f146 0 2024-09-21T10:41:12.282 INFO:tasks.workunit.client.0.smithi060.stdout:7/953: rename da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d11e/l13b to da/d14/l140 0 2024-09-21T10:41:12.282 INFO:tasks.workunit.client.0.smithi060.stdout:7/954: fdatasync da/d60/d6e/dd5/d10b/f136 0 2024-09-21T10:41:12.283 INFO:tasks.workunit.client.0.smithi060.stdout:7/955: write da/d60/d6e/dd5/d10b/d79/db0/dd7/d8b/da7/dcd/d49/d27/fae [4633545,112930] 0 2024-09-21T10:41:12.296 INFO:tasks.workunit.client.0.smithi060.stdout:4/937: dwrite d0/df/d88/ff5 [0,4194304] 0 2024-09-21T10:41:12.297 INFO:tasks.workunit.client.0.smithi060.stdout:7/956: rename da/d60/d6e/dd5/d10b to da/d14/d10a/d112/d141 0 2024-09-21T10:41:12.299 INFO:tasks.workunit.client.0.smithi060.stdout:4/938: rename d0/d5/d12/d3d/dd5/f3b to d0/d59/d9d/f147 0 2024-09-21T10:41:12.303 INFO:tasks.workunit.client.0.smithi060.stdout:4/939: link d0/d5/d12/d15/c1b d0/d5/d12/d15/c148 0 2024-09-21T10:41:12.304 INFO:tasks.workunit.client.0.smithi060.stdout:7/957: dread da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/d49/d27/f12e [0,4194304] 0 2024-09-21T10:41:12.306 INFO:tasks.workunit.client.0.smithi060.stdout:7/958: unlink da/d14/d25/f91 0 2024-09-21T10:41:12.308 INFO:tasks.workunit.client.0.smithi060.stdout:7/959: unlink da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/l55 0 2024-09-21T10:41:12.310 INFO:tasks.workunit.client.0.smithi060.stdout:7/960: mknod da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/d49/c142 0 2024-09-21T10:41:12.325 INFO:tasks.workunit.client.0.smithi060.stdout:4/940: dwrite d0/d3c/dab/d139/f7a [4194304,4194304] 0 2024-09-21T10:41:12.327 INFO:tasks.workunit.client.0.smithi060.stdout:4/941: creat d0/d5/d3a/dbe/f149 x:0 0 0 2024-09-21T10:41:12.328 INFO:tasks.workunit.client.0.smithi060.stdout:4/942: unlink d0/d8b/dd8/f129 0 2024-09-21T10:41:12.329 INFO:tasks.workunit.client.0.smithi060.stdout:4/943: dread d0/d5/d12/d3d/dd5/fba [0,4194304] 0 2024-09-21T10:41:12.338 INFO:tasks.workunit.client.0.smithi060.stdout:4/944: write d0/d5/f36 [151832,44867] 0 2024-09-21T10:41:12.369 INFO:tasks.workunit.client.0.smithi060.stdout:7/961: rename da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/d49 to da/d143 0 2024-09-21T10:41:12.369 INFO:tasks.workunit.client.0.smithi060.stdout:7/962: write da/d143/d2e/f94 [9114865,2325] 0 2024-09-21T10:41:12.369 INFO:tasks.workunit.client.0.smithi060.stdout:7/963: readlink da/d143/d2e/la9 0 2024-09-21T10:41:12.373 INFO:tasks.workunit.client.0.smithi060.stdout:4/945: getdents d0/d8b/dd8 0 2024-09-21T10:41:12.373 INFO:tasks.workunit.client.0.smithi060.stdout:4/946: fsync d0/d3c/dab/d139/fde 0 2024-09-21T10:41:12.375 INFO:tasks.workunit.client.0.smithi060.stdout:7/964: rmdir da/d14/d25 39 2024-09-21T10:41:12.375 INFO:tasks.workunit.client.0.smithi060.stdout:7/965: write da/d60/de4/de9/f117 [569075,24996] 0 2024-09-21T10:41:12.377 INFO:tasks.workunit.client.0.smithi060.stdout:4/947: link d0/d5/l21 d0/d3c/dab/d139/l14a 0 2024-09-21T10:41:12.377 INFO:tasks.workunit.client.0.smithi060.stdout:4/948: chown d0/d8b/dd8/d10f/d6b/d32/d57/c11f 33050169 1 2024-09-21T10:41:12.380 INFO:tasks.workunit.client.0.smithi060.stdout:7/966: getdents da/d14/d10a/d112 0 2024-09-21T10:41:12.382 INFO:tasks.workunit.client.0.smithi060.stdout:4/949: mkdir d0/d5/d12/d3d/d94/d13a/d14b 0 2024-09-21T10:41:12.382 INFO:tasks.workunit.client.0.smithi060.stdout:4/950: stat d0/d8b/dd8/d10f/d6b/d65/d51/l76 0 2024-09-21T10:41:12.382 INFO:tasks.workunit.client.0.smithi060.stdout:4/951: chown d0/d5/d12/d15/d72 3 1 2024-09-21T10:41:12.383 INFO:tasks.workunit.client.0.smithi060.stdout:4/952: truncate d0/d8b/dd8/d10f/d6b/fe5 960233 0 2024-09-21T10:41:12.384 INFO:tasks.workunit.client.0.smithi060.stdout:7/967: rmdir da/d14/d25 39 2024-09-21T10:41:12.385 INFO:tasks.workunit.client.0.smithi060.stdout:4/953: symlink d0/d8b/l14c 0 2024-09-21T10:41:12.385 INFO:tasks.workunit.client.0.smithi060.stdout:4/954: fsync d0/d5/d3a/dbe/f119 0 2024-09-21T10:41:12.387 INFO:tasks.workunit.client.0.smithi060.stdout:7/968: rmdir da/d60/d6e/d13f 0 2024-09-21T10:41:12.388 INFO:tasks.workunit.client.0.smithi060.stdout:4/955: symlink d0/d5/d12/d3d/dd5/d11c/l14d 0 2024-09-21T10:41:12.391 INFO:tasks.workunit.client.0.smithi060.stdout:7/969: symlink da/d14/d10a/d112/d141/d79/db0/dd7/d8b/d118/l144 0 2024-09-21T10:41:12.393 INFO:tasks.workunit.client.0.smithi060.stdout:7/970: getdents da/d143 0 2024-09-21T10:41:12.395 INFO:tasks.workunit.client.0.smithi060.stdout:7/971: symlink da/d60/de4/l145 0 2024-09-21T10:41:12.395 INFO:tasks.workunit.client.0.smithi060.stdout:7/972: fsync da/d14/d25/d56/fdb 0 2024-09-21T10:41:12.398 INFO:tasks.workunit.client.0.smithi060.stdout:4/956: dread d0/d59/f5c [0,4194304] 0 2024-09-21T10:41:12.399 INFO:tasks.workunit.client.0.smithi060.stdout:4/957: creat d0/d5/d12/d15/f14e x:0 0 0 2024-09-21T10:41:12.399 INFO:tasks.workunit.client.0.smithi060.stdout:4/958: creat d0/d8b/dd8/d10f/d6b/d32/dd6/f14f x:0 0 0 2024-09-21T10:41:12.402 INFO:tasks.workunit.client.0.smithi060.stdout:4/959: mkdir d0/d150 0 2024-09-21T10:41:12.402 INFO:tasks.workunit.client.0.smithi060.stdout:4/960: write d0/d8b/dd8/d10f/d6b/d32/dd6/f10b [303543,50853] 0 2024-09-21T10:41:12.403 INFO:tasks.workunit.client.0.smithi060.stdout:4/961: symlink d0/d5/d12/d3d/d94/l151 0 2024-09-21T10:41:12.404 INFO:tasks.workunit.client.0.smithi060.stdout:4/962: readlink d0/d8b/dd8/d10f/d6b/d65/l12f 0 2024-09-21T10:41:12.419 INFO:tasks.workunit.client.0.smithi060.stdout:7/973: dwrite da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/f81 [0,4194304] 0 2024-09-21T10:41:12.419 INFO:tasks.workunit.client.0.smithi060.stdout:4/963: dwrite d0/d5/f4b [0,4194304] 0 2024-09-21T10:41:12.420 INFO:tasks.workunit.client.0.smithi060.stdout:7/974: symlink da/d60/d6e/dd0/l146 0 2024-09-21T10:41:12.422 INFO:tasks.workunit.client.0.smithi060.stdout:7/975: creat da/d60/d6e/dd5/f147 x:0 0 0 2024-09-21T10:41:12.423 INFO:tasks.workunit.client.0.smithi060.stdout:4/964: getdents d0/d5/d12/d15 0 2024-09-21T10:41:12.425 INFO:tasks.workunit.client.0.smithi060.stdout:7/976: stat da/d14/d10a/d112/d141/d79/c96 0 2024-09-21T10:41:12.425 INFO:tasks.workunit.client.0.smithi060.stdout:7/977: truncate da/d14/fa5 2306681 0 2024-09-21T10:41:12.425 INFO:tasks.workunit.client.0.smithi060.stdout:7/978: truncate da/d143/d27/f12e 4251346 0 2024-09-21T10:41:12.425 INFO:tasks.workunit.client.0.smithi060.stdout:4/965: dread d0/d8b/dd8/d10f/d6b/d65/d51/fcc [0,4194304] 0 2024-09-21T10:41:12.427 INFO:tasks.workunit.client.0.smithi060.stdout:7/979: mknod da/d14/d10a/d112/d141/d79/db0/dd7/de1/c148 0 2024-09-21T10:41:12.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/966: truncate d0/d8b/dd8/d10f/d6b/d65/fd7 2576487 0 2024-09-21T10:41:12.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/967: write d0/d5/d12/d3d/dd5/d11c/f135 [26509,118696] 0 2024-09-21T10:41:12.428 INFO:tasks.workunit.client.0.smithi060.stdout:4/968: fsync d0/d3c/dab/d139/f131 0 2024-09-21T10:41:12.429 INFO:tasks.workunit.client.0.smithi060.stdout:7/980: dread da/d14/d10a/d112/d141/f30 [0,4194304] 0 2024-09-21T10:41:12.430 INFO:tasks.workunit.client.0.smithi060.stdout:7/981: chown da/d14/d10a/d112/d141/d79/db0/df0/d13e 38060 1 2024-09-21T10:41:12.430 INFO:tasks.workunit.client.0.smithi060.stdout:7/982: chown da/d143/ld6 57545982 1 2024-09-21T10:41:12.430 INFO:tasks.workunit.client.0.smithi060.stdout:4/969: rmdir d0/d5/d12/d3d/d94/d13a 39 2024-09-21T10:41:12.431 INFO:tasks.workunit.client.0.smithi060.stdout:7/983: mkdir da/d14/d10a/d112/d141/de7/d135/d149 0 2024-09-21T10:41:12.434 INFO:tasks.workunit.client.0.smithi060.stdout:4/970: rename d0/d8b/dd8/d10f/d6b/l6f to d0/d5/d12/d15/d72/l152 0 2024-09-21T10:41:12.437 INFO:tasks.workunit.client.0.smithi060.stdout:4/971: mknod d0/d3c/dab/c153 0 2024-09-21T10:41:12.439 INFO:tasks.workunit.client.0.smithi060.stdout:4/972: creat d0/d5/d12/d3d/d94/d13a/f154 x:0 0 0 2024-09-21T10:41:12.440 INFO:tasks.workunit.client.0.smithi060.stdout:4/973: creat d0/d5/d12/d15/d4d/d138/f155 x:0 0 0 2024-09-21T10:41:12.446 INFO:tasks.workunit.client.0.smithi060.stdout:4/974: dread d0/d83/fd1 [0,4194304] 0 2024-09-21T10:41:12.448 INFO:tasks.workunit.client.0.smithi060.stdout:7/984: dwrite da/d14/f54 [0,4194304] 0 2024-09-21T10:41:12.452 INFO:tasks.workunit.client.0.smithi060.stdout:7/985: creat da/d60/de4/f14a x:0 0 0 2024-09-21T10:41:12.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/986: dread da/d14/d10a/d112/d141/d79/db0/dd7/f7e [0,4194304] 0 2024-09-21T10:41:12.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/987: readlink da/d14/d10a/d112/d141/l37 0 2024-09-21T10:41:12.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/988: fsync da/d14/d10a/d112/d141/d79/db0/dd7/f9f 0 2024-09-21T10:41:12.455 INFO:tasks.workunit.client.0.smithi060.stdout:7/989: write da/d14/d25/f119 [115255,34772] 0 2024-09-21T10:41:12.462 INFO:tasks.workunit.client.0.smithi060.stdout:4/975: dwrite d0/d5/d12/d15/fc8 [0,4194304] 0 2024-09-21T10:41:12.467 INFO:tasks.workunit.client.0.smithi060.stdout:7/990: truncate da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/f86 2251365 0 2024-09-21T10:41:12.468 INFO:tasks.workunit.client.0.smithi060.stdout:4/976: creat d0/d8b/dd8/d10f/d140/f156 x:0 0 0 2024-09-21T10:41:12.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/991: mkdir da/d60/d6e/dd0/d14b 0 2024-09-21T10:41:12.471 INFO:tasks.workunit.client.0.smithi060.stdout:7/992: fdatasync da/d14/d10a/d112/d141/d32/ff3 0 2024-09-21T10:41:12.472 INFO:tasks.workunit.client.0.smithi060.stdout:7/993: chown da/c10 1431315 1 2024-09-21T10:41:12.472 INFO:tasks.workunit.client.0.smithi060.stdout:7/994: chown da/d14/d10a/d112/d141/d79/db0/dd7/d8b/da7/dcd/l13a 0 1 2024-09-21T10:41:12.472 INFO:tasks.workunit.client.0.smithi060.stdout:7/995: truncate da/d14/f13d 918605 0 2024-09-21T10:41:12.474 INFO:tasks.workunit.client.0.smithi060.stdout:7/996: mkdir da/d14/d10a/d112/d141/d79/db0/dd7/d14c 0 2024-09-21T10:41:12.476 INFO:tasks.workunit.client.0.smithi060.stdout:4/977: dread d0/d3c/f48 [0,4194304] 0 2024-09-21T10:41:12.477 INFO:tasks.workunit.client.0.smithi060.stdout:7/997: getdents da/d60/de4/de9 0 2024-09-21T10:41:12.478 INFO:tasks.workunit.client.0.smithi060.stdout:4/978: mkdir d0/d5/d12/d12e/d157 0 2024-09-21T10:41:12.478 INFO:tasks.workunit.client.0.smithi060.stdout:4/979: fdatasync d0/d8b/dd8/d10f/d6b/d32/dd6/f145 0 2024-09-21T10:41:12.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/998: unlink da/d60/d6e/dd5/fde 0 2024-09-21T10:41:12.481 INFO:tasks.workunit.client.0.smithi060.stdout:7/999: truncate da/d14/d10a/d112/d141/de7/fec 318358 0 2024-09-21T10:41:12.500 INFO:tasks.workunit.client.0.smithi060.stdout:4/980: dwrite d0/d5/f5a [4194304,4194304] 0 2024-09-21T10:41:12.500 INFO:tasks.workunit.client.0.smithi060.stdout:4/981: dread - d0/d3c/dab/d139/ff2 zero size 2024-09-21T10:41:12.500 INFO:tasks.workunit.client.0.smithi060.stdout:4/982: write d0/d5/d12/d15/d72/f146 [5306234,48583] 0 2024-09-21T10:41:12.501 INFO:tasks.workunit.client.0.smithi060.stdout:4/983: unlink d0/d8b/dd8/d10f/d6b/le0 0 2024-09-21T10:41:12.501 INFO:tasks.workunit.client.0.smithi060.stdout:4/984: fdatasync d0/df/d88/f47 0 2024-09-21T10:41:12.503 INFO:tasks.workunit.client.0.smithi060.stdout:4/985: truncate d0/d8b/dd8/d10f/d6b/d65/fd7 995810 0 2024-09-21T10:41:12.504 INFO:tasks.workunit.client.0.smithi060.stdout:4/986: creat d0/d3c/dab/f158 x:0 0 0 2024-09-21T10:41:12.504 INFO:tasks.workunit.client.0.smithi060.stdout:4/987: write d0/d83/dec/f102 [3127883,25812] 0 2024-09-21T10:41:12.505 INFO:tasks.workunit.client.0.smithi060.stdout:4/988: symlink d0/d5/d12/d3d/d94/d13a/d14b/l159 0 2024-09-21T10:41:12.507 INFO:tasks.workunit.client.0.smithi060.stdout:4/989: rename d0/d5/d12/d3d/d94/f110 to d0/d5/d3a/dbe/f15a 0 2024-09-21T10:41:12.507 INFO:tasks.workunit.client.0.smithi060.stdout:4/990: creat d0/d5/d12/d3d/dd5/f15b x:0 0 0 2024-09-21T10:41:12.508 INFO:tasks.workunit.client.0.smithi060.stdout:4/991: dread d0/d5/d12/d3d/dd5/f98 [0,4194304] 0 2024-09-21T10:41:12.517 INFO:tasks.workunit.client.0.smithi060.stdout:4/992: write d0/d8b/dd8/d10f/d6b/f22 [8060410,114444] 0 2024-09-21T10:41:12.518 INFO:tasks.workunit.client.0.smithi060.stdout:4/993: truncate d0/d8b/dd8/d10f/d6b/d65/d51/f100 549453 0 2024-09-21T10:41:12.526 INFO:tasks.workunit.client.0.smithi060.stdout:4/994: dread d0/d8b/dd8/d10f/d6b/f2f [0,4194304] 0 2024-09-21T10:41:12.526 INFO:tasks.workunit.client.0.smithi060.stdout:4/995: write d0/df/d9c/f109 [1510853,96185] 0 2024-09-21T10:41:12.527 INFO:tasks.workunit.client.0.smithi060.stdout:4/996: dread - d0/d5/d12/d3d/dd5/f111 zero size 2024-09-21T10:41:12.527 INFO:tasks.workunit.client.0.smithi060.stdout:4/997: stat d0/df/d88/l58 0 2024-09-21T10:41:12.529 INFO:tasks.workunit.client.0.smithi060.stdout:9/888: sync 2024-09-21T10:41:12.529 INFO:tasks.workunit.client.0.smithi060.stdout:1/915: sync 2024-09-21T10:41:12.529 INFO:tasks.workunit.client.0.smithi060.stdout:9/889: truncate d3/d15/fee 1314369 0 2024-09-21T10:41:12.531 INFO:tasks.workunit.client.0.smithi060.stdout:4/998: creat d0/d8b/dd8/d10f/d6b/d65/d51/d128/f15c x:0 0 0 2024-09-21T10:41:12.531 INFO:tasks.workunit.client.0.smithi060.stdout:4/999: creat d0/d5/d12/d3d/f15d x:0 0 0 2024-09-21T10:41:12.533 INFO:tasks.workunit.client.0.smithi060.stdout:9/890: mknod d3/d15/d5a/d64/c122 0 2024-09-21T10:41:12.536 INFO:tasks.workunit.client.0.smithi060.stdout:1/916: dread d6/d4a/d5a/db0/f78 [0,4194304] 0 2024-09-21T10:41:12.540 INFO:tasks.workunit.client.0.smithi060.stdout:9/891: dread d3/d16/fb9 [0,4194304] 0 2024-09-21T10:41:12.541 INFO:tasks.workunit.client.0.smithi060.stdout:9/892: rename d3/d16/d95/df9 to d3/d16/d7f/d123 0 2024-09-21T10:41:12.543 INFO:tasks.workunit.client.0.smithi060.stdout:9/893: creat d3/d15/f124 x:0 0 0 2024-09-21T10:41:12.545 INFO:tasks.workunit.client.0.smithi060.stdout:1/917: read d6/d24/da/db/dd/f92 [366419,67860] 0 2024-09-21T10:41:12.546 INFO:tasks.workunit.client.0.smithi060.stdout:1/918: dread d6/f40 [0,4194304] 0 2024-09-21T10:41:12.548 INFO:tasks.workunit.client.0.smithi060.stdout:1/919: truncate d6/d24/da/db/f12d 130653 0 2024-09-21T10:41:12.558 INFO:tasks.workunit.client.0.smithi060.stdout:9/894: write d3/fc [587444,62964] 0 2024-09-21T10:41:12.558 INFO:tasks.workunit.client.0.smithi060.stdout:9/895: readlink d3/d16/d42/l80 0 2024-09-21T10:41:12.560 INFO:tasks.workunit.client.0.smithi060.stdout:9/896: symlink d3/d16/d42/d7e/d105/d10b/dfa/l125 0 2024-09-21T10:41:12.561 INFO:tasks.workunit.client.0.smithi060.stdout:9/897: mkdir d3/d16/d1a/d71/d126 0 2024-09-21T10:41:12.562 INFO:tasks.workunit.client.0.smithi060.stdout:9/898: chown d3/c8a 145373 1 2024-09-21T10:41:12.562 INFO:tasks.workunit.client.0.smithi060.stdout:9/899: creat d3/d15/f127 x:0 0 0 2024-09-21T10:41:12.562 INFO:tasks.workunit.client.0.smithi060.stdout:9/900: chown d3/d16/d42/d7e/d85/d8f/d106/l103 114 1 2024-09-21T10:41:12.568 INFO:tasks.workunit.client.0.smithi060.stdout:1/920: dwrite d6/d24/da/db/de/f2e [0,4194304] 0 2024-09-21T10:41:12.569 INFO:tasks.workunit.client.0.smithi060.stdout:1/921: chown d6/d24/da/db/d7e/c146 1271752 1 2024-09-21T10:41:12.577 INFO:tasks.workunit.client.0.smithi060.stdout:1/922: write d6/d24/da/db/d7e/d90/f107 [7710665,31643] 0 2024-09-21T10:41:12.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/901: dwrite d3/d16/d1f/ff7 [0,4194304] 0 2024-09-21T10:41:12.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/902: creat d3/d16/d1a/d71/f128 x:0 0 0 2024-09-21T10:41:12.577 INFO:tasks.workunit.client.0.smithi060.stdout:9/903: creat d3/d5e/d60/d2f/f129 x:0 0 0 2024-09-21T10:41:12.578 INFO:tasks.workunit.client.0.smithi060.stdout:1/923: unlink d6/d24/da/db/d79/lf0 0 2024-09-21T10:41:12.578 INFO:tasks.workunit.client.0.smithi060.stdout:1/924: truncate d6/d4a/d5a/db0/f8f 1058325 0 2024-09-21T10:41:12.579 INFO:tasks.workunit.client.0.smithi060.stdout:1/925: fsync d6/d4a/fa8 0 2024-09-21T10:41:12.585 INFO:tasks.workunit.client.0.smithi060.stdout:9/904: rename d3/d16/d42/d7e/d85/d8f to d3/d15/d53/d12a 0 2024-09-21T10:41:12.586 INFO:tasks.workunit.client.0.smithi060.stdout:9/905: write d3/d16/d42/d7e/fa1 [330418,80695] 0 2024-09-21T10:41:12.607 INFO:tasks.workunit.client.0.smithi060.stdout:1/926: dwrite d6/d24/da/db/de/f77 [0,4194304] 0 2024-09-21T10:41:12.607 INFO:tasks.workunit.client.0.smithi060.stdout:9/906: dwrite d3/d16/d42/d7e/fa1 [0,4194304] 0 2024-09-21T10:41:12.607 INFO:tasks.workunit.client.0.smithi060.stdout:9/907: fsync d3/d15/d58/f7c 0 2024-09-21T10:41:12.607 INFO:tasks.workunit.client.0.smithi060.stdout:9/908: creat d3/d15/d58/f12b x:0 0 0 2024-09-21T10:41:12.607 INFO:tasks.workunit.client.0.smithi060.stdout:9/909: chown d3/d16/d7f/fba 30878529 1 2024-09-21T10:41:12.609 INFO:tasks.workunit.client.0.smithi060.stdout:1/927: mkdir d6/d24/da/db/de/d119/d147 0 2024-09-21T10:41:12.611 INFO:tasks.workunit.client.0.smithi060.stdout:9/910: unlink d3/d15/d53/d12a/d106/fc6 0 2024-09-21T10:41:12.614 INFO:tasks.workunit.client.0.smithi060.stdout:9/911: rename d3/cd to d3/d16/d42/d7e/c12c 0 2024-09-21T10:41:12.616 INFO:tasks.workunit.client.0.smithi060.stdout:9/912: rmdir d3/d15/d53/d12a/d106 39 2024-09-21T10:41:12.617 INFO:tasks.workunit.client.0.smithi060.stdout:9/913: readlink d3/l90 0 2024-09-21T10:41:12.617 INFO:tasks.workunit.client.0.smithi060.stdout:9/914: chown d3/d5e/d60/f25 12311557 1 2024-09-21T10:41:12.617 INFO:tasks.workunit.client.0.smithi060.stdout:9/915: write d3/d5e/d60/d2f/f31 [1668986,25964] 0 2024-09-21T10:41:12.617 INFO:tasks.workunit.client.0.smithi060.stdout:9/916: truncate d3/d16/d42/d7e/f81 177545 0 2024-09-21T10:41:12.617 INFO:tasks.workunit.client.0.smithi060.stdout:9/917: chown d3/f9 764436 1 2024-09-21T10:41:12.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/918: creat d3/d16/d42/d7e/d105/d10b/dfa/dff/d10a/f12d x:0 0 0 2024-09-21T10:41:12.619 INFO:tasks.workunit.client.0.smithi060.stdout:9/919: rmdir d3/d15/d53/dc8 39 2024-09-21T10:41:12.621 INFO:tasks.workunit.client.0.smithi060.stdout:9/920: mkdir d3/d16/d42/d7e/d85/d12e 0 2024-09-21T10:41:12.621 INFO:tasks.workunit.client.0.smithi060.stdout:9/921: write d3/d16/d1a/d109/f11c [697103,78075] 0 2024-09-21T10:41:12.621 INFO:tasks.workunit.client.0.smithi060.stdout:9/922: dread - d3/d16/d5f/ff3 zero size 2024-09-21T10:41:12.621 INFO:tasks.workunit.client.0.smithi060.stdout:9/923: fdatasync d3/d16/fb9 0 2024-09-21T10:41:12.621 INFO:tasks.workunit.client.0.smithi060.stdout:9/924: write d3/d15/f124 [41197,113407] 0 2024-09-21T10:41:12.622 INFO:tasks.workunit.client.0.smithi060.stdout:9/925: creat d3/d16/d9c/f12f x:0 0 0 2024-09-21T10:41:12.622 INFO:tasks.workunit.client.0.smithi060.stdout:9/926: getdents d3/d15/d53/dc8/dde 0 2024-09-21T10:41:12.623 INFO:tasks.workunit.client.0.smithi060.stdout:1/928: dwrite d6/d24/da/ffa [0,4194304] 0 2024-09-21T10:41:12.624 INFO:tasks.workunit.client.0.smithi060.stdout:9/927: symlink d3/d16/d1a/d71/d126/l130 0 2024-09-21T10:41:12.624 INFO:tasks.workunit.client.0.smithi060.stdout:1/929: dread d6/d4a/d5a/db0/fac [0,4194304] 0 2024-09-21T10:41:12.625 INFO:tasks.workunit.client.0.smithi060.stdout:2/835: sync 2024-09-21T10:41:12.629 INFO:tasks.workunit.client.0.smithi060.stdout:9/928: mkdir d3/d16/d1f/d115/d131 0 2024-09-21T10:41:12.630 INFO:tasks.workunit.client.0.smithi060.stdout:1/930: symlink d6/d24/da/dea/d102/d135/l148 0 2024-09-21T10:41:12.634 INFO:tasks.workunit.client.0.smithi060.stdout:9/929: creat d3/d15/d53/d12a/d106/f132 x:0 0 0 2024-09-21T10:41:12.636 INFO:tasks.workunit.client.0.smithi060.stdout:1/931: creat d6/d24/da/db/d79/d86/d9f/daa/f149 x:0 0 0 2024-09-21T10:41:12.636 INFO:tasks.workunit.client.0.smithi060.stdout:1/932: creat d6/d24/da/db/d79/f14a x:0 0 0 2024-09-21T10:41:12.636 INFO:tasks.workunit.client.0.smithi060.stdout:1/933: fdatasync d6/d24/da/db/d79/d86/d9f/fec 0 2024-09-21T10:41:12.638 INFO:tasks.workunit.client.0.smithi060.stdout:1/934: unlink d6/d24/da/db/de/c22 0 2024-09-21T10:41:12.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/930: dread d3/d5e/f66 [0,4194304] 0 2024-09-21T10:41:12.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/931: readlink d3/d16/d42/d7e/d85/lc3 0 2024-09-21T10:41:12.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/932: fsync d3/d16/d42/f9f 0 2024-09-21T10:41:12.643 INFO:tasks.workunit.client.0.smithi060.stdout:9/933: write d3/d16/d42/d7e/d105/d10b/dfa/f101 [435506,75042] 0 2024-09-21T10:41:12.647 INFO:tasks.workunit.client.0.smithi060.stdout:9/934: rmdir d3/d15 39 2024-09-21T10:41:12.651 INFO:tasks.workunit.client.0.smithi060.stdout:9/935: dread d3/d16/d42/d7e/d105/d10b/dfa/f101 [0,4194304] 0 2024-09-21T10:41:12.660 INFO:tasks.workunit.client.0.smithi060.stdout:9/936: dread d3/d15/d78/fe4 [0,4194304] 0 2024-09-21T10:41:12.676 INFO:tasks.workunit.client.0.smithi060.stdout:9/937: dwrite d3/d16/d42/d7e/f11a [0,4194304] 0 2024-09-21T10:41:12.681 INFO:tasks.workunit.client.0.smithi060.stdout:9/938: write d3/d15/d78/fe4 [251072,59700] 0 2024-09-21T10:41:12.681 INFO:tasks.workunit.client.0.smithi060.stdout:9/939: chown d3/d16/d1a/f72 23210135 1 2024-09-21T10:41:12.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/940: dread d3/d5e/d60/d2f/f50 [0,4194304] 0 2024-09-21T10:41:12.688 INFO:tasks.workunit.client.0.smithi060.stdout:9/941: chown d3/d16/d1a/c43 1025 1 2024-09-21T10:41:12.689 INFO:tasks.workunit.client.0.smithi060.stdout:9/942: symlink d3/d15/d5a/dc7/l133 0 2024-09-21T10:41:12.691 INFO:tasks.workunit.client.0.smithi060.stdout:9/943: symlink d3/d16/d95/d11b/l134 0 2024-09-21T10:41:12.696 INFO:tasks.workunit.client.0.smithi060.stdout:9/944: dread d3/d16/fb9 [0,4194304] 0 2024-09-21T10:41:12.698 INFO:tasks.workunit.client.0.smithi060.stdout:9/945: rmdir d3/d16/d1f 39 2024-09-21T10:41:12.698 INFO:tasks.workunit.client.0.smithi060.stdout:9/946: chown d3/d5e/d60/f91 1657794343 1 2024-09-21T10:41:12.699 INFO:tasks.workunit.client.0.smithi060.stdout:9/947: creat d3/d16/d42/d7e/d85/dd6/f135 x:0 0 0 2024-09-21T10:41:12.705 INFO:tasks.workunit.client.0.smithi060.stdout:9/948: write d3/f9 [2009914,109400] 0 2024-09-21T10:41:12.705 INFO:tasks.workunit.client.0.smithi060.stdout:9/949: write d3/d16/d5f/ff3 [536352,93047] 0 2024-09-21T10:41:12.715 INFO:tasks.workunit.client.0.smithi060.stdout:9/950: creat d3/d5e/f136 x:0 0 0 2024-09-21T10:41:12.716 INFO:tasks.workunit.client.0.smithi060.stdout:9/951: unlink d3/d15/d5a/d64/f99 0 2024-09-21T10:41:12.717 INFO:tasks.workunit.client.0.smithi060.stdout:9/952: symlink d3/d15/d5a/l137 0 2024-09-21T10:41:12.718 INFO:tasks.workunit.client.0.smithi060.stdout:9/953: chown d3/d16/d1a/d71/d126/l130 239297 1 2024-09-21T10:41:12.719 INFO:tasks.workunit.client.0.smithi060.stdout:9/954: mkdir d3/d16/d42/d7e/d105/d10b/dfa/dff/d10a/d120/d138 0 2024-09-21T10:41:12.728 INFO:tasks.workunit.client.0.smithi060.stdout:9/955: dread d3/d16/d42/d7e/fa1 [0,4194304] 0 2024-09-21T10:41:12.729 INFO:tasks.workunit.client.0.smithi060.stdout:9/956: stat d3/f10 0 2024-09-21T10:41:12.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/957: creat d3/d16/d1a/d71/d126/f139 x:0 0 0 2024-09-21T10:41:12.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/958: truncate d3/d16/f4b 4352818 0 2024-09-21T10:41:12.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/959: readlink d3/d16/d42/l80 0 2024-09-21T10:41:12.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/960: chown d3/fe 9612 1 2024-09-21T10:41:12.731 INFO:tasks.workunit.client.0.smithi060.stdout:9/961: chown d3/d15/d53/d12a/ca2 29799 1 2024-09-21T10:41:12.732 INFO:tasks.workunit.client.0.smithi060.stdout:9/962: mknod d3/d16/d5f/c13a 0 2024-09-21T10:41:12.734 INFO:tasks.workunit.client.0.smithi060.stdout:9/963: dread d3/d15/d53/f74 [0,4194304] 0 2024-09-21T10:41:12.735 INFO:tasks.workunit.client.0.smithi060.stdout:9/964: mkdir d3/d16/d42/d7e/d105/d13b 0 2024-09-21T10:41:12.735 INFO:tasks.workunit.client.0.smithi060.stdout:9/965: creat d3/d5e/db8/f13c x:0 0 0 2024-09-21T10:41:12.737 INFO:tasks.workunit.client.0.smithi060.stdout:9/966: stat d3/f47 0 2024-09-21T10:41:12.753 INFO:tasks.workunit.client.0.smithi060.stdout:9/967: dwrite d3/d16/d42/d7e/f94 [0,4194304] 0 2024-09-21T10:41:12.753 INFO:tasks.workunit.client.0.smithi060.stdout:9/968: fsync d3/d5e/f6a 0 2024-09-21T10:41:12.764 INFO:tasks.workunit.client.0.smithi060.stdout:9/969: write d3/d16/d5f/fbb [2493298,74295] 0 2024-09-21T10:41:12.775 INFO:tasks.workunit.client.0.smithi060.stdout:9/970: creat d3/d15/d5a/dc7/f13d x:0 0 0 2024-09-21T10:41:12.775 INFO:tasks.workunit.client.0.smithi060.stdout:9/971: truncate d3/d16/d5f/f84 5212605 0 2024-09-21T10:41:12.778 INFO:tasks.workunit.client.0.smithi060.stdout:9/972: mknod d3/d16/d42/d7e/d105/d10b/c13e 0 2024-09-21T10:41:12.797 INFO:tasks.workunit.client.0.smithi060.stdout:9/973: dwrite d3/d5e/f82 [0,4194304] 0 2024-09-21T10:41:12.797 INFO:tasks.workunit.client.0.smithi060.stdout:9/974: write d3/d16/d1a/d109/f11c [1089276,100180] 0 2024-09-21T10:41:12.800 INFO:tasks.workunit.client.0.smithi060.stdout:9/975: rename d3/d16/d7f/c10d to d3/d15/d92/c13f 0 2024-09-21T10:41:12.803 INFO:tasks.workunit.client.0.smithi060.stdout:9/976: rename d3/d16/d42/c55 to d3/d16/d5f/d114/c140 0 2024-09-21T10:41:12.803 INFO:tasks.workunit.client.0.smithi060.stdout:9/977: chown d3/d15/d53/dc8 169356 1 2024-09-21T10:41:12.804 INFO:tasks.workunit.client.0.smithi060.stdout:9/978: creat d3/d16/d42/d7e/d105/d10b/dfa/dff/d10a/f141 x:0 0 0 2024-09-21T10:41:12.804 INFO:tasks.workunit.client.0.smithi060.stdout:9/979: read - d3/fb7 zero size 2024-09-21T10:41:12.805 INFO:tasks.workunit.client.0.smithi060.stdout:9/980: dread d3/d15/d5a/d64/fae [0,4194304] 0 2024-09-21T10:41:12.817 INFO:tasks.workunit.client.0.smithi060.stdout:9/981: dread d3/d15/d53/dc8/fe7 [0,4194304] 0 2024-09-21T10:41:12.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/982: rename d3/l7 to d3/d16/d42/d7e/d85/l142 0 2024-09-21T10:41:12.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/983: readlink d3/d5e/d60/d2f/la7 0 2024-09-21T10:41:12.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/984: dread d3/d5e/d60/f8e [0,4194304] 0 2024-09-21T10:41:12.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/985: readlink d3/d15/d53/dc8/dde/l110 0 2024-09-21T10:41:12.827 INFO:tasks.workunit.client.0.smithi060.stdout:9/986: chown d3/fb7 0 1 2024-09-21T10:41:12.840 INFO:tasks.workunit.client.0.smithi060.stdout:9/987: write d3/d5e/d60/fcb [3477844,58624] 0 2024-09-21T10:41:12.852 INFO:tasks.workunit.client.0.smithi060.stdout:9/988: read d3/f10 [1768680,92088] 0 2024-09-21T10:41:12.853 INFO:tasks.workunit.client.0.smithi060.stdout:9/989: symlink d3/d16/d1a/l143 0 2024-09-21T10:41:12.855 INFO:tasks.workunit.client.0.smithi060.stdout:9/990: mkdir d3/d5e/db8/d144 0 2024-09-21T10:41:12.855 INFO:tasks.workunit.client.0.smithi060.stdout:9/991: chown d3/d15/f4a 3629 1 2024-09-21T10:41:12.856 INFO:tasks.workunit.client.0.smithi060.stdout:9/992: symlink d3/d16/d42/d7e/l145 0 2024-09-21T10:41:12.858 INFO:tasks.workunit.client.0.smithi060.stdout:9/993: symlink d3/d15/d5a/d64/l146 0 2024-09-21T10:41:12.882 INFO:tasks.workunit.client.0.smithi060.stdout:9/994: dwrite d3/d16/d5f/fbb [0,4194304] 0 2024-09-21T10:41:12.884 INFO:tasks.workunit.client.0.smithi060.stdout:9/995: mknod d3/d15/d5a/dc7/c147 0 2024-09-21T10:41:12.885 INFO:tasks.workunit.client.0.smithi060.stdout:9/996: mknod d3/d16/d42/d7e/d85/dd6/d108/c148 0 2024-09-21T10:41:12.894 INFO:tasks.workunit.client.0.smithi060.stdout:9/997: write d3/d5e/d60/f39 [8050744,93121] 0 2024-09-21T10:41:12.894 INFO:tasks.workunit.client.0.smithi060.stdout:9/998: chown d3/d16/d1a/d109/f11c 3 1 2024-09-21T10:41:12.896 INFO:tasks.workunit.client.0.smithi060.stdout:9/999: creat d3/d15/f149 x:0 0 0 2024-09-21T10:41:12.902 INFO:tasks.workunit.client.0.smithi060.stdout:1/935: sync 2024-09-21T10:41:12.902 INFO:tasks.workunit.client.0.smithi060.stdout:2/836: sync 2024-09-21T10:41:12.902 INFO:tasks.workunit.client.0.smithi060.stdout:1/936: creat d6/d24/da/db/dd/f14b x:0 0 0 2024-09-21T10:41:12.904 INFO:tasks.workunit.client.0.smithi060.stdout:2/837: mkdir d3/d79/db4/d8f/d11b 0 2024-09-21T10:41:12.904 INFO:tasks.workunit.client.0.smithi060.stdout:2/838: read d3/d20/d17/f92 [266450,55799] 0 2024-09-21T10:41:12.904 INFO:tasks.workunit.client.0.smithi060.stdout:1/937: mknod d6/d24/da/db/d7e/c14c 0 2024-09-21T10:41:12.905 INFO:tasks.workunit.client.0.smithi060.stdout:2/839: creat d3/d79/db4/d8b/f11c x:0 0 0 2024-09-21T10:41:12.907 INFO:tasks.workunit.client.0.smithi060.stdout:1/938: rename d6/d24/da/db/d79/dad/d101/d125 to d6/d24/da/db/d1c/d14d 0 2024-09-21T10:41:12.907 INFO:tasks.workunit.client.0.smithi060.stdout:1/939: write d6/d24/da/db/d79/d86/d9f/dcd/ff4 [681494,90197] 0 2024-09-21T10:41:12.908 INFO:tasks.workunit.client.0.smithi060.stdout:2/840: symlink d3/l11d 0 2024-09-21T10:41:12.908 INFO:tasks.workunit.client.0.smithi060.stdout:2/841: write d3/d7/d23/db3/fbd [315112,98035] 0 2024-09-21T10:41:12.908 INFO:tasks.workunit.client.0.smithi060.stdout:2/842: write d3/d7/d23/db3/fce [524775,21323] 0 2024-09-21T10:41:12.911 INFO:tasks.workunit.client.0.smithi060.stdout:1/940: creat d6/d4a/d5a/db0/f14e x:0 0 0 2024-09-21T10:41:12.916 INFO:tasks.workunit.client.0.smithi060.stdout:1/941: getdents d6/d24/da/d45/d47 0 2024-09-21T10:41:12.916 INFO:tasks.workunit.client.0.smithi060.stdout:1/942: fdatasync d6/d24/da/db/d79/d86/f100 0 2024-09-21T10:41:12.919 INFO:tasks.workunit.client.0.smithi060.stdout:1/943: chown d6/d24/da/d45/d76/c81 2786380 1 2024-09-21T10:41:12.922 INFO:tasks.workunit.client.0.smithi060.stdout:2/843: dwrite d3/d7/d24/f2a [4194304,4194304] 0 2024-09-21T10:41:12.922 INFO:tasks.workunit.client.0.smithi060.stdout:1/944: mkdir d6/d24/da/db/d7e/d14f 0 2024-09-21T10:41:12.925 INFO:tasks.workunit.client.0.smithi060.stdout:2/844: dread d3/d7/d24/d25/d8a/fdc [0,4194304] 0 2024-09-21T10:41:12.925 INFO:tasks.workunit.client.0.smithi060.stdout:2/845: truncate d3/d7/d18/f81 5672222 0 2024-09-21T10:41:12.929 INFO:tasks.workunit.client.0.smithi060.stdout:2/846: unlink d3/d20/d15/cc7 0 2024-09-21T10:41:12.934 INFO:tasks.workunit.client.0.smithi060.stdout:2/847: link d3/d7/d23/db3/l107 d3/d79/db4/d8b/d69/d83/da8/d106/l11e 0 2024-09-21T10:41:12.934 INFO:tasks.workunit.client.0.smithi060.stdout:2/848: write d3/d79/db4/d43/fed [5142280,65326] 0 2024-09-21T10:41:12.934 INFO:tasks.workunit.client.0.smithi060.stdout:2/849: fsync d3/d20/d15/d3b/f110 0 2024-09-21T10:41:12.935 INFO:tasks.workunit.client.0.smithi060.stdout:2/850: creat d3/d79/db4/d43/d62/f11f x:0 0 0 2024-09-21T10:41:12.937 INFO:tasks.workunit.client.0.smithi060.stdout:2/851: rename d3/d79/db4/d8b/d69/d83/da8/d106/l11e to d3/d79/db4/d8b/d69/d83/da8/l120 0 2024-09-21T10:41:12.938 INFO:tasks.workunit.client.0.smithi060.stdout:2/852: symlink d3/d7/d24/d33/l121 0 2024-09-21T10:41:12.946 INFO:tasks.workunit.client.0.smithi060.stdout:2/853: write d3/d79/db4/d8b/fa4 [1660397,44763] 0 2024-09-21T10:41:13.335 INFO:tasks.workunit.client.0.smithi060.stdout:1/945: sync 2024-09-21T10:41:13.336 INFO:tasks.workunit.client.0.smithi060.stdout:1/946: unlink d6/d24/da/db/dd/c68 0 2024-09-21T10:41:13.338 INFO:tasks.workunit.client.0.smithi060.stdout:1/947: link d6/d24/fc d6/f150 0 2024-09-21T10:41:13.354 INFO:tasks.workunit.client.0.smithi060.stdout:1/948: dwrite d6/d24/da/f1f [0,4194304] 0 2024-09-21T10:41:13.356 INFO:tasks.workunit.client.0.smithi060.stdout:1/949: getdents d6/d24/da/db/dd 0 2024-09-21T10:41:13.356 INFO:tasks.workunit.client.0.smithi060.stdout:1/950: dread - d6/d4a/d5a/db0/fba zero size 2024-09-21T10:41:13.356 INFO:tasks.workunit.client.0.smithi060.stdout:1/951: truncate d6/d24/da/db/d79/d86/d9f/daa/fed 615011 0 2024-09-21T10:41:13.373 INFO:tasks.workunit.client.0.smithi060.stdout:1/952: dwrite d6/d24/da/db/d1c/f4c [4194304,4194304] 0 2024-09-21T10:41:13.382 INFO:tasks.workunit.client.0.smithi060.stdout:1/953: dread d6/d24/da/dea/d102/d135/d138/f143 [0,4194304] 0 2024-09-21T10:41:13.406 INFO:tasks.workunit.client.0.smithi060.stdout:1/954: dwrite d6/d24/da/db/dd/f14b [0,4194304] 0 2024-09-21T10:41:13.414 INFO:tasks.workunit.client.0.smithi060.stdout:2/854: sync 2024-09-21T10:41:13.415 INFO:tasks.workunit.client.0.smithi060.stdout:2/855: mknod d3/d20/d17/c122 0 2024-09-21T10:41:13.424 INFO:tasks.workunit.client.0.smithi060.stdout:1/955: dwrite d6/d24/da/db/d79/d86/fb7 [0,4194304] 0 2024-09-21T10:41:13.426 INFO:tasks.workunit.client.0.smithi060.stdout:1/956: rmdir d6/d24/da/db/d79/d86/d9f/dcd/df8/d12e 0 2024-09-21T10:41:13.427 INFO:tasks.workunit.client.0.smithi060.stdout:1/957: unlink d6/d24/da/db/d1c/fdc 0 2024-09-21T10:41:13.428 INFO:tasks.workunit.client.0.smithi060.stdout:1/958: readlink d6/d24/da/db/d79/d86/d9f/daa/de5/d13f/l145 0 2024-09-21T10:41:13.429 INFO:tasks.workunit.client.0.smithi060.stdout:1/959: creat d6/d24/da/db/d7e/d90/f151 x:0 0 0 2024-09-21T10:41:13.429 INFO:tasks.workunit.client.0.smithi060.stdout:1/960: chown d6/d24/da/db/d79/dad/d101/f13c 460352813 1 2024-09-21T10:41:13.429 INFO:tasks.workunit.client.0.smithi060.stdout:1/961: write d6/d24/f49 [2974454,101975] 0 2024-09-21T10:41:13.431 INFO:tasks.workunit.client.0.smithi060.stdout:1/962: creat d6/d24/da/dea/d102/d135/d138/f152 x:0 0 0 2024-09-21T10:41:13.431 INFO:tasks.workunit.client.0.smithi060.stdout:2/856: dwrite d3/d7/d24/d25/fa3 [0,4194304] 0 2024-09-21T10:41:13.432 INFO:tasks.workunit.client.0.smithi060.stdout:2/857: fsync d3/d20/d15/d3b/f110 0 2024-09-21T10:41:13.432 INFO:tasks.workunit.client.0.smithi060.stdout:2/858: chown d3/d7/d18/lcb 48 1 2024-09-21T10:41:13.432 INFO:tasks.workunit.client.0.smithi060.stdout:1/963: unlink d6/d24/da/db/d79/dad/f112 0 2024-09-21T10:41:13.432 INFO:tasks.workunit.client.0.smithi060.stdout:1/964: chown d6/d4a/d5a/fa4 15411739 1 2024-09-21T10:41:13.433 INFO:tasks.workunit.client.0.smithi060.stdout:1/965: fdatasync d6/d24/fa3 0 2024-09-21T10:41:13.434 INFO:tasks.workunit.client.0.smithi060.stdout:1/966: creat d6/d4a/d5a/db0/dd0/f153 x:0 0 0 2024-09-21T10:41:13.435 INFO:tasks.workunit.client.0.smithi060.stdout:2/859: rmdir d3/d20/d17 39 2024-09-21T10:41:13.437 INFO:tasks.workunit.client.0.smithi060.stdout:1/967: creat d6/d24/da/db/d79/d86/d95/dce/f154 x:0 0 0 2024-09-21T10:41:13.440 INFO:tasks.workunit.client.0.smithi060.stdout:1/968: creat d6/d24/da/db/d79/d86/d9f/f155 x:0 0 0 2024-09-21T10:41:13.455 INFO:tasks.workunit.client.0.smithi060.stdout:2/860: dwrite d3/d79/db4/f5d [0,4194304] 0 2024-09-21T10:41:13.455 INFO:tasks.workunit.client.0.smithi060.stdout:2/861: write d3/d7/d23/fc4 [477609,62853] 0 2024-09-21T10:41:13.456 INFO:tasks.workunit.client.0.smithi060.stdout:2/862: chown d3/d79/db4/d8b/d69/d83/da8/l120 19313 1 2024-09-21T10:41:13.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/863: creat d3/d79/db4/d6a/d9a/f123 x:0 0 0 2024-09-21T10:41:13.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/864: dread - d3/d20/d15/d3b/f103 zero size 2024-09-21T10:41:13.457 INFO:tasks.workunit.client.0.smithi060.stdout:2/865: fdatasync d3/d7/d24/f2a 0 2024-09-21T10:41:13.457 INFO:tasks.workunit.client.0.smithi060.stdout:1/969: dwrite d6/d24/da/db/d7e/d90/f151 [0,4194304] 0 2024-09-21T10:41:13.458 INFO:tasks.workunit.client.0.smithi060.stdout:2/866: symlink d3/d79/db4/d8b/d69/d83/da8/dee/l124 0 2024-09-21T10:41:13.459 INFO:tasks.workunit.client.0.smithi060.stdout:2/867: unlink d3/d20/d15/d3b/l45 0 2024-09-21T10:41:13.461 INFO:tasks.workunit.client.0.smithi060.stdout:1/970: rmdir d6/d24/da/db/d79/d86/d95/dce 39 2024-09-21T10:41:13.474 INFO:tasks.workunit.client.0.smithi060.stdout:1/971: write d6/d24/da/db/f29 [3378516,30758] 0 2024-09-21T10:41:13.479 INFO:tasks.workunit.client.0.smithi060.stdout:1/972: mkdir d6/d24/da/d45/d156 0 2024-09-21T10:41:13.479 INFO:tasks.workunit.client.0.smithi060.stdout:1/973: chown d6/d24/da/db/d79/d86/fef 9141335 1 2024-09-21T10:41:13.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/974: rename d6/d4a/d5a/db0/l71 to d6/d4a/d5a/l157 0 2024-09-21T10:41:13.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/975: creat d6/d24/da/db/d79/f158 x:0 0 0 2024-09-21T10:41:13.481 INFO:tasks.workunit.client.0.smithi060.stdout:1/976: stat d6/d24/da/db/de/d32/f3b 0 2024-09-21T10:41:13.483 INFO:tasks.workunit.client.0.smithi060.stdout:2/868: dwrite d3/d79/db4/d6a/d9a/faf [0,4194304] 0 2024-09-21T10:41:13.483 INFO:tasks.workunit.client.0.smithi060.stdout:2/869: stat d3/d79/ld6 0 2024-09-21T10:41:13.484 INFO:tasks.workunit.client.0.smithi060.stdout:2/870: readlink d3/d79/db4/d8b/d69/d83/da8/l120 0 2024-09-21T10:41:13.484 INFO:tasks.workunit.client.0.smithi060.stdout:2/871: truncate d3/d7/d23/f2f 4408813 0 2024-09-21T10:41:13.484 INFO:tasks.workunit.client.0.smithi060.stdout:1/977: symlink d6/d4a/d5a/db0/l159 0 2024-09-21T10:41:13.487 INFO:tasks.workunit.client.0.smithi060.stdout:2/872: link d3/d79/db4/d43/d4b/f8e d3/d79/db4/f125 0 2024-09-21T10:41:13.490 INFO:tasks.workunit.client.0.smithi060.stdout:1/978: dread d6/d24/da/db/de/fe4 [0,4194304] 0 2024-09-21T10:41:13.491 INFO:tasks.workunit.client.0.smithi060.stdout:2/873: dread d3/d79/db4/d43/d62/fc9 [0,4194304] 0 2024-09-21T10:41:13.492 INFO:tasks.workunit.client.0.smithi060.stdout:1/979: mknod d6/d24/da/dea/dd8/c15a 0 2024-09-21T10:41:13.492 INFO:tasks.workunit.client.0.smithi060.stdout:1/980: fsync d6/d24/da/db/d79/f158 0 2024-09-21T10:41:13.493 INFO:tasks.workunit.client.0.smithi060.stdout:2/874: link d3/d79/c10c d3/d7/d24/d100/c126 0 2024-09-21T10:41:13.494 INFO:tasks.workunit.client.0.smithi060.stdout:1/981: creat d6/d4a/f15b x:0 0 0 2024-09-21T10:41:13.495 INFO:tasks.workunit.client.0.smithi060.stdout:2/875: mknod d3/d79/db4/d43/d4b/c127 0 2024-09-21T10:41:13.496 INFO:tasks.workunit.client.0.smithi060.stdout:1/982: unlink d6/d4a/d5a/ffb 0 2024-09-21T10:41:13.497 INFO:tasks.workunit.client.0.smithi060.stdout:2/876: mkdir d3/d20/d15/d4c/d128 0 2024-09-21T10:41:13.498 INFO:tasks.workunit.client.0.smithi060.stdout:1/983: symlink d6/d24/da/dea/d102/d135/l15c 0 2024-09-21T10:41:13.498 INFO:tasks.workunit.client.0.smithi060.stdout:1/984: creat d6/d4a/d5a/db0/dd0/f15d x:0 0 0 2024-09-21T10:41:13.498 INFO:tasks.workunit.client.0.smithi060.stdout:1/985: truncate d6/d24/da/db/de/fab 239337 0 2024-09-21T10:41:13.498 INFO:tasks.workunit.client.0.smithi060.stdout:1/986: creat d6/d24/da/db/d79/dad/d101/f15e x:0 0 0 2024-09-21T10:41:13.514 INFO:tasks.workunit.client.0.smithi060.stdout:1/987: read d6/d24/da/db/d1c/d4b/f72 [2482972,76509] 0 2024-09-21T10:41:13.514 INFO:tasks.workunit.client.0.smithi060.stdout:1/988: write d6/d24/da/db/de/d32/f37 [8117657,129183] 0 2024-09-21T10:41:13.514 INFO:tasks.workunit.client.0.smithi060.stdout:2/877: dwrite d3/d7/d24/d25/d8a/fe0 [0,4194304] 0 2024-09-21T10:41:13.514 INFO:tasks.workunit.client.0.smithi060.stdout:2/878: write d3/d79/db4/d43/d62/fc9 [468067,61355] 0 2024-09-21T10:41:13.524 INFO:tasks.workunit.client.0.smithi060.stdout:2/879: read d3/d7/d18/f3a [1859605,18229] 0 2024-09-21T10:41:13.525 INFO:tasks.workunit.client.0.smithi060.stdout:2/880: mkdir d3/d7/de9/d129 0 2024-09-21T10:41:13.526 INFO:tasks.workunit.client.0.smithi060.stdout:2/881: creat d3/d7/d18/dd9/f12a x:0 0 0 2024-09-21T10:41:13.526 INFO:tasks.workunit.client.0.smithi060.stdout:2/882: fdatasync d3/d20/d15/d3b/ffd 0 2024-09-21T10:41:13.527 INFO:tasks.workunit.client.0.smithi060.stdout:2/883: creat d3/d7/d24/f12b x:0 0 0 2024-09-21T10:41:13.528 INFO:tasks.workunit.client.0.smithi060.stdout:2/884: mknod d3/d20/d17/d10f/c12c 0 2024-09-21T10:41:13.528 INFO:tasks.workunit.client.0.smithi060.stdout:2/885: creat d3/d20/d15/d3b/f12d x:0 0 0 2024-09-21T10:41:13.528 INFO:tasks.workunit.client.0.smithi060.stdout:2/886: dread - d3/d7/d23/f86 zero size 2024-09-21T10:41:13.529 INFO:tasks.workunit.client.0.smithi060.stdout:1/989: dwrite d6/d24/da/db/d79/f158 [0,4194304] 0 2024-09-21T10:41:13.530 INFO:tasks.workunit.client.0.smithi060.stdout:2/887: symlink d3/d7/d18/l12e 0 2024-09-21T10:41:13.533 INFO:tasks.workunit.client.0.smithi060.stdout:1/990: creat d6/d24/da/db/d1c/d14d/f15f x:0 0 0 2024-09-21T10:41:13.534 INFO:tasks.workunit.client.0.smithi060.stdout:2/888: creat d3/d7/d24/d25/f12f x:0 0 0 2024-09-21T10:41:13.537 INFO:tasks.workunit.client.0.smithi060.stdout:2/889: creat d3/d79/db4/d8b/d69/d83/d118/f130 x:0 0 0 2024-09-21T10:41:13.538 INFO:tasks.workunit.client.0.smithi060.stdout:1/991: dread d6/d24/da/dea/d102/d135/d138/f143 [0,4194304] 0 2024-09-21T10:41:13.540 INFO:tasks.workunit.client.0.smithi060.stdout:2/890: rmdir d3/d7/d24/d25/d8a 39 2024-09-21T10:41:13.540 INFO:tasks.workunit.client.0.smithi060.stdout:2/891: read d3/d79/db4/d8b/fa4 [2526292,66339] 0 2024-09-21T10:41:13.542 INFO:tasks.workunit.client.0.smithi060.stdout:1/992: link d6/d24/da/d45/d76/c81 d6/d24/da/db/d79/d86/c160 0 2024-09-21T10:41:13.557 INFO:tasks.workunit.client.0.smithi060.stdout:2/892: dwrite d3/d20/d15/d3b/f12d [0,4194304] 0 2024-09-21T10:41:13.561 INFO:tasks.workunit.client.0.smithi060.stdout:2/893: rename d3/d79/db4/d5c/la2 to d3/d79/db4/d8b/d69/d83/da8/dee/df3/l131 0 2024-09-21T10:41:13.561 INFO:tasks.workunit.client.0.smithi060.stdout:2/894: chown d3/d20/d15/le6 11 1 2024-09-21T10:41:13.563 INFO:tasks.workunit.client.0.smithi060.stdout:2/895: symlink d3/d79/db4/l132 0 2024-09-21T10:41:13.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/896: rename d3/d7/d23/f86 to d3/d79/db4/d8b/d69/d83/da8/dee/df3/f133 0 2024-09-21T10:41:13.564 INFO:tasks.workunit.client.0.smithi060.stdout:2/897: creat d3/d7/d24/f134 x:0 0 0 2024-09-21T10:41:13.569 INFO:tasks.workunit.client.0.smithi060.stdout:1/993: dwrite d6/d24/da/db/d79/d86/d9f/fa9 [0,4194304] 0 2024-09-21T10:41:13.569 INFO:tasks.workunit.client.0.smithi060.stdout:1/994: dread - d6/d24/da/db/d79/d86/d9f/dcd/d128/f142 zero size 2024-09-21T10:41:13.571 INFO:tasks.workunit.client.0.smithi060.stdout:1/995: creat d6/d24/da/d45/f161 x:0 0 0 2024-09-21T10:41:13.571 INFO:tasks.workunit.client.0.smithi060.stdout:1/996: stat d6/d4a/d5a/db0/d97 0 2024-09-21T10:41:13.571 INFO:tasks.workunit.client.0.smithi060.stdout:1/997: readlink d6/d24/da/db/d1c/d4b/l5c 0 2024-09-21T10:41:13.572 INFO:tasks.workunit.client.0.smithi060.stdout:2/898: dread d3/d7/d23/f5a [4194304,4194304] 0 2024-09-21T10:41:13.574 INFO:tasks.workunit.client.0.smithi060.stdout:1/998: dread d6/d24/da/db/d1c/f55 [0,4194304] 0 2024-09-21T10:41:13.574 INFO:tasks.workunit.client.0.smithi060.stdout:1/999: fsync d6/d24/da/db/d1c/d14d/f15f 0 2024-09-21T10:41:13.574 INFO:tasks.workunit.client.0.smithi060.stdout:2/899: symlink d3/d7/d18/dfa/l135 0 2024-09-21T10:41:13.574 INFO:tasks.workunit.client.0.smithi060.stdout:2/900: read d3/d7/d23/f48 [493334,13555] 0 2024-09-21T10:41:13.576 INFO:tasks.workunit.client.0.smithi060.stdout:2/901: creat d3/d7/f136 x:0 0 0 2024-09-21T10:41:13.590 INFO:tasks.workunit.client.0.smithi060.stdout:2/902: dwrite d3/d7/d18/dd9/ff9 [0,4194304] 0 2024-09-21T10:41:13.593 INFO:tasks.workunit.client.0.smithi060.stdout:2/903: rename d3/f12 to d3/d79/db4/d8b/d69/d83/da8/dee/df3/dfc/f137 0 2024-09-21T10:41:13.593 INFO:tasks.workunit.client.0.smithi060.stdout:2/904: fdatasync d3/d20/d15/d3b/f103 0 2024-09-21T10:41:13.596 INFO:tasks.workunit.client.0.smithi060.stdout:2/905: creat d3/d79/db4/d8f/d11b/f138 x:0 0 0 2024-09-21T10:41:13.597 INFO:tasks.workunit.client.0.smithi060.stdout:2/906: getdents d3/d79/db4/d5c/d115 0 2024-09-21T10:41:13.598 INFO:tasks.workunit.client.0.smithi060.stdout:2/907: write d3/d20/d15/d3b/f12d [5198262,110861] 0 2024-09-21T10:41:13.598 INFO:tasks.workunit.client.0.smithi060.stdout:2/908: stat d3/d79/f7b 0 2024-09-21T10:41:13.600 INFO:tasks.workunit.client.0.smithi060.stdout:2/909: mkdir d3/d20/d15/d3b/d139 0 2024-09-21T10:41:13.610 INFO:tasks.workunit.client.0.smithi060.stdout:2/910: rename d3/d7/d18 to d3/d20/d15/d4c/d82/de8/d13a 0 2024-09-21T10:41:13.610 INFO:tasks.workunit.client.0.smithi060.stdout:2/911: write d3/d20/d17/f92 [1032413,19070] 0 2024-09-21T10:41:13.612 INFO:tasks.workunit.client.0.smithi060.stdout:2/912: creat d3/d7/d23/f13b x:0 0 0 2024-09-21T10:41:13.612 INFO:tasks.workunit.client.0.smithi060.stdout:2/913: truncate d3/d79/db4/d43/d62/fc9 1513157 0 2024-09-21T10:41:13.614 INFO:tasks.workunit.client.0.smithi060.stdout:2/914: rmdir d3/d7/d24/d25 39 2024-09-21T10:41:13.614 INFO:tasks.workunit.client.0.smithi060.stdout:2/915: readlink d3/d20/d15/d3b/l8d 0 2024-09-21T10:41:13.616 INFO:tasks.workunit.client.0.smithi060.stdout:2/916: rename d3/d7/d23/db3/ldb to d3/d79/db4/d5c/d115/l13c 0 2024-09-21T10:41:13.616 INFO:tasks.workunit.client.0.smithi060.stdout:2/917: read d3/d79/db4/f125 [2255964,117749] 0 2024-09-21T10:41:13.617 INFO:tasks.workunit.client.0.smithi060.stdout:2/918: getdents d3/d20/d15/d4c 0 2024-09-21T10:41:13.633 INFO:tasks.workunit.client.0.smithi060.stdout:2/919: dwrite d3/d20/fd4 [0,4194304] 0 2024-09-21T10:41:13.633 INFO:tasks.workunit.client.0.smithi060.stdout:2/920: dread - d3/d7/d23/f9b zero size 2024-09-21T10:41:13.633 INFO:tasks.workunit.client.0.smithi060.stdout:2/921: fsync d3/d20/d15/d4c/d82/f11a 0 2024-09-21T10:41:13.637 INFO:tasks.workunit.client.0.smithi060.stdout:2/922: mknod d3/d79/db4/d5c/c13d 0 2024-09-21T10:41:13.637 INFO:tasks.workunit.client.0.smithi060.stdout:2/923: write d3/d79/db4/d8b/f11c [590937,114036] 0 2024-09-21T10:41:13.638 INFO:tasks.workunit.client.0.smithi060.stdout:2/924: creat d3/d7/d24/d25/d8a/f13e x:0 0 0 2024-09-21T10:41:13.647 INFO:tasks.workunit.client.0.smithi060.stdout:2/925: dread d3/d20/d15/d3b/f12d [0,4194304] 0 2024-09-21T10:41:13.648 INFO:tasks.workunit.client.0.smithi060.stdout:2/926: creat d3/d7/d24/d33/f13f x:0 0 0 2024-09-21T10:41:13.649 INFO:tasks.workunit.client.0.smithi060.stdout:2/927: unlink d3/d79/db4/db9/cf7 0 2024-09-21T10:41:13.649 INFO:tasks.workunit.client.0.smithi060.stdout:2/928: chown d3/d7/d24/f12b 522 1 2024-09-21T10:41:13.650 INFO:tasks.workunit.client.0.smithi060.stdout:2/929: symlink d3/d20/d15/d4c/d82/dca/l140 0 2024-09-21T10:41:13.651 INFO:tasks.workunit.client.0.smithi060.stdout:2/930: mkdir d3/d20/d15/d4c/d82/de8/d13a/dd9/d141 0 2024-09-21T10:41:13.651 INFO:tasks.workunit.client.0.smithi060.stdout:2/931: chown d3/d20/ce 25 1 2024-09-21T10:41:13.652 INFO:tasks.workunit.client.0.smithi060.stdout:2/932: symlink d3/d7/d23/db3/l142 0 2024-09-21T10:41:13.654 INFO:tasks.workunit.client.0.smithi060.stdout:2/933: rename d3/d20/d15/d4c/f99 to d3/d79/db4/d8f/f143 0 2024-09-21T10:41:13.654 INFO:tasks.workunit.client.0.smithi060.stdout:2/934: fsync d3/d7/d24/d25/d8a/fdc 0 2024-09-21T10:41:13.654 INFO:tasks.workunit.client.0.smithi060.stdout:2/935: fdatasync d3/d20/d15/d3b/f12d 0 2024-09-21T10:41:13.655 INFO:tasks.workunit.client.0.smithi060.stdout:2/936: dread - d3/d20/d15/d4c/fdd zero size 2024-09-21T10:41:13.655 INFO:tasks.workunit.client.0.smithi060.stdout:2/937: stat d3/d20/d17/l5f 0 2024-09-21T10:41:13.655 INFO:tasks.workunit.client.0.smithi060.stdout:2/938: mknod d3/d20/d15/d3b/c144 0 2024-09-21T10:41:13.657 INFO:tasks.workunit.client.0.smithi060.stdout:2/939: getdents d3/d79 0 2024-09-21T10:41:13.659 INFO:tasks.workunit.client.0.smithi060.stdout:2/940: rename d3/d79/db4/d8b/d69/fd0 to d3/d7/d24/d33/d119/f145 0 2024-09-21T10:41:13.659 INFO:tasks.workunit.client.0.smithi060.stdout:2/941: readlink d3/d20/d15/d3b/l8d 0 2024-09-21T10:41:13.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/942: symlink d3/d7/l146 0 2024-09-21T10:41:13.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/943: chown d3/d20/d15/d3b/ffd 107 1 2024-09-21T10:41:13.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/944: write d3/d79/db4/d43/d62/f11f [264562,81834] 0 2024-09-21T10:41:13.661 INFO:tasks.workunit.client.0.smithi060.stdout:2/945: write d3/d7/d24/d25/d8a/fe0 [4884845,42263] 0 2024-09-21T10:41:13.662 INFO:tasks.workunit.client.0.smithi060.stdout:2/946: rmdir d3/d20/d15/d4c/d82/dca 39 2024-09-21T10:41:13.670 INFO:tasks.workunit.client.0.smithi060.stdout:2/947: dread d3/d79/db4/d43/d4b/f6c [0,4194304] 0 2024-09-21T10:41:13.679 INFO:tasks.workunit.client.0.smithi060.stdout:2/948: dread d3/d7/d24/f49 [0,4194304] 0 2024-09-21T10:41:13.682 INFO:tasks.workunit.client.0.smithi060.stdout:2/949: truncate d3/d20/d15/f74 467678 0 2024-09-21T10:41:13.689 INFO:tasks.workunit.client.0.smithi060.stdout:2/950: write d3/d79/db4/d5c/f76 [1216292,48678] 0 2024-09-21T10:41:13.689 INFO:tasks.workunit.client.0.smithi060.stdout:2/951: chown d3/d7/d24/d25 2030 1 2024-09-21T10:41:13.689 INFO:tasks.workunit.client.0.smithi060.stdout:2/952: fdatasync d3/d7/fc2 0 2024-09-21T10:41:13.692 INFO:tasks.workunit.client.0.smithi060.stdout:2/953: creat d3/d20/d17/f147 x:0 0 0 2024-09-21T10:41:13.692 INFO:tasks.workunit.client.0.smithi060.stdout:2/954: read d3/d20/d15/d4c/fea [330835,121019] 0 2024-09-21T10:41:13.693 INFO:tasks.workunit.client.0.smithi060.stdout:2/955: mknod d3/d79/db4/d6a/d9a/c148 0 2024-09-21T10:41:13.693 INFO:tasks.workunit.client.0.smithi060.stdout:2/956: stat d3/d20/d15/d4c 0 2024-09-21T10:41:13.693 INFO:tasks.workunit.client.0.smithi060.stdout:2/957: chown d3/d7/c68 54 1 2024-09-21T10:41:13.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:13 smithi060 ceph-mon[28215]: pgmap v23: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 122 MiB/s rd, 164 MiB/s wr, 291 op/s 2024-09-21T10:41:13.703 INFO:tasks.workunit.client.0.smithi060.stdout:2/958: dread d3/d79/db4/d6a/fc6 [0,4194304] 0 2024-09-21T10:41:13.704 INFO:tasks.workunit.client.0.smithi060.stdout:2/959: mknod d3/d79/db4/d8b/d69/d83/da8/dee/df3/dfc/c149 0 2024-09-21T10:41:13.706 INFO:tasks.workunit.client.0.smithi060.stdout:2/960: dread d3/d79/db4/d6a/d9a/fdf [0,4194304] 0 2024-09-21T10:41:13.722 INFO:tasks.workunit.client.0.smithi060.stdout:2/961: dwrite d3/d79/db4/d6a/d9a/faf [4194304,4194304] 0 2024-09-21T10:41:13.722 INFO:tasks.workunit.client.0.smithi060.stdout:2/962: chown d3/d7/d24/f134 199 1 2024-09-21T10:41:13.724 INFO:tasks.workunit.client.0.smithi060.stdout:2/963: mknod d3/d79/db4/db9/c14a 0 2024-09-21T10:41:13.724 INFO:tasks.workunit.client.0.smithi060.stdout:2/964: chown d3/d79/db4/d6a/d9a/c113 61 1 2024-09-21T10:41:13.724 INFO:tasks.workunit.client.0.smithi060.stdout:2/965: readlink d3/lf 0 2024-09-21T10:41:13.724 INFO:tasks.workunit.client.0.smithi060.stdout:2/966: dread - d3/d7/d24/fb1 zero size 2024-09-21T10:41:13.724 INFO:tasks.workunit.client.0.smithi060.stdout:2/967: dread - d3/d79/feb zero size 2024-09-21T10:41:13.725 INFO:tasks.workunit.client.0.smithi060.stdout:2/968: chown d3/d20/d17/l29 34632 1 2024-09-21T10:41:13.732 INFO:tasks.workunit.client.0.smithi060.stdout:2/969: dread d3/d20/d15/d4c/d82/de8/d13a/f81 [0,4194304] 0 2024-09-21T10:41:13.734 INFO:tasks.workunit.client.0.smithi060.stdout:2/970: symlink d3/d79/db4/d6a/d9a/l14b 0 2024-09-21T10:41:13.735 INFO:tasks.workunit.client.0.smithi060.stdout:2/971: creat d3/d20/d15/d3b/d139/f14c x:0 0 0 2024-09-21T10:41:13.735 INFO:tasks.workunit.client.0.smithi060.stdout:2/972: creat d3/d20/d15/d3b/f14d x:0 0 0 2024-09-21T10:41:13.753 INFO:tasks.workunit.client.0.smithi060.stdout:2/973: dwrite d3/d7/d23/f5a [4194304,4194304] 0 2024-09-21T10:41:13.762 INFO:tasks.workunit.client.0.smithi060.stdout:2/974: write d3/d7/d24/fbe [3706858,34454] 0 2024-09-21T10:41:13.767 INFO:tasks.workunit.client.0.smithi060.stdout:2/975: truncate d3/d7/d23/f7c 525057 0 2024-09-21T10:41:13.785 INFO:tasks.workunit.client.0.smithi060.stdout:2/976: dwrite d3/d79/db4/d6a/d9a/fdf [0,4194304] 0 2024-09-21T10:41:13.785 INFO:tasks.workunit.client.0.smithi060.stdout:2/977: rename d3/d20/d17 to d3/d20/d17/d10f/d14e 22 2024-09-21T10:41:13.785 INFO:tasks.workunit.client.0.smithi060.stdout:2/978: write f2 [1235199,103222] 0 2024-09-21T10:41:13.789 INFO:tasks.workunit.client.0.smithi060.stdout:2/979: link d3/d79/db4/d8b/d69/d83/da8/dee/df3/dfc/c149 d3/d20/d15/d4c/d82/de8/d13a/c14f 0 2024-09-21T10:41:13.817 INFO:tasks.workunit.client.0.smithi060.stdout:2/980: dwrite d3/d20/d15/d4c/d82/de8/d13a/dd9/f12a [0,4194304] 0 2024-09-21T10:41:13.817 INFO:tasks.workunit.client.0.smithi060.stdout:2/981: chown d3/d79/db4/l132 64566 1 2024-09-21T10:41:13.836 INFO:tasks.workunit.client.0.smithi060.stdout:2/982: dwrite d3/d20/d15/d3b/f14d [0,4194304] 0 2024-09-21T10:41:13.842 INFO:tasks.workunit.client.0.smithi060.stdout:2/983: link d3/d20/d15/d4c/d82/de8/d13a/c88 d3/d20/d15/d3b/c150 0 2024-09-21T10:41:13.842 INFO:tasks.workunit.client.0.smithi060.stdout:2/984: write d3/d79/db4/d5c/f76 [4856713,87256] 0 2024-09-21T10:41:13.849 INFO:tasks.workunit.client.0.smithi060.stdout:2/985: getdents d3/d20/d15/d4c 0 2024-09-21T10:41:13.868 INFO:tasks.workunit.client.0.smithi060.stdout:2/986: dwrite d3/d7/d24/fbe [0,4194304] 0 2024-09-21T10:41:13.869 INFO:tasks.workunit.client.0.smithi060.stdout:2/987: creat d3/d79/db4/d5c/d115/f151 x:0 0 0 2024-09-21T10:41:13.891 INFO:tasks.workunit.client.0.smithi060.stdout:2/988: dwrite d3/d79/db4/d6a/d9a/fbf [0,4194304] 0 2024-09-21T10:41:13.901 INFO:tasks.workunit.client.0.smithi060.stdout:2/989: write d3/d79/db4/d6a/d9a/faf [5931488,99475] 0 2024-09-21T10:41:13.902 INFO:tasks.workunit.client.0.smithi060.stdout:2/990: symlink d3/d79/db4/d8b/d69/d83/da8/dee/l152 0 2024-09-21T10:41:13.919 INFO:tasks.workunit.client.0.smithi060.stdout:2/991: dwrite d3/d20/fd4 [0,4194304] 0 2024-09-21T10:41:13.919 INFO:tasks.workunit.client.0.smithi060.stdout:2/992: chown d3/d7 36081725 1 2024-09-21T10:41:13.919 INFO:tasks.workunit.client.0.smithi060.stdout:2/993: truncate d3/d7/f136 276784 0 2024-09-21T10:41:13.920 INFO:tasks.workunit.client.0.smithi060.stdout:2/994: mknod d3/d79/db4/d8b/d69/c153 0 2024-09-21T10:41:13.921 INFO:tasks.workunit.client.0.smithi060.stdout:2/995: rename d3/d7/d23/f5a to d3/d20/d15/d3b/f154 0 2024-09-21T10:41:13.932 INFO:tasks.workunit.client.0.smithi060.stdout:2/996: write d3/d20/d15/d3b/f154 [7526142,104893] 0 2024-09-21T10:41:13.932 INFO:tasks.workunit.client.0.smithi060.stdout:2/997: readlink d3/d79/ld6 0 2024-09-21T10:41:13.933 INFO:tasks.workunit.client.0.smithi060.stdout:2/998: creat d3/d79/db4/d8b/d69/d83/da8/dee/df3/f155 x:0 0 0 2024-09-21T10:41:13.933 INFO:tasks.workunit.client.0.smithi060.stdout:2/999: dread - d3/f102 zero size 2024-09-21T10:41:13.937 INFO:tasks.workunit.client.0.smithi060.stderr:+ rm -rf -- ./tmp.JwzZRotgXu 2024-09-21T10:41:13.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:13 smithi112 ceph-mon[35117]: pgmap v23: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 122 MiB/s rd, 164 MiB/s wr, 291 op/s 2024-09-21T10:41:14.584 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T10:41:14.584 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T10:41:15.776 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:15 smithi060 ceph-mon[28215]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 166 MiB/s rd, 216 MiB/s wr, 412 op/s 2024-09-21T10:41:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:15 smithi112 ceph-mon[35117]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 166 MiB/s rd, 216 MiB/s wr, 412 op/s 2024-09-21T10:41:17.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:17 smithi060 ceph-mon[28215]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 102 MiB/s rd, 132 MiB/s wr, 259 op/s 2024-09-21T10:41:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:17 smithi112 ceph-mon[35117]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 102 MiB/s rd, 132 MiB/s wr, 259 op/s 2024-09-21T10:41:18.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:18.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:18.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: Reconfiguring ceph-exporter.smithi112 (dependencies changed)... 2024-09-21T10:41:18.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:41:18.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:41:18.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:41:18.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:41:18.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:18 smithi112 ceph-mon[35117]: pgmap v26: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 102 MiB/s rd, 132 MiB/s wr, 259 op/s 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: Reconfiguring ceph-exporter.smithi112 (dependencies changed)... 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:41:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:18 smithi060 ceph-mon[28215]: pgmap v26: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 102 MiB/s rd, 132 MiB/s wr, 259 op/s 2024-09-21T10:41:19.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 -- 172.21.15.60:0/3354256525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c100d90 msgr2=0x7f988c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 --2- 172.21.15.60:0/3354256525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c100d90 0x7f988c101210 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9880009880 tx=0x7f988002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 -- 172.21.15.60:0/3354256525 shutdown_connections 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 --2- 172.21.15.60:0/3354256525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c100d90 0x7f988c101210 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 --2- 172.21.15.60:0/3354256525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c0ffb90 0x7f988c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 -- 172.21.15.60:0/3354256525 >> 172.21.15.60:0/3354256525 conn(0x7f988c0fb360 msgr2=0x7f988c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 -- 172.21.15.60:0/3354256525 shutdown_connections 2024-09-21T10:41:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.900+0000 7f9890b40640 1 -- 172.21.15.60:0/3354256525 wait complete. 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f9890b40640 1 Processor -- start 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f9890b40640 1 -- start start 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f9890b40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 0x7f988c1955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f9890b40640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c100d90 0x7f988c195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f9890b40640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c1960f0 con 0x7f988c0ffb90 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f9890b40640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c196260 con 0x7f988c100d90 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.901+0000 7f988a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 0x7f988c1955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f988a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 0x7f988c1955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43414/0 (socket says 172.21.15.60:43414) 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f988a59c640 1 -- 172.21.15.60:0/2213199999 learned_addr learned my addr 172.21.15.60:0/2213199999 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f9889d9b640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c100d90 0x7f988c195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f988a59c640 1 -- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c100d90 msgr2=0x7f988c195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f988a59c640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c100d90 0x7f988c195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f988a59c640 1 -- 172.21.15.60:0/2213199999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880009560 con 0x7f988c0ffb90 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f9889d9b640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c100d90 0x7f988c195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f988a59c640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 0x7f988c1955e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f987c00e970 tx=0x7f987c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987c009700 con 0x7f988c0ffb90 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f987c00cc90 con 0x7f988c0ffb90 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987c010430 con 0x7f988c0ffb90 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.902+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c19ad00 con 0x7f988c0ffb90 2024-09-21T10:41:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.903+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c19b240 con 0x7f988c0ffb90 2024-09-21T10:41:19.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.904+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c108780 con 0x7f988c0ffb90 2024-09-21T10:41:19.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.905+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f987c003f70 con 0x7f988c0ffb90 2024-09-21T10:41:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.906+0000 7f987b7fe640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f9874073ee0 0x7f98740763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.906+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f987c014070 con 0x7f988c0ffb90 2024-09-21T10:41:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.906+0000 7f9889d9b640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f9874073ee0 0x7f98740763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.907+0000 7f9889d9b640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f9874073ee0 0x7f98740763a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f98800314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:19.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:19.909+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f987c058d60 con 0x7f988c0ffb90 2024-09-21T10:41:19.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:19 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:20.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:19 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.236+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f988c105540 con 0x7f9874073ee0 2024-09-21T10:41:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.237+0000 7f987b7fe640 1 -- 172.21.15.60:0/2213199999 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f988c105540 con 0x7f9874073ee0 2024-09-21T10:41:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f9874073ee0 msgr2=0x7f98740763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f9874073ee0 0x7f98740763a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f98800314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 msgr2=0x7f988c1955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 0x7f988c1955e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f987c00e970 tx=0x7f987c00ee30 comp rx=0 tx=0).stop 2024-09-21T10:41:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 shutdown_connections 2024-09-21T10:41:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f9874073ee0 0x7f98740763a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f988c100d90 0x7f988c195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 --2- 172.21.15.60:0/2213199999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f988c0ffb90 0x7f988c1955e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 >> 172.21.15.60:0/2213199999 conn(0x7f988c0fb360 msgr2=0x7f988c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 shutdown_connections 2024-09-21T10:41:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.240+0000 7f9890b40640 1 -- 172.21.15.60:0/2213199999 wait complete. 2024-09-21T10:41:20.251 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:41:20.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 -- 172.21.15.60:0/1596266395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 msgr2=0x7f45e00fdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/1596266395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e00fdd10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009880 tx=0x7f45dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 -- 172.21.15.60:0/1596266395 shutdown_connections 2024-09-21T10:41:20.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/1596266395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 0x7f45e0105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/1596266395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e00fdd10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 -- 172.21.15.60:0/1596266395 >> 172.21.15.60:0/1596266395 conn(0x7f45e00f9540 msgr2=0x7f45e00fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:20.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 -- 172.21.15.60:0/1596266395 shutdown_connections 2024-09-21T10:41:20.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.342+0000 7f45e7bc6640 1 -- 172.21.15.60:0/1596266395 wait complete. 2024-09-21T10:41:20.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e7bc6640 1 Processor -- start 2024-09-21T10:41:20.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e7bc6640 1 -- start start 2024-09-21T10:41:20.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e7bc6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e0195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e7bc6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 0x7f45e0195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e7bc6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0196130 con 0x7f45e00fd910 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e7bc6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e01962a0 con 0x7f45e00fe250 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e5962640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e0195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e5962640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e0195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43430/0 (socket says 172.21.15.60:43430) 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e5962640 1 -- 172.21.15.60:0/2939903710 learned_addr learned my addr 172.21.15.60:0/2939903710 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.343+0000 7f45e5161640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 0x7f45e0195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e5161640 1 -- 172.21.15.60:0/2939903710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 msgr2=0x7f45e0195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e5161640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e0195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e5161640 1 -- 172.21.15.60:0/2939903710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009560 con 0x7f45e00fe250 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e5962640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e0195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e5161640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 0x7f45e0195b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e00fee70 tx=0x7f45d000edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:20.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d0009640 con 0x7f45e00fe250 2024-09-21T10:41:20.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45d000cc90 con 0x7f45e00fe250 2024-09-21T10:41:20.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e019ad40 con 0x7f45e00fe250 2024-09-21T10:41:20.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d0018750 con 0x7f45e00fe250 2024-09-21T10:41:20.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.344+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e019b2c0 con 0x7f45e00fe250 2024-09-21T10:41:20.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.345+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e01087c0 con 0x7f45e00fe250 2024-09-21T10:41:20.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.346+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f45d0018a10 con 0x7f45e00fe250 2024-09-21T10:41:20.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.347+0000 7f45d6ffd640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f45cc073f00 0x7f45cc0763c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:20.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.347+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f45d0014070 con 0x7f45e00fe250 2024-09-21T10:41:20.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.347+0000 7f45e5962640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f45cc073f00 0x7f45cc0763c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:20.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.348+0000 7f45e5962640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f45cc073f00 0x7f45cc0763c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000c00 tx=0x7f45dc0314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:20.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.352+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f45d0055ce0 con 0x7f45e00fe250 2024-09-21T10:41:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.596+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45e019b500 con 0x7f45cc073f00 2024-09-21T10:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.598+0000 7f45d6ffd640 1 -- 172.21.15.60:0/2939903710 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f45e019b500 con 0x7f45cc073f00 2024-09-21T10:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f45cc073f00 msgr2=0x7f45cc0763c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f45cc073f00 0x7f45cc0763c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000c00 tx=0x7f45dc0314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 msgr2=0x7f45e0195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 0x7f45e0195b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e00fee70 tx=0x7f45d000edd0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 shutdown_connections 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f45cc073f00 0x7f45cc0763c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45e00fe250 0x7f45e0195b60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 --2- 172.21.15.60:0/2939903710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e00fd910 0x7f45e0195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.600+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 >> 172.21.15.60:0/2939903710 conn(0x7f45e00f9540 msgr2=0x7f45e01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.601+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 shutdown_connections 2024-09-21T10:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.601+0000 7f45e7bc6640 1 -- 172.21.15.60:0/2939903710 wait complete. 2024-09-21T10:41:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 -- 172.21.15.60:0/2113887608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980feaf0 msgr2=0x7f8d980feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 --2- 172.21.15.60:0/2113887608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980feaf0 0x7f8d980feef0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009880 tx=0x7f8d9402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 -- 172.21.15.60:0/2113887608 shutdown_connections 2024-09-21T10:41:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 --2- 172.21.15.60:0/2113887608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980ffcf0 0x7f8d98100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 --2- 172.21.15.60:0/2113887608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980feaf0 0x7f8d980feef0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 -- 172.21.15.60:0/2113887608 >> 172.21.15.60:0/2113887608 conn(0x7f8d980fa280 msgr2=0x7f8d980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 -- 172.21.15.60:0/2113887608 shutdown_connections 2024-09-21T10:41:20.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.718+0000 7f8da0515640 1 -- 172.21.15.60:0/2113887608 wait complete. 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8da0515640 1 Processor -- start 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8da0515640 1 -- start start 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8da0515640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980feaf0 0x7f8d98068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8da0515640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 0x7f8d9819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8da0515640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9819a990 con 0x7f8d980ffcf0 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8da0515640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9819aad0 con 0x7f8d980feaf0 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8d9dab0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 0x7f8d9819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8d9dab0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 0x7f8d9819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43450/0 (socket says 172.21.15.60:43450) 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8d9dab0640 1 -- 172.21.15.60:0/1225944462 learned_addr learned my addr 172.21.15.60:0/1225944462 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.719+0000 7f8d9e2b1640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980feaf0 0x7f8d98068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d9dab0640 1 -- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980feaf0 msgr2=0x7f8d98068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d9dab0640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980feaf0 0x7f8d98068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d9dab0640 1 -- 172.21.15.60:0/1225944462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009560 con 0x7f8d980ffcf0 2024-09-21T10:41:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d9e2b1640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980feaf0 0x7f8d98068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:41:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d9dab0640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 0x7f8d9819a3c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800e970 tx=0x7f8d8800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d8800cc90 con 0x7f8d980ffcf0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d8800cdf0 con 0x7f8d980ffcf0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9819ad80 con 0x7f8d980ffcf0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d88018810 con 0x7f8d980ffcf0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.720+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9819b2d0 con 0x7f8d980ffcf0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.722+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9818e670 con 0x7f8d980ffcf0 2024-09-21T10:41:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.722+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f8d88010c10 con 0x7f8d980ffcf0 2024-09-21T10:41:20.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.723+0000 7f8d8f7fe640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8d84073ed0 0x7f8d84076390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:20.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.723+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8d88014070 con 0x7f8d980ffcf0 2024-09-21T10:41:20.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.723+0000 7f8d9e2b1640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8d84073ed0 0x7f8d84076390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:20.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.724+0000 7f8d9e2b1640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8d84073ed0 0x7f8d84076390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8d94006010 tx=0x7f8d940314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:20.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.731+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f8d88055ce0 con 0x7f8d980ffcf0 2024-09-21T10:41:20.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:20 smithi112 ceph-mon[35117]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:20.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:20 smithi112 ceph-mon[35117]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 104 MiB/s rd, 135 MiB/s wr, 374 op/s 2024-09-21T10:41:20.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:20 smithi112 ceph-mon[35117]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:20.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:20.992+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d9802c4f0 con 0x7f8d84073ed0 2024-09-21T10:41:21.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.010+0000 7f8d8f7fe640 1 -- 172.21.15.60:0/1225944462 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8d9802c4f0 con 0x7f8d84073ed0 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (7m) 34s ago 9m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 starting - - - - 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (8m) 42s ago 8m 7411k - 18.2.4-871-g6a1bdf85 0adab276c97e 7163dd4d91a2 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (9m) 34s ago 9m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (8m) 42s ago 8m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (7m) 34s ago 8m 83.5M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (3m) 34s ago 3m 185M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (3m) 34s ago 3m 13.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (2m) 42s ago 2m 15.2M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (3m) 42s ago 3m 17.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:41:21.013 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:9283,8765,8443 running (10m) 34s ago 10m 319M - 18.2.4-871-g6a1bdf85 0adab276c97e d9748f7fa031 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (61s) 42s ago 8m 494M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f97064c83946 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (10m) 34s ago 10m 52.8M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (8m) 42s ago 8m 39.5M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 34s ago 9m 17.0M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 42s ago 8m 15.0M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 34s ago 6m 126M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (6m) 34s ago 6m 138M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 34s ago 5m 120M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (5m) 42s ago 5m 150M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (5m) 42s ago 5m 130M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (4m) 42s ago 4m 132M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:41:21.014 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 starting - - - - 2024-09-21T10:41:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.014+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8d84073ed0 msgr2=0x7f8d84076390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.014+0000 7f8da0515640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8d84073ed0 0x7f8d84076390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8d94006010 tx=0x7f8d940314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.014+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 msgr2=0x7f8d9819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.014+0000 7f8da0515640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 0x7f8d9819a3c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800e970 tx=0x7f8d8800ee30 comp rx=0 tx=0).stop 2024-09-21T10:41:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 shutdown_connections 2024-09-21T10:41:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8d84073ed0 0x7f8d84076390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d980ffcf0 0x7f8d9819a3c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 --2- 172.21.15.60:0/1225944462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d980feaf0 0x7f8d98068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 >> 172.21.15.60:0/1225944462 conn(0x7f8d980fa280 msgr2=0x7f8d98103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 shutdown_connections 2024-09-21T10:41:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.015+0000 7f8da0515640 1 -- 172.21.15.60:0/1225944462 wait complete. 2024-09-21T10:41:21.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.137+0000 7fb0fa143640 1 -- 172.21.15.60:0/1727831086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f40ffb80 msgr2=0x7fb0f40fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.137+0000 7fb0fa143640 1 --2- 172.21.15.60:0/1727831086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40fff80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009880 tx=0x7fb0e402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.137+0000 7fb0fa143640 1 -- 172.21.15.60:0/1727831086 shutdown_connections 2024-09-21T10:41:21.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.137+0000 7fb0fa143640 1 --2- 172.21.15.60:0/1727831086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f4100d80 0x7fb0f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.137+0000 7fb0fa143640 1 --2- 172.21.15.60:0/1727831086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40fff80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.137+0000 7fb0fa143640 1 -- 172.21.15.60:0/1727831086 >> 172.21.15.60:0/1727831086 conn(0x7fb0f40fb310 msgr2=0x7fb0f40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:21.140 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:20 smithi060 ceph-mon[28215]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:21.140 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:20 smithi060 ceph-mon[28215]: pgmap v27: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 104 MiB/s rd, 135 MiB/s wr, 374 op/s 2024-09-21T10:41:21.140 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:20 smithi060 ceph-mon[28215]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:21.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.138+0000 7fb0fa143640 1 -- 172.21.15.60:0/1727831086 shutdown_connections 2024-09-21T10:41:21.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.138+0000 7fb0fa143640 1 -- 172.21.15.60:0/1727831086 wait complete. 2024-09-21T10:41:21.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.138+0000 7fb0fa143640 1 Processor -- start 2024-09-21T10:41:21.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0fa143640 1 -- start start 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0fa143640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0fa143640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f4100d80 0x7fb0f40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0fa143640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40747b0 con 0x7fb0f4100d80 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0fa143640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4072e10 con 0x7fb0f40ffb80 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:37618/0 (socket says 172.21.15.60:37618) 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f37fe640 1 -- 172.21.15.60:0/2872374707 learned_addr learned my addr 172.21.15.60:0/2872374707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f2ffd640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f4100d80 0x7fb0f40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f37fe640 1 -- 172.21.15.60:0/2872374707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f4100d80 msgr2=0x7fb0f40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f37fe640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f4100d80 0x7fb0f40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.139+0000 7fb0f37fe640 1 -- 172.21.15.60:0/2872374707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e4009560 con 0x7fb0f40ffb80 2024-09-21T10:41:21.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.140+0000 7fb0f37fe640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40741e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0e402a9c0 tx=0x7fb0e40054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:21.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.140+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e4004aa0 con 0x7fb0f40ffb80 2024-09-21T10:41:21.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.140+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0e4004c00 con 0x7fb0f40ffb80 2024-09-21T10:41:21.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.140+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e4003a80 con 0x7fb0f40ffb80 2024-09-21T10:41:21.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.140+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4073090 con 0x7fb0f40ffb80 2024-09-21T10:41:21.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.140+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4073600 con 0x7fb0f40ffb80 2024-09-21T10:41:21.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.142+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f4108770 con 0x7fb0f40ffb80 2024-09-21T10:41:21.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.142+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7fb0e4003cf0 con 0x7fb0f40ffb80 2024-09-21T10:41:21.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.143+0000 7fb0f0ff9640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb0dc073ee0 0x7fb0dc0763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:21.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.143+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb0e40b6380 con 0x7fb0f40ffb80 2024-09-21T10:41:21.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.143+0000 7fb0f2ffd640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb0dc073ee0 0x7fb0dc0763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:21.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.144+0000 7fb0f2ffd640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb0dc073ee0 0x7fb0dc0763a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4073f60 tx=0x7fb0e800b390 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:21.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.147+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fb0e4079830 con 0x7fb0f40ffb80 2024-09-21T10:41:21.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.472+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb0f419d840 con 0x7fb0f40ffb80 2024-09-21T10:41:21.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.473+0000 7fb0f0ff9640 1 -- 172.21.15.60:0/2872374707 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7fb0e407c950 con 0x7fb0f40ffb80 2024-09-21T10:41:21.475 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:41:21.475 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:41:21.475 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:41:21.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 1, 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 13, 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:41:21.476 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb0dc073ee0 msgr2=0x7fb0dc0763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb0dc073ee0 0x7fb0dc0763a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4073f60 tx=0x7fb0e800b390 comp rx=0 tx=0).stop 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 msgr2=0x7fb0f40741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40741e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0e402a9c0 tx=0x7fb0e40054f0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 shutdown_connections 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb0dc073ee0 0x7fb0dc0763a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f4100d80 0x7fb0f40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 --2- 172.21.15.60:0/2872374707 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb0f40ffb80 0x7fb0f40741e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.475+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 >> 172.21.15.60:0/2872374707 conn(0x7fb0f40fb310 msgr2=0x7fb0f4103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.476+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 shutdown_connections 2024-09-21T10:41:21.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.476+0000 7fb0fa143640 1 -- 172.21.15.60:0/2872374707 wait complete. 2024-09-21T10:41:21.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 -- 172.21.15.60:0/3059554677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec100700 msgr2=0x7fd5ec102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/3059554677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec100700 0x7fd5ec102af0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009880 tx=0x7fd5dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 -- 172.21.15.60:0/3059554677 shutdown_connections 2024-09-21T10:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/3059554677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5ec103030 0x7fd5ec105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/3059554677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec100700 0x7fd5ec102af0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 -- 172.21.15.60:0/3059554677 >> 172.21.15.60:0/3059554677 conn(0x7fd5ec0fa280 msgr2=0x7fd5ec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 -- 172.21.15.60:0/3059554677 shutdown_connections 2024-09-21T10:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.567+0000 7fd5f08a6640 1 -- 172.21.15.60:0/3059554677 wait complete. 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.568+0000 7fd5f08a6640 1 Processor -- start 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.568+0000 7fd5f08a6640 1 -- start start 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.568+0000 7fd5f08a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5ec100700 0x7fd5ec100010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.568+0000 7fd5f08a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 0x7fd5ec0fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.568+0000 7fd5f08a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0febf0 con 0x7fd5ec103030 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.568+0000 7fd5f08a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0fed60 con 0x7fd5ec100700 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 0x7fd5ec0fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 0x7fd5ec0fe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43484/0 (socket says 172.21.15.60:43484) 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 -- 172.21.15.60:0/330338785 learned_addr learned my addr 172.21.15.60:0/330338785 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5ea59c640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5ec100700 0x7fd5ec100010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 -- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5ec100700 msgr2=0x7fd5ec100010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5ec100700 0x7fd5ec100010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 -- 172.21.15.60:0/330338785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc009560 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5e9d9b640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 0x7fd5ec0fe6b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000e940 tx=0x7fd5e000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e0009700 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec0ff040 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.569+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec19d740 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.570+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5e00054e0 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.570+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e0010430 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.571+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc005280 con 0x7fd5ec103030 2024-09-21T10:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.572+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7fd5e000cc90 con 0x7fd5ec103030 2024-09-21T10:41:21.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.572+0000 7fd5db7fe640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fd5d4073ee0 0x7fd5d40763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:21.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.572+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd5e0014070 con 0x7fd5ec103030 2024-09-21T10:41:21.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.572+0000 7fd5ea59c640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fd5d4073ee0 0x7fd5d40763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:21.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.573+0000 7fd5ea59c640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fd5d4073ee0 0x7fd5d40763a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000c00 tx=0x7fd5dc0314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:21.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.581+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fd5e0058a00 con 0x7fd5ec103030 2024-09-21T10:41:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.895+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5cc005800 con 0x7fd5ec103030 2024-09-21T10:41:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.896+0000 7fd5db7fe640 1 -- 172.21.15.60:0/330338785 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fd5e005bb20 con 0x7fd5ec103030 2024-09-21T10:41:21.898 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:41:21.898 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:41:21.899 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:41:21.900 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.898+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fd5d4073ee0 msgr2=0x7fd5d40763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.898+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fd5d4073ee0 0x7fd5d40763a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000c00 tx=0x7fd5dc0314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.898+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 msgr2=0x7fd5ec0fe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.898+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 0x7fd5ec0fe6b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000e940 tx=0x7fd5e000ee00 comp rx=0 tx=0).stop 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 shutdown_connections 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fd5d4073ee0 0x7fd5d40763a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5ec103030 0x7fd5ec0fe6b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 --2- 172.21.15.60:0/330338785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5ec100700 0x7fd5ec100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 >> 172.21.15.60:0/330338785 conn(0x7fd5ec0fa280 msgr2=0x7fd5ec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:21.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 shutdown_connections 2024-09-21T10:41:21.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:21.899+0000 7fd5f08a6640 1 -- 172.21.15.60:0/330338785 wait complete. 2024-09-21T10:41:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 -- 172.21.15.60:0/2186495466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 msgr2=0x7f8f180feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 --2- 172.21.15.60:0/2186495466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f180feef0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009880 tx=0x7f8f0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 -- 172.21.15.60:0/2186495466 shutdown_connections 2024-09-21T10:41:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 --2- 172.21.15.60:0/2186495466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f180ffcf0 0x7f8f18100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 --2- 172.21.15.60:0/2186495466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f180feef0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 -- 172.21.15.60:0/2186495466 >> 172.21.15.60:0/2186495466 conn(0x7f8f180fa280 msgr2=0x7f8f180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 -- 172.21.15.60:0/2186495466 shutdown_connections 2024-09-21T10:41:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.006+0000 7f8f1f100640 1 -- 172.21.15.60:0/2186495466 wait complete. 2024-09-21T10:41:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1f100640 1 Processor -- start 2024-09-21T10:41:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1f100640 1 -- start start 2024-09-21T10:41:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1f100640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f18102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1f100640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f180ffcf0 0x7f8f181010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1f100640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f18101610 con 0x7f8f180feaf0 2024-09-21T10:41:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1f100640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f18101780 con 0x7f8f180ffcf0 2024-09-21T10:41:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1ce9c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f18102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1ce9c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f18102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43496/0 (socket says 172.21.15.60:43496) 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.007+0000 7f8f1ce9c640 1 -- 172.21.15.60:0/3666573209 learned_addr learned my addr 172.21.15.60:0/3666573209 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f1ce9c640 1 -- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f180ffcf0 msgr2=0x7f8f181010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f1ce9c640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f180ffcf0 0x7f8f181010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f1ce9c640 1 -- 172.21.15.60:0/3666573209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c009560 con 0x7f8f180feaf0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f1ce9c640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f18102a80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c02a9c0 tx=0x7f8f0c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0c004aa0 con 0x7f8f180feaf0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f0c004c00 con 0x7f8f180feaf0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f18101a00 con 0x7f8f180feaf0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0c0039b0 con 0x7f8f180feaf0 2024-09-21T10:41:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.008+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f18101ef0 con 0x7f8f180feaf0 2024-09-21T10:41:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.010+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f181076e0 con 0x7f8f180feaf0 2024-09-21T10:41:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.010+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f8f0c031c00 con 0x7f8f180feaf0 2024-09-21T10:41:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.011+0000 7f8f15ffb640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8f08073ee0 0x7f8f080763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.011+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8f0c0b6370 con 0x7f8f180feaf0 2024-09-21T10:41:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.011+0000 7f8f17fff640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8f08073ee0 0x7f8f080763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:22.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.014+0000 7f8f17fff640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8f08073ee0 0x7f8f080763a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f040058c0 tx=0x7f8f04005850 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.019+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f8f0c079810 con 0x7f8f180feaf0 2024-09-21T10:41:22.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:21 smithi112 ceph-mon[35117]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:22.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:21 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2872374707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:41:22.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:21 smithi060 ceph-mon[28215]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:21 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/2872374707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:41:22.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.359+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f180683f0 con 0x7f8f08073ee0 2024-09-21T10:41:22.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.360+0000 7f8f15ffb640 1 -- 172.21.15.60:0/3666573209 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8f180683f0 con 0x7f8f08073ee0 2024-09-21T10:41:22.362 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "1/23 daemons upgraded", 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:41:22.363 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:41:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8f08073ee0 msgr2=0x7f8f080763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8f08073ee0 0x7f8f080763a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8f040058c0 tx=0x7f8f04005850 comp rx=0 tx=0).stop 2024-09-21T10:41:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 msgr2=0x7f8f18102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f18102a80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c02a9c0 tx=0x7f8f0c0055a0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 shutdown_connections 2024-09-21T10:41:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f8f08073ee0 0x7f8f080763a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8f180ffcf0 0x7f8f181010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 --2- 172.21.15.60:0/3666573209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f180feaf0 0x7f8f18102a80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 >> 172.21.15.60:0/3666573209 conn(0x7f8f180fa280 msgr2=0x7f8f18067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 shutdown_connections 2024-09-21T10:41:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.363+0000 7f8f1f100640 1 -- 172.21.15.60:0/3666573209 wait complete. 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.460+0000 7f7af659a640 1 -- 172.21.15.60:0/700145192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0102f90 msgr2=0x7f7af0103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.460+0000 7f7af659a640 1 --2- 172.21.15.60:0/700145192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0102f90 0x7f7af0103410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009880 tx=0x7f7ae402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 -- 172.21.15.60:0/700145192 shutdown_connections 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 --2- 172.21.15.60:0/700145192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0102f90 0x7f7af0103410 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 --2- 172.21.15.60:0/700145192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0101d90 0x7f7af0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 -- 172.21.15.60:0/700145192 >> 172.21.15.60:0/700145192 conn(0x7f7af00fd540 msgr2=0x7f7af00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 -- 172.21.15.60:0/700145192 shutdown_connections 2024-09-21T10:41:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 -- 172.21.15.60:0/700145192 wait complete. 2024-09-21T10:41:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 Processor -- start 2024-09-21T10:41:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.461+0000 7f7af659a640 1 -- start start 2024-09-21T10:41:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7af659a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 0x7f7af0197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7af659a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102f90 0x7f7af0197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7af659a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0198320 con 0x7f7af0101d90 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7af659a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0198490 con 0x7f7af0102f90 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aeffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 0x7f7af0197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aeffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 0x7f7af0197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43510/0 (socket says 172.21.15.60:43510) 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aeffff640 1 -- 172.21.15.60:0/3878331619 learned_addr learned my addr 172.21.15.60:0/3878331619 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aef7fe640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102f90 0x7f7af0197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aeffff640 1 -- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102f90 msgr2=0x7f7af0197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aeffff640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102f90 0x7f7af0197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.462+0000 7f7aeffff640 1 -- 172.21.15.60:0/3878331619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009560 con 0x7f7af0101d90 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.463+0000 7f7aeffff640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 0x7f7af0197810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000e970 tx=0x7f7ae000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.463+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae0009700 con 0x7f7af0101d90 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.463+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ae000cc90 con 0x7f7af0101d90 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.463+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af019cee0 con 0x7f7af0101d90 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.463+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae0010430 con 0x7f7af0101d90 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.463+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af019d420 con 0x7f7af0101d90 2024-09-21T10:41:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.464+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af0191910 con 0x7f7af0101d90 2024-09-21T10:41:22.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.465+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) v1 ==== 97116+0+0 (secure 0 0 0) 0x7f7ae0003f90 con 0x7f7af0101d90 2024-09-21T10:41:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.466+0000 7f7aed7fa640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7ad8073ee0 0x7f7ad80763a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.466+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7ae0014070 con 0x7f7af0101d90 2024-09-21T10:41:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.466+0000 7f7aef7fe640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7ad8073ee0 0x7f7ad80763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:22.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.467+0000 7f7aef7fe640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7ad8073ee0 0x7f7ad80763a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4000c00 tx=0x7f7ae40314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:22.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.470+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f7ae0058bc0 con 0x7f7af0101d90 2024-09-21T10:41:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.801+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7af010a980 con 0x7f7af0101d90 2024-09-21T10:41:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.801+0000 7f7aed7fa640 1 -- 172.21.15.60:0/3878331619 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7ae005bce0 con 0x7f7af0101d90 2024-09-21T10:41:22.803 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:41:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7ad8073ee0 msgr2=0x7f7ad80763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7ad8073ee0 0x7f7ad80763a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4000c00 tx=0x7f7ae40314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 msgr2=0x7f7af0197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 0x7f7af0197810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000e970 tx=0x7f7ae000ee30 comp rx=0 tx=0).stop 2024-09-21T10:41:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 shutdown_connections 2024-09-21T10:41:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f7ad8073ee0 0x7f7ad80763a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102f90 0x7f7af0197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 --2- 172.21.15.60:0/3878331619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af0101d90 0x7f7af0197810 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 >> 172.21.15.60:0/3878331619 conn(0x7f7af00fd540 msgr2=0x7f7af01066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 shutdown_connections 2024-09-21T10:41:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:22.804+0000 7f7af659a640 1 -- 172.21.15.60:0/3878331619 wait complete. 2024-09-21T10:41:23.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/330338785' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:41:23.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 45 MiB/s rd, 56 MiB/s wr, 236 op/s 2024-09-21T10:41:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3878331619' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:41:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:41:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:22 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:23.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/330338785' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:41:23.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: pgmap v28: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 45 MiB/s rd, 56 MiB/s wr, 236 op/s 2024-09-21T10:41:23.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:23.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:23.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:23.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3878331619' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:41:23.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:41:23.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:22 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:23 smithi060 ceph-mon[28215]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:41:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:23 smithi060 ceph-mon[28215]: Upgrade: Need to upgrade myself (mgr.smithi112.gkunly) 2024-09-21T10:41:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:23 smithi060 ceph-mon[28215]: Upgrade: Need to upgrade myself (mgr.smithi112.gkunly) 2024-09-21T10:41:24.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:23 smithi112 ceph-mon[35117]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:41:24.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:23 smithi112 ceph-mon[35117]: Upgrade: Need to upgrade myself (mgr.smithi112.gkunly) 2024-09-21T10:41:24.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:23 smithi112 ceph-mon[35117]: Upgrade: Need to upgrade myself (mgr.smithi112.gkunly) 2024-09-21T10:41:25.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: pgmap v29: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 45 MiB/s rd, 57 MiB/s wr, 368 op/s 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: Upgrade: Updating mgr.smithi060.mulzpr 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:41:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:25 smithi060 ceph-mon[28215]: Deploying daemon mgr.smithi060.mulzpr on smithi060 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: pgmap v29: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 45 MiB/s rd, 57 MiB/s wr, 368 op/s 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: Upgrade: Updating mgr.smithi060.mulzpr 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:41:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:25 smithi112 ceph-mon[35117]: Deploying daemon mgr.smithi060.mulzpr on smithi060 2024-09-21T10:41:27.503 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:27 smithi060 ceph-mon[28215]: pgmap v30: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 247 op/s 2024-09-21T10:41:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:27 smithi112 ceph-mon[35117]: pgmap v30: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 247 op/s 2024-09-21T10:41:29.748 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T10:41:29.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T10:41:29.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:29 smithi060 ceph-mon[28215]: pgmap v31: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 247 op/s 2024-09-21T10:41:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:29 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:29 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:29 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:29 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:29 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:29 smithi112 ceph-mon[35117]: pgmap v31: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.2 MiB/s wr, 247 op/s 2024-09-21T10:41:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:29 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:29 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:29 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:29.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:29 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:29.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:29 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:31.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:31 smithi060 ceph-mon[28215]: pgmap v32: 65 pgs: 65 active+clean; 552 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 5.0 MiB/s wr, 386 op/s 2024-09-21T10:41:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:31 smithi112 ceph-mon[35117]: pgmap v32: 65 pgs: 65 active+clean; 552 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 5.0 MiB/s wr, 386 op/s 2024-09-21T10:41:32.842 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:32 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:32.842 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:32 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:33.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:32 smithi060 ceph-mon[28215]: pgmap v33: 65 pgs: 65 active+clean; 552 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 271 op/s 2024-09-21T10:41:33.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:32 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:33.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:32 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:33.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:32 smithi112 ceph-mon[35117]: pgmap v33: 65 pgs: 65 active+clean; 552 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 271 op/s 2024-09-21T10:41:35.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:35 smithi060 ceph-mon[28215]: pgmap v34: 65 pgs: 65 active+clean; 345 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-21T10:41:35.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:35 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:35.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:35 smithi112 ceph-mon[35117]: pgmap v34: 65 pgs: 65 active+clean; 345 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-21T10:41:35.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:35 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:36.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:36 smithi060 ceph-mon[28215]: Standby manager daemon smithi060.mulzpr restarted 2024-09-21T10:41:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:36 smithi060 ceph-mon[28215]: Standby manager daemon smithi060.mulzpr started 2024-09-21T10:41:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:36 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/crt"}]: dispatch 2024-09-21T10:41:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:36 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:41:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:36 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/key"}]: dispatch 2024-09-21T10:41:36.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:36 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:41:36.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:36 smithi112 ceph-mon[35117]: Standby manager daemon smithi060.mulzpr restarted 2024-09-21T10:41:36.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:36 smithi112 ceph-mon[35117]: Standby manager daemon smithi060.mulzpr started 2024-09-21T10:41:36.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:36 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/crt"}]: dispatch 2024-09-21T10:41:36.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:36 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:41:36.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:36 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi060.mulzpr/key"}]: dispatch 2024-09-21T10:41:36.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:36 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:41:37.671 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:37 smithi060 ceph-mon[28215]: pgmap v35: 65 pgs: 65 active+clean; 345 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-09-21T10:41:37.671 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:37 smithi060 ceph-mon[28215]: mgrmap e26: smithi112.gkunly(active, since 64s), standbys: smithi060.mulzpr 2024-09-21T10:41:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:37 smithi112 ceph-mon[35117]: pgmap v35: 65 pgs: 65 active+clean; 345 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-09-21T10:41:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:37 smithi112 ceph-mon[35117]: mgrmap e26: smithi112.gkunly(active, since 64s), standbys: smithi060.mulzpr 2024-09-21T10:41:39.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:39 smithi060 ceph-mon[28215]: pgmap v36: 65 pgs: 65 active+clean; 345 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-09-21T10:41:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:39 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:39 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:39 smithi112 ceph-mon[35117]: pgmap v36: 65 pgs: 65 active+clean; 345 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-09-21T10:41:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:39 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:39 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:40.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:40 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:40.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:40 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:40 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:40.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:40 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:41.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:41 smithi060 ceph-mon[28215]: pgmap v37: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 479 op/s 2024-09-21T10:41:41.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:41 smithi112 ceph-mon[35117]: pgmap v37: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 479 op/s 2024-09-21T10:41:43.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:43 smithi060 ceph-mon[28215]: pgmap v38: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-21T10:41:43.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:43 smithi112 ceph-mon[35117]: pgmap v38: 65 pgs: 65 active+clean; 298 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-21T10:41:45.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:45 smithi060 ceph-mon[28215]: pgmap v39: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 442 op/s 2024-09-21T10:41:45.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:45 smithi112 ceph-mon[35117]: pgmap v39: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 442 op/s 2024-09-21T10:41:47.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:47 smithi060 ceph-mon[28215]: pgmap v40: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-21T10:41:47.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:47 smithi112 ceph-mon[35117]: pgmap v40: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-21T10:41:49.671 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:49 smithi060 ceph-mon[28215]: pgmap v41: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-21T10:41:49.671 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:49 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:49.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:49 smithi112 ceph-mon[35117]: pgmap v41: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-21T10:41:49.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:49 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:51.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:51 smithi060 ceph-mon[28215]: pgmap v42: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 362 op/s 2024-09-21T10:41:51.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:51 smithi112 ceph-mon[35117]: pgmap v42: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 362 op/s 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 -- 172.21.15.60:0/1049769235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 msgr2=0x7f9114073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 --2- 172.21.15.60:0/1049769235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114073310 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9108009880 tx=0x7f910802a530 comp rx=0 tx=0).stop 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 -- 172.21.15.60:0/1049769235 shutdown_connections 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 --2- 172.21.15.60:0/1049769235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114073310 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 --2- 172.21.15.60:0/1049769235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 0x7f91140728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 -- 172.21.15.60:0/1049769235 >> 172.21.15.60:0/1049769235 conn(0x7f91140fb320 msgr2=0x7f91140fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 -- 172.21.15.60:0/1049769235 shutdown_connections 2024-09-21T10:41:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.895+0000 7f9119af9640 1 -- 172.21.15.60:0/1049769235 wait complete. 2024-09-21T10:41:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9119af9640 1 Processor -- start 2024-09-21T10:41:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9119af9640 1 -- start start 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9119af9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9119af9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 0x7f9114197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9119af9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114198340 con 0x7f9114072eb0 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9119af9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91141984b0 con 0x7f9114074480 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f91137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f91137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48008/0 (socket says 172.21.15.60:48008) 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f91137fe640 1 -- 172.21.15.60:0/1983338353 learned_addr learned my addr 172.21.15.60:0/1983338353 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.896+0000 7f9112ffd640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 0x7f9114197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f91137fe640 1 -- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 msgr2=0x7f9114197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f91137fe640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 0x7f9114197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f91137fe640 1 -- 172.21.15.60:0/1983338353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108009560 con 0x7f9114072eb0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f9112ffd640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 0x7f9114197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f91137fe640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114197830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f910400e9a0 tx=0x7f910400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f910400cc90 con 0x7f9114072eb0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911419cf50 con 0x7f9114072eb0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f910400cdf0 con 0x7f9114072eb0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91040187f0 con 0x7f9114072eb0 2024-09-21T10:41:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.897+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911419d490 con 0x7f9114072eb0 2024-09-21T10:41:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.899+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9114073310 con 0x7f9114072eb0 2024-09-21T10:41:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.899+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7f9104010c10 con 0x7f9114072eb0 2024-09-21T10:41:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.900+0000 7f9110ff9640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f90fc07b020 0x7f90fc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.900+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9104014070 con 0x7f9114072eb0 2024-09-21T10:41:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.900+0000 7f9112ffd640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f90fc07b020 0x7f90fc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.901+0000 7f9112ffd640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f90fc07b020 0x7f90fc07d4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c00 tx=0x7f91080314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:52.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:52.909+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f91040617a0 con 0x7f9114072eb0 2024-09-21T10:41:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.125+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f911402c4f0 con 0x7f90fc07b020 2024-09-21T10:41:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.127+0000 7f9110ff9640 1 -- 172.21.15.60:0/1983338353 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f911402c4f0 con 0x7f90fc07b020 2024-09-21T10:41:53.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f90fc07b020 msgr2=0x7f90fc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f90fc07b020 0x7f90fc07d4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c00 tx=0x7f91080314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 msgr2=0x7f9114197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114197830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f910400e9a0 tx=0x7f910400ee60 comp rx=0 tx=0).stop 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 shutdown_connections 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f90fc07b020 0x7f90fc07d4e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9114074480 0x7f9114197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 --2- 172.21.15.60:0/1983338353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9114072eb0 0x7f9114197830 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 >> 172.21.15.60:0/1983338353 conn(0x7f91140fb320 msgr2=0x7f9114105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 shutdown_connections 2024-09-21T10:41:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.130+0000 7f9119af9640 1 -- 172.21.15.60:0/1983338353 wait complete. 2024-09-21T10:41:53.141 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:41:53.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 -- 172.21.15.60:0/1041537320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26740ffb90 msgr2=0x7f26740fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 --2- 172.21.15.60:0/1041537320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26740ffb90 0x7f26740fff90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2670009880 tx=0x7f267002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 -- 172.21.15.60:0/1041537320 shutdown_connections 2024-09-21T10:41:53.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 --2- 172.21.15.60:0/1041537320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2674100d90 0x7f2674101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 --2- 172.21.15.60:0/1041537320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26740ffb90 0x7f26740fff90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 -- 172.21.15.60:0/1041537320 >> 172.21.15.60:0/1041537320 conn(0x7f26740fb320 msgr2=0x7f26740fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:53.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 -- 172.21.15.60:0/1041537320 shutdown_connections 2024-09-21T10:41:53.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.223+0000 7f267c248640 1 -- 172.21.15.60:0/1041537320 wait complete. 2024-09-21T10:41:53.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f267c248640 1 Processor -- start 2024-09-21T10:41:53.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f267c248640 1 -- start start 2024-09-21T10:41:53.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f267c248640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740ffb90 0x7f2674197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:53.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f267c248640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 0x7f2674197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f267c248640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674198340 con 0x7f2674100d90 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f267c248640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26741984b0 con 0x7f26740ffb90 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f26797e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 0x7f2674197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f26797e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 0x7f2674197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48012/0 (socket says 172.21.15.60:48012) 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.224+0000 7f26797e3640 1 -- 172.21.15.60:0/3652221594 learned_addr learned my addr 172.21.15.60:0/3652221594 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f2679fe4640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740ffb90 0x7f2674197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f26797e3640 1 -- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740ffb90 msgr2=0x7f2674197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f26797e3640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740ffb90 0x7f2674197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f26797e3640 1 -- 172.21.15.60:0/3652221594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2670009560 con 0x7f2674100d90 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f26797e3640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 0x7f2674197d70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f266400c920 tx=0x7f266400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2664007b80 con 0x7f2674100d90 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267419cf50 con 0x7f2674100d90 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26640054e0 con 0x7f2674100d90 2024-09-21T10:41:53.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f266400f450 con 0x7f2674100d90 2024-09-21T10:41:53.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.225+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267419d4f0 con 0x7f2674100d90 2024-09-21T10:41:53.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.227+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26740fff90 con 0x7f2674100d90 2024-09-21T10:41:53.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.228+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7f2664004f60 con 0x7f2674100d90 2024-09-21T10:41:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.229+0000 7f266affd640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f266007b020 0x7f266007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.229+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f266409dd00 con 0x7f2674100d90 2024-09-21T10:41:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.229+0000 7f2679fe4640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f266007b020 0x7f266007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:53.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.230+0000 7f2679fe4640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f266007b020 0x7f266007d4e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2670009230 tx=0x7f2670005b50 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:53.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.237+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f26640a1030 con 0x7f2674100d90 2024-09-21T10:41:53.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.487+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f267402c540 con 0x7f266007b020 2024-09-21T10:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.488+0000 7f266affd640 1 -- 172.21.15.60:0/3652221594 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f267402c540 con 0x7f266007b020 2024-09-21T10:41:53.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f266007b020 msgr2=0x7f266007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f266007b020 0x7f266007d4e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2670009230 tx=0x7f2670005b50 comp rx=0 tx=0).stop 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 msgr2=0x7f2674197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 0x7f2674197d70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f266400c920 tx=0x7f266400cde0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 shutdown_connections 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f266007b020 0x7f266007d4e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2674100d90 0x7f2674197d70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 --2- 172.21.15.60:0/3652221594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26740ffb90 0x7f2674197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 >> 172.21.15.60:0/3652221594 conn(0x7f26740fb320 msgr2=0x7f2674072b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 shutdown_connections 2024-09-21T10:41:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.490+0000 7f267c248640 1 -- 172.21.15.60:0/3652221594 wait complete. 2024-09-21T10:41:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.596+0000 7f615bb27640 1 -- 172.21.15.60:0/1198873913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540febe0 msgr2=0x7f61540ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.596+0000 7f615bb27640 1 --2- 172.21.15.60:0/1198873913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540febe0 0x7f61540ff060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f614c009b60 tx=0x7f614c02a770 comp rx=0 tx=0).stop 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.597+0000 7f615bb27640 1 -- 172.21.15.60:0/1198873913 shutdown_connections 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.597+0000 7f615bb27640 1 --2- 172.21.15.60:0/1198873913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540febe0 0x7f61540ff060 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.597+0000 7f615bb27640 1 --2- 172.21.15.60:0/1198873913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61540fde70 0x7f61540fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.597+0000 7f615bb27640 1 -- 172.21.15.60:0/1198873913 >> 172.21.15.60:0/1198873913 conn(0x7f61540f99c0 msgr2=0x7f61540fbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.597+0000 7f615bb27640 1 -- 172.21.15.60:0/1198873913 shutdown_connections 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.597+0000 7f615bb27640 1 -- 172.21.15.60:0/1198873913 wait complete. 2024-09-21T10:41:53.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.598+0000 7f615bb27640 1 Processor -- start 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.598+0000 7f615bb27640 1 -- start start 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.598+0000 7f615bb27640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 0x7f61541a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.598+0000 7f615bb27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61540febe0 0x7f61541a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.598+0000 7f615bb27640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61541a4f50 con 0x7f61540febe0 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.598+0000 7f615bb27640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61541a50c0 con 0x7f61540fde70 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61598c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 0x7f61541a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61598c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 0x7f61541a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:43260/0 (socket says 172.21.15.60:43260) 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61598c3640 1 -- 172.21.15.60:0/3704647083 learned_addr learned my addr 172.21.15.60:0/3704647083 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:53.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61590c2640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61540febe0 0x7f61541a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61598c3640 1 -- 172.21.15.60:0/3704647083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61540febe0 msgr2=0x7f61541a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61598c3640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61540febe0 0x7f61541a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.599+0000 7f61598c3640 1 -- 172.21.15.60:0/3704647083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009840 con 0x7f61540fde70 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.600+0000 7f61598c3640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 0x7f61541a4440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f615000e940 tx=0x7f615000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.600+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615000cc90 con 0x7f61540fde70 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.600+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61541a9b60 con 0x7f61540fde70 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.600+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f615000cdf0 con 0x7f61540fde70 2024-09-21T10:41:53.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.600+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6150010430 con 0x7f61540fde70 2024-09-21T10:41:53.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.600+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61541aa080 con 0x7f61540fde70 2024-09-21T10:41:53.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.602+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6138005280 con 0x7f61540fde70 2024-09-21T10:41:53.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.603+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7f6150005020 con 0x7f61540fde70 2024-09-21T10:41:53.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.604+0000 7f614affd640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f614007b0b0 0x7f614007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:53.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.604+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6150014070 con 0x7f61540fde70 2024-09-21T10:41:53.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.605+0000 7f61590c2640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f614007b0b0 0x7f614007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:53.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.606+0000 7f61590c2640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f614007b0b0 0x7f614007d570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f614c009b30 tx=0x7f614c000f40 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:53.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.612+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f61500617f0 con 0x7f61540fde70 2024-09-21T10:41:53.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.921+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6138000bf0 con 0x7f614007b0b0 2024-09-21T10:41:53.924 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:53 smithi060 ceph-mon[28215]: pgmap v43: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 2.1 MiB/s wr, 186 op/s 2024-09-21T10:41:53.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.930+0000 7f614affd640 1 -- 172.21.15.60:0/3704647083 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6138000bf0 con 0x7f614007b0b0 2024-09-21T10:41:53.933 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (7m) 15s ago 9m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (47s) 15s ago 10m 7436k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (31s) 22s ago 8m 6958k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (9m) 15s ago 9m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (8m) 22s ago 8m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (7m) 15s ago 9m 84.5M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (3m) 15s ago 3m 230M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (3m) 15s ago 3m 13.8M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (3m) 22s ago 3m 15.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (3m) 22s ago 3m 17.9M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (26s) 15s ago 11m 90.0M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:41:53.934 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (94s) 22s ago 8m 508M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f97064c83946 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (11m) 15s ago 11m 52.2M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (8m) 22s ago 8m 40.5M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (9m) 15s ago 9m 16.5M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (8m) 22s ago 8m 15.5M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (7m) 15s ago 7m 202M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (6m) 15s ago 6m 213M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (6m) 15s ago 6m 175M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (6m) 22s ago 5m 249M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (5m) 22s ago 5m 212M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (5m) 22s ago 5m 200M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:41:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (36s) 15s ago 9m 38.8M - 2.43.0 a07b618ecd1d f737449ce4c2 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f614007b0b0 msgr2=0x7f614007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f614007b0b0 0x7f614007d570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f614c009b30 tx=0x7f614c000f40 comp rx=0 tx=0).stop 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 msgr2=0x7f61541a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 0x7f61541a4440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f615000e940 tx=0x7f615000ee00 comp rx=0 tx=0).stop 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 shutdown_connections 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f614007b0b0 0x7f614007d570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61540febe0 0x7f61541a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 --2- 172.21.15.60:0/3704647083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61540fde70 0x7f61541a4440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.933+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 >> 172.21.15.60:0/3704647083 conn(0x7f61540f99c0 msgr2=0x7f6154101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.934+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 shutdown_connections 2024-09-21T10:41:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:53.934+0000 7f615bb27640 1 -- 172.21.15.60:0/3704647083 wait complete. 2024-09-21T10:41:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:53 smithi112 ceph-mon[35117]: pgmap v43: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 2.1 MiB/s wr, 186 op/s 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 -- 172.21.15.60:0/4042329711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768072eb0 msgr2=0x7fb768073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/4042329711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768072eb0 0x7fb768073310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009880 tx=0x7fb75c02a530 comp rx=0 tx=0).stop 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 -- 172.21.15.60:0/4042329711 shutdown_connections 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/4042329711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768072eb0 0x7fb768073310 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/4042329711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768074480 0x7fb7680728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 -- 172.21.15.60:0/4042329711 >> 172.21.15.60:0/4042329711 conn(0x7fb7680fb320 msgr2=0x7fb7680fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 -- 172.21.15.60:0/4042329711 shutdown_connections 2024-09-21T10:41:54.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 -- 172.21.15.60:0/4042329711 wait complete. 2024-09-21T10:41:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 Processor -- start 2024-09-21T10:41:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.042+0000 7fb76d8fd640 1 -- start start 2024-09-21T10:41:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76d8fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 0x7fb768197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76d8fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768074480 0x7fb768197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76d8fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb768198370 con 0x7fb768074480 2024-09-21T10:41:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76d8fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681984e0 con 0x7fb768072eb0 2024-09-21T10:41:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 0x7fb768197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 0x7fb768197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:43282/0 (socket says 172.21.15.60:43282) 2024-09-21T10:41:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 -- 172.21.15.60:0/1452320137 learned_addr learned my addr 172.21.15.60:0/1452320137 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb7667fc640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768074480 0x7fb768197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 -- 172.21.15.60:0/1452320137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768074480 msgr2=0x7fb768197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768074480 0x7fb768197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 -- 172.21.15.60:0/1452320137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009560 con 0x7fb768072eb0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb766ffd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 0x7fb768197860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb75800e970 tx=0x7fb75800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb75800cc90 con 0x7fb768072eb0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb75800cdf0 con 0x7fb768072eb0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76819cf10 con 0x7fb768072eb0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb758018810 con 0x7fb768072eb0 2024-09-21T10:41:54.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.044+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76819d390 con 0x7fb768072eb0 2024-09-21T10:41:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.047+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb768191900 con 0x7fb768072eb0 2024-09-21T10:41:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.047+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7fb758010c10 con 0x7fb768072eb0 2024-09-21T10:41:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.048+0000 7fb76c8fb640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb75007b020 0x7fb75007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.048+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb758014070 con 0x7fb768072eb0 2024-09-21T10:41:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.049+0000 7fb7667fc640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb75007b020 0x7fb75007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.049+0000 7fb7667fc640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb75007b020 0x7fb75007d4e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009230 tx=0x7fb75c0058d0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:54.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.052+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fb758064fe0 con 0x7fb768072eb0 2024-09-21T10:41:54.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.506+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb76802c4d0 con 0x7fb768072eb0 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.507+0000 7fb76c8fb640 1 -- 172.21.15.60:0/1452320137 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+731 (secure 0 0 0) 0x7fb758064980 con 0x7fb768072eb0 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:41:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 12, 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:41:54.511 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:41:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.514+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb75007b020 msgr2=0x7fb75007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.514+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb75007b020 0x7fb75007d4e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009230 tx=0x7fb75c0058d0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.514+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 msgr2=0x7fb768197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.514+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 0x7fb768197860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb75800e970 tx=0x7fb75800ee30 comp rx=0 tx=0).stop 2024-09-21T10:41:54.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.516+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 shutdown_connections 2024-09-21T10:41:54.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.516+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fb75007b020 0x7fb75007d4e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.516+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb768074480 0x7fb768197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.516+0000 7fb76d8fd640 1 --2- 172.21.15.60:0/1452320137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb768072eb0 0x7fb768197860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.516+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 >> 172.21.15.60:0/1452320137 conn(0x7fb7680fb320 msgr2=0x7fb768105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.521+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 shutdown_connections 2024-09-21T10:41:54.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.522+0000 7fb76d8fd640 1 -- 172.21.15.60:0/1452320137 wait complete. 2024-09-21T10:41:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.674+0000 7f45527fc640 1 -- 172.21.15.60:0/2968355247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45480318b0 con 0x7f45540fe1b0 2024-09-21T10:41:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.675+0000 7f4559e6e640 1 -- 172.21.15.60:0/2968355247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fe1b0 msgr2=0x7f4554105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.675+0000 7f4559e6e640 1 --2- 172.21.15.60:0/2968355247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fe1b0 0x7f4554105320 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45480098b0 tx=0x7f454802a4f0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.675+0000 7f4559e6e640 1 -- 172.21.15.60:0/2968355247 shutdown_connections 2024-09-21T10:41:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.675+0000 7f4559e6e640 1 --2- 172.21.15.60:0/2968355247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fe1b0 0x7f4554105320 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.675+0000 7f4559e6e640 1 --2- 172.21.15.60:0/2968355247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fd7e0 0x7f45540fdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.675+0000 7f4559e6e640 1 -- 172.21.15.60:0/2968355247 >> 172.21.15.60:0/2968355247 conn(0x7f45540f9540 msgr2=0x7f45540fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.676+0000 7f4559e6e640 1 -- 172.21.15.60:0/2968355247 shutdown_connections 2024-09-21T10:41:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.676+0000 7f4559e6e640 1 -- 172.21.15.60:0/2968355247 wait complete. 2024-09-21T10:41:54.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.677+0000 7f4559e6e640 1 Processor -- start 2024-09-21T10:41:54.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.677+0000 7f4559e6e640 1 -- start start 2024-09-21T10:41:54.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.678+0000 7f4559e6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fd7e0 0x7f4554197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:54.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.678+0000 7f4559e6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 0x7f4554197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:54.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.678+0000 7f4559e6e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4554198450 con 0x7f45540fd7e0 2024-09-21T10:41:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.679+0000 7f4552ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 0x7f4554197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.679+0000 7f4552ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 0x7f4554197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:52922/0 (socket says 172.21.15.60:52922) 2024-09-21T10:41:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.679+0000 7f4552ffd640 1 -- 172.21.15.60:0/3289808529 learned_addr learned my addr 172.21.15.60:0/3289808529 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.679+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541985c0 con 0x7f45540fe1b0 2024-09-21T10:41:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.679+0000 7f45537fe640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fd7e0 0x7f4554197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.680+0000 7f4552ffd640 1 -- 172.21.15.60:0/3289808529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fd7e0 msgr2=0x7f4554197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.680+0000 7f4552ffd640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fd7e0 0x7f4554197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.680+0000 7f4552ffd640 1 -- 172.21.15.60:0/3289808529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009560 con 0x7f45540fe1b0 2024-09-21T10:41:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.680+0000 7f45537fe640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fd7e0 0x7f4554197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:41:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.680+0000 7f4552ffd640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 0x7f4554197e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4548006010 tx=0x7f4548005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.681+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4548004be0 con 0x7f45540fe1b0 2024-09-21T10:41:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.681+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4548004d40 con 0x7f45540fe1b0 2024-09-21T10:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.681+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455419d000 con 0x7f45540fe1b0 2024-09-21T10:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.681+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4548003c60 con 0x7f45540fe1b0 2024-09-21T10:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.681+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455419d4b0 con 0x7f45540fe1b0 2024-09-21T10:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.683+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4540005280 con 0x7f45540fe1b0 2024-09-21T10:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.684+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7f4548031640 con 0x7f45540fe1b0 2024-09-21T10:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.685+0000 7f4550ff9640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f453c07b140 0x7f453c07d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.685+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f45480befd0 con 0x7f45540fe1b0 2024-09-21T10:41:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.686+0000 7f45537fe640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f453c07b140 0x7f453c07d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.687+0000 7f45537fe640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f453c07b140 0x7f453c07d600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f454400a8b0 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:54.691+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f45480823d0 con 0x7f45540fe1b0 2024-09-21T10:41:54.763 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:54 smithi060 ceph-mon[28215]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:54.763 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:54 smithi060 ceph-mon[28215]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:54 smithi112 ceph-mon[35117]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:54 smithi112 ceph-mon[35117]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:55.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.045+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4540005800 con 0x7f45540fe1b0 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.045+0000 7f4550ff9640 1 -- 172.21.15.60:0/3289808529 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f45480854f0 con 0x7f45540fe1b0 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:41:55.048 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:41:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:55.050 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:41:55.051 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.048+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f453c07b140 msgr2=0x7f453c07d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.048+0000 7f4559e6e640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f453c07b140 0x7f453c07d600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f454400a8b0 tx=0x7f4544008040 comp rx=0 tx=0).stop 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.048+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 msgr2=0x7f4554197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.048+0000 7f4559e6e640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 0x7f4554197e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4548006010 tx=0x7f4548005610 comp rx=0 tx=0).stop 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 shutdown_connections 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f453c07b140 0x7f453c07d600 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45540fe1b0 0x7f4554197e80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 --2- 172.21.15.60:0/3289808529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45540fd7e0 0x7f4554197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 >> 172.21.15.60:0/3289808529 conn(0x7f45540f9540 msgr2=0x7f4554102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 shutdown_connections 2024-09-21T10:41:55.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.049+0000 7f4559e6e640 1 -- 172.21.15.60:0/3289808529 wait complete. 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 -- 172.21.15.60:0/3116822095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 msgr2=0x7fde080fdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/3116822095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde080fdbe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009880 tx=0x7fddfc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 -- 172.21.15.60:0/3116822095 shutdown_connections 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/3116822095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde080fdbe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/3116822095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 -- 172.21.15.60:0/3116822095 >> 172.21.15.60:0/3116822095 conn(0x7fde080f9950 msgr2=0x7fde080fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 -- 172.21.15.60:0/3116822095 shutdown_connections 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.178+0000 7fde0d2b3640 1 -- 172.21.15.60:0/3116822095 wait complete. 2024-09-21T10:41:55.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.180+0000 7fde0d2b3640 1 Processor -- start 2024-09-21T10:41:55.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.180+0000 7fde0d2b3640 1 -- start start 2024-09-21T10:41:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.180+0000 7fde0d2b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde0d2b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde08195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde0d2b3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08196160 con 0x7fde08101b30 2024-09-21T10:41:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde06ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde06ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:52950/0 (socket says 172.21.15.60:52950) 2024-09-21T10:41:55.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde06ffd640 1 -- 172.21.15.60:0/1287670552 learned_addr learned my addr 172.21.15.60:0/1287670552 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:55.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081962d0 con 0x7fde08101160 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.181+0000 7fde067fc640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde08195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.182+0000 7fde067fc640 1 -- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 msgr2=0x7fde08195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.182+0000 7fde067fc640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.182+0000 7fde067fc640 1 -- 172.21.15.60:0/1287670552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009560 con 0x7fde08101b30 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.182+0000 7fde06ffd640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.182+0000 7fde067fc640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde08195b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fde08067ba0 tx=0x7fddfc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.183+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddfc004aa0 con 0x7fde08101b30 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.183+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddfc005d50 con 0x7fde08101b30 2024-09-21T10:41:55.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.183+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddfc0039b0 con 0x7fde08101b30 2024-09-21T10:41:55.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.183+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde080fecf0 con 0x7fde08101b30 2024-09-21T10:41:55.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.183+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde080ff260 con 0x7fde08101b30 2024-09-21T10:41:55.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.184+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0818f6e0 con 0x7fde08101b30 2024-09-21T10:41:55.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.185+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7fddfc031c00 con 0x7fde08101b30 2024-09-21T10:41:55.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.186+0000 7fddeffff640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fddf007f430 0x7fddf00818f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:55.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.186+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fddfc0bee60 con 0x7fde08101b30 2024-09-21T10:41:55.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.186+0000 7fde06ffd640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fddf007f430 0x7fddf00818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:55.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.187+0000 7fde06ffd640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fddf007f430 0x7fddf00818f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddf80058c0 tx=0x7fddf8005f90 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:55.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.191+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fddfc082310 con 0x7fde08101b30 2024-09-21T10:41:55.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.482+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 --> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde0802c550 con 0x7fddf007f430 2024-09-21T10:41:55.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.484+0000 7fddeffff640 1 -- 172.21.15.60:0/1287670552 <== mgr.24465 v2:172.21.15.112:6828/2321701771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fde0802c550 con 0x7fddf007f430 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:41:55.486 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:41:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fddf007f430 msgr2=0x7fddf00818f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fddf007f430 0x7fddf00818f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddf80058c0 tx=0x7fddf8005f90 comp rx=0 tx=0).stop 2024-09-21T10:41:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 msgr2=0x7fde08195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde08195b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fde08067ba0 tx=0x7fddfc0055a0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 shutdown_connections 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7fddf007f430 0x7fddf00818f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde08101b30 0x7fde08195b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 --2- 172.21.15.60:0/1287670552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde08101160 0x7fde08195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 >> 172.21.15.60:0/1287670552 conn(0x7fde080f9950 msgr2=0x7fde08104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 shutdown_connections 2024-09-21T10:41:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.486+0000 7fde0d2b3640 1 -- 172.21.15.60:0/1287670552 wait complete. 2024-09-21T10:41:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 -- 172.21.15.60:0/316183880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 msgr2=0x7f844c103400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 --2- 172.21.15.60:0/316183880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c103400 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f843c009880 tx=0x7f843c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 -- 172.21.15.60:0/316183880 shutdown_connections 2024-09-21T10:41:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 --2- 172.21.15.60:0/316183880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c103400 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 --2- 172.21.15.60:0/316183880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 0x7f844c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 -- 172.21.15.60:0/316183880 >> 172.21.15.60:0/316183880 conn(0x7f844c0fd550 msgr2=0x7f844c0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:55.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 -- 172.21.15.60:0/316183880 shutdown_connections 2024-09-21T10:41:55.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.599+0000 7f84539d8640 1 -- 172.21.15.60:0/316183880 wait complete. 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f84539d8640 1 Processor -- start 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f84539d8640 1 -- start start 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f84539d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 0x7f844c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f84539d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f84539d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c198340 con 0x7f844c102f80 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f84539d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1984b0 con 0x7f844c101d80 2024-09-21T10:41:55.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f8450f73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f8451774640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 0x7f844c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f8450f73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54186/0 (socket says 172.21.15.60:54186) 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.600+0000 7f8450f73640 1 -- 172.21.15.60:0/1642117187 learned_addr learned my addr 172.21.15.60:0/1642117187 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f8451774640 1 -- 172.21.15.60:0/1642117187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 msgr2=0x7f844c197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f8451774640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f8451774640 1 -- 172.21.15.60:0/1642117187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009560 con 0x7f844c101d80 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f8451774640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 0x7f844c197830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f844800e940 tx=0x7f844800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800cc90 con 0x7f844c101d80 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f844800cdf0 con 0x7f844c101d80 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f84539d8640 1 -- 172.21.15.60:0/1642117187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c19cf50 con 0x7f844c101d80 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448010430 con 0x7f844c101d80 2024-09-21T10:41:55.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.601+0000 7f84539d8640 1 -- 172.21.15.60:0/1642117187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c19d490 con 0x7f844c101d80 2024-09-21T10:41:55.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.602+0000 7f84539d8640 1 -- 172.21.15.60:0/1642117187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c102180 con 0x7f844c101d80 2024-09-21T10:41:55.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.603+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 26) v1 ==== 103285+0+0 (secure 0 0 0) 0x7f8448003fa0 con 0x7f844c101d80 2024-09-21T10:41:55.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.604+0000 7f84427fc640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f843807b020 0x7f843807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:41:55.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.604+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8448014070 con 0x7f844c101d80 2024-09-21T10:41:55.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.604+0000 7f8450f73640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f843807b020 0x7f843807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:41:55.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.605+0000 7f8450f73640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f843807b020 0x7f843807d4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f844c198d50 tx=0x7f843c0314e0 comp rx=0 tx=0).ready entity=mgr.24465 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:41:55.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.609+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f84480616d0 con 0x7f844c101d80 2024-09-21T10:41:55.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:55 smithi060 ceph-mon[28215]: from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:55.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:55 smithi060 ceph-mon[28215]: pgmap v44: 65 pgs: 65 active+clean; 320 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 2.9 MiB/s wr, 714 op/s 2024-09-21T10:41:55.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:55 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1452320137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:41:55.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:55 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/3289808529' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:41:55.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.891+0000 7f84539d8640 1 -- 172.21.15.60:0/1642117187 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f844c191900 con 0x7f844c101d80 2024-09-21T10:41:55.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.898+0000 7f84427fc640 1 -- 172.21.15.60:0/1642117187 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f84480647f0 con 0x7f844c101d80 2024-09-21T10:41:55.903 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:41:55.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.907+0000 7f8437fff640 1 -- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f843807b020 msgr2=0x7f843807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.907+0000 7f8437fff640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f843807b020 0x7f843807d4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f844c198d50 tx=0x7f843c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.907+0000 7f8437fff640 1 -- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 msgr2=0x7f844c197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.907+0000 7f8437fff640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 0x7f844c197830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f844800e940 tx=0x7f844800ee00 comp rx=0 tx=0).stop 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.908+0000 7f8437fff640 1 -- 172.21.15.60:0/1642117187 shutdown_connections 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.908+0000 7f8437fff640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:6828/2321701771,v1:172.21.15.112:6829/2321701771] conn(0x7f843807b020 0x7f843807d4e0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f844c198d50 tx=0x7f843c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.908+0000 7f8437fff640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f844c102f80 0x7f844c197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.908+0000 7f8437fff640 1 --2- 172.21.15.60:0/1642117187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f844c101d80 0x7f844c197830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:41:55.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.908+0000 7f8437fff640 1 -- 172.21.15.60:0/1642117187 >> 172.21.15.60:0/1642117187 conn(0x7f844c0fd550 msgr2=0x7f844c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:41:55.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.911+0000 7f8437fff640 1 -- 172.21.15.60:0/1642117187 shutdown_connections 2024-09-21T10:41:55.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:41:55.913+0000 7f8437fff640 1 -- 172.21.15.60:0/1642117187 wait complete. 2024-09-21T10:41:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:55 smithi112 ceph-mon[35117]: from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:55 smithi112 ceph-mon[35117]: pgmap v44: 65 pgs: 65 active+clean; 320 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 2.9 MiB/s wr, 714 op/s 2024-09-21T10:41:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:55 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1452320137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:41:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:55 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/3289808529' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:41:56.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:56.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/1642117187' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:41:56.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:56.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:56.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:41:56.529 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr fail", "who": "smithi112.gkunly"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr fail", "who": "smithi112.gkunly"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd='[{"prefix": "mgr fail", "who": "smithi112.gkunly"}]': finished 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: mgrmap e27: smithi060.mulzpr(active, starting, since 0.00725231s) 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"}]: dispatch 2024-09-21T10:41:56.530 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:41:56.531 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:56 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1642117187' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:56.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 172.21.15.112:0/1138091709' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr fail", "who": "smithi112.gkunly"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "mgr fail", "who": "smithi112.gkunly"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.24465 ' entity='mgr.smithi112.gkunly' cmd='[{"prefix": "mgr fail", "who": "smithi112.gkunly"}]': finished 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: mgrmap e27: smithi060.mulzpr(active, starting, since 0.00725231s) 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T10:41:56.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T10:41:56.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T10:41:56.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T10:41:56.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T10:41:56.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T10:41:56.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T10:41:56.953 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:56 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T10:41:57.585 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:57 smithi060 ceph-mon[28215]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:41:57.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:57 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:57.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:57 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:41:57.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:57 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:41:57.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:57 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:57.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:57 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"}]: dispatch 2024-09-21T10:41:57.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:57 smithi112 ceph-mon[35117]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:41:57.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:57 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:41:57.858 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:57 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"}]: dispatch 2024-09-21T10:41:57.858 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:57 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:41:57.858 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:57 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:41:57.858 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:57 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"}]: dispatch 2024-09-21T10:41:58.860 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:58 smithi060 ceph-mon[28215]: mgrmap e28: smithi060.mulzpr(active, since 1.28354s) 2024-09-21T10:41:58.861 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:58 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:41:58.861 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:58 smithi060 ceph-mon[28215]: pgmap v3: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:41:58.861 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:41:58 smithi060 ceph-mon[28215]: pgmap v4: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:41:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:58 smithi112 ceph-mon[35117]: mgrmap e28: smithi060.mulzpr(active, since 1.28354s) 2024-09-21T10:41:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:58 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:41:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:58 smithi112 ceph-mon[35117]: pgmap v3: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:41:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:41:58 smithi112 ceph-mon[35117]: pgmap v4: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:42:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:41:59] ENGINE Bus STARTING 2024-09-21T10:42:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:41:59] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:42:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: mgrmap e29: smithi060.mulzpr(active, since 3s) 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:41:59] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:41:59] ENGINE Bus STARTED 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:41:59] ENGINE Error in HTTPServer.serve 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:42:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:42:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:00 smithi112 ceph-mon[35117]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: [21/Sep/2024:10:41:59] ENGINE Bus STARTING 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: [21/Sep/2024:10:41:59] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: mgrmap e29: smithi060.mulzpr(active, since 3s) 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: [21/Sep/2024:10:41:59] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: [21/Sep/2024:10:41:59] ENGINE Bus STARTED 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: [21/Sep/2024:10:41:59] ENGINE Error in HTTPServer.serve 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Traceback (most recent call last): 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._run(expiration_interval) 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:42:00.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self.do_handshake() 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:42:00.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:00 smithi060 ceph-mon[28215]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:42:02.135 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:01 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.135 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:01 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.135 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:01 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.135 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:01 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:01 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:01 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:01 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:01 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:02 smithi060 ceph-mon[28215]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:42:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:02 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:42:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:02 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:42:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:02 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:42:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:02 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:42:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:02 smithi060 ceph-mon[28215]: pgmap v6: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:42:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:02 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:42:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:02 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:42:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:02 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:42:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:02 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:42:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:02 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/1468848937' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:42:03.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:02 smithi112 ceph-mon[35117]: pgmap v6: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:42:04.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:03 smithi060 ceph-mon[28215]: mgrmap e30: smithi060.mulzpr(active, since 6s), standbys: smithi112.gkunly 2024-09-21T10:42:04.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:03 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"}]: dispatch 2024-09-21T10:42:04.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:03 smithi112 ceph-mon[35117]: mgrmap e30: smithi060.mulzpr(active, since 6s), standbys: smithi112.gkunly 2024-09-21T10:42:04.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:03 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"}]: dispatch 2024-09-21T10:42:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:04 smithi060 ceph-mon[28215]: pgmap v7: 65 pgs: 65 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.4 MiB/s wr, 632 op/s 2024-09-21T10:42:05.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:04 smithi112 ceph-mon[35117]: pgmap v7: 65 pgs: 65 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.4 MiB/s wr, 632 op/s 2024-09-21T10:42:07.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:07 smithi060 ceph-mon[28215]: pgmap v8: 65 pgs: 65 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.1 MiB/s wr, 487 op/s 2024-09-21T10:42:07.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:07 smithi112 ceph-mon[35117]: pgmap v8: 65 pgs: 65 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.1 MiB/s wr, 487 op/s 2024-09-21T10:42:09.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:09 smithi060 ceph-mon[28215]: pgmap v9: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 1.9 MiB/s wr, 598 op/s 2024-09-21T10:42:09.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:09 smithi112 ceph-mon[35117]: pgmap v9: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 1.9 MiB/s wr, 598 op/s 2024-09-21T10:42:11.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:11 smithi060 ceph-mon[28215]: pgmap v10: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.7 MiB/s wr, 533 op/s 2024-09-21T10:42:11.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:11 smithi112 ceph-mon[35117]: pgmap v10: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.7 MiB/s wr, 533 op/s 2024-09-21T10:42:12.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:12 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:12 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.678 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:12 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:12 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:12 smithi060 ceph-mon[28215]: pgmap v11: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.7 MiB/s wr, 533 op/s 2024-09-21T10:42:12.679 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:12 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:42:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:12 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:12 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:12 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:12 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:12 smithi112 ceph-mon[35117]: pgmap v11: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.7 MiB/s wr, 533 op/s 2024-09-21T10:42:12.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:12 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:42:15.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:15 smithi060 ceph-mon[28215]: pgmap v12: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 2.5 MiB/s wr, 776 op/s 2024-09-21T10:42:15.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:15 smithi112 ceph-mon[35117]: pgmap v12: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 2.5 MiB/s wr, 776 op/s 2024-09-21T10:42:17.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:17 smithi060 ceph-mon[28215]: pgmap v13: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 423 op/s 2024-09-21T10:42:17.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:17 smithi112 ceph-mon[35117]: pgmap v13: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 423 op/s 2024-09-21T10:42:19.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:19 smithi112 ceph-mon[35117]: pgmap v14: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 871 op/s 2024-09-21T10:42:19.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:19 smithi060 ceph-mon[28215]: pgmap v14: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 871 op/s 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:42:21.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: pgmap v15: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 691 op/s 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:21 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:42:21.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: pgmap v15: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 691 op/s 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:21.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:21 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:22 smithi060 ceph-mon[28215]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:42:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:22 smithi060 ceph-mon[28215]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:42:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:22 smithi060 ceph-mon[28215]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:42:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:22 smithi060 ceph-mon[28215]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:42:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:22 smithi060 ceph-mon[28215]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-09-21T10:42:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:22 smithi060 ceph-mon[28215]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-09-21T10:42:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:22 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:42:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:22 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:42:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:22 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:42:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:22 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:42:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:22 smithi112 ceph-mon[35117]: Reconfiguring prometheus.smithi060 (dependencies changed)... 2024-09-21T10:42:22.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:22 smithi112 ceph-mon[35117]: Reconfiguring daemon prometheus.smithi060 on smithi060 2024-09-21T10:42:23.289 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:23 smithi060 ceph-mon[28215]: pgmap v16: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 691 op/s 2024-09-21T10:42:23.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:23 smithi112 ceph-mon[35117]: pgmap v16: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 691 op/s 2024-09-21T10:42:25.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:25 smithi060 ceph-mon[28215]: pgmap v17: 65 pgs: 65 active+clean; 243 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 1.21k op/s 2024-09-21T10:42:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:25 smithi112 ceph-mon[35117]: pgmap v17: 65 pgs: 65 active+clean; 243 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 1.21k op/s 2024-09-21T10:42:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.092+0000 7f3860594640 1 -- 172.21.15.60:0/3096704868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 msgr2=0x7f38580feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.092+0000 7f3860594640 1 --2- 172.21.15.60:0/3096704868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 0x7f38580feef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f384c009880 tx=0x7f384c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.097+0000 7f3860594640 1 -- 172.21.15.60:0/3096704868 shutdown_connections 2024-09-21T10:42:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.097+0000 7f3860594640 1 --2- 172.21.15.60:0/3096704868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f3858100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.097+0000 7f3860594640 1 --2- 172.21.15.60:0/3096704868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 0x7f38580feef0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.097+0000 7f3860594640 1 -- 172.21.15.60:0/3096704868 >> 172.21.15.60:0/3096704868 conn(0x7f38580fa280 msgr2=0x7f38580fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.098+0000 7f3860594640 1 -- 172.21.15.60:0/3096704868 shutdown_connections 2024-09-21T10:42:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.100+0000 7f3860594640 1 -- 172.21.15.60:0/3096704868 wait complete. 2024-09-21T10:42:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.101+0000 7f3860594640 1 Processor -- start 2024-09-21T10:42:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.102+0000 7f3860594640 1 -- start start 2024-09-21T10:42:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.102+0000 7f3860594640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 0x7f385819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.102+0000 7f3860594640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f385819c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.102+0000 7f3860594640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819c7c0 con 0x7f38580feaf0 2024-09-21T10:42:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.102+0000 7f3860594640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819c930 con 0x7f38580ffcf0 2024-09-21T10:42:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.106+0000 7f385db2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f385819c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.106+0000 7f385db2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f385819c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:42182/0 (socket says 172.21.15.60:42182) 2024-09-21T10:42:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.106+0000 7f385db2f640 1 -- 172.21.15.60:0/3088903305 learned_addr learned my addr 172.21.15.60:0/3088903305 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:26.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.107+0000 7f385e330640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 0x7f385819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.108+0000 7f385db2f640 1 -- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 msgr2=0x7f385819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.108+0000 7f385db2f640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 0x7f385819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.108+0000 7f385db2f640 1 -- 172.21.15.60:0/3088903305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009560 con 0x7f38580ffcf0 2024-09-21T10:42:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.110+0000 7f385db2f640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f385819c1c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f385400c810 tx=0x7f385400ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.111+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38540041f0 con 0x7f38580ffcf0 2024-09-21T10:42:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.111+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38581a13c0 con 0x7f38580ffcf0 2024-09-21T10:42:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.111+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38581a18e0 con 0x7f38580ffcf0 2024-09-21T10:42:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.113+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3854007e70 con 0x7f38580ffcf0 2024-09-21T10:42:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.113+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38540049d0 con 0x7f38580ffcf0 2024-09-21T10:42:26.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.113+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3858195d70 con 0x7f38580ffcf0 2024-09-21T10:42:26.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.120+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7f38540079b0 con 0x7f38580ffcf0 2024-09-21T10:42:26.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.121+0000 7f384b7fe640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f384407b1a0 0x7f384407d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:26.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.122+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f385409e340 con 0x7f38580ffcf0 2024-09-21T10:42:26.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.122+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f385409e7c0 con 0x7f38580ffcf0 2024-09-21T10:42:26.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.122+0000 7f385e330640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f384407b1a0 0x7f384407d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:26.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.123+0000 7f385e330640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f384407b1a0 0x7f384407d660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384c02aac0 tx=0x7f384c000bc0 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:26.454 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-21T10:42:26.454 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T10:42:26.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.472+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 --> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f385802c550 con 0x7f384407b1a0 2024-09-21T10:42:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.473+0000 7f384b7fe640 1 -- 172.21.15.60:0/3088903305 <== mgr.14786 v2:172.21.15.60:6800/1665555180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f385802c550 con 0x7f384407b1a0 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f384407b1a0 msgr2=0x7f384407d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f384407b1a0 0x7f384407d660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f384c02aac0 tx=0x7f384c000bc0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 msgr2=0x7f385819c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f385819c1c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f385400c810 tx=0x7f385400ccd0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 shutdown_connections 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f384407b1a0 0x7f384407d660 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38580ffcf0 0x7f385819c1c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 --2- 172.21.15.60:0/3088903305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38580feaf0 0x7f385819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 >> 172.21.15.60:0/3088903305 conn(0x7f38580fa280 msgr2=0x7f3858103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 shutdown_connections 2024-09-21T10:42:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.476+0000 7f3860594640 1 -- 172.21.15.60:0/3088903305 wait complete. 2024-09-21T10:42:26.490 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:42:26.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 -- 172.21.15.60:0/2281426232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 msgr2=0x7fa1a40728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 --2- 172.21.15.60:0/2281426232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 0x7fa1a40728e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa194009880 tx=0x7fa19402a530 comp rx=0 tx=0).stop 2024-09-21T10:42:26.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 -- 172.21.15.60:0/2281426232 shutdown_connections 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 --2- 172.21.15.60:0/2281426232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a4073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 --2- 172.21.15.60:0/2281426232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 0x7fa1a40728e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 -- 172.21.15.60:0/2281426232 >> 172.21.15.60:0/2281426232 conn(0x7fa1a40fb320 msgr2=0x7fa1a40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 -- 172.21.15.60:0/2281426232 shutdown_connections 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.587+0000 7fa1a9c83640 1 -- 172.21.15.60:0/2281426232 wait complete. 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.588+0000 7fa1a9c83640 1 Processor -- start 2024-09-21T10:42:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.588+0000 7fa1a9c83640 1 -- start start 2024-09-21T10:42:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a9c83640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a41977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a9c83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 0x7fa1a4197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a9c83640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a41982f0 con 0x7fa1a4074480 2024-09-21T10:42:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a9c83640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a4198460 con 0x7fa1a4072eb0 2024-09-21T10:42:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a41977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a41977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:42212/0 (socket says 172.21.15.60:42212) 2024-09-21T10:42:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a37fe640 1 -- 172.21.15.60:0/1681269417 learned_addr learned my addr 172.21.15.60:0/1681269417 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.589+0000 7fa1a2ffd640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 0x7fa1a4197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a37fe640 1 -- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 msgr2=0x7fa1a4197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a37fe640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 0x7fa1a4197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a37fe640 1 -- 172.21.15.60:0/1681269417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009560 con 0x7fa1a4072eb0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a37fe640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a41977e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1940099a0 tx=0x7fa194004c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa194004430 con 0x7fa1a4072eb0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa194005d50 con 0x7fa1a4072eb0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa194031a00 con 0x7fa1a4072eb0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a9c83640 1 -- 172.21.15.60:0/1681269417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a419cea0 con 0x7fa1a4072eb0 2024-09-21T10:42:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.590+0000 7fa1a9c83640 1 -- 172.21.15.60:0/1681269417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a419d3c0 con 0x7fa1a4072eb0 2024-09-21T10:42:26.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.592+0000 7fa1a9c83640 1 -- 172.21.15.60:0/1681269417 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a4191900 con 0x7fa1a4072eb0 2024-09-21T10:42:26.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.592+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7fa19402ad50 con 0x7fa1a4072eb0 2024-09-21T10:42:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.593+0000 7fa1a0ff9640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fa18c07b020 0x7fa18c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.593+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa1940beb00 con 0x7fa1a4072eb0 2024-09-21T10:42:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.593+0000 7fa1a2ffd640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fa18c07b020 0x7fa18c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.594+0000 7fa1a2ffd640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fa18c07b020 0x7fa18c07d4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4198d00 tx=0x7fa198005f90 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.597+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fa194081f00 con 0x7fa1a4072eb0 2024-09-21T10:42:26.729 DEBUG:teuthology.parallel:result is None 2024-09-21T10:42:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.882+0000 7fa1a9c83640 1 -- 172.21.15.60:0/1681269417 --> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1a402c4f0 con 0x7fa18c07b020 2024-09-21T10:42:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.884+0000 7fa1a0ff9640 1 -- 172.21.15.60:0/1681269417 <== mgr.14786 v2:172.21.15.60:6800/1665555180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa1a402c4f0 con 0x7fa18c07b020 2024-09-21T10:42:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 -- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fa18c07b020 msgr2=0x7fa18c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fa18c07b020 0x7fa18c07d4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4198d00 tx=0x7fa198005f90 comp rx=0 tx=0).stop 2024-09-21T10:42:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 -- 172.21.15.60:0/1681269417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 msgr2=0x7fa1a41977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a41977e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1940099a0 tx=0x7fa194004c60 comp rx=0 tx=0).stop 2024-09-21T10:42:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 -- 172.21.15.60:0/1681269417 shutdown_connections 2024-09-21T10:42:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fa18c07b020 0x7fa18c07d4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a4074480 0x7fa1a4197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 --2- 172.21.15.60:0/1681269417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a4072eb0 0x7fa1a41977e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 -- 172.21.15.60:0/1681269417 >> 172.21.15.60:0/1681269417 conn(0x7fa1a40fb320 msgr2=0x7fa1a4105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 -- 172.21.15.60:0/1681269417 shutdown_connections 2024-09-21T10:42:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:26.890+0000 7fa18a7fc640 1 -- 172.21.15.60:0/1681269417 wait complete. 2024-09-21T10:42:27.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.038+0000 7fcb93f08640 1 -- 172.21.15.60:0/3410471909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c1073f0 msgr2=0x7fcb8c107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.038+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3410471909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c1073f0 0x7fcb8c107850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009880 tx=0x7fcb8002a4b0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.038+0000 7fcb93f08640 1 -- 172.21.15.60:0/3410471909 shutdown_connections 2024-09-21T10:42:27.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.038+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3410471909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c1073f0 0x7fcb8c107850 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.038+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3410471909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c106670 0x7fcb8c106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.038+0000 7fcb93f08640 1 -- 172.21.15.60:0/3410471909 >> 172.21.15.60:0/3410471909 conn(0x7fcb8c075530 msgr2=0x7fcb8c077970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:27.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.039+0000 7fcb93f08640 1 -- 172.21.15.60:0/3410471909 shutdown_connections 2024-09-21T10:42:27.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.039+0000 7fcb93f08640 1 -- 172.21.15.60:0/3410471909 wait complete. 2024-09-21T10:42:27.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.040+0000 7fcb93f08640 1 Processor -- start 2024-09-21T10:42:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.040+0000 7fcb93f08640 1 -- start start 2024-09-21T10:42:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb93f08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 0x7fcb8c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb93f08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c1073f0 0x7fcb8c071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb93f08640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c071fd0 con 0x7fcb8c1073f0 2024-09-21T10:42:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb93f08640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c072140 con 0x7fcb8c106670 2024-09-21T10:42:27.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb91ca4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 0x7fcb8c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb91ca4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 0x7fcb8c0714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:42226/0 (socket says 172.21.15.60:42226) 2024-09-21T10:42:27.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.041+0000 7fcb91ca4640 1 -- 172.21.15.60:0/3322951536 learned_addr learned my addr 172.21.15.60:0/3322951536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.042+0000 7fcb91ca4640 1 -- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c1073f0 msgr2=0x7fcb8c071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.042+0000 7fcb91ca4640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c1073f0 0x7fcb8c071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.042+0000 7fcb91ca4640 1 -- 172.21.15.60:0/3322951536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80009560 con 0x7fcb8c106670 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.044+0000 7fcb91ca4640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 0x7fcb8c0714c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ea30 tx=0x7fcb8400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.044+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8400cdb0 con 0x7fcb8c106670 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.044+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb84011930 con 0x7fcb8c106670 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.044+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c1a9ad0 con 0x7fcb8c106670 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.044+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8401aaa0 con 0x7fcb8c106670 2024-09-21T10:42:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.044+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c1aa040 con 0x7fcb8c106670 2024-09-21T10:42:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.046+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c06b5e0 con 0x7fcb8c106670 2024-09-21T10:42:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.047+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7fcb8401ac00 con 0x7fcb8c106670 2024-09-21T10:42:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.048+0000 7fcb8affd640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fcb7407b0b0 0x7fcb7407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.048+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcb8409e6e0 con 0x7fcb8c106670 2024-09-21T10:42:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.050+0000 7fcb914a3640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fcb7407b0b0 0x7fcb7407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.053+0000 7fcb914a3640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fcb7407b0b0 0x7fcb7407d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009850 tx=0x7fcb80000bc0 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.055+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fcb84061990 con 0x7fcb8c106670 2024-09-21T10:42:27.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.353+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 --> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb8c02c590 con 0x7fcb7407b0b0 2024-09-21T10:42:27.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.363+0000 7fcb8affd640 1 -- 172.21.15.60:0/3322951536 <== mgr.14786 v2:172.21.15.60:6800/1665555180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fcb8c02c590 con 0x7fcb7407b0b0 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (8m) 15s ago 10m 24.7M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (81s) 15s ago 10m 7549k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (65s) 26s ago 9m 7209k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (10m) 15s ago 10m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (9m) 26s ago 9m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (8m) 15s ago 10m 81.8M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (4m) 15s ago 4m 242M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (4m) 15s ago 4m 14.2M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (4m) 26s ago 4m 16.0M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:42:27.366 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (4m) 26s ago 4m 18.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (59s) 15s ago 11m 490M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (2m) 26s ago 9m 156M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f97064c83946 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (11m) 15s ago 11m 55.6M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (9m) 26s ago 9m 44.4M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (10m) 15s ago 10m 16.6M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 26s ago 9m 15.2M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (7m) 15s ago 7m 214M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (7m) 15s ago 7m 237M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (6m) 15s ago 6m 194M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (6m) 26s ago 6m 260M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (6m) 26s ago 6m 233M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (5m) 26s ago 5m 214M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:42:27.367 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (70s) 15s ago 9m 46.8M - 2.43.0 a07b618ecd1d f737449ce4c2 2024-09-21T10:42:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fcb7407b0b0 msgr2=0x7fcb7407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fcb7407b0b0 0x7fcb7407d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009850 tx=0x7fcb80000bc0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 msgr2=0x7fcb8c0714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 0x7fcb8c0714c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ea30 tx=0x7fcb8400eef0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 shutdown_connections 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fcb7407b0b0 0x7fcb7407d570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c1073f0 0x7fcb8c071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 --2- 172.21.15.60:0/3322951536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb8c106670 0x7fcb8c0714c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 >> 172.21.15.60:0/3322951536 conn(0x7fcb8c075530 msgr2=0x7fcb8c10aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.366+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 shutdown_connections 2024-09-21T10:42:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.367+0000 7fcb93f08640 1 -- 172.21.15.60:0/3322951536 wait complete. 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.451+0000 7fe2199d5640 1 -- 172.21.15.60:0/1376799826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 msgr2=0x7fe214102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.451+0000 7fe2199d5640 1 --2- 172.21.15.60:0/1376799826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214102ad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe204009880 tx=0x7fe20402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 -- 172.21.15.60:0/1376799826 shutdown_connections 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 --2- 172.21.15.60:0/1376799826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 0x7fe214105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 --2- 172.21.15.60:0/1376799826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214102ad0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 -- 172.21.15.60:0/1376799826 >> 172.21.15.60:0/1376799826 conn(0x7fe2140fa280 msgr2=0x7fe2140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 -- 172.21.15.60:0/1376799826 shutdown_connections 2024-09-21T10:42:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 -- 172.21.15.60:0/1376799826 wait complete. 2024-09-21T10:42:27.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.452+0000 7fe2199d5640 1 Processor -- start 2024-09-21T10:42:27.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2199d5640 1 -- start start 2024-09-21T10:42:27.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2199d5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2199d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 0x7fe214195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2199d5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214196180 con 0x7fe2141006e0 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2199d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141962f0 con 0x7fe214103010 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe212ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe212ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45440/0 (socket says 172.21.15.60:45440) 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe212ffd640 1 -- 172.21.15.60:0/740385955 learned_addr learned my addr 172.21.15.60:0/740385955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2127fc640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 0x7fe214195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2127fc640 1 -- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 msgr2=0x7fe214195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2127fc640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe2127fc640 1 -- 172.21.15.60:0/740385955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009560 con 0x7fe214103010 2024-09-21T10:42:27.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.453+0000 7fe212ffd640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.454+0000 7fe2127fc640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 0x7fe214195bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00e940 tx=0x7fe1fc00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.454+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1fc009620 con 0x7fe214103010 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.454+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21419ad90 con 0x7fe214103010 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.454+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1fc0044f0 con 0x7fe214103010 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.454+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1fc0049d0 con 0x7fe214103010 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.454+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21419b2b0 con 0x7fe214103010 2024-09-21T10:42:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.455+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe214100ac0 con 0x7fe214103010 2024-09-21T10:42:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.456+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7fe1fc00cc90 con 0x7fe214103010 2024-09-21T10:42:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.457+0000 7fe2189d3640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fe20007b010 0x7fe20007d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.457+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe1fc014070 con 0x7fe214103010 2024-09-21T10:42:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.457+0000 7fe212ffd640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fe20007b010 0x7fe20007d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.458+0000 7fe212ffd640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fe20007b010 0x7fe20007d4d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe204000c00 tx=0x7fe2040314e0 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.462+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fe1fc061530 con 0x7fe214103010 2024-09-21T10:42:27.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:27 smithi060 ceph-mon[28215]: pgmap v18: 65 pgs: 65 active+clean; 243 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 968 op/s 2024-09-21T10:42:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:27 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:42:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:27 smithi112 ceph-mon[35117]: pgmap v18: 65 pgs: 65 active+clean; 243 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 968 op/s 2024-09-21T10:42:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:27 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:42:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.741+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2141087c0 con 0x7fe214103010 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.742+0000 7fe2189d3640 1 -- 172.21.15.60:0/740385955 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+731 (secure 0 0 0) 0x7fe1fc064650 con 0x7fe214103010 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:42:27.744 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 12, 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:42:27.745 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:42:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fe20007b010 msgr2=0x7fe20007d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fe20007b010 0x7fe20007d4d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe204000c00 tx=0x7fe2040314e0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 msgr2=0x7fe214195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 0x7fe214195bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00e940 tx=0x7fe1fc00ee00 comp rx=0 tx=0).stop 2024-09-21T10:42:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 shutdown_connections 2024-09-21T10:42:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fe20007b010 0x7fe20007d4d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe214103010 0x7fe214195bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 --2- 172.21.15.60:0/740385955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2141006e0 0x7fe214195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 >> 172.21.15.60:0/740385955 conn(0x7fe2140fa280 msgr2=0x7fe2140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 shutdown_connections 2024-09-21T10:42:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.744+0000 7fe2199d5640 1 -- 172.21.15.60:0/740385955 wait complete. 2024-09-21T10:42:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 -- 172.21.15.60:0/2055599254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854100680 msgr2=0x7ff854102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 --2- 172.21.15.60:0/2055599254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854100680 0x7ff854102a70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff8440098b0 tx=0x7ff84402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 -- 172.21.15.60:0/2055599254 shutdown_connections 2024-09-21T10:42:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 --2- 172.21.15.60:0/2055599254 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854102fb0 0x7ff8541053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 --2- 172.21.15.60:0/2055599254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854100680 0x7ff854102a70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 -- 172.21.15.60:0/2055599254 >> 172.21.15.60:0/2055599254 conn(0x7ff8540fa280 msgr2=0x7ff8540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 -- 172.21.15.60:0/2055599254 shutdown_connections 2024-09-21T10:42:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 -- 172.21.15.60:0/2055599254 wait complete. 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.840+0000 7ff859a2f640 1 Processor -- start 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff859a2f640 1 -- start start 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff859a2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854100680 0x7ff854197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff859a2f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854102fb0 0x7ff854197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff859a2f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854198430 con 0x7ff854102fb0 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff859a2f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8541985a0 con 0x7ff854100680 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff8527fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854102fb0 0x7ff854197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff852ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854100680 0x7ff854197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff8527fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854102fb0 0x7ff854197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45466/0 (socket says 172.21.15.60:45466) 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff8527fc640 1 -- 172.21.15.60:0/190928506 learned_addr learned my addr 172.21.15.60:0/190928506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff852ffd640 1 -- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854102fb0 msgr2=0x7ff854197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.841+0000 7ff852ffd640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854102fb0 0x7ff854197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff852ffd640 1 -- 172.21.15.60:0/190928506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff844009560 con 0x7ff854100680 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff852ffd640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854100680 0x7ff854197920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff84402a9f0 tx=0x7ff8440055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff844004aa0 con 0x7ff854100680 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85419cfe0 con 0x7ff854100680 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff844005d50 con 0x7ff854100680 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8440039b0 con 0x7ff854100680 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.842+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85419d450 con 0x7ff854100680 2024-09-21T10:42:27.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.843+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff854108830 con 0x7ff854100680 2024-09-21T10:42:27.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.844+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7ff844031c00 con 0x7ff854100680 2024-09-21T10:42:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.845+0000 7ff858a2d640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7ff83c07b010 0x7ff83c07d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.845+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff8440bf000 con 0x7ff854100680 2024-09-21T10:42:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.845+0000 7ff8527fc640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7ff83c07b010 0x7ff83c07d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:27.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.846+0000 7ff8527fc640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7ff83c07b010 0x7ff83c07d4d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff854198e40 tx=0x7ff848005f90 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:27.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:27.849+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7ff844082380 con 0x7ff854100680 2024-09-21T10:42:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.240+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff854108a20 con 0x7ff854100680 2024-09-21T10:42:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.241+0000 7ff858a2d640 1 -- 172.21.15.60:0/190928506 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7ff8440854a0 con 0x7ff854100680 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:42:28.244 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:42:28.245 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:28.246 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7ff83c07b010 msgr2=0x7ff83c07d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7ff83c07b010 0x7ff83c07d4d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff854198e40 tx=0x7ff848005f90 comp rx=0 tx=0).stop 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854100680 msgr2=0x7ff854197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854100680 0x7ff854197920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff84402a9f0 tx=0x7ff8440055a0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 shutdown_connections 2024-09-21T10:42:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7ff83c07b010 0x7ff83c07d4d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854102fb0 0x7ff854197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 --2- 172.21.15.60:0/190928506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff854100680 0x7ff854197920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 >> 172.21.15.60:0/190928506 conn(0x7ff8540fa280 msgr2=0x7ff8540ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 shutdown_connections 2024-09-21T10:42:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.244+0000 7ff859a2f640 1 -- 172.21.15.60:0/190928506 wait complete. 2024-09-21T10:42:28.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 -- 172.21.15.60:0/1567759325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 msgr2=0x7f0018102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 --2- 172.21.15.60:0/1567759325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f0018102a70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f00080098b0 tx=0x7f000802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 -- 172.21.15.60:0/1567759325 shutdown_connections 2024-09-21T10:42:28.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 --2- 172.21.15.60:0/1567759325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0018102fb0 0x7f00181053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 --2- 172.21.15.60:0/1567759325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f0018102a70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 -- 172.21.15.60:0/1567759325 >> 172.21.15.60:0/1567759325 conn(0x7f00180fa280 msgr2=0x7f00180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:28.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.368+0000 7f001cdd8640 1 -- 172.21.15.60:0/1567759325 shutdown_connections 2024-09-21T10:42:28.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.369+0000 7f001cdd8640 1 -- 172.21.15.60:0/1567759325 wait complete. 2024-09-21T10:42:28.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001cdd8640 1 Processor -- start 2024-09-21T10:42:28.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001cdd8640 1 -- start start 2024-09-21T10:42:28.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001cdd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f00181956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001cdd8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0018102fb0 0x7f0018195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001cdd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0018196200 con 0x7f0018100680 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001cdd8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0018196370 con 0x7f0018102fb0 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f00181956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f00181956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45480/0 (socket says 172.21.15.60:45480) 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f001659c640 1 -- 172.21.15.60:0/3391379766 learned_addr learned my addr 172.21.15.60:0/3391379766 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.370+0000 7f0015d9b640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0018102fb0 0x7f0018195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f001659c640 1 -- 172.21.15.60:0/3391379766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0018102fb0 msgr2=0x7f0018195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f001659c640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0018102fb0 0x7f0018195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f001659c640 1 -- 172.21.15.60:0/3391379766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009560 con 0x7f0018100680 2024-09-21T10:42:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f001659c640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f00181956f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f00080054f0 tx=0x7f0008005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0008004aa0 con 0x7f0018100680 2024-09-21T10:42:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0008004c00 con 0x7f0018100680 2024-09-21T10:42:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0008003b10 con 0x7f0018100680 2024-09-21T10:42:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001819adb0 con 0x7f0018100680 2024-09-21T10:42:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.371+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001819b240 con 0x7f0018100680 2024-09-21T10:42:28.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.373+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0018108810 con 0x7f0018100680 2024-09-21T10:42:28.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.374+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7f0008003d80 con 0x7f0018100680 2024-09-21T10:42:28.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.374+0000 7f00077fe640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f000007b020 0x7f000007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:28.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.375+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f00080bf130 con 0x7f0018100680 2024-09-21T10:42:28.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.375+0000 7f0015d9b640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f000007b020 0x7f000007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:28.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.375+0000 7f0015d9b640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f000007b020 0x7f000007d4e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0018196c10 tx=0x7f000c00b410 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:28.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.379+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7f0008082530 con 0x7f0018100680 2024-09-21T10:42:28.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.608+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 --> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f001819b4b0 con 0x7f000007b020 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='client.24595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='client.24599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/740385955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/190928506' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:42:28.611 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:28 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.609+0000 7f00077fe640 1 -- 172.21.15.60:0/3391379766 <== mgr.14786 v2:172.21.15.60:6800/1665555180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f001819b4b0 con 0x7f000007b020 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:42:28.612 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T10:42:28.613 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T10:42:28.613 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:42:28.613 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f000007b020 msgr2=0x7f000007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f000007b020 0x7f000007d4e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0018196c10 tx=0x7f000c00b410 comp rx=0 tx=0).stop 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 msgr2=0x7f00181956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f00181956f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f00080054f0 tx=0x7f0008005520 comp rx=0 tx=0).stop 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 shutdown_connections 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7f000007b020 0x7f000007d4e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0018102fb0 0x7f0018195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 --2- 172.21.15.60:0/3391379766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0018100680 0x7f00181956f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 >> 172.21.15.60:0/3391379766 conn(0x7f00180fa280 msgr2=0x7f00180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:28.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 shutdown_connections 2024-09-21T10:42:28.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.613+0000 7f001cdd8640 1 -- 172.21.15.60:0/3391379766 wait complete. 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='client.24595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='client.24599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/740385955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/190928506' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:42:28.622 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:28 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:42:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/1274314190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc102fb0 msgr2=0x7fbccc1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/1274314190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc102fb0 0x7fbccc1053a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00098b0 tx=0x7fbcc002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/1274314190 shutdown_connections 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/1274314190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc102fb0 0x7fbccc1053a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/1274314190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbccc100680 0x7fbccc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/1274314190 >> 172.21.15.60:0/1274314190 conn(0x7fbccc0fa280 msgr2=0x7fbccc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/1274314190 shutdown_connections 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.718+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/1274314190 wait complete. 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcd0e3c640 1 Processor -- start 2024-09-21T10:42:28.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcd0e3c640 1 -- start start 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcd0e3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 0x7fbccc19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcd0e3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbccc102fb0 0x7fbccc19c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcd0e3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc19c840 con 0x7fbccc100680 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcd0e3c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc19c9b0 con 0x7fbccc102fb0 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcca59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 0x7fbccc19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcca59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 0x7fbccc19bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45496/0 (socket says 172.21.15.60:45496) 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcca59c640 1 -- 172.21.15.60:0/766753601 learned_addr learned my addr 172.21.15.60:0/766753601 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.719+0000 7fbcc9d9b640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbccc102fb0 0x7fbccc19c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcca59c640 1 -- 172.21.15.60:0/766753601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbccc102fb0 msgr2=0x7fbccc19c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcca59c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbccc102fb0 0x7fbccc19c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcca59c640 1 -- 172.21.15.60:0/766753601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0009560 con 0x7fbccc100680 2024-09-21T10:42:28.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcca59c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 0x7fbccc19bd30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00d900 tx=0x7fbcbc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc009c00 con 0x7fbccc100680 2024-09-21T10:42:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc1a13e0 con 0x7fbccc100680 2024-09-21T10:42:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcbc00b660 con 0x7fbccc100680 2024-09-21T10:42:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.720+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc00f680 con 0x7fbccc100680 2024-09-21T10:42:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.721+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1a1900 con 0x7fbccc100680 2024-09-21T10:42:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.722+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc1087e0 con 0x7fbccc100680 2024-09-21T10:42:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.723+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 30) v1 ==== 103283+0+0 (secure 0 0 0) 0x7fbcbc010ab0 con 0x7fbccc100680 2024-09-21T10:42:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.724+0000 7fbcbb7fe640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fbcb407b020 0x7fbcb407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:28.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.724+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbcbc09dcb0 con 0x7fbccc100680 2024-09-21T10:42:28.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.724+0000 7fbcc9d9b640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fbcb407b020 0x7fbcb407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:28.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.724+0000 7fbcc9d9b640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fbcb407b020 0x7fbcb407d4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009880 tx=0x7fbcc00314e0 comp rx=0 tx=0).ready entity=mgr.14786 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:28.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:28.728+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+195789 (secure 0 0 0) 0x7fbcbc0610b0 con 0x7fbccc100680 2024-09-21T10:42:29.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.117+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbccc1a1e10 con 0x7fbccc100680 2024-09-21T10:42:29.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.117+0000 7fbcbb7fe640 1 -- 172.21.15.60:0/766753601 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbcbc0641d0 con 0x7fbccc100680 2024-09-21T10:42:29.119 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fbcb407b020 msgr2=0x7fbcb407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fbcb407b020 0x7fbcb407d4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009880 tx=0x7fbcc00314e0 comp rx=0 tx=0).stop 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 msgr2=0x7fbccc19bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 0x7fbccc19bd30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00d900 tx=0x7fbcbc00ddc0 comp rx=0 tx=0).stop 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 shutdown_connections 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:6800/1665555180,v1:172.21.15.60:6801/1665555180] conn(0x7fbcb407b020 0x7fbcb407d4e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbccc102fb0 0x7fbccc19c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 --2- 172.21.15.60:0/766753601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbccc100680 0x7fbccc19bd30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:29.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 >> 172.21.15.60:0/766753601 conn(0x7fbccc0fa280 msgr2=0x7fbccc0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:29.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 shutdown_connections 2024-09-21T10:42:29.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:29.120+0000 7fbcd0e3c640 1 -- 172.21.15.60:0/766753601 wait complete. 2024-09-21T10:42:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:29 smithi060 ceph-mon[28215]: from='client.24603 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:29 smithi060 ceph-mon[28215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:42:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:29 smithi060 ceph-mon[28215]: pgmap v19: 65 pgs: 65 active+clean; 228 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 1.31k op/s 2024-09-21T10:42:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:29 smithi060 ceph-mon[28215]: from='client.? 172.21.15.60:0/766753601' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:42:29.694 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:29 smithi112 ceph-mon[35117]: from='client.24603 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:29.695 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:29 smithi112 ceph-mon[35117]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:42:29.695 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:29 smithi112 ceph-mon[35117]: pgmap v19: 65 pgs: 65 active+clean; 228 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 1.31k op/s 2024-09-21T10:42:29.695 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:29 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/766753601' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T10:42:30.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:30 smithi112 ceph-mon[35117]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:30.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:30 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:42:30.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:30 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:42:30.612 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:30 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:30.659 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:30 smithi060 ceph-mon[28215]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:42:30.659 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:30 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T10:42:30.659 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:30 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T10:42:30.660 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:30 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:31.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:31 smithi112 ceph-mon[35117]: Upgrade: Updating mgr.smithi112.gkunly 2024-09-21T10:42:31.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:31 smithi112 ceph-mon[35117]: Deploying daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:42:31.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:31 smithi112 ceph-mon[35117]: pgmap v20: 65 pgs: 65 active+clean; 228 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 861 op/s 2024-09-21T10:42:31.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:31 smithi060 ceph-mon[28215]: Upgrade: Updating mgr.smithi112.gkunly 2024-09-21T10:42:31.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:31 smithi060 ceph-mon[28215]: Deploying daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:42:31.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:31 smithi060 ceph-mon[28215]: pgmap v20: 65 pgs: 65 active+clean; 228 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 861 op/s 2024-09-21T10:42:33.632 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:33 smithi112 ceph-mon[35117]: pgmap v21: 65 pgs: 65 active+clean; 228 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 861 op/s 2024-09-21T10:42:33.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:33 smithi060 ceph-mon[28215]: pgmap v21: 65 pgs: 65 active+clean; 228 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 861 op/s 2024-09-21T10:42:33.753 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-21T10:42:33.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T10:42:34.220 DEBUG:teuthology.parallel:result is None 2024-09-21T10:42:34.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T10:42:34.257 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T10:42:34.257 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T10:42:34.292 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T10:42:34.292 DEBUG:teuthology.parallel:result is None 2024-09-21T10:42:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:34 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:34 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:34 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:42:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:34 smithi060 ceph-mon[28215]: pgmap v22: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 1.09k op/s 2024-09-21T10:42:35.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:34 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:35.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:34 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:35.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:34 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:42:35.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:34 smithi112 ceph-mon[35117]: pgmap v22: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 1.09k op/s 2024-09-21T10:42:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:37 smithi060 ceph-mon[28215]: pgmap v23: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 573 op/s 2024-09-21T10:42:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:37 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:37 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:37 smithi112 ceph-mon[35117]: pgmap v23: 65 pgs: 65 active+clean; 214 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 573 op/s 2024-09-21T10:42:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:37 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:37 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:38.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:38 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:38.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:38 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:38.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:38 smithi060 ceph-mon[28215]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 639 op/s 2024-09-21T10:42:38.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:38 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:38.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:38 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:38.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:38 smithi112 ceph-mon[35117]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 639 op/s 2024-09-21T10:42:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:39 smithi060 ceph-mon[28215]: Standby manager daemon smithi112.gkunly restarted 2024-09-21T10:42:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:39 smithi060 ceph-mon[28215]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:42:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:42:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:42:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:42:39.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:39 smithi060 ceph-mon[28215]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:42:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:39 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly restarted 2024-09-21T10:42:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:39 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:42:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:42:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:42:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:42:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:39 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/923018039' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:42:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:40 smithi060 ceph-mon[28215]: mgrmap e31: smithi060.mulzpr(active, since 43s), standbys: smithi112.gkunly 2024-09-21T10:42:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:40 smithi060 ceph-mon[28215]: pgmap v25: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 943 KiB/s wr, 299 op/s 2024-09-21T10:42:40.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:40 smithi112 ceph-mon[35117]: mgrmap e31: smithi060.mulzpr(active, since 43s), standbys: smithi112.gkunly 2024-09-21T10:42:40.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:40 smithi112 ceph-mon[35117]: pgmap v25: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 943 KiB/s wr, 299 op/s 2024-09-21T10:42:41.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:41 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:41.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:41 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:41 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:41 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:42 smithi060 ceph-mon[28215]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 943 KiB/s wr, 299 op/s 2024-09-21T10:42:42.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:42 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:42:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:42 smithi112 ceph-mon[35117]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 943 KiB/s wr, 299 op/s 2024-09-21T10:42:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:42 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T10:42:45.383 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 944 KiB/s wr, 301 op/s 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.mulzpr"}]: dispatch 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.mulzpr"}]': finished 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.gkunly"}]: dispatch 2024-09-21T10:42:45.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.gkunly"}]': finished 2024-09-21T10:42:45.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:45 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 944 KiB/s wr, 301 op/s 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.mulzpr"}]: dispatch 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi060.mulzpr"}]': finished 2024-09-21T10:42:45.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.gkunly"}]: dispatch 2024-09-21T10:42:45.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi112.gkunly"}]': finished 2024-09-21T10:42:45.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:45 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T10:42:46.659 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:46 smithi112 ceph-mon[35117]: Upgrade: Setting container_image for all mgr 2024-09-21T10:42:46.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:46 smithi060 ceph-mon[28215]: Upgrade: Setting container_image for all mgr 2024-09-21T10:42:47.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:47 smithi060 ceph-mon[28215]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 209 KiB/s wr, 68 op/s 2024-09-21T10:42:47.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:47 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:47.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:47 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:42:47.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:47 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T10:42:47.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:47 smithi060 ceph-mon[28215]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:47 smithi112 ceph-mon[35117]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.4 KiB/s rd, 209 KiB/s wr, 68 op/s 2024-09-21T10:42:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:47 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' 2024-09-21T10:42:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:47 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T10:42:47.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:47 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T10:42:47.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:47 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T10:42:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:42:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 ceph-mon[28215]: Upgrade: Updating mon.smithi060 2024-09-21T10:42:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 ceph-mon[28215]: Deploying daemon mon.smithi060 on smithi060 2024-09-21T10:42:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[28211]: 2024-09-21T10:42:48.445+0000 7f8606734640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:42:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[28211]: 2024-09-21T10:42:48.445+0000 7f8606734640 -1 mon.smithi060@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T10:42:48.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:48 smithi112 ceph-mon[35117]: Upgrade: Updating mon.smithi060 2024-09-21T10:42:48.602 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:48 smithi112 ceph-mon[35117]: Deploying daemon mon.smithi060 on smithi060 2024-09-21T10:42:48.723 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 podman[93101]: 2024-09-21 10:42:48.47701805 +0000 UTC m=+0.127986922 container died 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-6a1bdf8) 2024-09-21T10:42:49.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 podman[93101]: 2024-09-21 10:42:48.862893266 +0000 UTC m=+0.513862184 container cleanup 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, org.label-schema.vendor=CentOS, ceph=True, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:42:49.107 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:48 smithi060 bash[93101]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060 2024-09-21T10:42:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 podman[93113]: 2024-09-21 10:42:49.106116896 +0000 UTC m=+0.630022958 container remove 469d57c54e09396690d65488c288e09c2dbd900c8d9593fe20a9c2fba8bb9c6d (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, RELEASE=reef-6a1bdf8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T10:42:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service: Deactivated successfully. 2024-09-21T10:42:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 systemd[1]: Stopped Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:42:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service: Consumed 12.723s CPU time. 2024-09-21T10:42:49.812 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 systemd[1]: Starting Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:42:49.812 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 podman[93252]: 2024-09-21 10:42:49.58315764 +0000 UTC m=+0.016696336 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:42:49.812 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 podman[93252]: 2024-09-21 10:42:49.690874225 +0000 UTC m=+0.124412946 container create 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T10:42:50.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 podman[93252]: 2024-09-21 10:42:49.943781919 +0000 UTC m=+0.377320607 container init 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T10:42:50.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 podman[93252]: 2024-09-21 10:42:49.947135729 +0000 UTC m=+0.380674407 container start 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev), process ceph-mon, pid 2 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: pidfile_write: ignore empty --pid-file 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: load: jerasure load: lrc 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: RocksDB version: 7.9.2 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Git sha 0 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Compile date 2024-09-21 08:36:07 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: DB SUMMARY 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: DB Session ID: 3JHSX529IS8430QUT8JR 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: CURRENT file: CURRENT 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1493 Bytes 2024-09-21T10:42:50.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi060/store.db dir, Total Num: 1, files: 000032.sst 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi060/store.db: 000030.log size: 195814 ; 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.error_if_exists: 0 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.create_if_missing: 0 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.paranoid_checks: 1 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.env: 0x55fdf161c120 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.info_log: 0x55fdf31e18e0 2024-09-21T10:42:50.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.statistics: (nil) 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.use_fsync: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_log_file_size: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.allow_fallocate: 1 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.use_direct_reads: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T10:42:50.203 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.db_log_dir: 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.wal_dir: 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.write_buffer_manager: 0x55fdf31e5b80 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T10:42:50.204 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.unordered_write: 0 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.row_cache: None 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.wal_filter: None 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T10:42:50.205 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.two_write_queues: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.wal_compression: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.atomic_flush: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.log_readahead_size: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T10:42:50.206 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_background_jobs: 2 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_background_compactions: -1 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_subcompactions: 1 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_open_files: -1 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T10:42:50.207 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_background_flushes: -1 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Compression algorithms supported: 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kZSTD supported: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kXpressCompression supported: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kBZip2Compression supported: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kLZ4Compression supported: 1 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kZlibCompression supported: 1 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: kSnappyCompression supported: 1 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T10:42:50.208 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000015 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.merge_operator: 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_filter: None 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fdf31e1540) 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T10:42:50.209 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_type: 0 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_index_type: 0 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_shortening: 1 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: checksum: 4 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: no_block_cache: 0 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache: 0x55fdf31d5610 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_options: 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: capacity : 536870912 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_shard_bits : 4 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: strict_capacity_limit : 0 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_cache_compressed: (nil) 2024-09-21T10:42:50.210 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: persistent_cache: (nil) 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size: 4096 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_size_deviation: 10 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_restart_interval: 16 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: index_block_restart_interval: 1 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: metadata_block_size: 4096 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: partition_filters: 0 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: use_delta_encoding: 1 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: filter_policy: bloomfilter 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: whole_key_filtering: 1 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: verify_compression: 0 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: format_version: 5 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_index_compression: 1 2024-09-21T10:42:50.211 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: block_align: 0 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_auto_readahead_size: 262144 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: prepopulate_block_cache: 0 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: initial_auto_readahead_size: 8192 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression: NoCompression 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.num_levels: 7 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T10:42:50.212 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T10:42:50.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T10:42:50.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T10:42:50.215 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.inplace_update_support: 0 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T10:42:50.216 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.bloom_locality: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.max_successive_merges: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.ttl: 2592000 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.enable_blob_files: false 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.min_blob_size: 0 2024-09-21T10:42:50.217 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi060/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 11986, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 46823b86-3b59-4f7c-84a5-24ee1f3016c3 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726915369974528, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-21T10:42:50.218 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726915369976687, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 194726, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11987, "largest_seqno": 12152, "table_properties": {"data_size": 192899, "index_size": 533, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 261, "raw_key_size": 2556, "raw_average_key_size": 28, "raw_value_size": 190702, "raw_average_value_size": 2118, "num_data_blocks": 22, "num_entries": 90, "num_filter_entries": 90, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726915369, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "46823b86-3b59-4f7c-84a5-24ee1f3016c3", "db_session_id": "3JHSX529IS8430QUT8JR", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726915369976832, "job": 1, "event": "recovery_finished"} 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi060/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fdf3204e00 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: DB pointer 0x55fdf3306000 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** DB Stats ** 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:42:50.219 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L0 1/0 190.16 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: L6 1/0 7.08 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Sum 2/0 7.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T10:42:50.220 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Cumulative compaction: 0.00 GB write, 33.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Interval compaction: 0.00 GB write, 33.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Block cache BinnedLRUCache@0x55fdf31d5610#2 capacity: 512.00 MB usage: 0.95 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T10:42:50.221 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.31 KB,5.96046e-05%) IndexBlock(1,0.64 KB,0.00012219%) Misc(1,0.00 KB,0%) 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: starting mon.smithi060 rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi060 fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???) e2 preinit fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).mds e15 new map 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).mds e15 print_map 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: e15 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: legacy client fscid: 1 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Filesystem 'cephfs' (1) 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: fs_name cephfs 2024-09-21T10:42:50.222 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: epoch 15 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: tableserver 0 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: root 0 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: session_timeout 60 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: session_autoclose 300 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_file_size 1099511627776 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_xattr_size 65536 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: required_client_features {} 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: last_failure 0 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: last_failure_osd_epoch 45 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:42:50.223 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: max_mds 1 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: in 0 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: up {0=14544} 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: failed 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: damaged 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: stopped 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: data_pools [3] 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: metadata_pool 2 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: inline_data disabled 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: balancer 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: bal_rank_mask -1 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: standby_count_wanted 1 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: qdb_cluster leader: 0 members: 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.224 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Standby daemons: 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: [mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:49 smithi060 ceph-mon[93270]: mon.smithi060@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:50 smithi060 bash[93252]: 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 2024-09-21T10:42:50.225 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:50 smithi060 systemd[1]: Started Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T10:42:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: mon.smithi060 calling monitor election 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: mon.smithi060 is new leader, mons smithi060,smithi112 in quorum (ranks 0,1) 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: monmap epoch 2 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: last_changed 2024-09-21T10:33:12.176395+0000 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: created 2024-09-21T10:30:30.135352+0000 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: min_mon_release 18 (reef) 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: election_strategy: 1 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: mgrmap e31: smithi060.mulzpr(active, since 56s), standbys: smithi112.gkunly 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: overall HEALTH_OK 2024-09-21T10:42:53.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: from='mgr.14786 ' entity='' 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:53 smithi060 ceph-mon[93270]: mgrmap e32: smithi060.mulzpr(active, since 56s), standbys: smithi112.gkunly 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi060"}]: dispatch 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "mon metadata", "id": "smithi112"}]: dispatch 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: from='mgr.14786 172.21.15.60:0/4061973510' entity='mgr.smithi060.mulzpr' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: mon.smithi060 calling monitor election 2024-09-21T10:42:53.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: mon.smithi060 is new leader, mons smithi060,smithi112 in quorum (ranks 0,1) 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: monmap epoch 2 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: last_changed 2024-09-21T10:33:12.176395+0000 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: created 2024-09-21T10:30:30.135352+0000 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: min_mon_release 18 (reef) 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: election_strategy: 1 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: mgrmap e31: smithi060.mulzpr(active, since 56s), standbys: smithi112.gkunly 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: overall HEALTH_OK 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: from='mgr.14786 ' entity='' 2024-09-21T10:42:53.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:53 smithi112 ceph-mon[35117]: mgrmap e32: smithi060.mulzpr(active, since 56s), standbys: smithi112.gkunly 2024-09-21T10:42:58.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:58 smithi060 ceph-mon[93270]: Standby manager daemon smithi112.gkunly restarted 2024-09-21T10:42:58.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:58 smithi060 ceph-mon[93270]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:42:58.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:58 smithi060 ceph-mon[93270]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:42:58.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:58 smithi060 ceph-mon[93270]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:42:58.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:58 smithi060 ceph-mon[93270]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:42:58.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:58 smithi060 ceph-mon[93270]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:42:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:58 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly restarted 2024-09-21T10:42:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:58 smithi112 ceph-mon[35117]: Standby manager daemon smithi112.gkunly started 2024-09-21T10:42:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:58 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/crt"}]: dispatch 2024-09-21T10:42:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:58 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T10:42:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:58 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi112.gkunly/key"}]: dispatch 2024-09-21T10:42:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:58 smithi112 ceph-mon[35117]: from='mgr.? 172.21.15.112:0/4197599315' entity='mgr.smithi112.gkunly' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: mgrmap e33: smithi060.mulzpr(active, since 61s), standbys: smithi112.gkunly 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: Active manager daemon smithi060.mulzpr restarted 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: mgrmap e34: smithi060.mulzpr(active, starting, since 0.00591231s), standbys: smithi112.gkunly 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi060"} : dispatch 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi112"} : dispatch 2024-09-21T10:42:59.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T10:42:59.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T10:42:59.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:42:59.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:42:59.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:42:59.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T10:42:59.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"} : dispatch 2024-09-21T10:42:59.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:42:59 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"} : dispatch 2024-09-21T10:42:59.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.210+0000 7f2dbf655640 1 -- 172.21.15.60:0/781375078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 msgr2=0x7f2db8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.210+0000 7f2dbf655640 1 --2- 172.21.15.60:0/781375078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8100170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009880 tx=0x7f2da802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.210+0000 7f2dbf655640 1 -- 172.21.15.60:0/781375078 shutdown_connections 2024-09-21T10:42:59.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.210+0000 7f2dbf655640 1 --2- 172.21.15.60:0/781375078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8100170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.210+0000 7f2dbf655640 1 --2- 172.21.15.60:0/781375078 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 0x7f2db80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.210+0000 7f2dbf655640 1 -- 172.21.15.60:0/781375078 >> 172.21.15.60:0/781375078 conn(0x7f2db80fa280 msgr2=0x7f2db80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 -- 172.21.15.60:0/781375078 shutdown_connections 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 -- 172.21.15.60:0/781375078 wait complete. 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 Processor -- start 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 -- start start 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 0x7f2db81956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8196200 con 0x7f2db80ffcf0 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.211+0000 7f2dbf655640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8196370 con 0x7f2db80feaf0 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbcbf0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbcbf0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8195c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44008/0 (socket says 172.21.15.60:44008) 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbcbf0640 1 -- 172.21.15.60:0/3794413167 learned_addr learned my addr 172.21.15.60:0/3794413167 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbd3f1640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 0x7f2db81956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbd3f1640 1 -- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 msgr2=0x7f2db8195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbd3f1640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbd3f1640 1 -- 172.21.15.60:0/3794413167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8009560 con 0x7f2db80feaf0 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbd3f1640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 0x7f2db81956f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2db400e940 tx=0x7f2db400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db400cc90 con 0x7f2db80feaf0 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db819ae10 con 0x7f2db80feaf0 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2db400cdf0 con 0x7f2db80feaf0 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2db4010430 con 0x7f2db80feaf0 2024-09-21T10:42:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.212+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db819b2d0 con 0x7f2db80feaf0 2024-09-21T10:42:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.214+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db80feef0 con 0x7f2db80feaf0 2024-09-21T10:42:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.214+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 34) v1 ==== 102945+0+0 (secure 0 0 0) 0x7f2db4003fa0 con 0x7f2db80feaf0 2024-09-21T10:42:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.215+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2db4014070 con 0x7f2db80feaf0 2024-09-21T10:42:59.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.220+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2db4061450 con 0x7f2db80feaf0 2024-09-21T10:42:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.270+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 35) v1 ==== 103072+0+0 (secure 0 0 0) 0x7f2db4061070 con 0x7f2db80feaf0 2024-09-21T10:42:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.270+0000 7f2dae7fc640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2da4080280 0x7f2da4082670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.272+0000 7f2dbcbf0640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2da4080280 0x7f2da4082670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.274+0000 7f2dbcbf0640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2da4080280 0x7f2da4082670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2db8196c10 tx=0x7f2da80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:59.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: mgrmap e33: smithi060.mulzpr(active, since 61s), standbys: smithi112.gkunly 2024-09-21T10:42:59.390 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: Active manager daemon smithi060.mulzpr restarted 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: Activating manager daemon smithi060.mulzpr 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: mgrmap e34: smithi060.mulzpr(active, starting, since 0.00591231s), standbys: smithi112.gkunly 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi060"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi112"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr metadata", "who": "smithi060.mulzpr", "id": "smithi060.mulzpr"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr metadata", "who": "smithi112.gkunly", "id": "smithi112.gkunly"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T10:42:59.391 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: Manager daemon smithi060.mulzpr is now available 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/mirror_snapshot_schedule"} : dispatch 2024-09-21T10:42:59.392 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:42:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi060.mulzpr/trash_purge_schedule"} : dispatch 2024-09-21T10:42:59.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.446+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2db80683d0 con 0x7f2da4080280 2024-09-21T10:42:59.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.448+0000 7f2dae7fc640 1 -- 172.21.15.60:0/3794413167 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f2db80683d0 con 0x7f2da4080280 2024-09-21T10:42:59.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2da4080280 msgr2=0x7f2da4082670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2da4080280 0x7f2da4082670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2db8196c10 tx=0x7f2da80058d0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 msgr2=0x7f2db81956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 0x7f2db81956f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2db400e940 tx=0x7f2db400ee00 comp rx=0 tx=0).stop 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 shutdown_connections 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2da4080280 0x7f2da4082670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db80ffcf0 0x7f2db8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 --2- 172.21.15.60:0/3794413167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2db80feaf0 0x7f2db81956f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 >> 172.21.15.60:0/3794413167 conn(0x7f2db80fa280 msgr2=0x7f2db8067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 shutdown_connections 2024-09-21T10:42:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.450+0000 7f2dbf655640 1 -- 172.21.15.60:0/3794413167 wait complete. 2024-09-21T10:42:59.461 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:42:59.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 -- 172.21.15.60:0/447862284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0ffcf0 msgr2=0x7f3a2c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 --2- 172.21.15.60:0/447862284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0ffcf0 0x7f3a2c100170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009880 tx=0x7f3a2002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 -- 172.21.15.60:0/447862284 shutdown_connections 2024-09-21T10:42:59.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 --2- 172.21.15.60:0/447862284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0ffcf0 0x7f3a2c100170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 --2- 172.21.15.60:0/447862284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 -- 172.21.15.60:0/447862284 >> 172.21.15.60:0/447862284 conn(0x7f3a2c0fa280 msgr2=0x7f3a2c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:59.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 -- 172.21.15.60:0/447862284 shutdown_connections 2024-09-21T10:42:59.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.543+0000 7f3a30a79640 1 -- 172.21.15.60:0/447862284 wait complete. 2024-09-21T10:42:59.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a30a79640 1 Processor -- start 2024-09-21T10:42:59.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a30a79640 1 -- start start 2024-09-21T10:42:59.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a30a79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c1956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a30a79640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a2c0ffcf0 0x7f3a2c195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a30a79640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1961e0 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a30a79640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c196350 con 0x7f3a2c0ffcf0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a2a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c1956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a2a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c1956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44040/0 (socket says 172.21.15.60:44040) 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a2a59c640 1 -- 172.21.15.60:0/1385595438 learned_addr learned my addr 172.21.15.60:0/1385595438 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.544+0000 7f3a29d9b640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a2c0ffcf0 0x7f3a2c195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a2a59c640 1 -- 172.21.15.60:0/1385595438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a2c0ffcf0 msgr2=0x7f3a2c195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a2a59c640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a2c0ffcf0 0x7f3a2c195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a2a59c640 1 -- 172.21.15.60:0/1385595438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009560 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a2a59c640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c1956d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00e970 tx=0x7f3a1c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1c0096e0 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a1c0044f0 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1c010430 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c19adf0 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.545+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c19b2c0 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.547+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c107700 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.547+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 35) v1 ==== 103072+0+0 (secure 0 0 0) 0x7f3a1c00cc90 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.548+0000 7f3a1b7fe640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3a1407af80 0x7f3a1407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.548+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3a1c014070 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.548+0000 7f3a29d9b640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3a1407af80 0x7f3a1407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.548+0000 7f3a29d9b640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3a1407af80 0x7f3a1407d440 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000c00 tx=0x7f3a200314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:59.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.553+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f3a1c061580 con 0x7f3a2c0feaf0 2024-09-21T10:42:59.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.766+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a2c19b560 con 0x7f3a1407af80 2024-09-21T10:42:59.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.768+0000 7f3a1b7fe640 1 -- 172.21.15.60:0/1385595438 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3a2c19b560 con 0x7f3a1407af80 2024-09-21T10:42:59.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3a1407af80 msgr2=0x7f3a1407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3a1407af80 0x7f3a1407d440 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000c00 tx=0x7f3a200314e0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 msgr2=0x7f3a2c1956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c1956d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00e970 tx=0x7f3a1c00ee30 comp rx=0 tx=0).stop 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 shutdown_connections 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3a1407af80 0x7f3a1407d440 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3a2c0ffcf0 0x7f3a2c195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 --2- 172.21.15.60:0/1385595438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a2c0feaf0 0x7f3a2c1956d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 >> 172.21.15.60:0/1385595438 conn(0x7f3a2c0fa280 msgr2=0x7f3a2c067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 shutdown_connections 2024-09-21T10:42:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.770+0000 7f3a30a79640 1 -- 172.21.15.60:0/1385595438 wait complete. 2024-09-21T10:42:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 -- 172.21.15.60:0/2964336109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaf0 msgr2=0x7fdd180feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/2964336109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaf0 0x7fdd180feef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009880 tx=0x7fdd0802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 -- 172.21.15.60:0/2964336109 shutdown_connections 2024-09-21T10:42:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/2964336109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffcf0 0x7fdd18100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/2964336109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaf0 0x7fdd180feef0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 -- 172.21.15.60:0/2964336109 >> 172.21.15.60:0/2964336109 conn(0x7fdd180fa280 msgr2=0x7fdd180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:42:59.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 -- 172.21.15.60:0/2964336109 shutdown_connections 2024-09-21T10:42:59.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.857+0000 7fdd1cb71640 1 -- 172.21.15.60:0/2964336109 wait complete. 2024-09-21T10:42:59.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1cb71640 1 Processor -- start 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1cb71640 1 -- start start 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1cb71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180feaf0 0x7fdd181956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1cb71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 0x7fdd18195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1cb71640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181961f0 con 0x7fdd180ffcf0 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1cb71640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18196360 con 0x7fdd180feaf0 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd15d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 0x7fdd18195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd15d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 0x7fdd18195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44050/0 (socket says 172.21.15.60:44050) 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd15d9b640 1 -- 172.21.15.60:0/957947103 learned_addr learned my addr 172.21.15.60:0/957947103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.858+0000 7fdd1659c640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180feaf0 0x7fdd181956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd1659c640 1 -- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 msgr2=0x7fdd18195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd1659c640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 0x7fdd18195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:42:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd1659c640 1 -- 172.21.15.60:0/957947103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009560 con 0x7fdd180feaf0 2024-09-21T10:42:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd15d9b640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 0x7fdd18195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:42:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd1659c640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180feaf0 0x7fdd181956e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdd0802a9c0 tx=0x7fdd080054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd08004aa0 con 0x7fdd180feaf0 2024-09-21T10:42:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1819ada0 con 0x7fdd180feaf0 2024-09-21T10:42:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd08004c00 con 0x7fdd180feaf0 2024-09-21T10:42:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd08003a60 con 0x7fdd180feaf0 2024-09-21T10:42:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.859+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1819b230 con 0x7fdd180feaf0 2024-09-21T10:42:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.860+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18107700 con 0x7fdd180feaf0 2024-09-21T10:42:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.861+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 35) v1 ==== 103072+0+0 (secure 0 0 0) 0x7fdd08003bc0 con 0x7fdd180feaf0 2024-09-21T10:42:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.861+0000 7fdd077fe640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0007afa0 0x7fdd0007d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:42:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.861+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdd080beef0 con 0x7fdd180feaf0 2024-09-21T10:42:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.861+0000 7fdd15d9b640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0007afa0 0x7fdd0007d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:42:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.862+0000 7fdd15d9b640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0007afa0 0x7fdd0007d460 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdd18196c00 tx=0x7fdd0c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:42:59.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:42:59.866+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdd08082250 con 0x7fdd180feaf0 2024-09-21T10:43:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.071+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd180683b0 con 0x7fdd0007afa0 2024-09-21T10:43:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.083+0000 7fdd077fe640 1 -- 172.21.15.60:0/957947103 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fdd180683b0 con 0x7fdd0007afa0 2024-09-21T10:43:00.085 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:43:00.085 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (8m) 15s ago 10m 24.8M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:43:00.085 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (113s) 15s ago 11m 7596k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:43:00.085 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (97s) 23s ago 10m 7264k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (11m) 15s ago 11m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (10m) 23s ago 10m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (8m) 15s ago 10m 83.7M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (4m) 15s ago 4m 172M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (4m) 15s ago 4m 14.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (4m) 23s ago 4m 16.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (4m) 23s ago 4m 18.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (92s) 15s ago 12m 506M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (26s) 23s ago 9m 63.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (12m) 15s ago 12m 56.9M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e 469d57c54e09 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (9m) 23s ago 9m 45.7M 2048M 18.2.4-871-g6a1bdf85 0adab276c97e e85941e2ebd5 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (11m) 15s ago 11m 16.8M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (9m) 23s ago 9m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (8m) 15s ago 8m 252M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (7m) 15s ago 7m 263M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:43:00.086 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (7m) 15s ago 7m 222M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:43:00.087 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (7m) 23s ago 7m 287M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:43:00.087 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (6m) 23s ago 6m 262M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:43:00.087 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (6m) 23s ago 6m 239M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:43:00.087 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (32s) 15s ago 10m 38.6M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:43:00.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0007afa0 msgr2=0x7fdd0007d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0007afa0 0x7fdd0007d460 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdd18196c00 tx=0x7fdd0c00b410 comp rx=0 tx=0).stop 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180feaf0 msgr2=0x7fdd181956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180feaf0 0x7fdd181956e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdd0802a9c0 tx=0x7fdd080054f0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 shutdown_connections 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0007afa0 0x7fdd0007d460 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180ffcf0 0x7fdd18195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 --2- 172.21.15.60:0/957947103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180feaf0 0x7fdd181956e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 >> 172.21.15.60:0/957947103 conn(0x7fdd180fa280 msgr2=0x7fdd18067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 shutdown_connections 2024-09-21T10:43:00.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.085+0000 7fdd1cb71640 1 -- 172.21.15.60:0/957947103 wait complete. 2024-09-21T10:43:00.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2371114821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40ffca0 msgr2=0x7fa3c4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2371114821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40ffca0 0x7fa3c4100120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009880 tx=0x7fa3b802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2371114821 shutdown_connections 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2371114821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40ffca0 0x7fa3c4100120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2371114821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3c40feaa0 0x7fa3c40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2371114821 >> 172.21.15.60:0/2371114821 conn(0x7fa3c40fa250 msgr2=0x7fa3c40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2371114821 shutdown_connections 2024-09-21T10:43:00.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.168+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2371114821 wait complete. 2024-09-21T10:43:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c94b1640 1 Processor -- start 2024-09-21T10:43:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c94b1640 1 -- start start 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c94b1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 0x7fa3c4102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c94b1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3c40ffca0 0x7fa3c4101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c94b1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41015c0 con 0x7fa3c40feaa0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c94b1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c4101730 con 0x7fa3c40ffca0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 0x7fa3c4102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 0x7fa3c4102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44068/0 (socket says 172.21.15.60:44068) 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.169+0000 7fa3c2ffd640 1 -- 172.21.15.60:0/2086205193 learned_addr learned my addr 172.21.15.60:0/2086205193 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c27fc640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3c40ffca0 0x7fa3c4101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c2ffd640 1 -- 172.21.15.60:0/2086205193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3c40ffca0 msgr2=0x7fa3c4101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c2ffd640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3c40ffca0 0x7fa3c4101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c2ffd640 1 -- 172.21.15.60:0/2086205193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8009560 con 0x7fa3c40feaa0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c2ffd640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 0x7fa3c4102a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d8d0 tx=0x7fa3b400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3b4009a30 con 0x7fa3c40feaa0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3b4009b90 con 0x7fa3c40feaa0 2024-09-21T10:43:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c4101a10 con 0x7fa3c40feaa0 2024-09-21T10:43:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3b400f680 con 0x7fa3c40feaa0 2024-09-21T10:43:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.170+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c419d6b0 con 0x7fa3c40feaa0 2024-09-21T10:43:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.171+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c4108080 con 0x7fa3c40feaa0 2024-09-21T10:43:00.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.172+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 35) v1 ==== 103072+0+0 (secure 0 0 0) 0x7fa3b4009d00 con 0x7fa3c40feaa0 2024-09-21T10:43:00.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.172+0000 7fa3abfff640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa3ac07af80 0x7fa3ac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.173+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa3b409dbf0 con 0x7fa3c40feaa0 2024-09-21T10:43:00.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.173+0000 7fa3c27fc640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa3ac07af80 0x7fa3ac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.173+0000 7fa3c27fc640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa3ac07af80 0x7fa3ac07d440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8000c00 tx=0x7fa3b80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:00.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.177+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa3c4108080 con 0x7fa3c40feaa0 2024-09-21T10:43:00.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.434+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7fa3b4060b30 con 0x7fa3c40feaa0 2024-09-21T10:43:00.436 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: mgrmap e35: smithi060.mulzpr(active, since 1.01235s), standbys: smithi112.gkunly 2024-09-21T10:43:00.436 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: [21/Sep/2024:10:42:59] ENGINE Bus STARTING 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: [21/Sep/2024:10:42:59] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: [21/Sep/2024:10:42:59] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: [21/Sep/2024:10:42:59] ENGINE Bus STARTED 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: [21/Sep/2024:10:42:59] ENGINE Error in HTTPServer.serve 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: Traceback (most recent call last): 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._run(expiration_interval) 2024-09-21T10:43:00.437 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self.do_handshake() 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:43:00.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:00 smithi060 ceph-mon[93270]: from='client.24661 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:00.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.461+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3c4108010 con 0x7fa3c40feaa0 2024-09-21T10:43:00.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.461+0000 7fa3abfff640 1 -- 172.21.15.60:0/2086205193 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7fa3b407f140 con 0x7fa3c40feaa0 2024-09-21T10:43:00.463 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 1, 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:43:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 11, 2024-09-21T10:43:00.465 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T10:43:00.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:43:00.465 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.463+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa3ac07af80 msgr2=0x7fa3ac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.463+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa3ac07af80 0x7fa3ac07d440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8000c00 tx=0x7fa3b80314e0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.463+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 msgr2=0x7fa3c4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.463+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 0x7fa3c4102a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d8d0 tx=0x7fa3b400dd90 comp rx=0 tx=0).stop 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 shutdown_connections 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa3ac07af80 0x7fa3ac07d440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3c40ffca0 0x7fa3c4101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 --2- 172.21.15.60:0/2086205193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3c40feaa0 0x7fa3c4102a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 >> 172.21.15.60:0/2086205193 conn(0x7fa3c40fa250 msgr2=0x7fa3c40684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 shutdown_connections 2024-09-21T10:43:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.464+0000 7fa3c94b1640 1 -- 172.21.15.60:0/2086205193 wait complete. 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 -- 172.21.15.60:0/1734222806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 msgr2=0x7f7000100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 --2- 172.21.15.60:0/1734222806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 0x7f7000100170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009880 tx=0x7f6ff002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 -- 172.21.15.60:0/1734222806 shutdown_connections 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 --2- 172.21.15.60:0/1734222806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 0x7f7000100170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 --2- 172.21.15.60:0/1734222806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f70000feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 -- 172.21.15.60:0/1734222806 >> 172.21.15.60:0/1734222806 conn(0x7f70000fa280 msgr2=0x7f70000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 -- 172.21.15.60:0/1734222806 shutdown_connections 2024-09-21T10:43:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 -- 172.21.15.60:0/1734222806 wait complete. 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 Processor -- start 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.550+0000 7f7008571640 1 -- start start 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f7008571640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f7000068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f7008571640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 0x7f700019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f7008571640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700019aa20 con 0x7f70000ffcf0 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f7008571640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700019ab60 con 0x7f70000feaf0 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f7005b0c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 0x7f700019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f7000068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f7000068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:37770/0 (socket says 172.21.15.60:37770) 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 -- 172.21.15.60:0/1137202931 learned_addr learned my addr 172.21.15.60:0/1137202931 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 -- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 msgr2=0x7f700019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 0x7f700019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 -- 172.21.15.60:0/1137202931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0009560 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.551+0000 7f700630d640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f7000068790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00e940 tx=0x7f6ffc00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.552+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ffc0096e0 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.552+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700019ae10 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.552+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ffc0044f0 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.552+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ffc010430 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.552+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700019b2d0 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.553+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700018e690 con 0x7f70000feaf0 2024-09-21T10:43:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.553+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7f6ffc00cc90 con 0x7f70000feaf0 2024-09-21T10:43:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.554+0000 7f6ff77fe640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6fec07b310 0x7f6fec07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.554+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6ffc014070 con 0x7f70000feaf0 2024-09-21T10:43:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.554+0000 7f7005b0c640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6fec07b310 0x7f6fec07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.554+0000 7f7005b0c640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6fec07b310 0x7f6fec07d7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009230 tx=0x7f6ff00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:00.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.559+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f6ffc061700 con 0x7f70000feaf0 2024-09-21T10:43:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: mgrmap e35: smithi060.mulzpr(active, since 1.01235s), standbys: smithi112.gkunly 2024-09-21T10:43:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:42:59] ENGINE Bus STARTING 2024-09-21T10:43:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:42:59] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:42:59] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:42:59] ENGINE Bus STARTED 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: [21/Sep/2024:10:42:59] ENGINE Error in HTTPServer.serve 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Traceback (most recent call last): 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._run(expiration_interval) 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: s = self.context.wrap_socket( 2024-09-21T10:43:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: return self.sslsocket_class._create( 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self.do_handshake() 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: self._sslobj.do_handshake() 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T10:43:00.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:00 smithi112 ceph-mon[35117]: from='client.24661 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:00.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.792+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7000107980 con 0x7f70000feaf0 2024-09-21T10:43:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.793+0000 7f6ff77fe640 1 -- 172.21.15.60:0/1137202931 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f6ffc064820 con 0x7f70000feaf0 2024-09-21T10:43:00.795 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:43:00.795 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:43:00.795 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:43:00.795 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:43:00.795 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:43:00.796 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:43:00.797 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.795+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6fec07b310 msgr2=0x7f6fec07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.795+0000 7f7008571640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6fec07b310 0x7f6fec07d7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009230 tx=0x7f6ff00058d0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.795+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 msgr2=0x7f7000068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.795+0000 7f7008571640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f7000068790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00e940 tx=0x7f6ffc00ee00 comp rx=0 tx=0).stop 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 shutdown_connections 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6fec07b310 0x7f6fec07d7d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70000ffcf0 0x7f700019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 --2- 172.21.15.60:0/1137202931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70000feaf0 0x7f7000068790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 >> 172.21.15.60:0/1137202931 conn(0x7f70000fa280 msgr2=0x7f70001033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 shutdown_connections 2024-09-21T10:43:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.796+0000 7f7008571640 1 -- 172.21.15.60:0/1137202931 wait complete. 2024-09-21T10:43:00.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 -- 172.21.15.60:0/2399965525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 msgr2=0x7ffbec101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/2399965525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec101210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009880 tx=0x7ffbe002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 -- 172.21.15.60:0/2399965525 shutdown_connections 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/2399965525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec101210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/2399965525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 0x7ffbec0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 -- 172.21.15.60:0/2399965525 >> 172.21.15.60:0/2399965525 conn(0x7ffbec0fb320 msgr2=0x7ffbec0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 -- 172.21.15.60:0/2399965525 shutdown_connections 2024-09-21T10:43:00.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.880+0000 7ffbf0e51640 1 -- 172.21.15.60:0/2399965525 wait complete. 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbf0e51640 1 Processor -- start 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbf0e51640 1 -- start start 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbf0e51640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 0x7ffbec195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbf0e51640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbf0e51640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec196140 con 0x7ffbec100d90 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbf0e51640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec1962b0 con 0x7ffbec0ffb90 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbe9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbe9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44108/0 (socket says 172.21.15.60:44108) 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.881+0000 7ffbe9d9b640 1 -- 172.21.15.60:0/946003571 learned_addr learned my addr 172.21.15.60:0/946003571 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbe9d9b640 1 -- 172.21.15.60:0/946003571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 msgr2=0x7ffbec195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbea59c640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 0x7ffbec195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbe9d9b640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 0x7ffbec195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbe9d9b640 1 -- 172.21.15.60:0/946003571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe0009560 con 0x7ffbec100d90 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbea59c640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 0x7ffbec195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbe9d9b640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec195b70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffbe00055a0 tx=0x7ffbe00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbe0004aa0 con 0x7ffbec100d90 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbec19acf0 con 0x7ffbec100d90 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbe0004c00 con 0x7ffbec100d90 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbe0003b10 con 0x7ffbec100d90 2024-09-21T10:43:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.882+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbec19b260 con 0x7ffbec100d90 2024-09-21T10:43:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.883+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbec18f730 con 0x7ffbec100d90 2024-09-21T10:43:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.884+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7ffbe0003d40 con 0x7ffbec100d90 2024-09-21T10:43:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.884+0000 7ffbdb7fe640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ffbd407b310 0x7ffbd407d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.885+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffbe00bf610 con 0x7ffbec100d90 2024-09-21T10:43:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.885+0000 7ffbea59c640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ffbd407b310 0x7ffbd407d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:00.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.885+0000 7ffbea59c640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ffbd407b310 0x7ffbd407d7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffbec100bf0 tx=0x7ffbdc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:00.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:00.889+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ffbe0082600 con 0x7ffbec100d90 2024-09-21T10:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.094+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbec02c450 con 0x7ffbd407b310 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.096+0000 7ffbdb7fe640 1 -- 172.21.15.60:0/946003571 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ffbec02c450 con 0x7ffbd407b310 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:43:01.098 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T10:43:01.099 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-09-21T10:43:01.099 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:43:01.099 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ffbd407b310 msgr2=0x7ffbd407d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ffbd407b310 0x7ffbd407d7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffbec100bf0 tx=0x7ffbdc005f90 comp rx=0 tx=0).stop 2024-09-21T10:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 msgr2=0x7ffbec195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec195b70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffbe00055a0 tx=0x7ffbe00055d0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 shutdown_connections 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ffbd407b310 0x7ffbd407d7d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbec100d90 0x7ffbec195b70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 --2- 172.21.15.60:0/946003571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffbec0ffb90 0x7ffbec195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.098+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 >> 172.21.15.60:0/946003571 conn(0x7ffbec0fb320 msgr2=0x7ffbec104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.099+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 shutdown_connections 2024-09-21T10:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.099+0000 7ffbf0e51640 1 -- 172.21.15.60:0/946003571 wait complete. 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 -- 172.21.15.60:0/1592955723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca40ffbb0 msgr2=0x7f6ca40fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/1592955723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca40ffbb0 0x7f6ca40fffb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009880 tx=0x7f6c9402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 -- 172.21.15.60:0/1592955723 shutdown_connections 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/1592955723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca4100db0 0x7f6ca4101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/1592955723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca40ffbb0 0x7f6ca40fffb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 -- 172.21.15.60:0/1592955723 >> 172.21.15.60:0/1592955723 conn(0x7f6ca40fb360 msgr2=0x7f6ca40fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 -- 172.21.15.60:0/1592955723 shutdown_connections 2024-09-21T10:43:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.194+0000 7f6ca92b8640 1 -- 172.21.15.60:0/1592955723 wait complete. 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.195+0000 7f6ca92b8640 1 Processor -- start 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.195+0000 7f6ca92b8640 1 -- start start 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.195+0000 7f6ca92b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40ffbb0 0x7f6ca4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.195+0000 7f6ca92b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 0x7f6ca40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.195+0000 7f6ca92b8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4072de0 con 0x7f6ca4100db0 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.195+0000 7f6ca92b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4072f50 con 0x7f6ca40ffbb0 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 0x7f6ca40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 0x7f6ca40728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44130/0 (socket says 172.21.15.60:44130) 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 -- 172.21.15.60:0/4264381265 learned_addr learned my addr 172.21.15.60:0/4264381265 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca2ffd640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40ffbb0 0x7f6ca4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 -- 172.21.15.60:0/4264381265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40ffbb0 msgr2=0x7f6ca4074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40ffbb0 0x7f6ca4074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 -- 172.21.15.60:0/4264381265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009560 con 0x7f6ca4100db0 2024-09-21T10:43:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.196+0000 7f6ca27fc640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 0x7f6ca40728a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e970 tx=0x7f6c9800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.197+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c9800cc90 con 0x7f6ca4100db0 2024-09-21T10:43:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.197+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca4073230 con 0x7f6ca4100db0 2024-09-21T10:43:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.197+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c9800cdf0 con 0x7f6ca4100db0 2024-09-21T10:43:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.197+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c98018810 con 0x7f6ca4100db0 2024-09-21T10:43:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.197+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca419d6b0 con 0x7f6ca4100db0 2024-09-21T10:43:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.198+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca40fffb0 con 0x7f6ca4100db0 2024-09-21T10:43:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.199+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 36) v1 ==== 103366+0+0 (secure 0 0 0) 0x7f6c98010430 con 0x7f6ca4100db0 2024-09-21T10:43:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.199+0000 7f6c8bfff640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6c8c07b310 0x7f6c8c07d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.199+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6c98014070 con 0x7f6ca4100db0 2024-09-21T10:43:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.200+0000 7f6ca2ffd640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6c8c07b310 0x7f6c8c07d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.200+0000 7f6ca2ffd640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6c8c07b310 0x7f6c8c07d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c94031540 tx=0x7f6c94031400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:01.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.204+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f6c98064fc0 con 0x7f6ca4100db0 2024-09-21T10:43:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.476+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6ca41087a0 con 0x7f6ca4100db0 2024-09-21T10:43:01.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.477+0000 7f6c8bfff640 1 -- 172.21.15.60:0/4264381265 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6c98064960 con 0x7f6ca4100db0 2024-09-21T10:43:01.479 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6c8c07b310 msgr2=0x7f6c8c07d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6c8c07b310 0x7f6c8c07d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6c94031540 tx=0x7f6c94031400 comp rx=0 tx=0).stop 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 msgr2=0x7f6ca40728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 0x7f6ca40728a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e970 tx=0x7f6c9800ee30 comp rx=0 tx=0).stop 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 shutdown_connections 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f6c8c07b310 0x7f6c8c07d7d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ca4100db0 0x7f6ca40728a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 --2- 172.21.15.60:0/4264381265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6ca40ffbb0 0x7f6ca4074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.479+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 >> 172.21.15.60:0/4264381265 conn(0x7f6ca40fb360 msgr2=0x7f6ca4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.480+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 shutdown_connections 2024-09-21T10:43:01.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:01.480+0000 7f6ca92b8640 1 -- 172.21.15.60:0/4264381265 wait complete. 2024-09-21T10:43:01.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:01 smithi060 ceph-mon[93270]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:01 smithi060 ceph-mon[93270]: mgrmap e36: smithi060.mulzpr(active, since 2s), standbys: smithi112.gkunly 2024-09-21T10:43:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:01 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2086205193' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:01 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1137202931' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:43:01.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:01 smithi112 ceph-mon[35117]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:01.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:01 smithi112 ceph-mon[35117]: mgrmap e36: smithi060.mulzpr(active, since 2s), standbys: smithi112.gkunly 2024-09-21T10:43:01.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:01 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/2086205193' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:01.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:01 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/1137202931' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T10:43:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:02 smithi060 ceph-mon[93270]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:02 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/4264381265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:43:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:02 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:02.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:02 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:02 smithi112 ceph-mon[35117]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:02 smithi112 ceph-mon[35117]: from='client.? 172.21.15.60:0/4264381265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:43:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:02 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:02 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:03.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:03 smithi060 ceph-mon[93270]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:03.759 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:03.760 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:03.760 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:03 smithi060 ceph-mon[93270]: mgrmap e37: smithi060.mulzpr(active, since 4s), standbys: smithi112.gkunly 2024-09-21T10:43:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:03 smithi112 ceph-mon[35117]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:03 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:03.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:03 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:03.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:03 smithi112 ceph-mon[35117]: mgrmap e37: smithi060.mulzpr(active, since 4s), standbys: smithi112.gkunly 2024-09-21T10:43:05.351 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:05 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.351 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:05 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.351 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:05 smithi112 ceph-mon[35117]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:05.351 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:05 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:05 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:05 smithi060 ceph-mon[93270]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:05.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:05.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:43:07.184 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:07.185 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:06 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:07.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:07.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:07.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:06 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T10:43:08.108 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:43:08.108 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:43:08.108 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T10:43:08.108 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:43:08.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:43:08.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:08.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T10:43:08.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T10:43:08.109 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:07 smithi112 ceph-mon[35117]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: Updating smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: Updating smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T10:43:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:09.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:08 smithi112 ceph-mon[35117]: Upgrade: Updating mon.smithi112 2024-09-21T10:43:09.198 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:08 smithi112 ceph-mon[35117]: Deploying daemon mon.smithi112 on smithi112 2024-09-21T10:43:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:08 smithi060 ceph-mon[93270]: Upgrade: Updating mon.smithi112 2024-09-21T10:43:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:08 smithi060 ceph-mon[93270]: Deploying daemon mon.smithi112 on smithi112 2024-09-21T10:43:09.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:09 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:43:09.945 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:09 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112[35092]: 2024-09-21T10:43:09.626+0000 7fee40613640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:43:09.945 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:09 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112[35092]: 2024-09-21T10:43:09.626+0000 7fee40613640 -1 mon.smithi112@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T10:43:09.945 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:09 smithi112 podman[78534]: 2024-09-21 10:43:09.647154296 +0000 UTC m=+0.123296505 container stop e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=reef-6a1bdf8, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T10:43:09.945 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:09 smithi112 podman[78534]: 2024-09-21 10:43:09.67274389 +0000 UTC m=+0.148886100 container died e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8, GIT_CLEAN=True) 2024-09-21T10:43:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 podman[78534]: 2024-09-21 10:43:10.060417202 +0000 UTC m=+0.536559452 container cleanup e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2) 2024-09-21T10:43:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 bash[78534]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112 2024-09-21T10:43:10.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 podman[78546]: 2024-09-21 10:43:10.264610587 +0000 UTC m=+0.611204281 container remove e85941e2ebd546dae8f4761d0ce209a4cbdd0223dd905bab2edba4e1283a59d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-6a1bdf8) 2024-09-21T10:43:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112.service: Deactivated successfully. 2024-09-21T10:43:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:43:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112.service: Consumed 6.401s CPU time. 2024-09-21T10:43:10.689 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 systemd[1]: Starting Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:43:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:10 smithi112 podman[78676]: 2024-09-21 10:43:10.796144368 +0000 UTC m=+0.015875416 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 podman[78676]: 2024-09-21 10:43:11.021263607 +0000 UTC m=+0.240994640 container create 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 podman[78676]: 2024-09-21 10:43:11.240276 +0000 UTC m=+0.460007040 container init 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 podman[78676]: 2024-09-21 10:43:11.243608929 +0000 UTC m=+0.463339966 container start 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev), process ceph-mon, pid 2 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: pidfile_write: ignore empty --pid-file 2024-09-21T10:43:11.273 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: load: jerasure load: lrc 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: RocksDB version: 7.9.2 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Git sha 0 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Compile date 2024-09-21 08:36:07 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: DB SUMMARY 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: DB Session ID: 8V5JKRBNMPGFM434FGK1 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: CURRENT file: CURRENT 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1386 Bytes 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi112/store.db dir, Total Num: 1, files: 000027.sst 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi112/store.db: 000025.log size: 3499042 ; 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.error_if_exists: 0 2024-09-21T10:43:11.274 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.create_if_missing: 0 2024-09-21T10:43:11.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.paranoid_checks: 1 2024-09-21T10:43:11.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T10:43:11.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T10:43:11.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T10:43:11.275 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.env: 0x55fa8a099120 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.info_log: 0x55fa8aed78e0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.statistics: (nil) 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.use_fsync: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_log_file_size: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.allow_fallocate: 1 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.use_direct_reads: 0 2024-09-21T10:43:11.276 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.db_log_dir: 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.wal_dir: 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.write_buffer_manager: 0x55fa8aedbb80 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T10:43:11.277 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.unordered_write: 0 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.row_cache: None 2024-09-21T10:43:11.278 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.wal_filter: None 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.two_write_queues: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.wal_compression: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.atomic_flush: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.log_readahead_size: 0 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T10:43:11.279 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_background_jobs: 2 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_background_compactions: -1 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_subcompactions: 1 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T10:43:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_open_files: -1 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_background_flushes: -1 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Compression algorithms supported: 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kZSTD supported: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kXpressCompression supported: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kBZip2Compression supported: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kLZ4Compression supported: 1 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kZlibCompression supported: 1 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T10:43:11.281 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: kSnappyCompression supported: 1 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000010 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.merge_operator: 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_filter: None 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T10:43:11.282 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fa8aed7540) 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_type: 0 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_index_type: 0 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_shortening: 1 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: checksum: 4 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: no_block_cache: 0 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache: 0x55fa8aecb610 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_options: 2024-09-21T10:43:11.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: capacity : 536870912 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_shard_bits : 4 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: strict_capacity_limit : 0 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_cache_compressed: (nil) 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: persistent_cache: (nil) 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size: 4096 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_size_deviation: 10 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_restart_interval: 16 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: index_block_restart_interval: 1 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_block_size: 4096 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: partition_filters: 0 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: use_delta_encoding: 1 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: filter_policy: bloomfilter 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: whole_key_filtering: 1 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: verify_compression: 0 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-21T10:43:11.284 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: format_version: 5 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_index_compression: 1 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: block_align: 0 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_auto_readahead_size: 262144 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: prepopulate_block_cache: 0 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: initial_auto_readahead_size: 8192 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression: NoCompression 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T10:43:11.285 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T10:43:11.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:11 smithi060 ceph-mon[93270]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.num_levels: 7 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T10:43:11.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T10:43:11.702 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T10:43:11.703 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T10:43:11.704 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.inplace_update_support: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.bloom_locality: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.max_successive_merges: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.ttl: 2592000 2024-09-21T10:43:11.705 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.enable_blob_files: false 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.min_blob_size: 0 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T10:43:11.706 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi112/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12144, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 19a2467d-981e-4207-9db2-d743c1d538fc 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726915391270529, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726915391280177, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2208549, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12149, "largest_seqno": 12804, "table_properties": {"data_size": 2204638, "index_size": 2035, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 837, "raw_key_size": 7805, "raw_average_key_size": 25, "raw_value_size": 2197647, "raw_average_value_size": 7066, "num_data_blocks": 92, "num_entries": 311, "num_filter_entries": 311, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726915391, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "19a2467d-981e-4207-9db2-d743c1d538fc", "db_session_id": "8V5JKRBNMPGFM434FGK1", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726915391280317, "job": 1, "event": "recovery_finished"} 2024-09-21T10:43:11.707 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi112/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fa8aefae00 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: DB pointer 0x55fa8affc000 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** DB Stats ** 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T10:43:11.708 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L0 1/0 2.11 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 648.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: L6 1/0 7.08 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Sum 2/0 9.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 648.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 648.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 648.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.709 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Cumulative compaction: 0.00 GB write, 168.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Interval compaction: 0.00 GB write, 168.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache BinnedLRUCache@0x55fa8aecb610#2 capacity: 512.00 MB usage: 2.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: starting mon.smithi112 rank 1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi112 fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:43:11.710 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???) e2 preinit fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).mds e15 new map 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).mds e15 print_map 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: e15 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: legacy client fscid: 1 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Filesystem 'cephfs' (1) 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: fs_name cephfs 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: epoch 15 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:43:11.711 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: tableserver 0 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: root 0 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_timeout 60 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: session_autoclose 300 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_file_size 1099511627776 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_xattr_size 65536 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: required_client_features {} 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure 0 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: last_failure_osd_epoch 45 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: max_mds 1 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: in 0 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: up {0=14544} 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: failed 2024-09-21T10:43:11.712 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: damaged 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: stopped 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: data_pools [3] 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: metadata_pool 2 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: inline_data disabled 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: balancer 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: bal_rank_mask -1 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: standby_count_wanted 1 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: qdb_cluster leader: 0 members: 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: Standby daemons: 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: 2024-09-21T10:43:11.713 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout: [mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: mon.smithi112@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 ceph-mon[78695]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 bash[78676]: 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 2024-09-21T10:43:11.714 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:11 smithi112 systemd[1]: Started Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:43:12.673 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T10:43:12.673 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: mgrmap e37: smithi060.mulzpr(active, since 13s), standbys: smithi112.gkunly 2024-09-21T10:43:12.673 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: overall HEALTH_OK 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: mon.smithi112 calling monitor election 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: mon.smithi060 calling monitor election 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: mon.smithi060 is new leader, mons smithi060,smithi112 in quorum (ranks 0,1) 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi060"} : dispatch 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi112"} : dispatch 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: monmap epoch 3 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: last_changed 2024-09-21T10:43:11.314596+0000 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: created 2024-09-21T10:30:30.135352+0000 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: min_mon_release 19 (squid) 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: election_strategy: 1 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:43:12.674 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T10:43:12.675 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: mgrmap e37: smithi060.mulzpr(active, since 13s), standbys: smithi112.gkunly 2024-09-21T10:43:12.675 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: overall HEALTH_OK 2024-09-21T10:43:12.675 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:12.675 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:12.675 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:12 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: mgrmap e37: smithi060.mulzpr(active, since 13s), standbys: smithi112.gkunly 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: overall HEALTH_OK 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: mon.smithi112 calling monitor election 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: mon.smithi060 calling monitor election 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: mon.smithi060 is new leader, mons smithi060,smithi112 in quorum (ranks 0,1) 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi060"} : dispatch 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mon metadata", "id": "smithi112"} : dispatch 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: monmap epoch 3 2024-09-21T10:43:12.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: fsid 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: last_changed 2024-09-21T10:43:11.314596+0000 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: created 2024-09-21T10:30:30.135352+0000 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: min_mon_release 19 (squid) 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: election_strategy: 1 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.smithi060 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: 1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.smithi112 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: mgrmap e37: smithi060.mulzpr(active, since 13s), standbys: smithi112.gkunly 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: overall HEALTH_OK 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:12.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:12 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:13.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:13 smithi060 ceph-mon[93270]: pgmap v10: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T10:43:13.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:13 smithi112 ceph-mon[78695]: pgmap v10: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T10:43:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:14.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:14.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:14.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:15 smithi060 ceph-mon[93270]: pgmap v11: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T10:43:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:15.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:15 smithi112 ceph-mon[78695]: pgmap v11: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T10:43:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:17.876 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:17 smithi112 ceph-mon[78695]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T10:43:17.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:17 smithi060 ceph-mon[93270]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: Reconfiguring mon.smithi060 (monmap changed)... 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:18 smithi060 ceph-mon[93270]: Reconfiguring daemon mon.smithi060 on smithi060 2024-09-21T10:43:19.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:19.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:19.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: Reconfiguring mon.smithi060 (monmap changed)... 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:19.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:18 smithi112 ceph-mon[78695]: Reconfiguring daemon mon.smithi060 on smithi060 2024-09-21T10:43:20.017 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:19 smithi060 ceph-mon[93270]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:20.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:20.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:20.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T10:43:20.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T10:43:20.018 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:19 smithi112 ceph-mon[78695]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:20.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi060.mulzpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T10:43:20.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T10:43:20.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: Reconfiguring mgr.smithi060.mulzpr (monmap changed)... 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: Reconfiguring daemon mgr.smithi060.mulzpr on smithi060 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi060"} : dispatch 2024-09-21T10:43:21.151 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:20 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: Reconfiguring mgr.smithi060.mulzpr (monmap changed)... 2024-09-21T10:43:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: Reconfiguring daemon mgr.smithi060.mulzpr on smithi060 2024-09-21T10:43:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:21.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:21.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:21.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T10:43:21.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi060"} : dispatch 2024-09-21T10:43:21.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:20 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:22.168 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:21 smithi060 ceph-mon[93270]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:22.168 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:21 smithi060 ceph-mon[93270]: Reconfiguring ceph-exporter.smithi060 (monmap changed)... 2024-09-21T10:43:22.168 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:21 smithi060 ceph-mon[93270]: Unable to update caps for client.ceph-exporter.smithi060 2024-09-21T10:43:22.168 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:21 smithi060 ceph-mon[93270]: Reconfiguring daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:43:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:21 smithi112 ceph-mon[78695]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:21 smithi112 ceph-mon[78695]: Reconfiguring ceph-exporter.smithi060 (monmap changed)... 2024-09-21T10:43:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:21 smithi112 ceph-mon[78695]: Unable to update caps for client.ceph-exporter.smithi060 2024-09-21T10:43:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:21 smithi112 ceph-mon[78695]: Reconfiguring daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:43:23.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:23.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:23.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: Reconfiguring crash.smithi060 (monmap changed)... 2024-09-21T10:43:23.581 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:23.581 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:23.581 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: Reconfiguring daemon crash.smithi060 on smithi060 2024-09-21T10:43:23.581 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:23 smithi060 ceph-mon[93270]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: Reconfiguring crash.smithi060 (monmap changed)... 2024-09-21T10:43:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: Reconfiguring daemon crash.smithi060 on smithi060 2024-09-21T10:43:23.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:23 smithi112 ceph-mon[78695]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:24 smithi060 ceph-mon[93270]: Reconfiguring osd.0 (monmap changed)... 2024-09-21T10:43:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T10:43:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:24.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:24 smithi060 ceph-mon[93270]: Reconfiguring daemon osd.0 on smithi060 2024-09-21T10:43:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:24 smithi112 ceph-mon[78695]: Reconfiguring osd.0 (monmap changed)... 2024-09-21T10:43:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T10:43:24.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:24.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:24 smithi112 ceph-mon[78695]: Reconfiguring daemon osd.0 on smithi060 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: Reconfiguring osd.1 (monmap changed)... 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:26 smithi060 ceph-mon[93270]: Reconfiguring daemon osd.1 on smithi060 2024-09-21T10:43:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: Reconfiguring osd.1 (monmap changed)... 2024-09-21T10:43:26.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T10:43:26.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:26.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:26 smithi112 ceph-mon[78695]: Reconfiguring daemon osd.1 on smithi060 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: Reconfiguring osd.2 (monmap changed)... 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:27.920 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:27 smithi060 ceph-mon[93270]: Reconfiguring daemon osd.2 on smithi060 2024-09-21T10:43:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: Reconfiguring osd.2 (monmap changed)... 2024-09-21T10:43:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T10:43:27.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:27.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:27 smithi112 ceph-mon[78695]: Reconfiguring daemon osd.2 on smithi060 2024-09-21T10:43:29.384 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: Reconfiguring mds.cephfs.smithi060.xjabvh (monmap changed)... 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: Reconfiguring daemon mds.cephfs.smithi060.xjabvh on smithi060 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:29.385 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: Reconfiguring mds.cephfs.smithi060.xjabvh (monmap changed)... 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: Reconfiguring daemon mds.cephfs.smithi060.xjabvh on smithi060 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:30.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:30.862 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:30.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:30 smithi060 ceph-mon[93270]: Reconfiguring mds.cephfs.smithi060.lljnqu (monmap changed)... 2024-09-21T10:43:30.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:30.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:30.863 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:30 smithi060 ceph-mon[93270]: Reconfiguring daemon mds.cephfs.smithi060.lljnqu on smithi060 2024-09-21T10:43:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:30.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:30 smithi112 ceph-mon[78695]: Reconfiguring mds.cephfs.smithi060.lljnqu (monmap changed)... 2024-09-21T10:43:30.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:30.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:30.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:30 smithi112 ceph-mon[78695]: Reconfiguring daemon mds.cephfs.smithi060.lljnqu on smithi060 2024-09-21T10:43:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 -- 172.21.15.60:0/838640866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52780ffb90 msgr2=0x7f52780fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 --2- 172.21.15.60:0/838640866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52780ffb90 0x7f52780fff90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5274009880 tx=0x7f527402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 -- 172.21.15.60:0/838640866 shutdown_connections 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 --2- 172.21.15.60:0/838640866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5278100d90 0x7f5278101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 --2- 172.21.15.60:0/838640866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52780ffb90 0x7f52780fff90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 -- 172.21.15.60:0/838640866 >> 172.21.15.60:0/838640866 conn(0x7f52780fb320 msgr2=0x7f52780fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 -- 172.21.15.60:0/838640866 shutdown_connections 2024-09-21T10:43:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.576+0000 7f527efac640 1 -- 172.21.15.60:0/838640866 wait complete. 2024-09-21T10:43:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.577+0000 7f527efac640 1 Processor -- start 2024-09-21T10:43:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.577+0000 7f527efac640 1 -- start start 2024-09-21T10:43:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.577+0000 7f527efac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780ffb90 0x7f5278074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.577+0000 7f527efac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 0x7f52780728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.577+0000 7f527efac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5278072de0 con 0x7f5278100d90 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.577+0000 7f527efac640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5278072f50 con 0x7f52780ffb90 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 0x7f52780728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 0x7f52780728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54766/0 (socket says 172.21.15.60:54766) 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 -- 172.21.15.60:0/2156602648 learned_addr learned my addr 172.21.15.60:0/2156602648 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f527cd48640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780ffb90 0x7f5278074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 -- 172.21.15.60:0/2156602648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780ffb90 msgr2=0x7f5278074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780ffb90 0x7f5278074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 -- 172.21.15.60:0/2156602648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274009560 con 0x7f5278100d90 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526ffff640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 0x7f52780728a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f526800e970 tx=0x7f526800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526800cc90 con 0x7f5278100d90 2024-09-21T10:43:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5278073230 con 0x7f5278100d90 2024-09-21T10:43:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f526800cdf0 con 0x7f5278100d90 2024-09-21T10:43:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.578+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5268010430 con 0x7f5278100d90 2024-09-21T10:43:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.579+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527819d6f0 con 0x7f5278100d90 2024-09-21T10:43:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.580+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527818f730 con 0x7f5278100d90 2024-09-21T10:43:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.580+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f52680046c0 con 0x7f5278100d90 2024-09-21T10:43:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.581+0000 7f526dffb640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f526007b3a0 0x7f526007d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.581+0000 7f527cd48640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f526007b3a0 0x7f526007d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.581+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5268014070 con 0x7f5278100d90 2024-09-21T10:43:31.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.582+0000 7f527cd48640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f526007b3a0 0x7f526007d860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5274009230 tx=0x7f52740314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.586+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f5268061960 con 0x7f5278100d90 2024-09-21T10:43:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.794+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f527802c450 con 0x7f526007b3a0 2024-09-21T10:43:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.795+0000 7f526dffb640 1 -- 172.21.15.60:0/2156602648 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f527802c450 con 0x7f526007b3a0 2024-09-21T10:43:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f526007b3a0 msgr2=0x7f526007d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f526007b3a0 0x7f526007d860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5274009230 tx=0x7f52740314e0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 msgr2=0x7f52780728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 0x7f52780728a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f526800e970 tx=0x7f526800ed70 comp rx=0 tx=0).stop 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 shutdown_connections 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f526007b3a0 0x7f526007d860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5278100d90 0x7f52780728a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 --2- 172.21.15.60:0/2156602648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52780ffb90 0x7f5278074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 >> 172.21.15.60:0/2156602648 conn(0x7f52780fb320 msgr2=0x7f52781044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 shutdown_connections 2024-09-21T10:43:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.797+0000 7f527efac640 1 -- 172.21.15.60:0/2156602648 wait complete. 2024-09-21T10:43:31.809 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:43:31.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 -- 172.21.15.60:0/2174394472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101b40 msgr2=0x7f34900fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 --2- 172.21.15.60:0/2174394472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101b40 0x7f34900fdc10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3484009880 tx=0x7f348402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 -- 172.21.15.60:0/2174394472 shutdown_connections 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 --2- 172.21.15.60:0/2174394472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101b40 0x7f34900fdc10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 --2- 172.21.15.60:0/2174394472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3490101170 0x7f3490101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 -- 172.21.15.60:0/2174394472 >> 172.21.15.60:0/2174394472 conn(0x7f34900f99c0 msgr2=0x7f34900fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 -- 172.21.15.60:0/2174394472 shutdown_connections 2024-09-21T10:43:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.882+0000 7f3495577640 1 -- 172.21.15.60:0/2174394472 wait complete. 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f3495577640 1 Processor -- start 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f3495577640 1 -- start start 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f3495577640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 0x7f3490195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f3495577640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3490101b40 0x7f3490195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f3495577640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34901961a0 con 0x7f3490101170 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f3495577640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490196310 con 0x7f3490101b40 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f348effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 0x7f3490195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f348effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 0x7f3490195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54784/0 (socket says 172.21.15.60:54784) 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.883+0000 7f348effd640 1 -- 172.21.15.60:0/67200622 learned_addr learned my addr 172.21.15.60:0/67200622 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:31.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f348e7fc640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3490101b40 0x7f3490195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f348effd640 1 -- 172.21.15.60:0/67200622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3490101b40 msgr2=0x7f3490195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f348effd640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3490101b40 0x7f3490195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f348effd640 1 -- 172.21.15.60:0/67200622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009560 con 0x7f3490101170 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f348effd640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 0x7f3490195690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f348000e970 tx=0x7f348000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3480009700 con 0x7f3490101170 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349019ad60 con 0x7f3490101170 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f348000cc90 con 0x7f3490101170 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3480010430 con 0x7f3490101170 2024-09-21T10:43:31.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.884+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349019b2a0 con 0x7f3490101170 2024-09-21T10:43:31.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.885+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349018f720 con 0x7f3490101170 2024-09-21T10:43:31.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.886+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f3480003f70 con 0x7f3490101170 2024-09-21T10:43:31.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.887+0000 7f3477fff640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f347807b3a0 0x7f347807d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:31.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.887+0000 7f348e7fc640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f347807b3a0 0x7f347807d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:31.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.887+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3480014070 con 0x7f3490101170 2024-09-21T10:43:31.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.887+0000 7f348e7fc640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f347807b3a0 0x7f347807d860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3484009230 tx=0x7f34840314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:31.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:31.891+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f3480061910 con 0x7f3490101170 2024-09-21T10:43:32.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.100+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f349002c5d0 con 0x7f347807b3a0 2024-09-21T10:43:32.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.101+0000 7f3477fff640 1 -- 172.21.15.60:0/67200622 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f349002c5d0 con 0x7f347807b3a0 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f347807b3a0 msgr2=0x7f347807d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f347807b3a0 0x7f347807d860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3484009230 tx=0x7f34840314e0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 msgr2=0x7f3490195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 0x7f3490195690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f348000e970 tx=0x7f348000ee30 comp rx=0 tx=0).stop 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 shutdown_connections 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f347807b3a0 0x7f347807d860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3490101b40 0x7f3490195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 --2- 172.21.15.60:0/67200622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3490101170 0x7f3490195690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 >> 172.21.15.60:0/67200622 conn(0x7f34900f99c0 msgr2=0x7f3490104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 shutdown_connections 2024-09-21T10:43:32.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.103+0000 7f3495577640 1 -- 172.21.15.60:0/67200622 wait complete. 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.186+0000 7f1be5021640 1 -- 172.21.15.60:0/1091521408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00feaa0 msgr2=0x7f1be00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.186+0000 7f1be5021640 1 --2- 172.21.15.60:0/1091521408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00feaa0 0x7f1be00feea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009880 tx=0x7f1bd002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 -- 172.21.15.60:0/1091521408 shutdown_connections 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 --2- 172.21.15.60:0/1091521408 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be00ffca0 0x7f1be0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 --2- 172.21.15.60:0/1091521408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00feaa0 0x7f1be00feea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 -- 172.21.15.60:0/1091521408 >> 172.21.15.60:0/1091521408 conn(0x7f1be00fa250 msgr2=0x7f1be00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:32.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 -- 172.21.15.60:0/1091521408 shutdown_connections 2024-09-21T10:43:32.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 -- 172.21.15.60:0/1091521408 wait complete. 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: Reconfiguring ceph-exporter.smithi112 (monmap changed)... 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: Unable to update caps for client.ceph-exporter.smithi112 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi112"} : dispatch 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:32.191 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:31 smithi060 ceph-mon[93270]: Reconfiguring daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.187+0000 7f1be5021640 1 Processor -- start 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1be5021640 1 -- start start 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1be5021640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be00feaa0 0x7f1be0195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1be5021640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 0x7f1be0195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1be5021640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0196180 con 0x7f1be00ffca0 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1be5021640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01962f0 con 0x7f1be00feaa0 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bde59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 0x7f1be0195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bded9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be00feaa0 0x7f1be0195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bde59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 0x7f1be0195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54810/0 (socket says 172.21.15.60:54810) 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bde59c640 1 -- 172.21.15.60:0/1901337066 learned_addr learned my addr 172.21.15.60:0/1901337066 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bde59c640 1 -- 172.21.15.60:0/1901337066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be00feaa0 msgr2=0x7f1be0195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bde59c640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be00feaa0 0x7f1be0195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.188+0000 7f1bde59c640 1 -- 172.21.15.60:0/1901337066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0009560 con 0x7f1be00ffca0 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.189+0000 7f1bde59c640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 0x7f1be0195bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400d900 tx=0x7f1bd400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.189+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd4009c00 con 0x7f1be00ffca0 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.189+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be019ad90 con 0x7f1be00ffca0 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.189+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1bd400b660 con 0x7f1be00ffca0 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.189+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd400f680 con 0x7f1be00ffca0 2024-09-21T10:43:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.189+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be019b330 con 0x7f1be00ffca0 2024-09-21T10:43:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.190+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be00feea0 con 0x7f1be00ffca0 2024-09-21T10:43:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.191+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f1bd400f8b0 con 0x7f1be00ffca0 2024-09-21T10:43:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.191+0000 7f1bc7fff640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1bc807b3a0 0x7f1bc807d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.191+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1bd409e2d0 con 0x7f1be00ffca0 2024-09-21T10:43:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.191+0000 7f1bded9d640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1bc807b3a0 0x7f1bc807d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.192+0000 7f1bded9d640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1bc807b3a0 0x7f1bc807d860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009230 tx=0x7f1bd00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.196+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1bd4061170 con 0x7f1be00ffca0 2024-09-21T10:43:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: Reconfiguring ceph-exporter.smithi112 (monmap changed)... 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: Unable to update caps for client.ceph-exporter.smithi112 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi112"} : dispatch 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:31 smithi112 ceph-mon[78695]: Reconfiguring daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:43:32.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.393+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1be0068c30 con 0x7f1bc807b3a0 2024-09-21T10:43:32.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.403+0000 7f1bc7fff640 1 -- 172.21.15.60:0/1901337066 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1be0068c30 con 0x7f1bc807b3a0 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (9m) 28s ago 11m 24.8M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (2m) 28s ago 11m 7629k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (2m) 18s ago 10m 7310k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (11m) 28s ago 11m 6903k - 18.2.4-871-g6a1bdf85 0adab276c97e 4e17db1a9221 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (10m) 18s ago 10m 6899k - 18.2.4-871-g6a1bdf85 0adab276c97e ac8c6b244897 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (9m) 28s ago 11m 86.6M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (5m) 28s ago 5m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (5m) 28s ago 5m 15.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (5m) 18s ago 5m 17.1M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:43:32.407 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (5m) 18s ago 5m 19.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (2m) 28s ago 12m 488M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (59s) 18s ago 10m 452M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (42s) 28s ago 12m 31.6M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (21s) 18s ago 10m 21.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (11m) 28s ago 11m 16.8M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (10m) 18s ago 10m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (8m) 28s ago 8m 252M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (8m) 28s ago 8m 263M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (8m) 28s ago 8m 222M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (7m) 18s ago 7m 285M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (7m) 18s ago 7m 263M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (6m) 18s ago 6m 239M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:43:32.408 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (65s) 28s ago 11m 44.3M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:43:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1bc807b3a0 msgr2=0x7f1bc807d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1bc807b3a0 0x7f1bc807d860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009230 tx=0x7f1bd00314e0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 msgr2=0x7f1be0195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 0x7f1be0195bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400d900 tx=0x7f1bd400ddc0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 shutdown_connections 2024-09-21T10:43:32.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1bc807b3a0 0x7f1bc807d860 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be00ffca0 0x7f1be0195bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 --2- 172.21.15.60:0/1901337066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be00feaa0 0x7f1be0195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 >> 172.21.15.60:0/1901337066 conn(0x7f1be00fa250 msgr2=0x7f1be0068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:32.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 shutdown_connections 2024-09-21T10:43:32.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.406+0000 7f1be5021640 1 -- 172.21.15.60:0/1901337066 wait complete. 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.489+0000 7f79738e2640 1 -- 172.21.15.60:0/1326392812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 msgr2=0x7f796c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.489+0000 7f79738e2640 1 --2- 172.21.15.60:0/1326392812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c101200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f795c009880 tx=0x7f795c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.489+0000 7f79738e2640 1 -- 172.21.15.60:0/1326392812 shutdown_connections 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.489+0000 7f79738e2640 1 --2- 172.21.15.60:0/1326392812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c101200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.489+0000 7f79738e2640 1 --2- 172.21.15.60:0/1326392812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0ffb80 0x7f796c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.489+0000 7f79738e2640 1 -- 172.21.15.60:0/1326392812 >> 172.21.15.60:0/1326392812 conn(0x7f796c0fb330 msgr2=0x7f796c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 -- 172.21.15.60:0/1326392812 shutdown_connections 2024-09-21T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 -- 172.21.15.60:0/1326392812 wait complete. 2024-09-21T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 Processor -- start 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 -- start start 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0ffb80 0x7f796c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c196140 con 0x7f796c100d80 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.490+0000 7f79738e2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1962b0 con 0x7f796c0ffb80 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54828/0 (socket says 172.21.15.60:54828) 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 -- 172.21.15.60:0/623649704 learned_addr learned my addr 172.21.15.60:0/623649704 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f797167e640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0ffb80 0x7f796c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 -- 172.21.15.60:0/623649704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0ffb80 msgr2=0x7f796c195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0ffb80 0x7f796c195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 -- 172.21.15.60:0/623649704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c009560 con 0x7f796c100d80 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f7970e7d640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c195b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f795c0055a0 tx=0x7f795c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c004aa0 con 0x7f796c100d80 2024-09-21T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f795c004c00 con 0x7f796c100d80 2024-09-21T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c19aca0 con 0x7f796c100d80 2024-09-21T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c003b10 con 0x7f796c100d80 2024-09-21T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.491+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c19b210 con 0x7f796c100d80 2024-09-21T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.492+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c18f720 con 0x7f796c100d80 2024-09-21T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.493+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f795c003c70 con 0x7f796c100d80 2024-09-21T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.493+0000 7f79627fc640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f795807b3a0 0x7f795807d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.494+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f795c0bf5a0 con 0x7f796c100d80 2024-09-21T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.494+0000 7f797167e640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f795807b3a0 0x7f795807d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.494+0000 7f797167e640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f795807b3a0 0x7f795807d860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f796c100be0 tx=0x7f7968005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.498+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f795c0825e0 con 0x7f796c100d80 2024-09-21T10:43:32.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.761+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f796c108a10 con 0x7f796c100d80 2024-09-21T10:43:32.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.762+0000 7f79627fc640 1 -- 172.21.15.60:0/623649704 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f795c085700 con 0x7f796c100d80 2024-09-21T10:43:32.765 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:43:32.765 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:43:32.765 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:43:32.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:32.765 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 10, 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:43:32.766 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f795807b3a0 msgr2=0x7f795807d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f795807b3a0 0x7f795807d860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f796c100be0 tx=0x7f7968005f90 comp rx=0 tx=0).stop 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 msgr2=0x7f796c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c195b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f795c0055a0 tx=0x7f795c0055d0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 shutdown_connections 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f795807b3a0 0x7f795807d860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f796c100d80 0x7f796c195b70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 --2- 172.21.15.60:0/623649704 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796c0ffb80 0x7f796c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.764+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 >> 172.21.15.60:0/623649704 conn(0x7f796c0fb330 msgr2=0x7f796c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:32.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.765+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 shutdown_connections 2024-09-21T10:43:32.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.765+0000 7f79738e2640 1 -- 172.21.15.60:0/623649704 wait complete. 2024-09-21T10:43:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.847+0000 7fdd5c9df640 1 -- 172.21.15.60:0/3362214644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 msgr2=0x7fdd58105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.847+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/3362214644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd58105350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0098b0 tx=0x7fdd4c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 -- 172.21.15.60:0/3362214644 shutdown_connections 2024-09-21T10:43:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/3362214644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd58105350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/3362214644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 0x7fdd58102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 -- 172.21.15.60:0/3362214644 >> 172.21.15.60:0/3362214644 conn(0x7fdd580fa230 msgr2=0x7fdd580fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 -- 172.21.15.60:0/3362214644 shutdown_connections 2024-09-21T10:43:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 -- 172.21.15.60:0/3362214644 wait complete. 2024-09-21T10:43:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 Processor -- start 2024-09-21T10:43:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.848+0000 7fdd5c9df640 1 -- start start 2024-09-21T10:43:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5c9df640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 0x7fdd580fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5c9df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd580fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5c9df640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580feb20 con 0x7fdd58102f60 2024-09-21T10:43:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5c9df640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580fec90 con 0x7fdd58100630 2024-09-21T10:43:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd55d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd580fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5659c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 0x7fdd580fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd55d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd580fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54848/0 (socket says 172.21.15.60:54848) 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd55d9b640 1 -- 172.21.15.60:0/588446166 learned_addr learned my addr 172.21.15.60:0/588446166 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5659c640 1 -- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 msgr2=0x7fdd580fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5659c640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd580fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5659c640 1 -- 172.21.15.60:0/588446166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009560 con 0x7fdd58100630 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd55d9b640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd580fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.849+0000 7fdd5659c640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 0x7fdd580fff90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e970 tx=0x7fdd4800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.850+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd48009620 con 0x7fdd58100630 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.850+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd480044f0 con 0x7fdd58100630 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.850+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd580fef70 con 0x7fdd58100630 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.850+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd480049d0 con 0x7fdd58100630 2024-09-21T10:43:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.850+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5819d6c0 con 0x7fdd58100630 2024-09-21T10:43:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.851+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd58100a10 con 0x7fdd58100630 2024-09-21T10:43:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.851+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fdd4800cc90 con 0x7fdd58100630 2024-09-21T10:43:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.852+0000 7fdd477fe640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd4007b3a0 0x7fdd4007d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.852+0000 7fdd55d9b640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd4007b3a0 0x7fdd4007d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.852+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdd48014070 con 0x7fdd58100630 2024-09-21T10:43:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.852+0000 7fdd55d9b640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd4007b3a0 0x7fdd4007d860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd580ffd10 tx=0x7fdd4c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:32.857+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdd48061710 con 0x7fdd58100630 2024-09-21T10:43:33.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:32 smithi112 ceph-mon[78695]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:33.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:32 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:33.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:32 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:33.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:32 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:33.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:32 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:33.001 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:32 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/623649704' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.083+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd58108a10 con 0x7fdd58100630 2024-09-21T10:43:33.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:32 smithi060 ceph-mon[93270]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:33.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:32 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:33.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:32 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:33.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:32 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:33.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:32 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:33.087 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:32 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/623649704' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:33.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.084+0000 7fdd477fe640 1 -- 172.21.15.60:0/588446166 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7fdd48064830 con 0x7fdd58100630 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:43:33.088 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:43:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:43:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:43:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd4007b3a0 msgr2=0x7fdd4007d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd4007b3a0 0x7fdd4007d860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd580ffd10 tx=0x7fdd4c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 msgr2=0x7fdd580fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 0x7fdd580fff90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e970 tx=0x7fdd4800ee30 comp rx=0 tx=0).stop 2024-09-21T10:43:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 shutdown_connections 2024-09-21T10:43:33.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd4007b3a0 0x7fdd4007d860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd58102f60 0x7fdd580fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 --2- 172.21.15.60:0/588446166 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd58100630 0x7fdd580fff90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 >> 172.21.15.60:0/588446166 conn(0x7fdd580fa230 msgr2=0x7fdd580fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:33.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 shutdown_connections 2024-09-21T10:43:33.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.086+0000 7fdd5c9df640 1 -- 172.21.15.60:0/588446166 wait complete. 2024-09-21T10:43:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2748775895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80ff410 msgr2=0x7fe1f80ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2748775895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80ff410 0x7fe1f80ff890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009880 tx=0x7fe1ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2748775895 shutdown_connections 2024-09-21T10:43:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2748775895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80ff410 0x7fe1f80ff890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2748775895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1f80fe210 0x7fe1f80fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2748775895 >> 172.21.15.60:0/2748775895 conn(0x7fe1f80f99c0 msgr2=0x7fe1f80fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2748775895 shutdown_connections 2024-09-21T10:43:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.170+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2748775895 wait complete. 2024-09-21T10:43:33.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1fc8e3640 1 Processor -- start 2024-09-21T10:43:33.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1fc8e3640 1 -- start start 2024-09-21T10:43:33.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1fc8e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 0x7fe1f8102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:33.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1fc8e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1f80ff410 0x7fe1f81007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:33.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1fc8e3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8100d30 con 0x7fe1f80fe210 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1fc8e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8100ea0 con 0x7fe1f80ff410 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1f659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 0x7fe1f8102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1f659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 0x7fe1f8102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54860/0 (socket says 172.21.15.60:54860) 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.171+0000 7fe1f659c640 1 -- 172.21.15.60:0/2635741130 learned_addr learned my addr 172.21.15.60:0/2635741130 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1f5d9b640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1f80ff410 0x7fe1f81007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1f659c640 1 -- 172.21.15.60:0/2635741130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1f80ff410 msgr2=0x7fe1f81007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1f659c640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1f80ff410 0x7fe1f81007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1f659c640 1 -- 172.21.15.60:0/2635741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009560 con 0x7fe1f80fe210 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1f659c640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 0x7fe1f8102150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800daf0 tx=0x7fe1e800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e800ae60 con 0x7fe1f80fe210 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f8101180 con 0x7fe1f80fe210 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1e800e910 con 0x7fe1f80fe210 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e8016b20 con 0x7fe1f80fe210 2024-09-21T10:43:33.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.172+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f819d700 con 0x7fe1f80fe210 2024-09-21T10:43:33.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.173+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f80fe610 con 0x7fe1f80fe210 2024-09-21T10:43:33.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.174+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fe1e800e450 con 0x7fe1f80fe210 2024-09-21T10:43:33.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.174+0000 7fe1e77fe640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe1e007b390 0x7fe1e007d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.174+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe1e809e9a0 con 0x7fe1f80fe210 2024-09-21T10:43:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.174+0000 7fe1f5d9b640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe1e007b390 0x7fe1e007d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.175+0000 7fe1f5d9b640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe1e007b390 0x7fe1e007d850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec000c00 tx=0x7fe1ec005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:33.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.180+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fe1e8061790 con 0x7fe1f80fe210 2024-09-21T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.388+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1f80608f0 con 0x7fe1e007b390 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.389+0000 7fe1e77fe640 1 -- 172.21.15.60:0/2635741130 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe1f80608f0 con 0x7fe1e007b390 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "4/23 daemons upgraded", 2024-09-21T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe1e007b390 msgr2=0x7fe1e007d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe1e007b390 0x7fe1e007d850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec000c00 tx=0x7fe1ec005d90 comp rx=0 tx=0).stop 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 msgr2=0x7fe1f8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 0x7fe1f8102150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800daf0 tx=0x7fe1e800a250 comp rx=0 tx=0).stop 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 shutdown_connections 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe1e007b390 0x7fe1e007d850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1f80ff410 0x7fe1f81007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 --2- 172.21.15.60:0/2635741130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f80fe210 0x7fe1f8102150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 >> 172.21.15.60:0/2635741130 conn(0x7fe1f80f99c0 msgr2=0x7fe1f8102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 shutdown_connections 2024-09-21T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.391+0000 7fe1fc8e3640 1 -- 172.21.15.60:0/2635741130 wait complete. 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.473+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3975661561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f48103010 msgr2=0x7f5f48105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.473+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3975661561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f48103010 0x7f5f48105400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009880 tx=0x7f5f3802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.473+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3975661561 shutdown_connections 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.473+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3975661561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f48103010 0x7f5f48105400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.473+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3975661561 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f481006e0 0x7f5f48102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.474+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3975661561 >> 172.21.15.60:0/3975661561 conn(0x7f5f480fa280 msgr2=0x7f5f480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.474+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3975661561 shutdown_connections 2024-09-21T10:43:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.474+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3975661561 wait complete. 2024-09-21T10:43:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.474+0000 7f5f4cbcf640 1 Processor -- start 2024-09-21T10:43:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.474+0000 7f5f4cbcf640 1 -- start start 2024-09-21T10:43:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4cbcf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 0x7f5f481956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4cbcf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f48103010 0x7f5f48195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4cbcf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481961f0 con 0x7f5f481006e0 2024-09-21T10:43:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4cbcf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48196360 con 0x7f5f48103010 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 0x7f5f481956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 0x7f5f481956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54876/0 (socket says 172.21.15.60:54876) 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 -- 172.21.15.60:0/3683777262 learned_addr learned my addr 172.21.15.60:0/3683777262 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f45d9b640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f48103010 0x7f5f48195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 -- 172.21.15.60:0/3683777262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f48103010 msgr2=0x7f5f48195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f48103010 0x7f5f48195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 -- 172.21.15.60:0/3683777262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009560 con 0x7f5f481006e0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4659c640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 0x7f5f481956e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b450 tx=0x7f5f3000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f30011860 con 0x7f5f481006e0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f30011e80 con 0x7f5f481006e0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4819ae00 con 0x7f5f481006e0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.475+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f3000f570 con 0x7f5f481006e0 2024-09-21T10:43:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.476+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4819b350 con 0x7f5f481006e0 2024-09-21T10:43:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.476+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f481087f0 con 0x7f5f481006e0 2024-09-21T10:43:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.477+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f5f300103e0 con 0x7f5f481006e0 2024-09-21T10:43:33.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.478+0000 7f5f3f7fe640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5f3407b3a0 0x7f5f3407d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:43:33.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.478+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5f3009e2e0 con 0x7f5f481006e0 2024-09-21T10:43:33.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.478+0000 7f5f45d9b640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5f3407b3a0 0x7f5f3407d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:43:33.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.478+0000 7f5f45d9b640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5f3407b3a0 0x7f5f3407d860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009230 tx=0x7f5f380314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:43:33.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.483+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f5f300610d0 con 0x7f5f481006e0 2024-09-21T10:43:33.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.746+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5f48108980 con 0x7f5f481006e0 2024-09-21T10:43:33.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.747+0000 7f5f3f7fe640 1 -- 172.21.15.60:0/3683777262 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5f300641f0 con 0x7f5f481006e0 2024-09-21T10:43:33.750 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:43:33.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5f3407b3a0 msgr2=0x7f5f3407d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5f3407b3a0 0x7f5f3407d860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009230 tx=0x7f5f380314e0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 msgr2=0x7f5f481956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 0x7f5f481956e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b450 tx=0x7f5f3000b910 comp rx=0 tx=0).stop 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 shutdown_connections 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5f3407b3a0 0x7f5f3407d860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f48103010 0x7f5f48195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 --2- 172.21.15.60:0/3683777262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f481006e0 0x7f5f481956e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 >> 172.21.15.60:0/3683777262 conn(0x7f5f480fa280 msgr2=0x7f5f480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 shutdown_connections 2024-09-21T10:43:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:43:33.749+0000 7f5f4cbcf640 1 -- 172.21.15.60:0/3683777262 wait complete. 2024-09-21T10:43:34.101 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/588446166' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3683777262' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T10:43:34.102 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:33 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: Reconfiguring crash.smithi112 (monmap changed)... 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: Reconfiguring daemon crash.smithi112 on smithi112 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/588446166' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:43:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3683777262' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:43:34.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:34.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:34.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi112.gkunly", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T10:43:34.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T10:43:34.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:33 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:35.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:34 smithi112 ceph-mon[78695]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:35.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:34 smithi112 ceph-mon[78695]: Reconfiguring mgr.smithi112.gkunly (monmap changed)... 2024-09-21T10:43:35.032 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:34 smithi112 ceph-mon[78695]: Reconfiguring daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:43:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:34 smithi060 ceph-mon[93270]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:43:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:34 smithi060 ceph-mon[93270]: Reconfiguring mgr.smithi112.gkunly (monmap changed)... 2024-09-21T10:43:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:34 smithi060 ceph-mon[93270]: Reconfiguring daemon mgr.smithi112.gkunly on smithi112 2024-09-21T10:43:36.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:35 smithi060 ceph-mon[93270]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:36.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:36.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:36.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T10:43:36.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T10:43:36.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:35 smithi112 ceph-mon[78695]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T10:43:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T10:43:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:37.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:36 smithi060 ceph-mon[93270]: Reconfiguring mon.smithi112 (monmap changed)... 2024-09-21T10:43:37.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:36 smithi060 ceph-mon[93270]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-21T10:43:37.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:36 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:37.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:36 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:37.100 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:36 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T10:43:37.101 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:36 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:37.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:36 smithi112 ceph-mon[78695]: Reconfiguring mon.smithi112 (monmap changed)... 2024-09-21T10:43:37.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:36 smithi112 ceph-mon[78695]: Reconfiguring daemon mon.smithi112 on smithi112 2024-09-21T10:43:37.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:36 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:37.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:36 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:37.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:36 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T10:43:37.117 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:36 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: Reconfiguring osd.3 (monmap changed)... 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: Reconfiguring daemon osd.3 on smithi112 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T10:43:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: Reconfiguring osd.3 (monmap changed)... 2024-09-21T10:43:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: Reconfiguring daemon osd.3 on smithi112 2024-09-21T10:43:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T10:43:38.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:39.144 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:38 smithi112 ceph-mon[78695]: Reconfiguring osd.4 (monmap changed)... 2024-09-21T10:43:39.144 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:38 smithi112 ceph-mon[78695]: Reconfiguring daemon osd.4 on smithi112 2024-09-21T10:43:39.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:38 smithi060 ceph-mon[93270]: Reconfiguring osd.4 (monmap changed)... 2024-09-21T10:43:39.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:38 smithi060 ceph-mon[93270]: Reconfiguring daemon osd.4 on smithi112 2024-09-21T10:43:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:39 smithi060 ceph-mon[93270]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T10:43:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:39 smithi112 ceph-mon[78695]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T10:43:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:41.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:40 smithi112 ceph-mon[78695]: Reconfiguring osd.5 (monmap changed)... 2024-09-21T10:43:41.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:40 smithi112 ceph-mon[78695]: Reconfiguring daemon osd.5 on smithi112 2024-09-21T10:43:41.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:41.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:41.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:41.230 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:40 smithi060 ceph-mon[93270]: Reconfiguring osd.5 (monmap changed)... 2024-09-21T10:43:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:40 smithi060 ceph-mon[93270]: Reconfiguring daemon osd.5 on smithi112 2024-09-21T10:43:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:41 smithi060 ceph-mon[93270]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:41 smithi060 ceph-mon[93270]: Reconfiguring mds.cephfs.smithi112.worwat (monmap changed)... 2024-09-21T10:43:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:41 smithi060 ceph-mon[93270]: Reconfiguring daemon mds.cephfs.smithi112.worwat on smithi112 2024-09-21T10:43:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:41 smithi112 ceph-mon[78695]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:41 smithi112 ceph-mon[78695]: Reconfiguring mds.cephfs.smithi112.worwat (monmap changed)... 2024-09-21T10:43:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:41 smithi112 ceph-mon[78695]: Reconfiguring daemon mds.cephfs.smithi112.worwat on smithi112 2024-09-21T10:43:43.233 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:43.233 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:43.234 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:42 smithi112 ceph-mon[78695]: Reconfiguring mds.cephfs.smithi112.urlyzu (monmap changed)... 2024-09-21T10:43:43.234 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:43.234 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:43.234 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:42 smithi112 ceph-mon[78695]: Reconfiguring daemon mds.cephfs.smithi112.urlyzu on smithi112 2024-09-21T10:43:43.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:42 smithi060 ceph-mon[93270]: Reconfiguring mds.cephfs.smithi112.urlyzu (monmap changed)... 2024-09-21T10:43:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:43:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:42 smithi060 ceph-mon[93270]: Reconfiguring daemon mds.cephfs.smithi112.urlyzu on smithi112 2024-09-21T10:43:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"} : dispatch 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]': finished 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"} : dispatch 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"} : dispatch 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi060"}]': finished 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"} : dispatch 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi112"}]': finished 2024-09-21T10:43:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:45.265 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:44 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all mon 2024-09-21T10:43:45.265 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:45.265 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:45.265 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:44 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all mon 2024-09-21T10:43:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi060", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:45.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:46.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:45 smithi060 ceph-mon[93270]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:46.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:45 smithi060 ceph-mon[93270]: Upgrade: Updating crash.smithi060 (1/2) 2024-09-21T10:43:46.136 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:45 smithi060 ceph-mon[93270]: Deploying daemon crash.smithi060 on smithi060 2024-09-21T10:43:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:45 smithi112 ceph-mon[78695]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:45 smithi112 ceph-mon[78695]: Upgrade: Updating crash.smithi060 (1/2) 2024-09-21T10:43:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:45 smithi112 ceph-mon[78695]: Deploying daemon crash.smithi060 on smithi060 2024-09-21T10:43:48.178 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:47 smithi060 ceph-mon[93270]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:48.252 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:47 smithi112 ceph-mon[78695]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:49.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:49.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:49.532 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:49 smithi112 ceph-mon[78695]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:49.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:49.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:49.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:49 smithi060 ceph-mon[93270]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:50.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:50 smithi112 ceph-mon[78695]: Upgrade: Updating crash.smithi112 (2/2) 2024-09-21T10:43:50.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:50 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:50.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:50 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:50.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:50 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:50.806 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:50 smithi112 ceph-mon[78695]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T10:43:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:50 smithi060 ceph-mon[93270]: Upgrade: Updating crash.smithi112 (2/2) 2024-09-21T10:43:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:50 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:50 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi112", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T10:43:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:50 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:43:50.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:50 smithi060 ceph-mon[93270]: Deploying daemon crash.smithi112 on smithi112 2024-09-21T10:43:51.578 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:51 smithi112 ceph-mon[78695]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:51.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:51 smithi060 ceph-mon[93270]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:54.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:53 smithi060 ceph-mon[93270]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:54.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:54.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:54.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:54.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:53 smithi112 ceph-mon[78695]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:54.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:54.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:54.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:43:55.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:55 smithi060 ceph-mon[93270]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:55.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:55.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:55 smithi112 ceph-mon[78695]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:56.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:57.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:57 smithi060 ceph-mon[93270]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:57.609 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:57.609 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:57 smithi112 ceph-mon[78695]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:57.609 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.896 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.896 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.897 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.897 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:58.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:59 smithi112 ceph-mon[78695]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:59.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:43:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:59.935 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:59 smithi060 ceph-mon[93270]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:43:59.936 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:43:59.936 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:43:59.936 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:43:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"} : dispatch 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]': finished 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"} : dispatch 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-09-21T10:44:01.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T10:44:01.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi060"}]': finished 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"} : dispatch 2024-09-21T10:44:01.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi112"}]': finished 2024-09-21T10:44:01.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T10:44:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:02 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all crash 2024-09-21T10:44:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:02 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T10:44:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:02 smithi060 ceph-mon[93270]: Upgrade: osd.0 is safe to restart 2024-09-21T10:44:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:02 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all crash 2024-09-21T10:44:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:02 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T10:44:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:02 smithi112 ceph-mon[78695]: Upgrade: osd.0 is safe to restart 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/1550975067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40ffaa0 msgr2=0x7fd7a40fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/1550975067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40ffaa0 0x7fd7a40fff20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd798009880 tx=0x7fd79802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/1550975067 shutdown_connections 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/1550975067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40ffaa0 0x7fd7a40fff20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/1550975067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a40feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/1550975067 >> 172.21.15.60:0/1550975067 conn(0x7fd7a40fa010 msgr2=0x7fd7a40fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:03.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/1550975067 shutdown_connections 2024-09-21T10:44:03.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/1550975067 wait complete. 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 Processor -- start 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.840+0000 7fd7aa7a2640 1 -- start start 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7aa7a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a4195430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7aa7a2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a40ffaa0 0x7fd7a4195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7aa7a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4195f40 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7aa7a2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41960b0 con 0x7fd7a40ffaa0 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a4195430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a4195430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47356/0 (socket says 172.21.15.60:47356) 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 -- 172.21.15.60:0/3615001632 learned_addr learned my addr 172.21.15.60:0/3615001632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a8f9f640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a40ffaa0 0x7fd7a4195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 -- 172.21.15.60:0/3615001632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a40ffaa0 msgr2=0x7fd7a4195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:03.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a40ffaa0 0x7fd7a4195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 -- 172.21.15.60:0/3615001632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798009560 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.841+0000 7fd7a97a0640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a4195430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c920 tx=0x7fd79c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.842+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79c0041f0 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.842+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd79c007e70 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.842+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a419ab50 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.842+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd79c0049d0 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.842+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a419b070 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.843+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a41074b0 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.843+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fd79c004350 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.844+0000 7fd7a27fc640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd78c07b3a0 0x7fd78c07d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:03.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.844+0000 7fd7a8f9f640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd78c07b3a0 0x7fd78c07d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:03.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.844+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd79c09e3b0 con 0x7fd7a40fe8a0 2024-09-21T10:44:03.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.845+0000 7fd7a8f9f640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd78c07b3a0 0x7fd78c07d860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd798000c00 tx=0x7fd7980314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:03.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:03.849+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fd79c0611a0 con 0x7fd7a40fe8a0 2024-09-21T10:44:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.062+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7a4068390 con 0x7fd78c07b3a0 2024-09-21T10:44:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.063+0000 7fd7a27fc640 1 -- 172.21.15.60:0/3615001632 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd7a4068390 con 0x7fd78c07b3a0 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd78c07b3a0 msgr2=0x7fd78c07d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd78c07b3a0 0x7fd78c07d860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd798000c00 tx=0x7fd7980314e0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 msgr2=0x7fd7a4195430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a4195430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c920 tx=0x7fd79c00cde0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 shutdown_connections 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd78c07b3a0 0x7fd78c07d860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7a40ffaa0 0x7fd7a4195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 --2- 172.21.15.60:0/3615001632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7a40fe8a0 0x7fd7a4195430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 >> 172.21.15.60:0/3615001632 conn(0x7fd7a40fa010 msgr2=0x7fd7a4067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 shutdown_connections 2024-09-21T10:44:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.066+0000 7fd7aa7a2640 1 -- 172.21.15.60:0/3615001632 wait complete. 2024-09-21T10:44:04.077 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:44:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:03 smithi060 ceph-mon[93270]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:03 smithi060 ceph-mon[93270]: Upgrade: Updating osd.0 2024-09-21T10:44:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T10:44:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:03 smithi060 ceph-mon[93270]: Deploying daemon osd.0 on smithi060 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 -- 172.21.15.60:0/1707632198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108102f60 msgr2=0x7f7108105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 --2- 172.21.15.60:0/1707632198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108102f60 0x7f7108105350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0098b0 tx=0x7f70fc02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 -- 172.21.15.60:0/1707632198 shutdown_connections 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 --2- 172.21.15.60:0/1707632198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108102f60 0x7f7108105350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 --2- 172.21.15.60:0/1707632198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7108100630 0x7f7108102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 -- 172.21.15.60:0/1707632198 >> 172.21.15.60:0/1707632198 conn(0x7f71080fa250 msgr2=0x7f71080fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 -- 172.21.15.60:0/1707632198 shutdown_connections 2024-09-21T10:44:04.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 -- 172.21.15.60:0/1707632198 wait complete. 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 Processor -- start 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.151+0000 7f710e62f640 1 -- start start 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f710e62f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 0x7f7108195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f710e62f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7108102f60 0x7f7108195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f710e62f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108196180 con 0x7f7108100630 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f710e62f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71081962f0 con 0x7f7108102f60 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 0x7f7108195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 0x7f7108195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40736/0 (socket says 172.21.15.60:40736) 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 -- 172.21.15.60:0/398978915 learned_addr learned my addr 172.21.15.60:0/398978915 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f71077fe640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7108102f60 0x7f7108195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 -- 172.21.15.60:0/398978915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7108102f60 msgr2=0x7f7108195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7108102f60 0x7f7108195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 -- 172.21.15.60:0/398978915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc009560 con 0x7f7108100630 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.152+0000 7f7107fff640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 0x7f7108195670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d720 tx=0x7f70f800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.153+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70f80051f0 con 0x7f7108100630 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.153+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70f8009ce0 con 0x7f7108100630 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.153+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70f8010460 con 0x7f7108100630 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.153+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710819ad90 con 0x7f7108100630 2024-09-21T10:44:04.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.153+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710819b2d0 con 0x7f7108100630 2024-09-21T10:44:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.154+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71081087b0 con 0x7f7108100630 2024-09-21T10:44:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.154+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f70f8005350 con 0x7f7108100630 2024-09-21T10:44:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.155+0000 7f71057fa640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f70f007b3a0 0x7f70f007d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.155+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f70f809dfd0 con 0x7f7108100630 2024-09-21T10:44:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.155+0000 7f71077fe640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f70f007b3a0 0x7f70f007d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.155+0000 7f71077fe640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f70f007b3a0 0x7f70f007d860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009880 tx=0x7f70fc0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.159+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f70f8060ef0 con 0x7f7108100630 2024-09-21T10:44:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.367+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71081039c0 con 0x7f70f007b3a0 2024-09-21T10:44:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.369+0000 7f71057fa640 1 -- 172.21.15.60:0/398978915 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f71081039c0 con 0x7f70f007b3a0 2024-09-21T10:44:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f70f007b3a0 msgr2=0x7f70f007d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f70f007b3a0 0x7f70f007d860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009880 tx=0x7f70fc0314e0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 msgr2=0x7f7108195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 0x7f7108195670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d720 tx=0x7f70f800dbe0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 shutdown_connections 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f70f007b3a0 0x7f70f007d860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7108102f60 0x7f7108195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 --2- 172.21.15.60:0/398978915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7108100630 0x7f7108195670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 >> 172.21.15.60:0/398978915 conn(0x7f71080fa250 msgr2=0x7f71080fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 shutdown_connections 2024-09-21T10:44:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.371+0000 7f710e62f640 1 -- 172.21.15.60:0/398978915 wait complete. 2024-09-21T10:44:04.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:03 smithi112 ceph-mon[78695]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:04.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:03 smithi112 ceph-mon[78695]: Upgrade: Updating osd.0 2024-09-21T10:44:04.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:04.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T10:44:04.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:04.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:03 smithi112 ceph-mon[78695]: Deploying daemon osd.0 on smithi060 2024-09-21T10:44:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 -- 172.21.15.60:0/2003486149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 msgr2=0x7f40881011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 --2- 172.21.15.60:0/2003486149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f40881011b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f407c009880 tx=0x7f407c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 -- 172.21.15.60:0/2003486149 shutdown_connections 2024-09-21T10:44:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 --2- 172.21.15.60:0/2003486149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f40881011b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 --2- 172.21.15.60:0/2003486149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880ffb30 0x7f40880fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 -- 172.21.15.60:0/2003486149 >> 172.21.15.60:0/2003486149 conn(0x7f40880fb2e0 msgr2=0x7f40880fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 -- 172.21.15.60:0/2003486149 shutdown_connections 2024-09-21T10:44:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.456+0000 7f408ce42640 1 -- 172.21.15.60:0/2003486149 wait complete. 2024-09-21T10:44:04.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408ce42640 1 Processor -- start 2024-09-21T10:44:04.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408ce42640 1 -- start start 2024-09-21T10:44:04.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408ce42640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880ffb30 0x7f4088195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408ce42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f4088195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408ce42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4088196080 con 0x7f4088100d30 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408ce42640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881961f0 con 0x7f40880ffb30 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f4085d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f4088195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f4085d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f4088195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40766/0 (socket says 172.21.15.60:40766) 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f4085d9b640 1 -- 172.21.15.60:0/3376656319 learned_addr learned my addr 172.21.15.60:0/3376656319 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.457+0000 7f408659c640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880ffb30 0x7f4088195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f4085d9b640 1 -- 172.21.15.60:0/3376656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880ffb30 msgr2=0x7f4088195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f4085d9b640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880ffb30 0x7f4088195570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f4085d9b640 1 -- 172.21.15.60:0/3376656319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c009560 con 0x7f4088100d30 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f4085d9b640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f4088195ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f407c005520 tx=0x7f407c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407c004aa0 con 0x7f4088100d30 2024-09-21T10:44:04.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408819ac30 con 0x7f4088100d30 2024-09-21T10:44:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f407c004c00 con 0x7f4088100d30 2024-09-21T10:44:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407c003b10 con 0x7f4088100d30 2024-09-21T10:44:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.458+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408819b120 con 0x7f4088100d30 2024-09-21T10:44:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.459+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4088108720 con 0x7f4088100d30 2024-09-21T10:44:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.460+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f407c003d40 con 0x7f4088100d30 2024-09-21T10:44:04.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.460+0000 7f40777fe640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f407007b3a0 0x7f407007d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.460+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f407c0bf7e0 con 0x7f4088100d30 2024-09-21T10:44:04.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.461+0000 7f408659c640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f407007b3a0 0x7f407007d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.461+0000 7f408659c640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f407007b3a0 0x7f407007d860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4078005ca0 tx=0x7f4078005bf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:04.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.465+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f407c082630 con 0x7f4088100d30 2024-09-21T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.676+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40881054c0 con 0x7f407007b3a0 2024-09-21T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.686+0000 7f40777fe640 1 -- 172.21.15.60:0/3376656319 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f40881054c0 con 0x7f407007b3a0 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (9m) 7s ago 11m 24.8M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (2m) 7s ago 12m 7704k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (2m) 8s ago 11m 7365k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (16s) 7s ago 12m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (12s) 8s ago 11m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (9m) 7s ago 11m 86.7M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (5m) 7s ago 5m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (5m) 7s ago 5m 15.8M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (5m) 8s ago 5m 17.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (5m) 8s ago 5m 19.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (2m) 7s ago 13m 507M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (91s) 8s ago 10m 453M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (75s) 7s ago 13m 43.2M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (53s) 8s ago 10m 34.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (12m) 7s ago 12m 16.4M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (11m) 8s ago 11m 14.6M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (9m) 7s ago 9m 253M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 1c427056a371 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (9m) 7s ago 9m 265M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (8m) 7s ago 8m 223M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (8m) 8s ago 8m 286M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (7m) 8s ago 7m 263M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (7m) 8s ago 7m 240M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (97s) 7s ago 11m 53.7M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f407007b3a0 msgr2=0x7f407007d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f407007b3a0 0x7f407007d860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4078005ca0 tx=0x7f4078005bf0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 msgr2=0x7f4088195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f4088195ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f407c005520 tx=0x7f407c005550 comp rx=0 tx=0).stop 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 shutdown_connections 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f407007b3a0 0x7f407007d860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4088100d30 0x7f4088195ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 --2- 172.21.15.60:0/3376656319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880ffb30 0x7f4088195570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 >> 172.21.15.60:0/3376656319 conn(0x7f40880fb2e0 msgr2=0x7f40880fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 shutdown_connections 2024-09-21T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.689+0000 7f408ce42640 1 -- 172.21.15.60:0/3376656319 wait complete. 2024-09-21T10:44:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1988330193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 msgr2=0x7fafd0102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1988330193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd0102a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009c50 tx=0x7fafcc02a9a0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1988330193 shutdown_connections 2024-09-21T10:44:04.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1988330193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd0102fb0 0x7fafd01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1988330193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd0102a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1988330193 >> 172.21.15.60:0/1988330193 conn(0x7fafd00fa280 msgr2=0x7fafd00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:04.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1988330193 shutdown_connections 2024-09-21T10:44:04.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1988330193 wait complete. 2024-09-21T10:44:04.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 Processor -- start 2024-09-21T10:44:04.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- start start 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd00fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd0102fb0 0x7fafd00fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00feb70 con 0x7fafd0100680 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00fece0 con 0x7fafd0102fb0 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd00fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd00fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40780/0 (socket says 172.21.15.60:40780) 2024-09-21T10:44:04.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 -- 172.21.15.60:0/1670307999 learned_addr learned my addr 172.21.15.60:0/1670307999 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5780640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd0102fb0 0x7fafd00fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 -- 172.21.15.60:0/1670307999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd0102fb0 msgr2=0x7fafd00fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd0102fb0 0x7fafd00fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 -- 172.21.15.60:0/1670307999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc009900 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd5f81640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd00fffe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009c20 tx=0x7fafcc030890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafcc003b40 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafcc030c90 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd00fef60 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafcc039710 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.773+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd00ff400 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.779+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0100a60 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.779+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fafcc00a040 con 0x7fafd0100680 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.779+0000 7fafc6ffd640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fafbc07b3a0 0x7fafbc07d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:04.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.779+0000 7fafd5780640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fafbc07b3a0 0x7fafbc07d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.779+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fafcc0bf9b0 con 0x7fafd0100680 2024-09-21T10:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.779+0000 7fafd5780640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fafbc07b3a0 0x7fafbc07d860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fafd00ffd60 tx=0x7fafc000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:04.784+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fafcc082740 con 0x7fafd0100680 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.052+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafd0108ac0 con 0x7fafd0100680 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.053+0000 7fafc6ffd640 1 -- 172.21.15.60:0/1670307999 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7fafcc085860 con 0x7fafd0100680 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:05.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 10, 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:44:05.056 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:44:05.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.055+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fafbc07b3a0 msgr2=0x7fafbc07d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.055+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fafbc07b3a0 0x7fafbc07d860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fafd00ffd60 tx=0x7fafc000b390 comp rx=0 tx=0).stop 2024-09-21T10:44:05.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.055+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 msgr2=0x7fafd00fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.055+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd00fffe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009c20 tx=0x7fafcc030890 comp rx=0 tx=0).stop 2024-09-21T10:44:05.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 shutdown_connections 2024-09-21T10:44:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fafbc07b3a0 0x7fafbc07d860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafd0102fb0 0x7fafd00fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 --2- 172.21.15.60:0/1670307999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd0100680 0x7fafd00fffe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 >> 172.21.15.60:0/1670307999 conn(0x7fafd00fa280 msgr2=0x7fafd00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 shutdown_connections 2024-09-21T10:44:05.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.056+0000 7fafd81e5640 1 -- 172.21.15.60:0/1670307999 wait complete. 2024-09-21T10:44:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.140+0000 7fef32af5640 1 -- 172.21.15.60:0/2599432218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c102fb0 msgr2=0x7fef2c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.140+0000 7fef32af5640 1 --2- 172.21.15.60:0/2599432218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c102fb0 0x7fef2c1053a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef200098b0 tx=0x7fef2002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.140+0000 7fef32af5640 1 -- 172.21.15.60:0/2599432218 shutdown_connections 2024-09-21T10:44:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.140+0000 7fef32af5640 1 --2- 172.21.15.60:0/2599432218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c102fb0 0x7fef2c1053a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.140+0000 7fef32af5640 1 --2- 172.21.15.60:0/2599432218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c100680 0x7fef2c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.140+0000 7fef32af5640 1 -- 172.21.15.60:0/2599432218 >> 172.21.15.60:0/2599432218 conn(0x7fef2c0fa280 msgr2=0x7fef2c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 -- 172.21.15.60:0/2599432218 shutdown_connections 2024-09-21T10:44:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 -- 172.21.15.60:0/2599432218 wait complete. 2024-09-21T10:44:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 Processor -- start 2024-09-21T10:44:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 -- start start 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 0x7fef2c1956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c102fb0 0x7fef2c195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c196200 con 0x7fef2c100680 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef32af5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c196370 con 0x7fef2c102fb0 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.141+0000 7fef30891640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 0x7fef2c1956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef30891640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 0x7fef2c1956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40802/0 (socket says 172.21.15.60:40802) 2024-09-21T10:44:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef30891640 1 -- 172.21.15.60:0/680328401 learned_addr learned my addr 172.21.15.60:0/680328401 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef2bfff640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c102fb0 0x7fef2c195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef30891640 1 -- 172.21.15.60:0/680328401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c102fb0 msgr2=0x7fef2c195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef30891640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c102fb0 0x7fef2c195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef30891640 1 -- 172.21.15.60:0/680328401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20009560 con 0x7fef2c100680 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef30891640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 0x7fef2c1956f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00d900 tx=0x7fef1c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1c009c00 con 0x7fef2c100680 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c19ae10 con 0x7fef2c100680 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef1c00b660 con 0x7fef2c100680 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1c00f680 con 0x7fef2c100680 2024-09-21T10:44:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.142+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c19b2d0 con 0x7fef2c100680 2024-09-21T10:44:05.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.144+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c100a60 con 0x7fef2c100680 2024-09-21T10:44:05.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.144+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fef1c010ab0 con 0x7fef2c100680 2024-09-21T10:44:05.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.145+0000 7fef29ffb640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef1407b390 0x7fef1407d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.145+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fef1c09e290 con 0x7fef2c100680 2024-09-21T10:44:05.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.145+0000 7fef2bfff640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef1407b390 0x7fef1407d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.145+0000 7fef2bfff640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef1407b390 0x7fef1407d850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef20009880 tx=0x7fef20000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.149+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fef1c061100 con 0x7fef2c100680 2024-09-21T10:44:05.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:04 smithi112 ceph-mon[78695]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:05.370 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:04 smithi060 ceph-mon[93270]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.381+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fef2c108a60 con 0x7fef2c100680 2024-09-21T10:44:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.381+0000 7fef29ffb640 1 -- 172.21.15.60:0/680328401 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7fef1c064220 con 0x7fef2c100680 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:44:05.384 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:44:05.385 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:05.386 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:05.387 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:05.387 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:44:05.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef1407b390 msgr2=0x7fef1407d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef1407b390 0x7fef1407d850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef20009880 tx=0x7fef20000bc0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 msgr2=0x7fef2c1956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 0x7fef2c1956f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00d900 tx=0x7fef1c00ddc0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 shutdown_connections 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef1407b390 0x7fef1407d850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef2c102fb0 0x7fef2c195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 --2- 172.21.15.60:0/680328401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef2c100680 0x7fef2c1956f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 >> 172.21.15.60:0/680328401 conn(0x7fef2c0fa280 msgr2=0x7fef2c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 shutdown_connections 2024-09-21T10:44:05.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.384+0000 7fef32af5640 1 -- 172.21.15.60:0/680328401 wait complete. 2024-09-21T10:44:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.469+0000 7fb67e2dc640 1 -- 172.21.15.60:0/2195237721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780ffcf0 msgr2=0x7fb678100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.469+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/2195237721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780ffcf0 0x7fb678100170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009880 tx=0x7fb66c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.469+0000 7fb67e2dc640 1 -- 172.21.15.60:0/2195237721 shutdown_connections 2024-09-21T10:44:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.469+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/2195237721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780ffcf0 0x7fb678100170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.469+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/2195237721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6780feaf0 0x7fb6780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.469+0000 7fb67e2dc640 1 -- 172.21.15.60:0/2195237721 >> 172.21.15.60:0/2195237721 conn(0x7fb6780fa280 msgr2=0x7fb6780fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.470+0000 7fb67e2dc640 1 -- 172.21.15.60:0/2195237721 shutdown_connections 2024-09-21T10:44:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.470+0000 7fb67e2dc640 1 -- 172.21.15.60:0/2195237721 wait complete. 2024-09-21T10:44:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.470+0000 7fb67e2dc640 1 Processor -- start 2024-09-21T10:44:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.470+0000 7fb67e2dc640 1 -- start start 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.470+0000 7fb67e2dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 0x7fb6781956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.470+0000 7fb67e2dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6780ffcf0 0x7fb678195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb67e2dc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678196200 con 0x7fb6780feaf0 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb67e2dc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678196370 con 0x7fb6780ffcf0 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 0x7fb6781956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 0x7fb6781956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40824/0 (socket says 172.21.15.60:40824) 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 -- 172.21.15.60:0/293809325 learned_addr learned my addr 172.21.15.60:0/293809325 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb6777fe640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6780ffcf0 0x7fb678195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 -- 172.21.15.60:0/293809325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6780ffcf0 msgr2=0x7fb678195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6780ffcf0 0x7fb678195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 -- 172.21.15.60:0/293809325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c009560 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb677fff640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 0x7fb6781956f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb66800d720 tx=0x7fb66800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6680041f0 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67819ae10 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb668004350 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.471+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb668003df0 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.472+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67819b2d0 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.472+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780feef0 con 0x7fb6780feaf0 2024-09-21T10:44:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.473+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7fb6680035f0 con 0x7fb6780feaf0 2024-09-21T10:44:05.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.474+0000 7fb6757fa640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb66007b340 0x7fb66007d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.474+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fb66809e0c0 con 0x7fb6780feaf0 2024-09-21T10:44:05.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.474+0000 7fb6777fe640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb66007b340 0x7fb66007d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.474+0000 7fb6777fe640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb66007b340 0x7fb66007d800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:05.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.478+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fb668060e10 con 0x7fb6780feaf0 2024-09-21T10:44:05.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.684+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6780683d0 con 0x7fb66007b340 2024-09-21T10:44:05.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.685+0000 7fb6757fa640 1 -- 172.21.15.60:0/293809325 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb6780683d0 con 0x7fb66007b340 2024-09-21T10:44:05.687 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:44:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:44:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:44:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:44:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "6/23 daemons upgraded", 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:44:05.688 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:44:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb66007b340 msgr2=0x7fb66007d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb66007b340 0x7fb66007d800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb66c000c00 tx=0x7fb66c005d50 comp rx=0 tx=0).stop 2024-09-21T10:44:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 msgr2=0x7fb6781956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 0x7fb6781956f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb66800d720 tx=0x7fb66800dbe0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 shutdown_connections 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb66007b340 0x7fb66007d800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6780ffcf0 0x7fb678195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 --2- 172.21.15.60:0/293809325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6780feaf0 0x7fb6781956f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 >> 172.21.15.60:0/293809325 conn(0x7fb6780fa280 msgr2=0x7fb678067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 shutdown_connections 2024-09-21T10:44:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.687+0000 7fb67e2dc640 1 -- 172.21.15.60:0/293809325 wait complete. 2024-09-21T10:44:05.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 -- 172.21.15.60:0/2515315433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 msgr2=0x7f29b80feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 --2- 172.21.15.60:0/2515315433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b80feea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009c20 tx=0x7f29a802a970 comp rx=0 tx=0).stop 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 -- 172.21.15.60:0/2515315433 shutdown_connections 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 --2- 172.21.15.60:0/2515315433 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b80ffca0 0x7f29b8100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 --2- 172.21.15.60:0/2515315433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b80feea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 -- 172.21.15.60:0/2515315433 >> 172.21.15.60:0/2515315433 conn(0x7f29b80fa250 msgr2=0x7f29b80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 -- 172.21.15.60:0/2515315433 shutdown_connections 2024-09-21T10:44:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.771+0000 7f29bf61c640 1 -- 172.21.15.60:0/2515315433 wait complete. 2024-09-21T10:44:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bf61c640 1 Processor -- start 2024-09-21T10:44:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bf61c640 1 -- start start 2024-09-21T10:44:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bf61c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b8068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bf61c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b80ffca0 0x7f29b819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bf61c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b819a9a0 con 0x7f29b80feaa0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bf61c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b819aae0 con 0x7f29b80ffca0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bd3b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b8068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bd3b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b8068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40844/0 (socket says 172.21.15.60:40844) 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bd3b8640 1 -- 172.21.15.60:0/1979102242 learned_addr learned my addr 172.21.15.60:0/1979102242 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.772+0000 7f29bcbb7640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b80ffca0 0x7f29b819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29bd3b8640 1 -- 172.21.15.60:0/1979102242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b80ffca0 msgr2=0x7f29b819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29bd3b8640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b80ffca0 0x7f29b819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29bd3b8640 1 -- 172.21.15.60:0/1979102242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8009900 con 0x7f29b80feaa0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29bd3b8640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b8068fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f29a802fd20 tx=0x7f29a802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a8030670 con 0x7f29b80feaa0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29a8030c90 con 0x7f29b80feaa0 2024-09-21T10:44:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b819ad30 con 0x7f29b80feaa0 2024-09-21T10:44:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a8039680 con 0x7f29b80feaa0 2024-09-21T10:44:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.773+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b819b2a0 con 0x7f29b80feaa0 2024-09-21T10:44:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.774+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b818e640 con 0x7f29b80feaa0 2024-09-21T10:44:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.775+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 37) v1 ==== 103422+0+0 (secure 0 0 0) 0x7f29a800a040 con 0x7f29b80feaa0 2024-09-21T10:44:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.775+0000 7f29b67fc640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f29a007b3a0 0x7f29a007d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.775+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f29a802c040 con 0x7f29b80feaa0 2024-09-21T10:44:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.775+0000 7f29bcbb7640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f29a007b3a0 0x7f29a007d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.776+0000 7f29bcbb7640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f29a007b3a0 0x7f29a007d860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29b8069530 tx=0x7f29ac00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:05.780+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f29a80826f0 con 0x7f29b80feaa0 2024-09-21T10:44:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.054+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f29b81076b0 con 0x7f29b80feaa0 2024-09-21T10:44:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.055+0000 7f29b67fc640 1 -- 172.21.15.60:0/1979102242 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f29a8085810 con 0x7f29b80feaa0 2024-09-21T10:44:06.057 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:44:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f29a007b3a0 msgr2=0x7f29a007d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f29a007b3a0 0x7f29a007d860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29b8069530 tx=0x7f29ac00b390 comp rx=0 tx=0).stop 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 msgr2=0x7f29b8068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b8068fb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f29a802fd20 tx=0x7f29a802f5f0 comp rx=0 tx=0).stop 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 shutdown_connections 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f29a007b3a0 0x7f29a007d860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f29b80ffca0 0x7f29b819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 --2- 172.21.15.60:0/1979102242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b80feaa0 0x7f29b8068fb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 >> 172.21.15.60:0/1979102242 conn(0x7f29b80fa250 msgr2=0x7f29b8103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 shutdown_connections 2024-09-21T10:44:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:06.057+0000 7f29bf61c640 1 -- 172.21.15.60:0/1979102242 wait complete. 2024-09-21T10:44:06.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:05 smithi060 ceph-mon[93270]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:06.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:05 smithi060 ceph-mon[93270]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:06.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:05 smithi060 ceph-mon[93270]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:06.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:05 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1670307999' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:06.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:05 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/680328401' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:44:06.449 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:06 smithi060 systemd[1]: Stopping Ceph osd.0 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:44:06.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:05 smithi112 ceph-mon[78695]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:06.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:05 smithi112 ceph-mon[78695]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:06.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:05 smithi112 ceph-mon[78695]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:06.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:05 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1670307999' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:06.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:05 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/680328401' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:44:06.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:06 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[50590]: 2024-09-21T10:44:06.446+0000 7fb4afb92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:44:06.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:06 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[50590]: 2024-09-21T10:44:06.446+0000 7fb4afb92640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-21T10:44:06.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:06 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[50590]: 2024-09-21T10:44:06.446+0000 7fb4afb92640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:44:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:06 smithi060 ceph-mon[93270]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:06 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1979102242' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:44:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:06 smithi060 ceph-mon[93270]: osd.0 marked itself down and dead 2024-09-21T10:44:07.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:06 smithi112 ceph-mon[78695]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:07.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:06 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1979102242' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:44:07.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:06 smithi112 ceph-mon[78695]: osd.0 marked itself down and dead 2024-09-21T10:44:07.867 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:07 smithi060 podman[100493]: 2024-09-21 10:44:07.572244574 +0000 UTC m=+1.227407130 container died 1c427056a3715f47d935c4f8b8af37ac92c2620a9cb00b4f67836c5da4b73feb (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-6a1bdf8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T10:44:08.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:08 smithi060 ceph-mon[93270]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:08 smithi060 ceph-mon[93270]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:44:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:08 smithi060 ceph-mon[93270]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T10:44:08.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100493]: 2024-09-21 10:44:08.086932287 +0000 UTC m=+1.742094880 container cleanup 1c427056a3715f47d935c4f8b8af37ac92c2620a9cb00b4f67836c5da4b73feb (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=reef-6a1bdf8) 2024-09-21T10:44:08.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 bash[100493]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0 2024-09-21T10:44:08.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:08 smithi112 ceph-mon[78695]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:08.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:08 smithi112 ceph-mon[78695]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:44:08.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:08 smithi112 ceph-mon[78695]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T10:44:08.667 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100508]: 2024-09-21 10:44:08.334030765 +0000 UTC m=+0.753431898 container remove 1c427056a3715f47d935c4f8b8af37ac92c2620a9cb00b4f67836c5da4b73feb (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-6a1bdf8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T10:44:08.947 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100598]: 2024-09-21 10:44:08.56888529 +0000 UTC m=+0.016417966 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:44:08.947 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100598]: 2024-09-21 10:44:08.676371434 +0000 UTC m=+0.123904100 container create 3c754ba4609e51abff23206e5a2ac9be883d4d57c7056d74794f1e60856cd40b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:44:08.948 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100598]: 2024-09-21 10:44:08.870648655 +0000 UTC m=+0.318181328 container init 3c754ba4609e51abff23206e5a2ac9be883d4d57c7056d74794f1e60856cd40b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T10:44:08.948 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100598]: 2024-09-21 10:44:08.875496659 +0000 UTC m=+0.323029334 container start 3c754ba4609e51abff23206e5a2ac9be883d4d57c7056d74794f1e60856cd40b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T10:44:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:09 smithi060 ceph-mon[93270]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T10:44:09.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:08 smithi060 podman[100598]: 2024-09-21 10:44:08.945547486 +0000 UTC m=+0.393080154 container attach 3c754ba4609e51abff23206e5a2ac9be883d4d57c7056d74794f1e60856cd40b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T10:44:09.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:09 smithi060 podman[100598]: 2024-09-21 10:44:09.074336761 +0000 UTC m=+0.521869429 container died 3c754ba4609e51abff23206e5a2ac9be883d4d57c7056d74794f1e60856cd40b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T10:44:09.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:09 smithi112 ceph-mon[78695]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T10:44:09.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:09 smithi060 podman[100622]: 2024-09-21 10:44:09.632978821 +0000 UTC m=+0.551041397 container remove 3c754ba4609e51abff23206e5a2ac9be883d4d57c7056d74794f1e60856cd40b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T10:44:09.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:09 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T10:44:09.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:09 smithi060 systemd[1]: Stopped Ceph osd.0 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:44:09.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:09 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.0.service: Consumed 1min 3.482s CPU time. 2024-09-21T10:44:09.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:09 smithi060 systemd[1]: Starting Ceph osd.0 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:44:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:10 smithi112 ceph-mon[78695]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:10.313 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:10 smithi060 ceph-mon[93270]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:10.314 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 podman[100732]: 2024-09-21 10:44:09.993309734 +0000 UTC m=+0.016662235 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:44:10.314 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 podman[100732]: 2024-09-21 10:44:10.120976663 +0000 UTC m=+0.144329155 container create ceb573fc0244f9a9496b8b0ca38198beac0ee5b34602f708bd833fea65b36ed2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T10:44:10.314 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 podman[100732]: 2024-09-21 10:44:10.312134681 +0000 UTC m=+0.335487185 container init ceb573fc0244f9a9496b8b0ca38198beac0ee5b34602f708bd833fea65b36ed2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:44:10.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 podman[100732]: 2024-09-21 10:44:10.315707861 +0000 UTC m=+0.339060359 container start ceb573fc0244f9a9496b8b0ca38198beac0ee5b34602f708bd833fea65b36ed2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T10:44:10.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 podman[100732]: 2024-09-21 10:44:10.403783735 +0000 UTC m=+0.427136235 container attach ceb573fc0244f9a9496b8b0ca38198beac0ee5b34602f708bd833fea65b36ed2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T10:44:10.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:10.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 bash[100732]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:10.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:10.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:10 smithi060 bash[100732]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:11.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:11 smithi060 ceph-mon[93270]: Health check failed: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T10:44:11.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:11 smithi112 ceph-mon[78695]: Health check failed: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T10:44:12.315 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:12 smithi060 ceph-mon[93270]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:12.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:12 smithi112 ceph-mon[78695]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:13.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:44:13.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:13.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:44:13.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:13.700 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:13.700 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:13.700 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T10:44:13.700 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T10:44:13.700 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T10:44:13.700 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate[100748]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 bash[100732]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T10:44:14.065 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:13 smithi060 podman[100732]: 2024-09-21 10:44:13.771926948 +0000 UTC m=+3.795279440 container died ceb573fc0244f9a9496b8b0ca38198beac0ee5b34602f708bd833fea65b36ed2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:44:14.409 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:14 smithi060 ceph-mon[93270]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:14.410 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:14.410 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:14 smithi112 ceph-mon[78695]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:14.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:14.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 podman[100967]: 2024-09-21 10:44:14.408118238 +0000 UTC m=+0.629675520 container remove ceb573fc0244f9a9496b8b0ca38198beac0ee5b34602f708bd833fea65b36ed2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T10:44:14.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 podman[101026]: 2024-09-21 10:44:14.617438844 +0000 UTC m=+0.107546280 container create 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:44:14.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 podman[101026]: 2024-09-21 10:44:14.526846252 +0000 UTC m=+0.016953687 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:44:15.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 podman[101026]: 2024-09-21 10:44:14.811722837 +0000 UTC m=+0.301830271 container init 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T10:44:15.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 podman[101026]: 2024-09-21 10:44:14.815077584 +0000 UTC m=+0.305185021 container start 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:44:15.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 ceph-osd[101045]: -- 172.21.15.60:0/709446914 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b5801a1e0 con 0x563b58016000 2024-09-21T10:44:15.199 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 bash[101026]: 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d 2024-09-21T10:44:15.200 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:14 smithi060 systemd[1]: Started Ceph osd.0 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:44:16.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:15 smithi060 ceph-mon[93270]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:15 smithi112 ceph-mon[78695]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:16.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:16 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[101041]: 2024-09-21T10:44:16.678+0000 7f442e7d3640 -1 Falling back to public interface 2024-09-21T10:44:17.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:17 smithi060 ceph-mon[93270]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:18.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:17 smithi112 ceph-mon[78695]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:20.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:19 smithi060 ceph-mon[93270]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:19 smithi112 ceph-mon[78695]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:21.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:21 smithi060 ceph-mon[93270]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:21.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:21.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:21.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:21 smithi112 ceph-mon[78695]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:21.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:21.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:22.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:22 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[101041]: 2024-09-21T10:44:22.528+0000 7f442e7d3640 -1 osd.0 48 log_to_monitors true 2024-09-21T10:44:23.569 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:23 smithi060 ceph-mon[93270]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:23.569 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:23 smithi060 ceph-mon[93270]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T10:44:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:23 smithi112 ceph-mon[78695]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:23 smithi112 ceph-mon[78695]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T10:44:24.296 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[101041]: 2024-09-21T10:44:24.215+0000 7f4422575640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: osdmap e51: 6 total, 5 up, 6 in 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:24.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:24 smithi060 ceph-mon[93270]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T10:44:24.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: osdmap e51: 6 total, 5 up, 6 in 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T10:44:24.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:24 smithi112 ceph-mon[78695]: from='osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939]' entity='osd.0' 2024-09-21T10:44:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:25 smithi060 ceph-mon[93270]: pgmap v49: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:25 smithi060 ceph-mon[93270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:44:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:25 smithi060 ceph-mon[93270]: osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939] boot 2024-09-21T10:44:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:25 smithi060 ceph-mon[93270]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T10:44:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T10:44:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:25 smithi112 ceph-mon[78695]: pgmap v49: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:25 smithi112 ceph-mon[78695]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:44:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:25 smithi112 ceph-mon[78695]: osd.0 [v2:172.21.15.60:6802/548070939,v1:172.21.15.60:6803/548070939] boot 2024-09-21T10:44:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:25 smithi112 ceph-mon[78695]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T10:44:25.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T10:44:27.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:27 smithi060 ceph-mon[93270]: osdmap e53: 6 total, 6 up, 6 in 2024-09-21T10:44:27.572 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:27 smithi060 ceph-mon[93270]: pgmap v52: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:27 smithi112 ceph-mon[78695]: osdmap e53: 6 total, 6 up, 6 in 2024-09-21T10:44:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:27 smithi112 ceph-mon[78695]: pgmap v52: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:30.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:29 smithi112 ceph-mon[78695]: pgmap v53: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:30.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:30.181 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:29 smithi060 ceph-mon[93270]: pgmap v53: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 45/222 objects degraded (20.270%) 2024-09-21T10:44:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:31.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:30 smithi060 ceph-mon[93270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded) 2024-09-21T10:44:31.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:30 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:44:31.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:30 smithi060 ceph-mon[93270]: mgrmap e38: smithi060.mulzpr(active, since 92s), standbys: smithi112.gkunly 2024-09-21T10:44:31.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:30 smithi112 ceph-mon[78695]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded) 2024-09-21T10:44:31.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:30 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:44:31.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:30 smithi112 ceph-mon[78695]: mgrmap e38: smithi060.mulzpr(active, since 92s), standbys: smithi112.gkunly 2024-09-21T10:44:32.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:31 smithi060 ceph-mon[93270]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 447 B/s wr, 0 op/s 2024-09-21T10:44:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:31 smithi112 ceph-mon[78695]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 447 B/s wr, 0 op/s 2024-09-21T10:44:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:33 smithi060 ceph-mon[93270]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-21T10:44:34.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:33 smithi112 ceph-mon[78695]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-21T10:44:36.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:35 smithi060 ceph-mon[93270]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 338 B/s wr, 0 op/s 2024-09-21T10:44:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 -- 172.21.15.60:0/3809203406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 msgr2=0x7ff250105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 --2- 172.21.15.60:0/3809203406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250105350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2440098b0 tx=0x7ff24402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 -- 172.21.15.60:0/3809203406 shutdown_connections 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 --2- 172.21.15.60:0/3809203406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250105350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 --2- 172.21.15.60:0/3809203406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 0x7ff250102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 -- 172.21.15.60:0/3809203406 >> 172.21.15.60:0/3809203406 conn(0x7ff2500fa250 msgr2=0x7ff2500fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 -- 172.21.15.60:0/3809203406 shutdown_connections 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 -- 172.21.15.60:0/3809203406 wait complete. 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.156+0000 7ff25567a640 1 Processor -- start 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff25567a640 1 -- start start 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff25567a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 0x7ff250197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff25567a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff25567a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff250198370 con 0x7ff250102f60 2024-09-21T10:44:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff25567a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2501984e0 con 0x7ff250100630 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53712/0 (socket says 172.21.15.60:53712) 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24e7fc640 1 -- 172.21.15.60:0/4025730144 learned_addr learned my addr 172.21.15.60:0/4025730144 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24effd640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 0x7ff250197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24e7fc640 1 -- 172.21.15.60:0/4025730144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 msgr2=0x7ff250197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24e7fc640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 0x7ff250197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24e7fc640 1 -- 172.21.15.60:0/4025730144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009560 con 0x7ff250102f60 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.157+0000 7ff24effd640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 0x7ff250197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.158+0000 7ff24e7fc640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250197da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2440055a0 tx=0x7ff2440055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.158+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff244004aa0 con 0x7ff250102f60 2024-09-21T10:44:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.158+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff244004c00 con 0x7ff250102f60 2024-09-21T10:44:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.158+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25019cf20 con 0x7ff250102f60 2024-09-21T10:44:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.158+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff244003b50 con 0x7ff250102f60 2024-09-21T10:44:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.158+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25019d460 con 0x7ff250102f60 2024-09-21T10:44:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.159+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250100a10 con 0x7ff250102f60 2024-09-21T10:44:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.160+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff244003cb0 con 0x7ff250102f60 2024-09-21T10:44:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.160+0000 7ff237fff640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff23807b270 0x7ff23807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.161+0000 7ff24effd640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff23807b270 0x7ff23807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.161+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff2440bf5a0 con 0x7ff250102f60 2024-09-21T10:44:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.161+0000 7ff24effd640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff23807b270 0x7ff23807d730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2400058c0 tx=0x7ff240005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.165+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ff2440825b0 con 0x7ff250102f60 2024-09-21T10:44:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:35 smithi112 ceph-mon[78695]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 338 B/s wr, 0 op/s 2024-09-21T10:44:36.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.372+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff25002c540 con 0x7ff23807b270 2024-09-21T10:44:36.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.373+0000 7ff237fff640 1 -- 172.21.15.60:0/4025730144 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff25002c540 con 0x7ff23807b270 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff23807b270 msgr2=0x7ff23807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff23807b270 0x7ff23807d730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2400058c0 tx=0x7ff240005850 comp rx=0 tx=0).stop 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 msgr2=0x7ff250197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250197da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2440055a0 tx=0x7ff2440055d0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 shutdown_connections 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff23807b270 0x7ff23807d730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff250102f60 0x7ff250197da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 --2- 172.21.15.60:0/4025730144 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff250100630 0x7ff250197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.375+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 >> 172.21.15.60:0/4025730144 conn(0x7ff2500fa250 msgr2=0x7ff2500fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:36.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.376+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 shutdown_connections 2024-09-21T10:44:36.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.376+0000 7ff25567a640 1 -- 172.21.15.60:0/4025730144 wait complete. 2024-09-21T10:44:36.387 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:44:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 -- 172.21.15.60:0/4086191199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b640ffbc0 msgr2=0x7f8b640fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/4086191199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b640ffbc0 0x7f8b640fffc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009880 tx=0x7f8b6002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 -- 172.21.15.60:0/4086191199 shutdown_connections 2024-09-21T10:44:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/4086191199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b64100dc0 0x7f8b64101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/4086191199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b640ffbc0 0x7f8b640fffc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 -- 172.21.15.60:0/4086191199 >> 172.21.15.60:0/4086191199 conn(0x7f8b640fb350 msgr2=0x7f8b640fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 -- 172.21.15.60:0/4086191199 shutdown_connections 2024-09-21T10:44:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 -- 172.21.15.60:0/4086191199 wait complete. 2024-09-21T10:44:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.461+0000 7f8b6b45a640 1 Processor -- start 2024-09-21T10:44:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b6b45a640 1 -- start start 2024-09-21T10:44:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b6b45a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b640ffbc0 0x7f8b64074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b6b45a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 0x7f8b640728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b6b45a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64072de0 con 0x7f8b64100dc0 2024-09-21T10:44:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b6b45a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64072f50 con 0x7f8b640ffbc0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 0x7f8b640728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 0x7f8b640728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53734/0 (socket says 172.21.15.60:53734) 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 -- 172.21.15.60:0/438276016 learned_addr learned my addr 172.21.15.60:0/438276016 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b691f6640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b640ffbc0 0x7f8b64074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 -- 172.21.15.60:0/438276016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b640ffbc0 msgr2=0x7f8b64074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b640ffbc0 0x7f8b64074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 -- 172.21.15.60:0/438276016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60009560 con 0x7f8b64100dc0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.462+0000 7f8b689f5640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 0x7f8b640728a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c8f0 tx=0x7f8b5400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.463+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b54007b80 con 0x7f8b64100dc0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.463+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b540054e0 con 0x7f8b64100dc0 2024-09-21T10:44:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.463+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5400f450 con 0x7f8b64100dc0 2024-09-21T10:44:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.463+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b64073230 con 0x7f8b64100dc0 2024-09-21T10:44:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.463+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6419d690 con 0x7f8b64100dc0 2024-09-21T10:44:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.464+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b641087d0 con 0x7f8b64100dc0 2024-09-21T10:44:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.464+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8b54004f60 con 0x7f8b64100dc0 2024-09-21T10:44:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.465+0000 7f8b5a7fc640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8b5007b270 0x7f8b5007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.465+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8b5409e080 con 0x7f8b64100dc0 2024-09-21T10:44:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.465+0000 7f8b691f6640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8b5007b270 0x7f8b5007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.465+0000 7f8b691f6640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8b5007b270 0x7f8b5007d730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009230 tx=0x7f8b60005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:36.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.469+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f8b54061110 con 0x7f8b64100dc0 2024-09-21T10:44:36.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.673+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b64105570 con 0x7f8b5007b270 2024-09-21T10:44:36.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.675+0000 7f8b5a7fc640 1 -- 172.21.15.60:0/438276016 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8b64105570 con 0x7f8b5007b270 2024-09-21T10:44:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8b5007b270 msgr2=0x7f8b5007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8b5007b270 0x7f8b5007d730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009230 tx=0x7f8b60005b50 comp rx=0 tx=0).stop 2024-09-21T10:44:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 msgr2=0x7f8b640728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 0x7f8b640728a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c8f0 tx=0x7f8b5400cdb0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 shutdown_connections 2024-09-21T10:44:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8b5007b270 0x7f8b5007d730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b64100dc0 0x7f8b640728a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 --2- 172.21.15.60:0/438276016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b640ffbc0 0x7f8b64074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 >> 172.21.15.60:0/438276016 conn(0x7f8b640fb350 msgr2=0x7f8b640fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 shutdown_connections 2024-09-21T10:44:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.677+0000 7f8b6b45a640 1 -- 172.21.15.60:0/438276016 wait complete. 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.760+0000 7fbd40b18640 1 -- 172.21.15.60:0/3004180342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 msgr2=0x7fbd3c105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.760+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3004180342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c105460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009880 tx=0x7fbd3002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.761+0000 7fbd40b18640 1 -- 172.21.15.60:0/3004180342 shutdown_connections 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.761+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3004180342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c105460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.761+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3004180342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd3c100740 0x7fbd3c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.761+0000 7fbd40b18640 1 -- 172.21.15.60:0/3004180342 >> 172.21.15.60:0/3004180342 conn(0x7fbd3c0fa280 msgr2=0x7fbd3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:36.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.761+0000 7fbd40b18640 1 -- 172.21.15.60:0/3004180342 shutdown_connections 2024-09-21T10:44:36.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.761+0000 7fbd40b18640 1 -- 172.21.15.60:0/3004180342 wait complete. 2024-09-21T10:44:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd40b18640 1 Processor -- start 2024-09-21T10:44:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd40b18640 1 -- start start 2024-09-21T10:44:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd40b18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd3c100740 0x7fbd3c1000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd40b18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c0fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd40b18640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0fec30 con 0x7fbd3c103070 2024-09-21T10:44:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd40b18640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c0feda0 con 0x7fbd3c100740 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c0fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd39d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c0fe6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53748/0 (socket says 172.21.15.60:53748) 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd39d9b640 1 -- 172.21.15.60:0/3635350282 learned_addr learned my addr 172.21.15.60:0/3635350282 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd3a59c640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd3c100740 0x7fbd3c1000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd39d9b640 1 -- 172.21.15.60:0/3635350282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd3c100740 msgr2=0x7fbd3c1000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd39d9b640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd3c100740 0x7fbd3c1000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.762+0000 7fbd39d9b640 1 -- 172.21.15.60:0/3635350282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009560 con 0x7fbd3c103070 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.763+0000 7fbd39d9b640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c0fe6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009230 tx=0x7fbd30032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.763+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd30005430 con 0x7fbd3c103070 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.763+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd30032e80 con 0x7fbd3c103070 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.763+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c0ff020 con 0x7fbd3c103070 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.763+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd30003c30 con 0x7fbd3c103070 2024-09-21T10:44:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.763+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c0ff510 con 0x7fbd3c103070 2024-09-21T10:44:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.764+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c108800 con 0x7fbd3c103070 2024-09-21T10:44:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.765+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fbd300046c0 con 0x7fbd3c103070 2024-09-21T10:44:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.766+0000 7fbd2b7fe640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd2407b270 0x7fbd2407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.766+0000 7fbd3a59c640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd2407b270 0x7fbd2407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.766+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbd300bf430 con 0x7fbd3c103070 2024-09-21T10:44:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.767+0000 7fbd3a59c640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd2407b270 0x7fbd2407d730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0058c0 tx=0x7fbd2c00a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:36.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.770+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fbd30082610 con 0x7fbd3c103070 2024-09-21T10:44:36.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.967+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd3c103a10 con 0x7fbd2407b270 2024-09-21T10:44:36.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.976+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/3635350282 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbd3c103a10 con 0x7fbd2407b270 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (10m) 17s ago 12m 24.3M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (3m) 17s ago 12m 7730k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (3m) 41s ago 11m 7365k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (49s) 17s ago 12m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (44s) 41s ago 11m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (10m) 17s ago 12m 83.7M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (6m) 17s ago 6m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (6m) 17s ago 6m 15.9M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (6m) 41s ago 6m 17.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (6m) 41s ago 6m 19.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:44:36.979 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (3m) 17s ago 13m 510M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (2m) 41s ago 11m 453M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (107s) 17s ago 14m 44.2M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (86s) 41s ago 11m 34.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (12m) 17s ago 12m 16.5M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (11m) 41s ago 11m 14.6M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (22s) 17s ago 10m 12.0M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (9m) 17s ago 9m 263M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 3aa0d1b3291b 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (9m) 17s ago 9m 222M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (8m) 41s ago 8m 286M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (8m) 41s ago 8m 263M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (7m) 41s ago 7m 240M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:44:36.980 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (2m) 17s ago 12m 56.4M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:44:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd2407b270 msgr2=0x7fbd2407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd2407b270 0x7fbd2407d730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0058c0 tx=0x7fbd2c00a250 comp rx=0 tx=0).stop 2024-09-21T10:44:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 msgr2=0x7fbd3c0fe6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c0fe6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009230 tx=0x7fbd30032bd0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 shutdown_connections 2024-09-21T10:44:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd2407b270 0x7fbd2407d730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd3c103070 0x7fbd3c0fe6f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 --2- 172.21.15.60:0/3635350282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd3c100740 0x7fbd3c1000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 >> 172.21.15.60:0/3635350282 conn(0x7fbd3c0fa280 msgr2=0x7fbd3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 shutdown_connections 2024-09-21T10:44:36.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:36.979+0000 7fbd40b18640 1 -- 172.21.15.60:0/3635350282 wait complete. 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 -- 172.21.15.60:0/3447442783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fed30 msgr2=0x7f8e700ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 --2- 172.21.15.60:0/3447442783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fed30 0x7f8e700ff190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009880 tx=0x7f8e6402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 -- 172.21.15.60:0/3447442783 shutdown_connections 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 --2- 172.21.15.60:0/3447442783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fed30 0x7f8e700ff190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 --2- 172.21.15.60:0/3447442783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fe3f0 0x7f8e700fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 -- 172.21.15.60:0/3447442783 >> 172.21.15.60:0/3447442783 conn(0x7f8e700fa200 msgr2=0x7f8e700fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 -- 172.21.15.60:0/3447442783 shutdown_connections 2024-09-21T10:44:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.061+0000 7f8e74a35640 1 -- 172.21.15.60:0/3447442783 wait complete. 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.062+0000 7f8e74a35640 1 Processor -- start 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.062+0000 7f8e74a35640 1 -- start start 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e74a35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 0x7f8e701977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e74a35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fed30 0x7f8e70197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e74a35640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701982f0 con 0x7f8e700fe3f0 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e74a35640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70198460 con 0x7f8e700fed30 2024-09-21T10:44:37.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 0x7f8e701977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 0x7f8e701977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53774/0 (socket says 172.21.15.60:53774) 2024-09-21T10:44:37.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6e59c640 1 -- 172.21.15.60:0/2762622559 learned_addr learned my addr 172.21.15.60:0/2762622559 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6dd9b640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fed30 0x7f8e70197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6e59c640 1 -- 172.21.15.60:0/2762622559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fed30 msgr2=0x7f8e70197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6e59c640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fed30 0x7f8e70197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6e59c640 1 -- 172.21.15.60:0/2762622559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64009560 con 0x7f8e700fe3f0 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.063+0000 7f8e6dd9b640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fed30 0x7f8e70197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.064+0000 7f8e6e59c640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 0x7f8e701977e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e9a0 tx=0x7f8e6000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.064+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e6000cd50 con 0x7f8e700fe3f0 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.064+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e6000ceb0 con 0x7f8e700fe3f0 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.064+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7019cf00 con 0x7f8e700fe3f0 2024-09-21T10:44:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.064+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e60010660 con 0x7f8e700fe3f0 2024-09-21T10:44:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.065+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7019d440 con 0x7f8e700fe3f0 2024-09-21T10:44:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.066+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8e600048a0 con 0x7f8e700fe3f0 2024-09-21T10:44:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.066+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700fe7f0 con 0x7f8e700fe3f0 2024-09-21T10:44:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.067+0000 7f8e5f7fe640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e5807b270 0x7f8e5807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.067+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8e60014070 con 0x7f8e700fe3f0 2024-09-21T10:44:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.067+0000 7f8e6dd9b640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e5807b270 0x7f8e5807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.067+0000 7f8e6dd9b640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e5807b270 0x7f8e5807d730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e64000c00 tx=0x7f8e640314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.071+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f8e60061810 con 0x7f8e700fe3f0 2024-09-21T10:44:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.334+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e7019d6e0 con 0x7f8e700fe3f0 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.334+0000 7f8e5f7fe640 1 -- 172.21.15.60:0/2762622559 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f8e60064930 con 0x7f8e700fe3f0 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 5, 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:37.337 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 9, 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 5 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:44:37.338 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:44:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.336+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e5807b270 msgr2=0x7f8e5807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.336+0000 7f8e74a35640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e5807b270 0x7f8e5807d730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8e64000c00 tx=0x7f8e640314e0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.336+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 msgr2=0x7f8e701977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.336+0000 7f8e74a35640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 0x7f8e701977e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000e9a0 tx=0x7f8e6000eda0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 shutdown_connections 2024-09-21T10:44:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e5807b270 0x7f8e5807d730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e700fed30 0x7f8e70197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 --2- 172.21.15.60:0/2762622559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e700fe3f0 0x7f8e701977e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 >> 172.21.15.60:0/2762622559 conn(0x7f8e700fa200 msgr2=0x7f8e70106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:37.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 shutdown_connections 2024-09-21T10:44:37.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.337+0000 7f8e74a35640 1 -- 172.21.15.60:0/2762622559 wait complete. 2024-09-21T10:44:37.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 -- 172.21.15.60:0/4174539040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40ffcf0 msgr2=0x7fc4c4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 --2- 172.21.15.60:0/4174539040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40ffcf0 0x7fc4c4100170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009880 tx=0x7fc4b402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 -- 172.21.15.60:0/4174539040 shutdown_connections 2024-09-21T10:44:37.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 --2- 172.21.15.60:0/4174539040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40ffcf0 0x7fc4c4100170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 --2- 172.21.15.60:0/4174539040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40feaf0 0x7fc4c40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 -- 172.21.15.60:0/4174539040 >> 172.21.15.60:0/4174539040 conn(0x7fc4c40fa280 msgr2=0x7fc4c40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:37.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 -- 172.21.15.60:0/4174539040 shutdown_connections 2024-09-21T10:44:37.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.421+0000 7fc4cb252640 1 -- 172.21.15.60:0/4174539040 wait complete. 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4cb252640 1 Processor -- start 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4cb252640 1 -- start start 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4cb252640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 0x7fc4c41956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4cb252640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40ffcf0 0x7fc4c4195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4cb252640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4196130 con 0x7fc4c40feaf0 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4cb252640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41962a0 con 0x7fc4c40ffcf0 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4c8fee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 0x7fc4c41956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4c8fee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 0x7fc4c41956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53786/0 (socket says 172.21.15.60:53786) 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4c8fee640 1 -- 172.21.15.60:0/454723809 learned_addr learned my addr 172.21.15.60:0/454723809 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.422+0000 7fc4c3fff640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40ffcf0 0x7fc4c4195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c8fee640 1 -- 172.21.15.60:0/454723809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40ffcf0 msgr2=0x7fc4c4195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c8fee640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40ffcf0 0x7fc4c4195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c8fee640 1 -- 172.21.15.60:0/454723809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009560 con 0x7fc4c40feaf0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c8fee640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 0x7fc4c41956b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00c8f0 tx=0x7fc4ac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ac0041f0 con 0x7fc4c40feaf0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4ac007e10 con 0x7fc4c40feaf0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c419ad80 con 0x7fc4c40feaf0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ac00f450 con 0x7fc4c40feaf0 2024-09-21T10:44:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.423+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c419b1f0 con 0x7fc4c40feaf0 2024-09-21T10:44:37.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.424+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c41076e0 con 0x7fc4c40feaf0 2024-09-21T10:44:37.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.425+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc4ac007950 con 0x7fc4c40feaf0 2024-09-21T10:44:37.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.425+0000 7fc4c1ffb640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc4b007b270 0x7fc4b007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.425+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc4ac013070 con 0x7fc4c40feaf0 2024-09-21T10:44:37.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.425+0000 7fc4c3fff640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc4b007b270 0x7fc4b007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.426+0000 7fc4c3fff640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc4b007b270 0x7fc4b007d730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4000c00 tx=0x7fc4b40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:37.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.430+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fc4ac061420 con 0x7fc4c40feaf0 2024-09-21T10:44:37.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.661+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4c419b7e0 con 0x7fc4c40feaf0 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.661+0000 7fc4c1ffb640 1 -- 172.21.15.60:0/454723809 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7fc4ac064540 con 0x7fc4c40feaf0 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:44:37.664 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:44:37.665 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:37.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:37.667 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:37.667 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:44:37.667 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:44:37.667 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:37.667 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:37.667 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.663+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc4b007b270 msgr2=0x7fc4b007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc4b007b270 0x7fc4b007d730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4000c00 tx=0x7fc4b40314e0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 msgr2=0x7fc4c41956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 0x7fc4c41956b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00c8f0 tx=0x7fc4ac00cdb0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 shutdown_connections 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc4b007b270 0x7fc4b007d730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4c40ffcf0 0x7fc4c4195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 --2- 172.21.15.60:0/454723809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4c40feaf0 0x7fc4c41956b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 >> 172.21.15.60:0/454723809 conn(0x7fc4c40fa280 msgr2=0x7fc4c40fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 shutdown_connections 2024-09-21T10:44:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.664+0000 7fc4cb252640 1 -- 172.21.15.60:0/454723809 wait complete. 2024-09-21T10:44:37.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 -- 172.21.15.60:0/2777986500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8102fb0 msgr2=0x7f2fa81053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 --2- 172.21.15.60:0/2777986500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8102fb0 0x7f2fa81053a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f980098b0 tx=0x7f2f9802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 -- 172.21.15.60:0/2777986500 shutdown_connections 2024-09-21T10:44:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 --2- 172.21.15.60:0/2777986500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8102fb0 0x7f2fa81053a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 --2- 172.21.15.60:0/2777986500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8100680 0x7f2fa8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 -- 172.21.15.60:0/2777986500 >> 172.21.15.60:0/2777986500 conn(0x7f2fa80fa280 msgr2=0x7f2fa80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 -- 172.21.15.60:0/2777986500 shutdown_connections 2024-09-21T10:44:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.752+0000 7f2faf628640 1 -- 172.21.15.60:0/2777986500 wait complete. 2024-09-21T10:44:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2faf628640 1 Processor -- start 2024-09-21T10:44:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2faf628640 1 -- start start 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2faf628640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 0x7f2fa80fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2faf628640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8102fb0 0x7f2fa80fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2faf628640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80feb70 con 0x7f2fa8100680 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2faf628640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa80fece0 con 0x7f2fa8102fb0 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2fad3c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 0x7f2fa80fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2fad3c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 0x7f2fa80fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53814/0 (socket says 172.21.15.60:53814) 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2fad3c4640 1 -- 172.21.15.60:0/1830344856 learned_addr learned my addr 172.21.15.60:0/1830344856 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.753+0000 7f2facbc3640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8102fb0 0x7f2fa80fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2fad3c4640 1 -- 172.21.15.60:0/1830344856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8102fb0 msgr2=0x7f2fa80fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2fad3c4640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8102fb0 0x7f2fa80fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2fad3c4640 1 -- 172.21.15.60:0/1830344856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009560 con 0x7f2fa8100680 2024-09-21T10:44:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2facbc3640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8102fb0 0x7f2fa80fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:44:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2fad3c4640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 0x7f2fa80fffe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b420 tx=0x7f2fa400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa4011800 con 0x7f2fa8100680 2024-09-21T10:44:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fa4011e20 con 0x7f2fa8100680 2024-09-21T10:44:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.754+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa80fefc0 con 0x7f2fa8100680 2024-09-21T10:44:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.755+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fa400f2e0 con 0x7f2fa8100680 2024-09-21T10:44:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.755+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa819d7b0 con 0x7f2fa8100680 2024-09-21T10:44:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.756+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa81091c0 con 0x7f2fa8100680 2024-09-21T10:44:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.757+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2fa4011960 con 0x7f2fa8100680 2024-09-21T10:44:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.757+0000 7f2f9e7fc640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2f9407b060 0x7f2f9407d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.758+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2fa409d710 con 0x7f2fa8100680 2024-09-21T10:44:37.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.758+0000 7f2facbc3640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2f9407b060 0x7f2f9407d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.758+0000 7f2facbc3640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2f9407b060 0x7f2f9407d520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009880 tx=0x7f2f98004320 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.762+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2fa40607a0 con 0x7f2fa8100680 2024-09-21T10:44:37.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:37 smithi060 ceph-mon[93270]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 304 B/s wr, 0 op/s 2024-09-21T10:44:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:37 smithi060 ceph-mon[93270]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:37 smithi060 ceph-mon[93270]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:37 smithi060 ceph-mon[93270]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:37 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2762622559' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:37.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:37 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/454723809' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:44:37.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.968+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fa81039f0 con 0x7f2f9407b060 2024-09-21T10:44:37.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.969+0000 7f2f9e7fc640 1 -- 172.21.15.60:0/1830344856 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2fa81039f0 con 0x7f2f9407b060 2024-09-21T10:44:37.971 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:44:37.972 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:44:37.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2f9407b060 msgr2=0x7f2f9407d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2f9407b060 0x7f2f9407d520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009880 tx=0x7f2f98004320 comp rx=0 tx=0).stop 2024-09-21T10:44:37.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 msgr2=0x7f2fa80fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:37.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 0x7f2fa80fffe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b420 tx=0x7f2fa400b8e0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 shutdown_connections 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2f9407b060 0x7f2f9407d520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fa8102fb0 0x7f2fa80fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 --2- 172.21.15.60:0/1830344856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8100680 0x7f2fa80fffe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 >> 172.21.15.60:0/1830344856 conn(0x7f2fa80fa280 msgr2=0x7f2fa80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 shutdown_connections 2024-09-21T10:44:37.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:37.972+0000 7f2faf628640 1 -- 172.21.15.60:0/1830344856 wait complete. 2024-09-21T10:44:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.055+0000 7f156d972640 1 -- 172.21.15.60:0/3328691570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 msgr2=0x7f1568102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.055+0000 7f156d972640 1 --2- 172.21.15.60:0/3328691570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568102ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1558009880 tx=0x7f155802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 -- 172.21.15.60:0/3328691570 shutdown_connections 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 --2- 172.21.15.60:0/3328691570 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1568103010 0x7f1568105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 --2- 172.21.15.60:0/3328691570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568102ad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 -- 172.21.15.60:0/3328691570 >> 172.21.15.60:0/3328691570 conn(0x7f15680fa280 msgr2=0x7f15680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 -- 172.21.15.60:0/3328691570 shutdown_connections 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 -- 172.21.15.60:0/3328691570 wait complete. 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 Processor -- start 2024-09-21T10:44:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.056+0000 7f156d972640 1 -- start start 2024-09-21T10:44:38.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f156d972640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568100040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:38.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f156d972640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1568103010 0x7f15680fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:38.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f156d972640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680febd0 con 0x7f15681006e0 2024-09-21T10:44:38.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f156d972640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680fed40 con 0x7f1568103010 2024-09-21T10:44:38.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568100040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568100040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53838/0 (socket says 172.21.15.60:53838) 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 -- 172.21.15.60:0/4088081240 learned_addr learned my addr 172.21.15.60:0/4088081240 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f15667fc640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1568103010 0x7f15680fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 -- 172.21.15.60:0/4088081240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1568103010 msgr2=0x7f15680fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1568103010 0x7f15680fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 -- 172.21.15.60:0/4088081240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558009560 con 0x7f15681006e0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.057+0000 7f1566ffd640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568100040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15580054f0 tx=0x7f1558005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.058+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1558004aa0 con 0x7f15681006e0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.058+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1558004c00 con 0x7f15681006e0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.058+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15680ff020 con 0x7f15681006e0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.058+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1558003ac0 con 0x7f15681006e0 2024-09-21T10:44:38.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.058+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156819d6d0 con 0x7f15681006e0 2024-09-21T10:44:38.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.059+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1568100ac0 con 0x7f15681006e0 2024-09-21T10:44:38.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.060+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1558003d30 con 0x7f15681006e0 2024-09-21T10:44:38.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.060+0000 7f156c970640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f155407b270 0x7f155407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:44:38.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.061+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f15580bf4e0 con 0x7f15681006e0 2024-09-21T10:44:38.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.061+0000 7f15667fc640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f155407b270 0x7f155407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:44:38.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.061+0000 7f15667fc640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f155407b270 0x7f155407d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15680ffdc0 tx=0x7f155000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:44:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.069+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1558082580 con 0x7f15681006e0 2024-09-21T10:44:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:37 smithi112 ceph-mon[78695]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 304 B/s wr, 0 op/s 2024-09-21T10:44:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:37 smithi112 ceph-mon[78695]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:37 smithi112 ceph-mon[78695]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:37 smithi112 ceph-mon[78695]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:38.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:37 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2762622559' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:44:38.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:37 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/454723809' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:44:38.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.336+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f156819d9b0 con 0x7f15681006e0 2024-09-21T10:44:38.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.337+0000 7f156c970640 1 -- 172.21.15.60:0/4088081240 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f15580856a0 con 0x7f15681006e0 2024-09-21T10:44:38.339 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f155407b270 msgr2=0x7f155407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f155407b270 0x7f155407d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15680ffdc0 tx=0x7f155000b390 comp rx=0 tx=0).stop 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 msgr2=0x7f1568100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568100040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15580054f0 tx=0x7f1558005520 comp rx=0 tx=0).stop 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 shutdown_connections 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f155407b270 0x7f155407d730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1568103010 0x7f15680fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 --2- 172.21.15.60:0/4088081240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15681006e0 0x7f1568100040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.339+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 >> 172.21.15.60:0/4088081240 conn(0x7f15680fa280 msgr2=0x7f15680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.340+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 shutdown_connections 2024-09-21T10:44:38.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:44:38.340+0000 7f156d972640 1 -- 172.21.15.60:0/4088081240 wait complete. 2024-09-21T10:44:39.127 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:38 smithi060 ceph-mon[93270]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:39.127 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:38 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/4088081240' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:44:39.127 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T10:44:39.127 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:39.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:38 smithi112 ceph-mon[78695]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:44:39.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:38 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/4088081240' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:44:39.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T10:44:39.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:40.133 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:39 smithi060 ceph-mon[93270]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T10:44:40.133 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:39 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T10:44:40.133 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:39 smithi060 ceph-mon[93270]: Upgrade: osd.1 is safe to restart 2024-09-21T10:44:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:39 smithi112 ceph-mon[78695]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T10:44:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:39 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T10:44:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:39 smithi112 ceph-mon[78695]: Upgrade: osd.1 is safe to restart 2024-09-21T10:44:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:41 smithi060 ceph-mon[93270]: Upgrade: Updating osd.1 2024-09-21T10:44:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T10:44:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:41 smithi060 ceph-mon[93270]: Deploying daemon osd.1 on smithi060 2024-09-21T10:44:41.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:41 smithi060 ceph-mon[93270]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T10:44:41.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:41 smithi112 ceph-mon[78695]: Upgrade: Updating osd.1 2024-09-21T10:44:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T10:44:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:44:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:41 smithi112 ceph-mon[78695]: Deploying daemon osd.1 on smithi060 2024-09-21T10:44:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:41 smithi112 ceph-mon[78695]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T10:44:43.344 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:43 smithi060 systemd[1]: Stopping Ceph osd.1 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:44:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:43 smithi060 ceph-mon[93270]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:43.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:43 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[57958]: 2024-09-21T10:44:43.343+0000 7ff2a6c9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:44:43.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:43 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[57958]: 2024-09-21T10:44:43.343+0000 7ff2a6c9f640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-21T10:44:43.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:43 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[57958]: 2024-09-21T10:44:43.343+0000 7ff2a6c9f640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:44:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:43 smithi112 ceph-mon[78695]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:44 smithi060 ceph-mon[93270]: osd.1 marked itself down and dead 2024-09-21T10:44:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:44 smithi112 ceph-mon[78695]: osd.1 marked itself down and dead 2024-09-21T10:44:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:44.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:45.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:44 smithi060 podman[105913]: 2024-09-21 10:44:44.898480684 +0000 UTC m=+1.676559915 container died 3aa0d1b3291b175a990fcc187dd917316a5048264bbbad95729358067a1c3d14 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8) 2024-09-21T10:44:45.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:45 smithi060 ceph-mon[93270]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:45.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:45 smithi060 ceph-mon[93270]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:44:45.580 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:45 smithi060 ceph-mon[93270]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T10:44:45.580 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:45 smithi060 podman[105913]: 2024-09-21 10:44:45.326971391 +0000 UTC m=+2.105050613 container cleanup 3aa0d1b3291b175a990fcc187dd917316a5048264bbbad95729358067a1c3d14 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T10:44:45.581 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:45 smithi060 bash[105913]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1 2024-09-21T10:44:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:45 smithi112 ceph-mon[78695]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:45 smithi112 ceph-mon[78695]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:44:45.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:45 smithi112 ceph-mon[78695]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T10:44:45.948 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:45 smithi060 podman[105930]: 2024-09-21 10:44:45.578589545 +0000 UTC m=+0.670386025 container remove 3aa0d1b3291b175a990fcc187dd917316a5048264bbbad95729358067a1c3d14 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-6a1bdf8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T10:44:46.292 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:46 smithi060 podman[106016]: 2024-09-21 10:44:45.928931102 +0000 UTC m=+0.017413870 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:44:46.292 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:46 smithi060 podman[106016]: 2024-09-21 10:44:46.062798578 +0000 UTC m=+0.151281334 container create 119045e7cd169c4432d816d4c2a040e8239ece0e168bfcc6f7ccbabcb9104dc4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T10:44:46.292 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:46 smithi060 podman[106016]: 2024-09-21 10:44:46.291005991 +0000 UTC m=+0.379488758 container init 119045e7cd169c4432d816d4c2a040e8239ece0e168bfcc6f7ccbabcb9104dc4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:44:46.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:46 smithi060 ceph-mon[93270]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T10:44:46.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:46 smithi060 podman[106016]: 2024-09-21 10:44:46.29503388 +0000 UTC m=+0.383516644 container start 119045e7cd169c4432d816d4c2a040e8239ece0e168bfcc6f7ccbabcb9104dc4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T10:44:46.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:46 smithi060 podman[106016]: 2024-09-21 10:44:46.390819628 +0000 UTC m=+0.479302383 container attach 119045e7cd169c4432d816d4c2a040e8239ece0e168bfcc6f7ccbabcb9104dc4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T10:44:46.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:46 smithi060 podman[106016]: 2024-09-21 10:44:46.495959859 +0000 UTC m=+0.584442615 container died 119045e7cd169c4432d816d4c2a040e8239ece0e168bfcc6f7ccbabcb9104dc4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True) 2024-09-21T10:44:46.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:46 smithi112 ceph-mon[78695]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T10:44:47.271 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 podman[106039]: 2024-09-21 10:44:47.019306907 +0000 UTC m=+0.516694445 container remove 119045e7cd169c4432d816d4c2a040e8239ece0e168bfcc6f7ccbabcb9104dc4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:44:47.271 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T10:44:47.272 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 systemd[1]: Stopped Ceph osd.1 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:44:47.272 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.1.service: Consumed 1min 9.875s CPU time. 2024-09-21T10:44:47.272 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 systemd[1]: Starting Ceph osd.1 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:44:47.644 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:47 smithi060 ceph-mon[93270]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:47.645 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 podman[106137]: 2024-09-21 10:44:47.384442978 +0000 UTC m=+0.016512764 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:44:47.645 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 podman[106137]: 2024-09-21 10:44:47.525984747 +0000 UTC m=+0.158054533 container create 50bfc86fadafcca1a619a7424d92e79ab84bbc58e44a8e65987ba3b325877970 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T10:44:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:47 smithi112 ceph-mon[78695]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:47.907 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 podman[106137]: 2024-09-21 10:44:47.765286654 +0000 UTC m=+0.397356449 container init 50bfc86fadafcca1a619a7424d92e79ab84bbc58e44a8e65987ba3b325877970 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T10:44:47.907 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 podman[106137]: 2024-09-21 10:44:47.768681573 +0000 UTC m=+0.400751369 container start 50bfc86fadafcca1a619a7424d92e79ab84bbc58e44a8e65987ba3b325877970 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T10:44:47.907 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 podman[106137]: 2024-09-21 10:44:47.865321724 +0000 UTC m=+0.497391528 container attach 50bfc86fadafcca1a619a7424d92e79ab84bbc58e44a8e65987ba3b325877970 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2) 2024-09-21T10:44:48.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:48.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 bash[106137]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:48.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:48.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:47 smithi060 bash[106137]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:49.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:49 smithi060 ceph-mon[93270]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:49.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:49 smithi112 ceph-mon[78695]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:44:50.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:50 smithi060 ceph-mon[93270]: Health check failed: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T10:44:50.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:50 smithi112 ceph-mon[78695]: Health check failed: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T10:44:51.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:44:51.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:51.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 bash[106137]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:44:51.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 bash[106137]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:51.199 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:51.200 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 bash[106137]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:44:51.200 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T10:44:51.200 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 bash[106137]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T10:44:51.200 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T10:44:51.200 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:50 smithi060 bash[106137]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T10:44:51.563 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:51 smithi060 ceph-mon[93270]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 bash[106137]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 bash[106137]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 bash[106137]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 bash[106137]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate[106152]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T10:44:51.563 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 bash[106137]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T10:44:51.564 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 podman[106137]: 2024-09-21 10:44:51.24593721 +0000 UTC m=+3.878006998 container died 50bfc86fadafcca1a619a7424d92e79ab84bbc58e44a8e65987ba3b325877970 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:44:51.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:51 smithi112 ceph-mon[78695]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:52.185 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:51 smithi060 podman[106379]: 2024-09-21 10:44:51.835874372 +0000 UTC m=+0.577486409 container remove 50bfc86fadafcca1a619a7424d92e79ab84bbc58e44a8e65987ba3b325877970 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T10:44:52.185 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 podman[106438]: 2024-09-21 10:44:51.951191662 +0000 UTC m=+0.016498729 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:44:52.185 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 podman[106438]: 2024-09-21 10:44:52.070344374 +0000 UTC m=+0.135651434 container create 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731) 2024-09-21T10:44:52.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 podman[106438]: 2024-09-21 10:44:52.306262169 +0000 UTC m=+0.371569236 container init 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T10:44:52.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 podman[106438]: 2024-09-21 10:44:52.309613014 +0000 UTC m=+0.374920069 container start 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T10:44:52.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 ceph-osd[106457]: -- 172.21.15.60:0/2700278594 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c101cae1e0 con 0x55c101c3e000 2024-09-21T10:44:52.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 bash[106438]: 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 2024-09-21T10:44:52.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:52 smithi060 systemd[1]: Started Ceph osd.1 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:44:53.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:53 smithi060 ceph-mon[93270]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:53.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:53.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:53.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:53 smithi112 ceph-mon[78695]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:44:54.039 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:44:53 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[106453]: 2024-09-21T10:44:53.948+0000 7fd24d3e7640 -1 Falling back to public interface 2024-09-21T10:44:55.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:55 smithi060 ceph-mon[93270]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:55 smithi112 ceph-mon[78695]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:57.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:57 smithi060 ceph-mon[93270]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:57.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:57.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:57.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:57 smithi112 ceph-mon[78695]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:44:57.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:57.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:58 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:44:59.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:44:59.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:58 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:00.178 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:44:59 smithi060 ceph-mon[93270]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:44:59 smithi112 ceph-mon[78695]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:00.443 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:45:00 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[106453]: 2024-09-21T10:45:00.174+0000 7fd24d3e7640 -1 osd.1 53 log_to_monitors true 2024-09-21T10:45:01.081 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:00 smithi060 ceph-mon[93270]: from='osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T10:45:01.081 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:45:00 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[106453]: 2024-09-21T10:45:00.906+0000 7fd245191640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:45:01.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:00 smithi112 ceph-mon[78695]: from='osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: osdmap e56: 6 total, 5 up, 6 in 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: osdmap e56: 6 total, 5 up, 6 in 2024-09-21T10:45:02.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:02.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T10:45:03.171 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T10:45:03.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T10:45:03.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:45:03.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613] boot 2024-09-21T10:45:03.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T10:45:03.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T10:45:03.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:02 smithi060 ceph-mon[93270]: osdmap e58: 6 total, 6 up, 6 in 2024-09-21T10:45:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T10:45:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T10:45:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:45:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: osd.1 [v2:172.21.15.60:6810/1506763613,v1:172.21.15.60:6811/1506763613] boot 2024-09-21T10:45:03.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T10:45:03.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T10:45:03.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:02 smithi112 ceph-mon[78695]: osdmap e58: 6 total, 6 up, 6 in 2024-09-21T10:45:04.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:03 smithi060 ceph-mon[93270]: pgmap v74: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:04.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:03 smithi112 ceph-mon[78695]: pgmap v74: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:04 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:05.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:04 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:06.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:05 smithi060 ceph-mon[93270]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/222 objects degraded (7.207%) 2024-09-21T10:45:06.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:05 smithi112 ceph-mon[78695]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/222 objects degraded (7.207%) 2024-09-21T10:45:07.350 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:07 smithi060 ceph-mon[93270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-21T10:45:07.350 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:07 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:45:07.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:07 smithi112 ceph-mon[78695]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-21T10:45:07.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:07 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:45:08.430 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:08 smithi060 ceph-mon[93270]: pgmap v77: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 -- 172.21.15.60:0/972191373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880ffcf0 msgr2=0x7f2c88100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 --2- 172.21.15.60:0/972191373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880ffcf0 0x7f2c88100170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009880 tx=0x7f2c7802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 -- 172.21.15.60:0/972191373 shutdown_connections 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 --2- 172.21.15.60:0/972191373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880ffcf0 0x7f2c88100170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 --2- 172.21.15.60:0/972191373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c880feaf0 0x7f2c880feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 -- 172.21.15.60:0/972191373 >> 172.21.15.60:0/972191373 conn(0x7f2c880fa280 msgr2=0x7f2c880fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 -- 172.21.15.60:0/972191373 shutdown_connections 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 -- 172.21.15.60:0/972191373 wait complete. 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.427+0000 7f2c8f852640 1 Processor -- start 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8f852640 1 -- start start 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8f852640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 0x7f2c88102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8f852640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c880ffcf0 0x7f2c881010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8f852640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88101610 con 0x7f2c880feaf0 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8f852640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88101780 con 0x7f2c880ffcf0 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8d5ee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 0x7f2c88102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8d5ee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 0x7f2c88102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33432/0 (socket says 172.21.15.60:33432) 2024-09-21T10:45:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8d5ee640 1 -- 172.21.15.60:0/2260059501 learned_addr learned my addr 172.21.15.60:0/2260059501 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:08.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8cded640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c880ffcf0 0x7f2c881010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:08.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8d5ee640 1 -- 172.21.15.60:0/2260059501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c880ffcf0 msgr2=0x7f2c881010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8d5ee640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c880ffcf0 0x7f2c881010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.428+0000 7f2c8d5ee640 1 -- 172.21.15.60:0/2260059501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78009560 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.429+0000 7f2c8d5ee640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 0x7f2c88102a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400d8d0 tx=0x7f2c8400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.429+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c84009a30 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.429+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c88101a60 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.429+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c84009b90 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.429+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c8400f680 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.429+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8819d730 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.430+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c880feef0 con 0x7f2c880feaf0 2024-09-21T10:45:08.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.431+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2c84009d00 con 0x7f2c880feaf0 2024-09-21T10:45:08.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.431+0000 7f2c7e7fc640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2c7407b270 0x7f2c7407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:08.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.431+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2c8409e010 con 0x7f2c880feaf0 2024-09-21T10:45:08.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.431+0000 7f2c8cded640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2c7407b270 0x7f2c7407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:08.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.432+0000 7f2c8cded640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2c7407b270 0x7f2c7407d730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c78000c00 tx=0x7f2c780314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:08.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.436+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2c84061150 con 0x7f2c880feaf0 2024-09-21T10:45:08.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:08 smithi112 ceph-mon[78695]: pgmap v77: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:08.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.643+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c88068430 con 0x7f2c7407b270 2024-09-21T10:45:08.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.645+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/2260059501 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2c88068430 con 0x7f2c7407b270 2024-09-21T10:45:08.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2c7407b270 msgr2=0x7f2c7407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2c7407b270 0x7f2c7407d730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c78000c00 tx=0x7f2c780314e0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 msgr2=0x7f2c88102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 0x7f2c88102a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400d8d0 tx=0x7f2c8400dd90 comp rx=0 tx=0).stop 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 shutdown_connections 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2c7407b270 0x7f2c7407d730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2c880ffcf0 0x7f2c881010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 --2- 172.21.15.60:0/2260059501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c880feaf0 0x7f2c88102a80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 >> 172.21.15.60:0/2260059501 conn(0x7f2c880fa280 msgr2=0x7f2c88067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 shutdown_connections 2024-09-21T10:45:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.647+0000 7f2c8f852640 1 -- 172.21.15.60:0/2260059501 wait complete. 2024-09-21T10:45:08.659 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:45:08.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 -- 172.21.15.60:0/3329284381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 msgr2=0x7fddf0100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 --2- 172.21.15.60:0/3329284381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0100120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009880 tx=0x7fdde402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 -- 172.21.15.60:0/3329284381 shutdown_connections 2024-09-21T10:45:08.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 --2- 172.21.15.60:0/3329284381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0100120 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 --2- 172.21.15.60:0/3329284381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddf00feaa0 0x7fddf00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 -- 172.21.15.60:0/3329284381 >> 172.21.15.60:0/3329284381 conn(0x7fddf00fa250 msgr2=0x7fddf00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:08.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 -- 172.21.15.60:0/3329284381 shutdown_connections 2024-09-21T10:45:08.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.732+0000 7fddf8274640 1 -- 172.21.15.60:0/3329284381 wait complete. 2024-09-21T10:45:08.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf8274640 1 Processor -- start 2024-09-21T10:45:08.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf8274640 1 -- start start 2024-09-21T10:45:08.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf8274640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddf00feaa0 0x7fddf0195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:08.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf8274640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:08.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf8274640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf0196160 con 0x7fddf00ffca0 2024-09-21T10:45:08.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf8274640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01962d0 con 0x7fddf00feaa0 2024-09-21T10:45:08.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf580f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:08.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf580f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33452/0 (socket says 172.21.15.60:33452) 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.733+0000 7fddf580f640 1 -- 172.21.15.60:0/2303687789 learned_addr learned my addr 172.21.15.60:0/2303687789 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf6010640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddf00feaa0 0x7fddf0195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf580f640 1 -- 172.21.15.60:0/2303687789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddf00feaa0 msgr2=0x7fddf0195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf580f640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddf00feaa0 0x7fddf0195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf580f640 1 -- 172.21.15.60:0/2303687789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4009560 con 0x7fddf00ffca0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf580f640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0195b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdde4005640 tx=0x7fdde4005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde4004ba0 con 0x7fddf00ffca0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdde4004d00 con 0x7fddf00ffca0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf019ad10 con 0x7fddf00ffca0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde4003c30 con 0x7fddf00ffca0 2024-09-21T10:45:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.734+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf019b280 con 0x7fddf00ffca0 2024-09-21T10:45:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.735+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf01076b0 con 0x7fddf00ffca0 2024-09-21T10:45:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.736+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fdde4031640 con 0x7fddf00ffca0 2024-09-21T10:45:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.736+0000 7fdde37fe640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdddc07b270 0x7fdddc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.737+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdde40bf480 con 0x7fddf00ffca0 2024-09-21T10:45:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.737+0000 7fddf6010640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdddc07b270 0x7fdddc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:08.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.737+0000 7fddf6010640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdddc07b270 0x7fdddc07d730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddec0058c0 tx=0x7fddec00a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:08.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.741+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdde40825c0 con 0x7fddf00ffca0 2024-09-21T10:45:08.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.944+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf019b4c0 con 0x7fdddc07b270 2024-09-21T10:45:08.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.946+0000 7fdde37fe640 1 -- 172.21.15.60:0/2303687789 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fddf019b4c0 con 0x7fdddc07b270 2024-09-21T10:45:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdddc07b270 msgr2=0x7fdddc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdddc07b270 0x7fdddc07d730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddec0058c0 tx=0x7fddec00a2d0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 msgr2=0x7fddf0195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0195b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdde4005640 tx=0x7fdde4005670 comp rx=0 tx=0).stop 2024-09-21T10:45:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 shutdown_connections 2024-09-21T10:45:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdddc07b270 0x7fdddc07d730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf00ffca0 0x7fddf0195b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 --2- 172.21.15.60:0/2303687789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddf00feaa0 0x7fddf0195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:08.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 >> 172.21.15.60:0/2303687789 conn(0x7fddf00fa250 msgr2=0x7fddf0068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:08.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 shutdown_connections 2024-09-21T10:45:08.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:08.948+0000 7fddf8274640 1 -- 172.21.15.60:0/2303687789 wait complete. 2024-09-21T10:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 -- 172.21.15.60:0/461888732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 msgr2=0x7fa31c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 --2- 172.21.15.60:0/461888732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c102a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0098b0 tx=0x7fa30c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 -- 172.21.15.60:0/461888732 shutdown_connections 2024-09-21T10:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 --2- 172.21.15.60:0/461888732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa31c102f60 0x7fa31c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 --2- 172.21.15.60:0/461888732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c102a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 -- 172.21.15.60:0/461888732 >> 172.21.15.60:0/461888732 conn(0x7fa31c0fa250 msgr2=0x7fa31c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 -- 172.21.15.60:0/461888732 shutdown_connections 2024-09-21T10:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.032+0000 7fa321153640 1 -- 172.21.15.60:0/461888732 wait complete. 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.033+0000 7fa321153640 1 Processor -- start 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.033+0000 7fa321153640 1 -- start start 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.033+0000 7fa321153640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.033+0000 7fa321153640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa31c102f60 0x7fa31c195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.033+0000 7fa321153640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c196150 con 0x7fa31c100630 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.033+0000 7fa321153640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1962c0 con 0x7fa31c102f60 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33468/0 (socket says 172.21.15.60:33468) 2024-09-21T10:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 -- 172.21.15.60:0/3446844688 learned_addr learned my addr 172.21.15.60:0/3446844688 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31a59c640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa31c102f60 0x7fa31c195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 -- 172.21.15.60:0/3446844688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa31c102f60 msgr2=0x7fa31c195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa31c102f60 0x7fa31c195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 -- 172.21.15.60:0/3446844688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009560 con 0x7fa31c100630 2024-09-21T10:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa31ad9d640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c195640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0054f0 tx=0x7fa30c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30c004aa0 con 0x7fa31c100630 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa30c004c00 con 0x7fa31c100630 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.034+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30c003b10 con 0x7fa31c100630 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.035+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c19ad00 con 0x7fa31c100630 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.035+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c19b1a0 con 0x7fa31c100630 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.036+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c1087c0 con 0x7fa31c100630 2024-09-21T10:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.036+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa30c031640 con 0x7fa31c100630 2024-09-21T10:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.037+0000 7fa303fff640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa30407b270 0x7fa30407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.037+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa30c0bf4a0 con 0x7fa31c100630 2024-09-21T10:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.037+0000 7fa31a59c640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa30407b270 0x7fa30407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.037+0000 7fa31a59c640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa30407b270 0x7fa30407d730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa31c196b60 tx=0x7fa31000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.041+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa30c082560 con 0x7fa31c100630 2024-09-21T10:45:09.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.239+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa31c19b410 con 0x7fa30407b270 2024-09-21T10:45:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.249+0000 7fa303fff640 1 -- 172.21.15.60:0/3446844688 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa31c19b410 con 0x7fa30407b270 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (11m) 11s ago 12m 24.5M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (4m) 11s ago 13m 8170k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (3m) 73s ago 12m 7365k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (81s) 11s ago 13m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (76s) 73s ago 12m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (10m) 11s ago 12m 85.8M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (6m) 11s ago 6m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (6m) 11s ago 6m 16.2M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (6m) 73s ago 6m 17.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (6m) 73s ago 6m 19.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (3m) 11s ago 14m 514M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:45:09.253 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (2m) 73s ago 12m 453M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (2m) 11s ago 14m 46.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (118s) 73s ago 11m 34.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (13m) 11s ago 13m 16.5M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (12m) 73s ago 12m 14.6M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (54s) 11s ago 10m 102M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (17s) 11s ago 10m 11.8M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (9m) 11s ago 9m 223M 1217M 18.2.4-871-g6a1bdf85 0adab276c97e 72fe79b63258 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (9m) 73s ago 9m 286M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (8m) 73s ago 8m 263M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (8m) 73s ago 8m 240M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:45:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (2m) 11s ago 12m 64.4M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:45:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa30407b270 msgr2=0x7fa30407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa30407b270 0x7fa30407d730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa31c196b60 tx=0x7fa31000b390 comp rx=0 tx=0).stop 2024-09-21T10:45:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 msgr2=0x7fa31c195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c195640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0054f0 tx=0x7fa30c005520 comp rx=0 tx=0).stop 2024-09-21T10:45:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 shutdown_connections 2024-09-21T10:45:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa30407b270 0x7fa30407d730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa31c102f60 0x7fa31c195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 --2- 172.21.15.60:0/3446844688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31c100630 0x7fa31c195640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 >> 172.21.15.60:0/3446844688 conn(0x7fa31c0fa250 msgr2=0x7fa31c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 shutdown_connections 2024-09-21T10:45:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.252+0000 7fa321153640 1 -- 172.21.15.60:0/3446844688 wait complete. 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 -- 172.21.15.60:0/3418874615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 msgr2=0x7f91580fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3418874615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f91580fff90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9148009880 tx=0x7f914802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 -- 172.21.15.60:0/3418874615 shutdown_connections 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3418874615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 0x7f9158101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3418874615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f91580fff90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 -- 172.21.15.60:0/3418874615 >> 172.21.15.60:0/3418874615 conn(0x7f91580fb320 msgr2=0x7f91580fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 -- 172.21.15.60:0/3418874615 shutdown_connections 2024-09-21T10:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.335+0000 7f915f0f5640 1 -- 172.21.15.60:0/3418874615 wait complete. 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.336+0000 7f915f0f5640 1 Processor -- start 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.336+0000 7f915f0f5640 1 -- start start 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.336+0000 7f915f0f5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f9158195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.336+0000 7f915f0f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 0x7f9158195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.336+0000 7f915f0f5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581961a0 con 0x7f91580ffb90 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.336+0000 7f915f0f5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158196310 con 0x7f9158100d90 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f9158195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f9158195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33480/0 (socket says 172.21.15.60:33480) 2024-09-21T10:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 -- 172.21.15.60:0/3650371393 learned_addr learned my addr 172.21.15.60:0/3650371393 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f9157fff640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 0x7f9158195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 -- 172.21.15.60:0/3650371393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 msgr2=0x7f9158195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 0x7f9158195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 -- 172.21.15.60:0/3650371393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148009560 con 0x7f91580ffb90 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f9157fff640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 0x7f9158195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915ce91640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f9158195690 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91480054f0 tx=0x7f9148005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9148004aa0 con 0x7f91580ffb90 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915819ad00 con 0x7f91580ffb90 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9148004c00 con 0x7f91580ffb90 2024-09-21T10:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.337+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9148003ac0 con 0x7f91580ffb90 2024-09-21T10:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.338+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915819b220 con 0x7f91580ffb90 2024-09-21T10:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.339+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915818f730 con 0x7f91580ffb90 2024-09-21T10:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.339+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9148003d80 con 0x7f91580ffb90 2024-09-21T10:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.340+0000 7f9155ffb640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f914007b270 0x7f914007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.340+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f91480bf5c0 con 0x7f91580ffb90 2024-09-21T10:45:09.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.340+0000 7f9157fff640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f914007b270 0x7f914007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.341+0000 7f9157fff640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f914007b270 0x7f914007d730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9158196b60 tx=0x7f914c005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:09.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.345+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f91480825d0 con 0x7f91580ffb90 2024-09-21T10:45:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.607+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f915802c480 con 0x7f91580ffb90 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.608+0000 7f9155ffb640 1 -- 172.21.15.60:0/3650371393 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f91480856f0 con 0x7f91580ffb90 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:09.611 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4, 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 8, 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:45:09.612 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f914007b270 msgr2=0x7f914007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f914007b270 0x7f914007d730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9158196b60 tx=0x7f914c005e50 comp rx=0 tx=0).stop 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 msgr2=0x7f9158195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f9158195690 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91480054f0 tx=0x7f9148005520 comp rx=0 tx=0).stop 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 shutdown_connections 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f914007b270 0x7f914007d730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9158100d90 0x7f9158195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 --2- 172.21.15.60:0/3650371393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91580ffb90 0x7f9158195690 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.610+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 >> 172.21.15.60:0/3650371393 conn(0x7f91580fb320 msgr2=0x7f91581044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.611+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 shutdown_connections 2024-09-21T10:45:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.611+0000 7f915f0f5640 1 -- 172.21.15.60:0/3650371393 wait complete. 2024-09-21T10:45:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 -- 172.21.15.60:0/2771909325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 msgr2=0x7f4b5c101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 --2- 172.21.15.60:0/2771909325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c101020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009880 tx=0x7f4b4802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 -- 172.21.15.60:0/2771909325 shutdown_connections 2024-09-21T10:45:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 --2- 172.21.15.60:0/2771909325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c101020 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 --2- 172.21.15.60:0/2771909325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b5c0ff9a0 0x7f4b5c0ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 -- 172.21.15.60:0/2771909325 >> 172.21.15.60:0/2771909325 conn(0x7f4b5c0fb110 msgr2=0x7f4b5c0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 -- 172.21.15.60:0/2771909325 shutdown_connections 2024-09-21T10:45:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.694+0000 7f4b6199d640 1 -- 172.21.15.60:0/2771909325 wait complete. 2024-09-21T10:45:09.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6199d640 1 Processor -- start 2024-09-21T10:45:09.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6199d640 1 -- start start 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6199d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b5c0ff9a0 0x7f4b5c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6199d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6199d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c072de0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6199d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c072f50 con 0x7f4b5c0ff9a0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33506/0 (socket says 172.21.15.60:33506) 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b5bfff640 1 -- 172.21.15.60:0/693218065 learned_addr learned my addr 172.21.15.60:0/693218065 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.695+0000 7f4b6099b640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b5c0ff9a0 0x7f4b5c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b5bfff640 1 -- 172.21.15.60:0/693218065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b5c0ff9a0 msgr2=0x7f4b5c074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b5bfff640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b5c0ff9a0 0x7f4b5c074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b5bfff640 1 -- 172.21.15.60:0/693218065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009560 con 0x7f4b5c100ba0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b5bfff640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c0728a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b480054f0 tx=0x7f4b48005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b48004aa0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b48004c00 con 0x7f4b5c100ba0 2024-09-21T10:45:09.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c0731d0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b48003ac0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.696+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c19d4c0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.697+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c0ffda0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.698+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4b48031c70 con 0x7f4b5c100ba0 2024-09-21T10:45:09.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.698+0000 7f4b59ffb640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4b4c07b270 0x7f4b4c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:09.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.699+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4b480bf5e0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.699+0000 7f4b6099b640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4b4c07b270 0x7f4b4c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:09.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.699+0000 7f4b6099b640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4b4c07b270 0x7f4b4c07d730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b50005fd0 tx=0x7f4b5000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:09.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.703+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f4b48082600 con 0x7f4b5c100ba0 2024-09-21T10:45:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.929+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b5c1085b0 con 0x7f4b5c100ba0 2024-09-21T10:45:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.930+0000 7f4b59ffb640 1 -- 172.21.15.60:0/693218065 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f4b48085720 con 0x7f4b5c100ba0 2024-09-21T10:45:09.933 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:45:09.933 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:45:09.933 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:45:09.934 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:45:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:09.936 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4b4c07b270 msgr2=0x7f4b4c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4b4c07b270 0x7f4b4c07d730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b50005fd0 tx=0x7f4b5000b390 comp rx=0 tx=0).stop 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 msgr2=0x7f4b5c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c0728a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b480054f0 tx=0x7f4b48005520 comp rx=0 tx=0).stop 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 shutdown_connections 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4b4c07b270 0x7f4b4c07d730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b5c100ba0 0x7f4b5c0728a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 --2- 172.21.15.60:0/693218065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b5c0ff9a0 0x7f4b5c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.932+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 >> 172.21.15.60:0/693218065 conn(0x7f4b5c0fb110 msgr2=0x7f4b5c103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:09.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.933+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 shutdown_connections 2024-09-21T10:45:09.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:09.933+0000 7f4b6199d640 1 -- 172.21.15.60:0/693218065 wait complete. 2024-09-21T10:45:10.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 -- 172.21.15.60:0/2824098165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5100ffb90 msgr2=0x7fd5100fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 --2- 172.21.15.60:0/2824098165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5100ffb90 0x7fd5100fff90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd500009880 tx=0x7fd50002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 -- 172.21.15.60:0/2824098165 shutdown_connections 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 --2- 172.21.15.60:0/2824098165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd510100d90 0x7fd510101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 --2- 172.21.15.60:0/2824098165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5100ffb90 0x7fd5100fff90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 -- 172.21.15.60:0/2824098165 >> 172.21.15.60:0/2824098165 conn(0x7fd5100fb320 msgr2=0x7fd5100fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 -- 172.21.15.60:0/2824098165 shutdown_connections 2024-09-21T10:45:10.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.017+0000 7fd51507e640 1 -- 172.21.15.60:0/2824098165 wait complete. 2024-09-21T10:45:10.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.018+0000 7fd51507e640 1 Processor -- start 2024-09-21T10:45:10.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.018+0000 7fd51507e640 1 -- start start 2024-09-21T10:45:10.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd51507e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5100ffb90 0x7fd510074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:10.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd51507e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 0x7fd5100728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd51507e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510072de0 con 0x7fd510100d90 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd51507e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510072f50 con 0x7fd5100ffb90 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 0x7fd5100728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 0x7fd5100728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33522/0 (socket says 172.21.15.60:33522) 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 -- 172.21.15.60:0/2881053709 learned_addr learned my addr 172.21.15.60:0/2881053709 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50ed9d640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5100ffb90 0x7fd510074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 -- 172.21.15.60:0/2881053709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5100ffb90 msgr2=0x7fd510074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5100ffb90 0x7fd510074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 -- 172.21.15.60:0/2881053709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500009560 con 0x7fd510100d90 2024-09-21T10:45:10.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.019+0000 7fd50e59c640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 0x7fd5100728a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d6f0 tx=0x7fd50400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:10.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.020+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd504009a30 con 0x7fd510100d90 2024-09-21T10:45:10.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.020+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5040054e0 con 0x7fd510100d90 2024-09-21T10:45:10.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.020+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd510073230 con 0x7fd510100d90 2024-09-21T10:45:10.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.020+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd504010460 con 0x7fd510100d90 2024-09-21T10:45:10.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.020+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51019d6f0 con 0x7fd510100d90 2024-09-21T10:45:10.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.021+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51018f730 con 0x7fd510100d90 2024-09-21T10:45:10.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.022+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fd5040106d0 con 0x7fd510100d90 2024-09-21T10:45:10.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.022+0000 7fd4f7fff640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd4f807b270 0x7fd4f807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:10.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.022+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd50409de10 con 0x7fd510100d90 2024-09-21T10:45:10.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.022+0000 7fd50ed9d640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd4f807b270 0x7fd4f807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:10.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.023+0000 7fd50ed9d640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd4f807b270 0x7fd4f807d730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd500009230 tx=0x7fd5000314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:10.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.027+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fd504060ed0 con 0x7fd510100d90 2024-09-21T10:45:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:10 smithi060 ceph-mon[93270]: pgmap v78: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:10 smithi060 ceph-mon[93270]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:10 smithi060 ceph-mon[93270]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:10 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3650371393' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:10 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/693218065' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.234+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5100608f0 con 0x7fd4f807b270 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.236+0000 7fd4f7fff640 1 -- 172.21.15.60:0/2881053709 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd5100608f0 con 0x7fd4f807b270 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:45:10.239 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "8/23 daemons upgraded", 2024-09-21T10:45:10.240 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:45:10.240 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:45:10.240 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd4f807b270 msgr2=0x7fd4f807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd4f807b270 0x7fd4f807d730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd500009230 tx=0x7fd5000314e0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 msgr2=0x7fd5100728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 0x7fd5100728a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d6f0 tx=0x7fd50400dbb0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 shutdown_connections 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd4f807b270 0x7fd4f807d730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd510100d90 0x7fd5100728a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 --2- 172.21.15.60:0/2881053709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd5100ffb90 0x7fd510074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 >> 172.21.15.60:0/2881053709 conn(0x7fd5100fb320 msgr2=0x7fd5101044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 shutdown_connections 2024-09-21T10:45:10.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.238+0000 7fd51507e640 1 -- 172.21.15.60:0/2881053709 wait complete. 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 -- 172.21.15.60:0/1079564252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb8100d90 msgr2=0x7effb8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 --2- 172.21.15.60:0/1079564252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb8100d90 0x7effb8101210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7effa8009880 tx=0x7effa802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 -- 172.21.15.60:0/1079564252 shutdown_connections 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 --2- 172.21.15.60:0/1079564252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb8100d90 0x7effb8101210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 --2- 172.21.15.60:0/1079564252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb80ffb90 0x7effb80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 -- 172.21.15.60:0/1079564252 >> 172.21.15.60:0/1079564252 conn(0x7effb80fb320 msgr2=0x7effb80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 -- 172.21.15.60:0/1079564252 shutdown_connections 2024-09-21T10:45:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.322+0000 7effbddd4640 1 -- 172.21.15.60:0/1079564252 wait complete. 2024-09-21T10:45:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effbddd4640 1 Processor -- start 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effbddd4640 1 -- start start 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effbddd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 0x7effb81955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effbddd4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb8100d90 0x7effb8195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effbddd4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb81960f0 con 0x7effb80ffb90 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effbddd4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8196260 con 0x7effb8100d90 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effb77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 0x7effb81955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effb77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 0x7effb81955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33550/0 (socket says 172.21.15.60:33550) 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effb77fe640 1 -- 172.21.15.60:0/4009726008 learned_addr learned my addr 172.21.15.60:0/4009726008 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effaeffd640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb8100d90 0x7effb8195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effb77fe640 1 -- 172.21.15.60:0/4009726008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb8100d90 msgr2=0x7effb8195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effb77fe640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb8100d90 0x7effb8195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.323+0000 7effb77fe640 1 -- 172.21.15.60:0/4009726008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8009560 con 0x7effb80ffb90 2024-09-21T10:45:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.324+0000 7effb77fe640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 0x7effb81955e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effa000d900 tx=0x7effa000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.324+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa0009c00 con 0x7effb80ffb90 2024-09-21T10:45:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.324+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effa0009d60 con 0x7effb80ffb90 2024-09-21T10:45:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.324+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb819ad00 con 0x7effb80ffb90 2024-09-21T10:45:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.324+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa000f7b0 con 0x7effb80ffb90 2024-09-21T10:45:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.324+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb819b1c0 con 0x7effb80ffb90 2024-09-21T10:45:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.325+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb8108780 con 0x7effb80ffb90 2024-09-21T10:45:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.326+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7effa0010460 con 0x7effb80ffb90 2024-09-21T10:45:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.326+0000 7effb57fa640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7effa407b270 0x7effa407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.326+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6500+0+0 (secure 0 0 0) 0x7effa009e4b0 con 0x7effb80ffb90 2024-09-21T10:45:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.326+0000 7effaeffd640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7effa407b270 0x7effa407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.327+0000 7effaeffd640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7effa407b270 0x7effa407d730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effa8000c00 tx=0x7effa80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.331+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7effa0061540 con 0x7effb80ffb90 2024-09-21T10:45:10.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:10 smithi112 ceph-mon[78695]: pgmap v78: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:10.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:10 smithi112 ceph-mon[78695]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:10.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:10 smithi112 ceph-mon[78695]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:10.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:10 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3650371393' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:10.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:10 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/693218065' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:45:10.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.605+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7effb819b460 con 0x7effb80ffb90 2024-09-21T10:45:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.606+0000 7effb57fa640 1 -- 172.21.15.60:0/4009726008 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7effa0064660 con 0x7effb80ffb90 2024-09-21T10:45:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:45:10.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7effa407b270 msgr2=0x7effa407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7effa407b270 0x7effa407d730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effa8000c00 tx=0x7effa80314e0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 msgr2=0x7effb81955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:10.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 0x7effb81955e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effa000d900 tx=0x7effa000ddc0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 shutdown_connections 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7effa407b270 0x7effa407d730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb8100d90 0x7effb8195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 --2- 172.21.15.60:0/4009726008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80ffb90 0x7effb81955e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 >> 172.21.15.60:0/4009726008 conn(0x7effb80fb320 msgr2=0x7effb80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 shutdown_connections 2024-09-21T10:45:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:10.608+0000 7effbddd4640 1 -- 172.21.15.60:0/4009726008 wait complete. 2024-09-21T10:45:11.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:11 smithi060 ceph-mon[93270]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:11.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:11 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/4009726008' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:45:11.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:11 smithi112 ceph-mon[78695]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:11.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:11 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/4009726008' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:45:12.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:12 smithi060 ceph-mon[93270]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:12.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:12 smithi060 ceph-mon[93270]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:12.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:12 smithi112 ceph-mon[78695]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:12.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:12 smithi112 ceph-mon[78695]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:14 smithi060 ceph-mon[93270]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:14 smithi112 ceph-mon[78695]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:16 smithi112 ceph-mon[78695]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:16.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:16 smithi060 ceph-mon[93270]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:17 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T10:45:17.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:17 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T10:45:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:18 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T10:45:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:18 smithi060 ceph-mon[93270]: Upgrade: osd.2 is safe to restart 2024-09-21T10:45:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:18 smithi060 ceph-mon[93270]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T10:45:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:18 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T10:45:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:18 smithi112 ceph-mon[78695]: Upgrade: osd.2 is safe to restart 2024-09-21T10:45:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:18 smithi112 ceph-mon[78695]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T10:45:18.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:19.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:19 smithi060 ceph-mon[93270]: Upgrade: Updating osd.2 2024-09-21T10:45:19.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:19 smithi060 ceph-mon[93270]: Deploying daemon osd.2 on smithi060 2024-09-21T10:45:19.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:19 smithi112 ceph-mon[78695]: Upgrade: Updating osd.2 2024-09-21T10:45:19.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:19 smithi112 ceph-mon[78695]: Deploying daemon osd.2 on smithi060 2024-09-21T10:45:20.161 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:20 smithi060 ceph-mon[93270]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:20.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:20 smithi112 ceph-mon[78695]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:20.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:20 smithi060 systemd[1]: Stopping Ceph osd.2 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:45:20.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:20 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[65408]: 2024-09-21T10:45:20.780+0000 7f589d42a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:45:20.950 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:20 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[65408]: 2024-09-21T10:45:20.780+0000 7f589d42a640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-21T10:45:20.950 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:20 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[65408]: 2024-09-21T10:45:20.780+0000 7f589d42a640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:45:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:21 smithi112 ceph-mon[78695]: osd.2 marked itself down and dead 2024-09-21T10:45:21.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:21 smithi060 ceph-mon[93270]: osd.2 marked itself down and dead 2024-09-21T10:45:21.816 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:21 smithi060 podman[111430]: 2024-09-21 10:45:21.547994609 +0000 UTC m=+0.862843202 container died 72fe79b63258a0bc383c815b43640a1867dbaea36fb64f489fdb06678aa68202 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2) 2024-09-21T10:45:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:22 smithi060 ceph-mon[93270]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:22 smithi060 ceph-mon[93270]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:45:22.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:22 smithi060 ceph-mon[93270]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T10:45:22.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:21 smithi060 podman[111430]: 2024-09-21 10:45:21.906118421 +0000 UTC m=+1.220967015 container cleanup 72fe79b63258a0bc383c815b43640a1867dbaea36fb64f489fdb06678aa68202 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=reef-6a1bdf8, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:45:22.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:21 smithi060 bash[111430]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2 2024-09-21T10:45:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:22 smithi112 ceph-mon[78695]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:22 smithi112 ceph-mon[78695]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:45:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:22 smithi112 ceph-mon[78695]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T10:45:22.583 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111444]: 2024-09-21 10:45:22.241130073 +0000 UTC m=+0.682502780 container remove 72fe79b63258a0bc383c815b43640a1867dbaea36fb64f489fdb06678aa68202 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=reef-6a1bdf8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T10:45:22.880 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111532]: 2024-09-21 10:45:22.485210796 +0000 UTC m=+0.017022121 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:45:22.880 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111532]: 2024-09-21 10:45:22.583657525 +0000 UTC m=+0.115468844 container create 963bc224f5b4dc54b7ad049815bbb5044ba76a7a44ad7678a57334b84377cf36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T10:45:22.880 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111532]: 2024-09-21 10:45:22.803160259 +0000 UTC m=+0.334971579 container init 963bc224f5b4dc54b7ad049815bbb5044ba76a7a44ad7678a57334b84377cf36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T10:45:22.880 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111532]: 2024-09-21 10:45:22.80664296 +0000 UTC m=+0.338454283 container start 963bc224f5b4dc54b7ad049815bbb5044ba76a7a44ad7678a57334b84377cf36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T10:45:22.880 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111532]: 2024-09-21 10:45:22.878141516 +0000 UTC m=+0.409952845 container attach 963bc224f5b4dc54b7ad049815bbb5044ba76a7a44ad7678a57334b84377cf36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T10:45:23.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:23 smithi060 ceph-mon[93270]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T10:45:23.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:22 smithi060 podman[111532]: 2024-09-21 10:45:22.997057294 +0000 UTC m=+0.528868617 container died 963bc224f5b4dc54b7ad049815bbb5044ba76a7a44ad7678a57334b84377cf36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T10:45:23.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:23 smithi112 ceph-mon[78695]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T10:45:23.909 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:23 smithi060 podman[111555]: 2024-09-21 10:45:23.657537146 +0000 UTC m=+0.654095932 container remove 963bc224f5b4dc54b7ad049815bbb5044ba76a7a44ad7678a57334b84377cf36 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:45:23.909 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:23 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T10:45:23.909 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:23 smithi060 systemd[1]: Stopped Ceph osd.2 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:45:23.909 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:23 smithi060 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.2.service: Consumed 59.163s CPU time. 2024-09-21T10:45:24.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:24 smithi060 ceph-mon[93270]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:24.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:23 smithi060 systemd[1]: Starting Ceph osd.2 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:45:24.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 podman[111664]: 2024-09-21 10:45:24.030173114 +0000 UTC m=+0.017578546 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:45:24.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 podman[111664]: 2024-09-21 10:45:24.142022482 +0000 UTC m=+0.129427907 container create 73e6cbfc6678057b35c8ce3c4b64ce7916d3dfdbde75aa2285260cf07c52e39f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:45:24.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:24 smithi112 ceph-mon[78695]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:24.541 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 podman[111664]: 2024-09-21 10:45:24.395222332 +0000 UTC m=+0.382627767 container init 73e6cbfc6678057b35c8ce3c4b64ce7916d3dfdbde75aa2285260cf07c52e39f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T10:45:24.541 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 podman[111664]: 2024-09-21 10:45:24.398692525 +0000 UTC m=+0.386097958 container start 73e6cbfc6678057b35c8ce3c4b64ce7916d3dfdbde75aa2285260cf07c52e39f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:45:24.541 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 podman[111664]: 2024-09-21 10:45:24.486695395 +0000 UTC m=+0.474100827 container attach 73e6cbfc6678057b35c8ce3c4b64ce7916d3dfdbde75aa2285260cf07c52e39f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:45:24.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:24.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 bash[111664]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:24.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:24.949 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:24 smithi060 bash[111664]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:25.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:25 smithi060 ceph-mon[93270]: pgmap v88: 65 pgs: 12 active+undersized, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-09-21T10:45:25.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:25 smithi060 ceph-mon[93270]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:25.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:25 smithi112 ceph-mon[78695]: pgmap v88: 65 pgs: 12 active+undersized, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-09-21T10:45:25.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:25 smithi112 ceph-mon[78695]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-mon[93270]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:27.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:45:27.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:27.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:45:27.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:27.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:27.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:45:27.700 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T10:45:27.700 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T10:45:27.700 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T10:45:27.700 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T10:45:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:27 smithi112 ceph-mon[78695]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T10:45:28.135 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T10:45:28.136 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate[111678]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T10:45:28.136 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 bash[111664]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T10:45:28.136 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:27 smithi060 podman[111664]: 2024-09-21 10:45:27.842726118 +0000 UTC m=+3.830131541 container died 73e6cbfc6678057b35c8ce3c4b64ce7916d3dfdbde75aa2285260cf07c52e39f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T10:45:28.685 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:28 smithi060 podman[111891]: 2024-09-21 10:45:28.424033396 +0000 UTC m=+0.574960900 container remove 73e6cbfc6678057b35c8ce3c4b64ce7916d3dfdbde75aa2285260cf07c52e39f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:45:28.685 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:28 smithi060 podman[111947]: 2024-09-21 10:45:28.537296297 +0000 UTC m=+0.016587953 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:45:28.685 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:28 smithi060 podman[111947]: 2024-09-21 10:45:28.683502019 +0000 UTC m=+0.162793660 container create 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T10:45:28.946 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:28 smithi060 podman[111947]: 2024-09-21 10:45:28.919848189 +0000 UTC m=+0.399139840 container init 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T10:45:28.947 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:28 smithi060 podman[111947]: 2024-09-21 10:45:28.923221131 +0000 UTC m=+0.402512770 container start 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T10:45:29.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:28 smithi060 ceph-osd[111965]: -- 172.21.15.60:0/2538199819 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f013941e0 con 0x563f00533c00 2024-09-21T10:45:29.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:29 smithi060 bash[111947]: 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 2024-09-21T10:45:29.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:29 smithi060 systemd[1]: Started Ceph osd.2 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:45:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:29 smithi060 ceph-mon[93270]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:29.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:29.950 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:45:30.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:29 smithi112 ceph-mon[78695]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:30.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:30.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:30.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:30.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:30.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:45:30.428 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:30 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[111961]: 2024-09-21T10:45:30.064+0000 7fe1f707f640 -1 Falling back to public interface 2024-09-21T10:45:32.091 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:31 smithi060 ceph-mon[93270]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:31 smithi112 ceph-mon[78695]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:34.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:33 smithi060 ceph-mon[93270]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:34.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:33 smithi112 ceph-mon[78695]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:35.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:35 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:35 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:35 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:35 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:36.303 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:36 smithi060 ceph-mon[93270]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:36.303 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:36 smithi060 ceph-mon[93270]: from='osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T10:45:36.303 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:36 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[111961]: 2024-09-21T10:45:36.043+0000 7fe1f707f640 -1 osd.2 58 log_to_monitors true 2024-09-21T10:45:36.304 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:45:36 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[111961]: 2024-09-21T10:45:36.119+0000 7fe1eee29640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:45:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:36 smithi112 ceph-mon[78695]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:36 smithi112 ceph-mon[78695]: from='osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T10:45:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:37 smithi060 ceph-mon[93270]: from='osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T10:45:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:37 smithi060 ceph-mon[93270]: osdmap e61: 6 total, 5 up, 6 in 2024-09-21T10:45:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:37 smithi060 ceph-mon[93270]: from='osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T10:45:37.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:37 smithi060 ceph-mon[93270]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:37.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:37 smithi112 ceph-mon[78695]: from='osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T10:45:37.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:37 smithi112 ceph-mon[78695]: osdmap e61: 6 total, 5 up, 6 in 2024-09-21T10:45:37.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:37 smithi112 ceph-mon[78695]: from='osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T10:45:37.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:37 smithi112 ceph-mon[78695]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190] boot 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:45:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T10:45:38.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:38 smithi060 ceph-mon[93270]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T10:45:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: osd.2 [v2:172.21.15.60:6818/3643829190,v1:172.21.15.60:6819/3643829190] boot 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T10:45:38.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T10:45:38.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:38 smithi112 ceph-mon[78695]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T10:45:39.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:39 smithi060 ceph-mon[93270]: osdmap e63: 6 total, 6 up, 6 in 2024-09-21T10:45:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:39 smithi060 ceph-mon[93270]: pgmap v98: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:39.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:39 smithi112 ceph-mon[78695]: osdmap e63: 6 total, 6 up, 6 in 2024-09-21T10:45:39.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:39 smithi112 ceph-mon[78695]: pgmap v98: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/222 objects degraded (13.964%) 2024-09-21T10:45:40.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:40 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 21/222 objects degraded (9.459%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:40.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:40 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 21/222 objects degraded (9.459%), 6 pgs degraded (PG_DEGRADED) 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 -- 172.21.15.60:0/3139117250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 msgr2=0x7f1f3c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 --2- 172.21.15.60:0/3139117250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c102af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009880 tx=0x7f1f2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 -- 172.21.15.60:0/3139117250 shutdown_connections 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 --2- 172.21.15.60:0/3139117250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3c103030 0x7f1f3c105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 --2- 172.21.15.60:0/3139117250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c102af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 -- 172.21.15.60:0/3139117250 >> 172.21.15.60:0/3139117250 conn(0x7f1f3c0fa280 msgr2=0x7f1f3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 -- 172.21.15.60:0/3139117250 shutdown_connections 2024-09-21T10:45:40.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.698+0000 7f1f4242b640 1 -- 172.21.15.60:0/3139117250 wait complete. 2024-09-21T10:45:40.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.699+0000 7f1f4242b640 1 Processor -- start 2024-09-21T10:45:40.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.699+0000 7f1f4242b640 1 -- start start 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f4242b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c1956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f4242b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3c103030 0x7f1f3c195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f4242b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c1961f0 con 0x7f1f3c100700 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f4242b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c196360 con 0x7f1f3c103030 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c1956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c1956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59872/0 (socket says 172.21.15.60:59872) 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 -- 172.21.15.60:0/1728723080 learned_addr learned my addr 172.21.15.60:0/1728723080 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3b7fe640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3c103030 0x7f1f3c195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 -- 172.21.15.60:0/1728723080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3c103030 msgr2=0x7f1f3c195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3c103030 0x7f1f3c195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 -- 172.21.15.60:0/1728723080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c009560 con 0x7f1f3c100700 2024-09-21T10:45:40.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.700+0000 7f1f3bfff640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c1956e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005520 tx=0x7f1f2c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:40.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.701+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2c004aa0 con 0x7f1f3c100700 2024-09-21T10:45:40.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.701+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c19ad50 con 0x7f1f3c100700 2024-09-21T10:45:40.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.701+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f2c004c00 con 0x7f1f3c100700 2024-09-21T10:45:40.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.701+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2c003b10 con 0x7f1f3c100700 2024-09-21T10:45:40.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.701+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c19b1e0 con 0x7f1f3c100700 2024-09-21T10:45:40.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.702+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c108800 con 0x7f1f3c100700 2024-09-21T10:45:40.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.702+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1f2c003d10 con 0x7f1f3c100700 2024-09-21T10:45:40.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.703+0000 7f1f397fa640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1f2407b270 0x7f1f2407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:40.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.703+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1f2c0bf410 con 0x7f1f3c100700 2024-09-21T10:45:40.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.703+0000 7f1f3b7fe640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1f2407b270 0x7f1f2407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:40.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.704+0000 7f1f3b7fe640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1f2407b270 0x7f1f2407d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c196bb0 tx=0x7f1f3000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:40.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.708+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1f2c082550 con 0x7f1f3c100700 2024-09-21T10:45:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.926+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f3c19b450 con 0x7f1f2407b270 2024-09-21T10:45:40.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.927+0000 7f1f397fa640 1 -- 172.21.15.60:0/1728723080 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1f3c19b450 con 0x7f1f2407b270 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1f2407b270 msgr2=0x7f1f2407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1f2407b270 0x7f1f2407d730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c196bb0 tx=0x7f1f3000b410 comp rx=0 tx=0).stop 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 msgr2=0x7f1f3c1956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c1956e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005520 tx=0x7f1f2c005550 comp rx=0 tx=0).stop 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 shutdown_connections 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1f2407b270 0x7f1f2407d730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1f3c103030 0x7f1f3c195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.929+0000 7f1f4242b640 1 --2- 172.21.15.60:0/1728723080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3c100700 0x7f1f3c1956e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.930+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 >> 172.21.15.60:0/1728723080 conn(0x7f1f3c0fa280 msgr2=0x7f1f3c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.930+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 shutdown_connections 2024-09-21T10:45:40.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:40.930+0000 7f1f4242b640 1 -- 172.21.15.60:0/1728723080 wait complete. 2024-09-21T10:45:40.941 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.015+0000 7f12fdc56640 1 -- 172.21.15.60:0/4119700498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80fea80 msgr2=0x7f12f80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.015+0000 7f12fdc56640 1 --2- 172.21.15.60:0/4119700498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80fea80 0x7f12f80fee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009880 tx=0x7f12ec02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.015+0000 7f12fdc56640 1 -- 172.21.15.60:0/4119700498 shutdown_connections 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.015+0000 7f12fdc56640 1 --2- 172.21.15.60:0/4119700498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f80ffc80 0x7f12f8100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.015+0000 7f12fdc56640 1 --2- 172.21.15.60:0/4119700498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80fea80 0x7f12f80fee80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.015+0000 7f12fdc56640 1 -- 172.21.15.60:0/4119700498 >> 172.21.15.60:0/4119700498 conn(0x7f12f80fa230 msgr2=0x7f12f80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.016+0000 7f12fdc56640 1 -- 172.21.15.60:0/4119700498 shutdown_connections 2024-09-21T10:45:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.016+0000 7f12fdc56640 1 -- 172.21.15.60:0/4119700498 wait complete. 2024-09-21T10:45:41.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.016+0000 7f12fdc56640 1 Processor -- start 2024-09-21T10:45:41.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.016+0000 7f12fdc56640 1 -- start start 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12fdc56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f80fea80 0x7f12f81956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12fdc56640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 0x7f12f8195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12fdc56640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81961d0 con 0x7f12f80ffc80 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12fdc56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8196340 con 0x7f12f80fea80 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 0x7f12f8195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 0x7f12f8195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59886/0 (socket says 172.21.15.60:59886) 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f6ffd640 1 -- 172.21.15.60:0/200760224 learned_addr learned my addr 172.21.15.60:0/200760224 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f77fe640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f80fea80 0x7f12f81956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f6ffd640 1 -- 172.21.15.60:0/200760224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f80fea80 msgr2=0x7f12f81956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f6ffd640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f80fea80 0x7f12f81956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.017+0000 7f12f6ffd640 1 -- 172.21.15.60:0/200760224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec009560 con 0x7f12f80ffc80 2024-09-21T10:45:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.018+0000 7f12f6ffd640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 0x7f12f8195c00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12e800d720 tx=0x7f12e800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.018+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e80051f0 con 0x7f12f80ffc80 2024-09-21T10:45:41.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.018+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12e8009ce0 con 0x7f12f80ffc80 2024-09-21T10:45:41.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.018+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f819ade0 con 0x7f12f80ffc80 2024-09-21T10:45:41.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.018+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e8010460 con 0x7f12f80ffc80 2024-09-21T10:45:41.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.018+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f819b380 con 0x7f12f80ffc80 2024-09-21T10:45:41.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.019+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f80fee80 con 0x7f12f80ffc80 2024-09-21T10:45:41.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.020+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f12e8005350 con 0x7f12f80ffc80 2024-09-21T10:45:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.021+0000 7f12f4ff9640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f12e007b270 0x7f12e007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.021+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f12e809de00 con 0x7f12f80ffc80 2024-09-21T10:45:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.021+0000 7f12f77fe640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f12e007b270 0x7f12e007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.021+0000 7f12f77fe640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f12e007b270 0x7f12e007d730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12ec005940 tx=0x7f12ec0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.029+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f12e8060ec0 con 0x7f12f80ffc80 2024-09-21T10:45:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.236+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12f8068bf0 con 0x7f12e007b270 2024-09-21T10:45:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.237+0000 7f12f4ff9640 1 -- 172.21.15.60:0/200760224 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f12f8068bf0 con 0x7f12e007b270 2024-09-21T10:45:41.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f12e007b270 msgr2=0x7f12e007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f12e007b270 0x7f12e007d730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12ec005940 tx=0x7f12ec0058d0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 msgr2=0x7f12f8195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 0x7f12f8195c00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f12e800d720 tx=0x7f12e800dbe0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 shutdown_connections 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f12e007b270 0x7f12e007d730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12f80ffc80 0x7f12f8195c00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 --2- 172.21.15.60:0/200760224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12f80fea80 0x7f12f81956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 >> 172.21.15.60:0/200760224 conn(0x7f12f80fa230 msgr2=0x7f12f80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 shutdown_connections 2024-09-21T10:45:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.239+0000 7f12fdc56640 1 -- 172.21.15.60:0/200760224 wait complete. 2024-09-21T10:45:41.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 -- 172.21.15.60:0/70541311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 msgr2=0x7f4d940fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 --2- 172.21.15.60:0/70541311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d940fe610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400a990 tx=0x7f4d8402b7d0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 -- 172.21.15.60:0/70541311 shutdown_connections 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 --2- 172.21.15.60:0/70541311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d940ff410 0x7f4d940ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 --2- 172.21.15.60:0/70541311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d940fe610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 -- 172.21.15.60:0/70541311 >> 172.21.15.60:0/70541311 conn(0x7f4d940f99c0 msgr2=0x7f4d940fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 -- 172.21.15.60:0/70541311 shutdown_connections 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.324+0000 7f4d99d06640 1 -- 172.21.15.60:0/70541311 wait complete. 2024-09-21T10:45:41.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d99d06640 1 Processor -- start 2024-09-21T10:45:41.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d99d06640 1 -- start start 2024-09-21T10:45:41.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d99d06640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d94195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d99d06640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d940ff410 0x7f4d94195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d99d06640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d94196110 con 0x7f4d940fe210 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d99d06640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d94196280 con 0x7f4d940ff410 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d94195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d94195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59900/0 (socket says 172.21.15.60:59900) 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d937fe640 1 -- 172.21.15.60:0/2728613606 learned_addr learned my addr 172.21.15.60:0/2728613606 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d92ffd640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d940ff410 0x7f4d94195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d937fe640 1 -- 172.21.15.60:0/2728613606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d940ff410 msgr2=0x7f4d94195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d937fe640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d940ff410 0x7f4d94195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.325+0000 7f4d937fe640 1 -- 172.21.15.60:0/2728613606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8400a670 con 0x7f4d940fe210 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.326+0000 7f4d937fe640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d94195600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000c00 tx=0x7f4d84005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.326+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d84004430 con 0x7f4d940fe210 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.326+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d84008ec0 con 0x7f4d940fe210 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.326+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d840053d0 con 0x7f4d940fe210 2024-09-21T10:45:41.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.326+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9419ac70 con 0x7f4d940fe210 2024-09-21T10:45:41.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.326+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9419b1c0 con 0x7f4d940fe210 2024-09-21T10:45:41.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.327+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9418f4c0 con 0x7f4d940fe210 2024-09-21T10:45:41.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.328+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4d84005530 con 0x7f4d940fe210 2024-09-21T10:45:41.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.328+0000 7f4d90ff9640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4d8007b270 0x7f4d8007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.329+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4d840bf810 con 0x7f4d940fe210 2024-09-21T10:45:41.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.329+0000 7f4d92ffd640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4d8007b270 0x7f4d8007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.329+0000 7f4d92ffd640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4d8007b270 0x7f4d8007d730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c005fd0 tx=0x7f4d7c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.333+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f4d84082800 con 0x7f4d940fe210 2024-09-21T10:45:41.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.531+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d9402c550 con 0x7f4d8007b270 2024-09-21T10:45:41.533 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:41 smithi060 ceph-mon[93270]: pgmap v99: 65 pgs: 6 active+undersized, 6 active+undersized+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21/222 objects degraded (9.459%) 2024-09-21T10:45:41.534 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:41 smithi060 ceph-mon[93270]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:41.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.541+0000 7f4d90ff9640 1 -- 172.21.15.60:0/2728613606 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4d9402c550 con 0x7f4d8007b270 2024-09-21T10:45:41.543 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:45:41.543 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (11m) 7s ago 13m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:45:41.543 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (4m) 7s ago 13m 8376k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:45:41.543 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (4m) 105s ago 12m 7365k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:45:41.543 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (113s) 7s ago 13m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (109s) 105s ago 12m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (11m) 7s ago 13m 86.6M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (7m) 7s ago 7m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (7m) 7s ago 7m 16.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (7m) 105s ago 7m 17.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (7m) 105s ago 7m 19.6M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (4m) 7s ago 14m 516M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (3m) 105s ago 12m 453M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (2m) 7s ago 15m 47.5M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (2m) 105s ago 12m 34.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (13m) 7s ago 13m 16.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (12m) 105s ago 12m 14.6M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (87s) 7s ago 11m 103M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (49s) 7s ago 10m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:45:41.544 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (12s) 7s ago 10m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:45:41.545 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (9m) 105s ago 9m 286M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 997cbc538bf4 2024-09-21T10:45:41.545 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (9m) 105s ago 9m 263M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:45:41.545 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (8m) 105s ago 8m 240M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:45:41.545 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (3m) 7s ago 13m 66.5M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:45:41.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4d8007b270 msgr2=0x7f4d8007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4d8007b270 0x7f4d8007d730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c005fd0 tx=0x7f4d7c005850 comp rx=0 tx=0).stop 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 msgr2=0x7f4d94195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d94195600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000c00 tx=0x7f4d84005de0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 shutdown_connections 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4d8007b270 0x7f4d8007d730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d940ff410 0x7f4d94195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 --2- 172.21.15.60:0/2728613606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d940fe210 0x7f4d94195600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 >> 172.21.15.60:0/2728613606 conn(0x7f4d940f99c0 msgr2=0x7f4d94102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 shutdown_connections 2024-09-21T10:45:41.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.543+0000 7f4d99d06640 1 -- 172.21.15.60:0/2728613606 wait complete. 2024-09-21T10:45:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 -- 172.21.15.60:0/2410191483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 msgr2=0x7f9abc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 --2- 172.21.15.60:0/2410191483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc102b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009880 tx=0x7f9aac02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 -- 172.21.15.60:0/2410191483 shutdown_connections 2024-09-21T10:45:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 --2- 172.21.15.60:0/2410191483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 0x7f9abc105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 --2- 172.21.15.60:0/2410191483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc102b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 -- 172.21.15.60:0/2410191483 >> 172.21.15.60:0/2410191483 conn(0x7f9abc0fa280 msgr2=0x7f9abc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 -- 172.21.15.60:0/2410191483 shutdown_connections 2024-09-21T10:45:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.626+0000 7f9ac1633640 1 -- 172.21.15.60:0/2410191483 wait complete. 2024-09-21T10:45:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9ac1633640 1 Processor -- start 2024-09-21T10:45:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9ac1633640 1 -- start start 2024-09-21T10:45:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9ac1633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc1000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9ac1633640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 0x7f9abc0fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9ac1633640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0fec30 con 0x7f9abc100740 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9ac1633640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0feda0 con 0x7f9abc103070 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9abaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc1000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9abaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc1000a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59928/0 (socket says 172.21.15.60:59928) 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9abaffd640 1 -- 172.21.15.60:0/3714846322 learned_addr learned my addr 172.21.15.60:0/3714846322 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.627+0000 7f9aba7fc640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 0x7f9abc0fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9abaffd640 1 -- 172.21.15.60:0/3714846322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 msgr2=0x7f9abc0fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9abaffd640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 0x7f9abc0fe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9abaffd640 1 -- 172.21.15.60:0/3714846322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac009560 con 0x7f9abc100740 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9aba7fc640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 0x7f9abc0fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9abaffd640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc1000a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005940 tx=0x7f9aac032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aac0037c0 con 0x7f9abc100740 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aac003de0 con 0x7f9abc100740 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aac03a3c0 con 0x7f9abc100740 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc0ff020 con 0x7f9abc100740 2024-09-21T10:45:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.628+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc0ff510 con 0x7f9abc100740 2024-09-21T10:45:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.629+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc100b20 con 0x7f9abc100740 2024-09-21T10:45:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.630+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9aac03b460 con 0x7f9abc100740 2024-09-21T10:45:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.631+0000 7f9aa3fff640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f9aa407b270 0x7f9aa407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.631+0000 7f9aba7fc640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f9aa407b270 0x7f9aa407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.631+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9aac0bf180 con 0x7f9abc100740 2024-09-21T10:45:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.631+0000 7f9aba7fc640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f9aa407b270 0x7f9aa407d730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0ffe20 tx=0x7f9ab0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.635+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f9aac082190 con 0x7f9abc100740 2024-09-21T10:45:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:41 smithi112 ceph-mon[78695]: pgmap v99: 65 pgs: 6 active+undersized, 6 active+undersized+degraded, 53 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21/222 objects degraded (9.459%) 2024-09-21T10:45:41.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:41 smithi112 ceph-mon[78695]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:41.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.899+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9abc19d740 con 0x7f9abc100740 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.899+0000 7f9aa3fff640 1 -- 172.21.15.60:0/3714846322 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f9aac0852b0 con 0x7f9abc100740 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:45:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 3, 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 7, 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 7 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:45:41.903 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.901+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f9aa407b270 msgr2=0x7f9aa407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.901+0000 7f9ac1633640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f9aa407b270 0x7f9aa407d730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0ffe20 tx=0x7f9ab0005f90 comp rx=0 tx=0).stop 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.901+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 msgr2=0x7f9abc1000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.901+0000 7f9ac1633640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc1000a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005940 tx=0x7f9aac032bb0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 shutdown_connections 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f9aa407b270 0x7f9aa407d730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9abc103070 0x7f9abc0fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 --2- 172.21.15.60:0/3714846322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9abc100740 0x7f9abc1000a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 >> 172.21.15.60:0/3714846322 conn(0x7f9abc0fa280 msgr2=0x7f9abc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 shutdown_connections 2024-09-21T10:45:41.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.902+0000 7f9ac1633640 1 -- 172.21.15.60:0/3714846322 wait complete. 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.984+0000 7f7b94f43640 1 -- 172.21.15.60:0/2937637031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b90101b80 msgr2=0x7f7b900fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.984+0000 7f7b94f43640 1 --2- 172.21.15.60:0/2937637031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b90101b80 0x7f7b900fdc30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009880 tx=0x7f7b8402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 -- 172.21.15.60:0/2937637031 shutdown_connections 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 --2- 172.21.15.60:0/2937637031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b90101b80 0x7f7b900fdc30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 --2- 172.21.15.60:0/2937637031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b901011b0 0x7f7b901015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 -- 172.21.15.60:0/2937637031 >> 172.21.15.60:0/2937637031 conn(0x7f7b900f99c0 msgr2=0x7f7b900fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 -- 172.21.15.60:0/2937637031 shutdown_connections 2024-09-21T10:45:41.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 -- 172.21.15.60:0/2937637031 wait complete. 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 Processor -- start 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.985+0000 7f7b94f43640 1 -- start start 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b94f43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 0x7f7b901978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b94f43640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b90101b80 0x7f7b90197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b94f43640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b901983c0 con 0x7f7b901011b0 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b94f43640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90198530 con 0x7f7b90101b80 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 0x7f7b901978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 0x7f7b901978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59944/0 (socket says 172.21.15.60:59944) 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 -- 172.21.15.60:0/3575812188 learned_addr learned my addr 172.21.15.60:0/3575812188 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8dd9b640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b90101b80 0x7f7b90197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 -- 172.21.15.60:0/3575812188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b90101b80 msgr2=0x7f7b90197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b90101b80 0x7f7b90197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:41.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 -- 172.21.15.60:0/3575812188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84009560 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b8e59c640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 0x7f7b901978b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000d720 tx=0x7f7b8000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.986+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b800041f0 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.987+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b80004350 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.987+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9019cf80 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.987+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b80003df0 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.987+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9019d4c0 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.988+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b901015b0 con 0x7f7b901011b0 2024-09-21T10:45:41.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.988+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f7b800035f0 con 0x7f7b901011b0 2024-09-21T10:45:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.989+0000 7f7b7f7fe640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7b7807b220 0x7f7b7807d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.989+0000 7f7b8dd9b640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7b7807b220 0x7f7b7807d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.989+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7b8009dd20 con 0x7f7b901011b0 2024-09-21T10:45:41.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.990+0000 7f7b8dd9b640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7b7807b220 0x7f7b7807d6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009230 tx=0x7f7b840314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:41.993+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f7b80060de0 con 0x7f7b901011b0 2024-09-21T10:45:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.219+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b9002c4d0 con 0x7f7b901011b0 2024-09-21T10:45:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.219+0000 7f7b7f7fe640 1 -- 172.21.15.60:0/3575812188 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f7b80063f00 con 0x7f7b901011b0 2024-09-21T10:45:42.221 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:45:42.221 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:45:42.221 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:45:42.222 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:45:42.223 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:42.224 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7b7807b220 msgr2=0x7f7b7807d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7b7807b220 0x7f7b7807d6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009230 tx=0x7f7b840314e0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 msgr2=0x7f7b901978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 0x7f7b901978b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000d720 tx=0x7f7b8000dbe0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 shutdown_connections 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7b7807b220 0x7f7b7807d6e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b90101b80 0x7f7b90197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 --2- 172.21.15.60:0/3575812188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b901011b0 0x7f7b901978b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 >> 172.21.15.60:0/3575812188 conn(0x7f7b900f99c0 msgr2=0x7f7b900ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.221+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 shutdown_connections 2024-09-21T10:45:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.222+0000 7f7b94f43640 1 -- 172.21.15.60:0/3575812188 wait complete. 2024-09-21T10:45:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 -- 172.21.15.60:0/26349537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 msgr2=0x7fe274101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 --2- 172.21.15.60:0/26349537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274101210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009880 tx=0x7fe25c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 -- 172.21.15.60:0/26349537 shutdown_connections 2024-09-21T10:45:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 --2- 172.21.15.60:0/26349537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274101210 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 --2- 172.21.15.60:0/26349537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 0x7fe2740fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 -- 172.21.15.60:0/26349537 >> 172.21.15.60:0/26349537 conn(0x7fe2740fb320 msgr2=0x7fe2740fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 -- 172.21.15.60:0/26349537 shutdown_connections 2024-09-21T10:45:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.306+0000 7fe278b59640 1 -- 172.21.15.60:0/26349537 wait complete. 2024-09-21T10:45:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe278b59640 1 Processor -- start 2024-09-21T10:45:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe278b59640 1 -- start start 2024-09-21T10:45:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe278b59640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 0x7fe274195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe278b59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe278b59640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274196140 con 0x7fe274100d90 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe278b59640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741962b0 con 0x7fe2740ffb90 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe271d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe271d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59960/0 (socket says 172.21.15.60:59960) 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe271d9b640 1 -- 172.21.15.60:0/3519660484 learned_addr learned my addr 172.21.15.60:0/3519660484 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe27259c640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 0x7fe274195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe271d9b640 1 -- 172.21.15.60:0/3519660484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 msgr2=0x7fe274195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.307+0000 7fe271d9b640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 0x7fe274195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe271d9b640 1 -- 172.21.15.60:0/3519660484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c009560 con 0x7fe274100d90 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe27259c640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 0x7fe274195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe271d9b640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274195b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe25c005520 tx=0x7fe25c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c004aa0 con 0x7fe274100d90 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe25c004c00 con 0x7fe274100d90 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27419acf0 con 0x7fe274100d90 2024-09-21T10:45:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c003b10 con 0x7fe274100d90 2024-09-21T10:45:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.308+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27419b260 con 0x7fe274100d90 2024-09-21T10:45:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.309+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27418f730 con 0x7fe274100d90 2024-09-21T10:45:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.310+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe25c031d20 con 0x7fe274100d90 2024-09-21T10:45:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.310+0000 7fe26b7fe640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe26007b270 0x7fe26007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.310+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe25c0bf570 con 0x7fe274100d90 2024-09-21T10:45:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.310+0000 7fe27259c640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe26007b270 0x7fe26007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.311+0000 7fe27259c640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe26007b270 0x7fe26007d730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe274100bf0 tx=0x7fe264005e70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.314+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fe25c082580 con 0x7fe274100d90 2024-09-21T10:45:42.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.523+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe27402c4f0 con 0x7fe26007b270 2024-09-21T10:45:42.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:42 smithi060 ceph-mon[93270]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:42.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:42 smithi060 ceph-mon[93270]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:42.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:42 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3714846322' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:42.525 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:42 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3575812188' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:45:42.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.524+0000 7fe26b7fe640 1 -- 172.21.15.60:0/3519660484 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe27402c4f0 con 0x7fe26007b270 2024-09-21T10:45:42.526 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:45:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "9/23 daemons upgraded", 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:45:42.527 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.527+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe26007b270 msgr2=0x7fe26007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.527+0000 7fe278b59640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe26007b270 0x7fe26007d730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe274100bf0 tx=0x7fe264005e70 comp rx=0 tx=0).stop 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.527+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 msgr2=0x7fe274195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.527+0000 7fe278b59640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274195b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe25c005520 tx=0x7fe25c005550 comp rx=0 tx=0).stop 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.527+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 shutdown_connections 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.527+0000 7fe278b59640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe26007b270 0x7fe26007d730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.528+0000 7fe278b59640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe274100d90 0x7fe274195b70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.528+0000 7fe278b59640 1 --2- 172.21.15.60:0/3519660484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2740ffb90 0x7fe274195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.528+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 >> 172.21.15.60:0/3519660484 conn(0x7fe2740fb320 msgr2=0x7fe274104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.528+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 shutdown_connections 2024-09-21T10:45:42.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.528+0000 7fe278b59640 1 -- 172.21.15.60:0/3519660484 wait complete. 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.611+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1393142329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00ffca0 msgr2=0x7fdcc0100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.611+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1393142329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00ffca0 0x7fdcc0100120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009880 tx=0x7fdcb402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1393142329 shutdown_connections 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1393142329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00ffca0 0x7fdcc0100120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1393142329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc00feaa0 0x7fdcc00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1393142329 >> 172.21.15.60:0/1393142329 conn(0x7fdcc00fa250 msgr2=0x7fdcc00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1393142329 shutdown_connections 2024-09-21T10:45:42.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1393142329 wait complete. 2024-09-21T10:45:42.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 Processor -- start 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.612+0000 7fdcc52c8640 1 -- start start 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcc52c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 0x7fdcc0195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcc52c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc00ffca0 0x7fdcc0195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcc52c8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0196160 con 0x7fdcc00feaa0 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcc52c8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc01962d0 con 0x7fdcc00ffca0 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 0x7fdcc0195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 0x7fdcc0195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59978/0 (socket says 172.21.15.60:59978) 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 -- 172.21.15.60:0/1839047746 learned_addr learned my addr 172.21.15.60:0/1839047746 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbe7fc640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc00ffca0 0x7fdcc0195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 -- 172.21.15.60:0/1839047746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc00ffca0 msgr2=0x7fdcc0195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc00ffca0 0x7fdcc0195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 -- 172.21.15.60:0/1839047746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009560 con 0x7fdcc00feaa0 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcbeffd640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 0x7fdcc0195650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000d900 tx=0x7fdcb000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcb0009c00 con 0x7fdcc00feaa0 2024-09-21T10:45:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc019ad20 con 0x7fdcc00feaa0 2024-09-21T10:45:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.613+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcb0009d60 con 0x7fdcc00feaa0 2024-09-21T10:45:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.614+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcb000f660 con 0x7fdcc00feaa0 2024-09-21T10:45:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.614+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc019b260 con 0x7fdcc00feaa0 2024-09-21T10:45:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.615+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc01076b0 con 0x7fdcc00feaa0 2024-09-21T10:45:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.615+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fdcb0010460 con 0x7fdcc00feaa0 2024-09-21T10:45:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.616+0000 7fdca7fff640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdca807b270 0x7fdca807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:45:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.616+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdcb009e1c0 con 0x7fdcc00feaa0 2024-09-21T10:45:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.616+0000 7fdcbe7fc640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdca807b270 0x7fdca807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:45:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.616+0000 7fdcbe7fc640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdca807b270 0x7fdca807d730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000c00 tx=0x7fdcb40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:45:42.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.620+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdcb00611e0 con 0x7fdcc00feaa0 2024-09-21T10:45:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:42 smithi112 ceph-mon[78695]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:42 smithi112 ceph-mon[78695]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:42 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3714846322' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:45:42.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:42 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3575812188' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:45:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.884+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdcc019b780 con 0x7fdcc00feaa0 2024-09-21T10:45:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.885+0000 7fdca7fff640 1 -- 172.21.15.60:0/1839047746 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdcb0064300 con 0x7fdcc00feaa0 2024-09-21T10:45:42.887 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:45:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdca807b270 msgr2=0x7fdca807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdca807b270 0x7fdca807d730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000c00 tx=0x7fdcb40314e0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 msgr2=0x7fdcc0195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:45:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 0x7fdcc0195650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000d900 tx=0x7fdcb000ddc0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 shutdown_connections 2024-09-21T10:45:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdca807b270 0x7fdca807d730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcc00ffca0 0x7fdcc0195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 --2- 172.21.15.60:0/1839047746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc00feaa0 0x7fdcc0195650 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:45:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 >> 172.21.15.60:0/1839047746 conn(0x7fdcc00fa250 msgr2=0x7fdcc00fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:45:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 shutdown_connections 2024-09-21T10:45:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:45:42.888+0000 7fdcc52c8640 1 -- 172.21.15.60:0/1839047746 wait complete. 2024-09-21T10:45:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:43 smithi060 ceph-mon[93270]: pgmap v100: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:43 smithi060 ceph-mon[93270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/222 objects degraded (9.459%), 6 pgs degraded) 2024-09-21T10:45:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:43 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:45:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:43 smithi060 ceph-mon[93270]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:43.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:43 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1839047746' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:45:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:43 smithi112 ceph-mon[78695]: pgmap v100: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:43 smithi112 ceph-mon[78695]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/222 objects degraded (9.459%), 6 pgs degraded) 2024-09-21T10:45:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:43 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:45:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:43 smithi112 ceph-mon[78695]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:45:43.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:43 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1839047746' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:45:45.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:45.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:45.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:45.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:45 smithi060 ceph-mon[93270]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:46.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:45 smithi112 ceph-mon[78695]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:48.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:47 smithi060 ceph-mon[93270]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:48.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:47 smithi112 ceph-mon[78695]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:50.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:49 smithi060 ceph-mon[93270]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:50.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:50.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:49 smithi112 ceph-mon[78695]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:50.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:52.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:51 smithi060 ceph-mon[93270]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:52.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:51 smithi112 ceph-mon[78695]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:53 smithi112 ceph-mon[78695]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:53 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T10:45:53.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:53 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T10:45:53.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:53 smithi112 ceph-mon[78695]: Upgrade: osd.3 is safe to restart 2024-09-21T10:45:54.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:53 smithi060 ceph-mon[93270]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:54.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:53 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T10:45:54.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:53 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T10:45:54.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:53 smithi060 ceph-mon[93270]: Upgrade: osd.3 is safe to restart 2024-09-21T10:45:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:55 smithi112 ceph-mon[78695]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:55 smithi112 ceph-mon[78695]: Upgrade: Updating osd.3 2024-09-21T10:45:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T10:45:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:55.669 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:55 smithi112 ceph-mon[78695]: Deploying daemon osd.3 on smithi112 2024-09-21T10:45:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:55 smithi060 ceph-mon[93270]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:55 smithi060 ceph-mon[93270]: Upgrade: Updating osd.3 2024-09-21T10:45:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T10:45:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:45:55.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:55 smithi060 ceph-mon[93270]: Deploying daemon osd.3 on smithi112 2024-09-21T10:45:57.396 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:57 smithi112 ceph-mon[78695]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:57.396 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:57 smithi112 systemd[1]: Stopping Ceph osd.3 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:45:57.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:57 smithi060 ceph-mon[93270]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:57.950 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:57 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[41028]: 2024-09-21T10:45:57.588+0000 7fcb2c696640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:45:57.950 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:57 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[41028]: 2024-09-21T10:45:57.588+0000 7fcb2c696640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-21T10:45:57.950 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:57 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[41028]: 2024-09-21T10:45:57.588+0000 7fcb2c696640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:45:58.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:58 smithi060 ceph-mon[93270]: osd.3 marked itself down and dead 2024-09-21T10:45:58.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:58 smithi112 ceph-mon[78695]: osd.3 marked itself down and dead 2024-09-21T10:45:59.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:58 smithi112 podman[87349]: 2024-09-21 10:45:58.897664686 +0000 UTC m=+1.434631125 container died 997cbc538bf4efacb24181b4aa638f29a3e499e42a0745c9487624f15db3530d (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-6a1bdf8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T10:45:59.542 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:59 smithi112 ceph-mon[78695]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:59.542 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:59 smithi112 ceph-mon[78695]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:45:59.542 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:59 smithi112 ceph-mon[78695]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T10:45:59.542 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:59.543 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:45:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:59.543 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:59 smithi112 podman[87349]: 2024-09-21 10:45:59.332089113 +0000 UTC m=+1.869055558 container cleanup 997cbc538bf4efacb24181b4aa638f29a3e499e42a0745c9487624f15db3530d (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=reef-6a1bdf8, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-21T10:45:59.543 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:59 smithi112 bash[87349]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3 2024-09-21T10:45:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:59 smithi060 ceph-mon[93270]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:45:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:59 smithi060 ceph-mon[93270]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:45:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:59 smithi060 ceph-mon[93270]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T10:45:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:45:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:45:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:45:59.943 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:59 smithi112 podman[87367]: 2024-09-21 10:45:59.540702065 +0000 UTC m=+0.634297888 container remove 997cbc538bf4efacb24181b4aa638f29a3e499e42a0745c9487624f15db3530d (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, RELEASE=reef-6a1bdf8, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T10:46:00.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:59 smithi112 podman[87455]: 2024-09-21 10:45:59.941567589 +0000 UTC m=+0.107860003 container create 0207c7b7cca064b096fd6c28a6bf9f73df37982c691c1fd42da8125f72ea750a (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:46:00.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:45:59 smithi112 podman[87455]: 2024-09-21 10:45:59.849425499 +0000 UTC m=+0.015717919 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:46:00.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 podman[87455]: 2024-09-21 10:46:00.169861637 +0000 UTC m=+0.336154051 container init 0207c7b7cca064b096fd6c28a6bf9f73df37982c691c1fd42da8125f72ea750a (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:46:00.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 podman[87455]: 2024-09-21 10:46:00.173452479 +0000 UTC m=+0.339744892 container start 0207c7b7cca064b096fd6c28a6bf9f73df37982c691c1fd42da8125f72ea750a (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T10:46:00.632 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:00 smithi112 ceph-mon[78695]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T10:46:00.633 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 podman[87455]: 2024-09-21 10:46:00.2611855 +0000 UTC m=+0.427477924 container attach 0207c7b7cca064b096fd6c28a6bf9f73df37982c691c1fd42da8125f72ea750a (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:00.633 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 podman[87455]: 2024-09-21 10:46:00.35997448 +0000 UTC m=+0.526266898 container died 0207c7b7cca064b096fd6c28a6bf9f73df37982c691c1fd42da8125f72ea750a (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:46:00.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:00 smithi060 ceph-mon[93270]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T10:46:01.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 podman[87478]: 2024-09-21 10:46:00.923727856 +0000 UTC m=+0.554086436 container remove 0207c7b7cca064b096fd6c28a6bf9f73df37982c691c1fd42da8125f72ea750a (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:01.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T10:46:01.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 systemd[1]: Stopped Ceph osd.3 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:46:01.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:00 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.3.service: Consumed 1min 11.612s CPU time. 2024-09-21T10:46:01.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 systemd[1]: Starting Ceph osd.3 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:46:01.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:01 smithi112 ceph-mon[78695]: pgmap v111: 65 pgs: 25 peering, 3 stale+active+clean, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:01.645 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:01 smithi112 ceph-mon[78695]: Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2024-09-21T10:46:01.646 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 podman[87577]: 2024-09-21 10:46:01.266016347 +0000 UTC m=+0.015975917 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:46:01.646 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 podman[87577]: 2024-09-21 10:46:01.399841493 +0000 UTC m=+0.149801092 container create 0b5399435d422cc40cbe2dd009909f2a1baabbb802d9fa1a8943df7a208be48c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:01.646 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 podman[87577]: 2024-09-21 10:46:01.644135634 +0000 UTC m=+0.394095191 container init 0b5399435d422cc40cbe2dd009909f2a1baabbb802d9fa1a8943df7a208be48c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T10:46:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:01 smithi060 ceph-mon[93270]: pgmap v111: 65 pgs: 25 peering, 3 stale+active+clean, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:01 smithi060 ceph-mon[93270]: Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2024-09-21T10:46:01.951 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 podman[87577]: 2024-09-21 10:46:01.647483817 +0000 UTC m=+0.397443377 container start 0b5399435d422cc40cbe2dd009909f2a1baabbb802d9fa1a8943df7a208be48c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T10:46:01.951 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 podman[87577]: 2024-09-21 10:46:01.719114718 +0000 UTC m=+0.469074289 container attach 0b5399435d422cc40cbe2dd009909f2a1baabbb802d9fa1a8943df7a208be48c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T10:46:01.951 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:01.951 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 bash[87577]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:01.951 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:01.951 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:01 smithi112 bash[87577]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:02.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:02 smithi060 ceph-mon[93270]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:02 smithi112 ceph-mon[78695]: Health check failed: Degraded data redundancy: 18/222 objects degraded (8.108%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:03.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:03 smithi060 ceph-mon[93270]: pgmap v112: 65 pgs: 6 active+undersized, 25 peering, 7 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-09-21T10:46:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:03 smithi112 ceph-mon[78695]: pgmap v112: 65 pgs: 6 active+undersized, 25 peering, 7 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18/222 objects degraded (8.108%) 2024-09-21T10:46:04.938 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-mon[78695]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs peering) 2024-09-21T10:46:04.938 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T10:46:04.939 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T10:46:04.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:04 smithi060 ceph-mon[93270]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs peering) 2024-09-21T10:46:05.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate[87592]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 bash[87577]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T10:46:05.201 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:04 smithi112 podman[87577]: 2024-09-21 10:46:04.965293524 +0000 UTC m=+3.715253094 container died 0b5399435d422cc40cbe2dd009909f2a1baabbb802d9fa1a8943df7a208be48c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:05.558 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:05 smithi112 ceph-mon[78695]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:05.889 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:05 smithi112 podman[87790]: 2024-09-21 10:46:05.556215742 +0000 UTC m=+0.581177051 container remove 0b5399435d422cc40cbe2dd009909f2a1baabbb802d9fa1a8943df7a208be48c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-activate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:05.889 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:05 smithi112 podman[87849]: 2024-09-21 10:46:05.667283903 +0000 UTC m=+0.015629520 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:46:05.889 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:05 smithi112 podman[87849]: 2024-09-21 10:46:05.782200337 +0000 UTC m=+0.130545955 container create 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:46:05.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:05 smithi060 ceph-mon[93270]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:06.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:06 smithi112 podman[87849]: 2024-09-21 10:46:06.001281326 +0000 UTC m=+0.349626947 container init 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T10:46:06.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:06 smithi112 podman[87849]: 2024-09-21 10:46:06.00465926 +0000 UTC m=+0.353004878 container start 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:46:06.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:06 smithi112 ceph-osd[87869]: -- 172.21.15.112:0/303339552 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55616d6821e0 con 0x55616d612000 2024-09-21T10:46:06.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:06 smithi112 bash[87849]: 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 2024-09-21T10:46:06.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:06 smithi112 systemd[1]: Started Ceph osd.3 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:46:07.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:07.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:07.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:07.419 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:07 smithi112 ceph-mon[78695]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:07 smithi060 ceph-mon[93270]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:07.700 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:07 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:46:07.664+0000 7f2ef92e1640 -1 Falling back to public interface 2024-09-21T10:46:10.126 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:09 smithi112 ceph-mon[78695]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:10.126 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:09 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.127 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:09 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.127 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:09 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.127 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:09 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:09 smithi060 ceph-mon[93270]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:09 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:09 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:09 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:09 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:11.040 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:10 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:11.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:10 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:12.157 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:11 smithi112 ceph-mon[78695]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:12.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:11 smithi060 ceph-mon[93270]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 -- 172.21.15.60:0/2648419658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 msgr2=0x7facdc0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 --2- 172.21.15.60:0/2648419658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc0feea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7facd8009880 tx=0x7facd802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 -- 172.21.15.60:0/2648419658 shutdown_connections 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 --2- 172.21.15.60:0/2648419658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facdc0ffca0 0x7facdc100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 --2- 172.21.15.60:0/2648419658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc0feea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 -- 172.21.15.60:0/2648419658 >> 172.21.15.60:0/2648419658 conn(0x7facdc0fa250 msgr2=0x7facdc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 -- 172.21.15.60:0/2648419658 shutdown_connections 2024-09-21T10:46:12.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.981+0000 7face34eb640 1 -- 172.21.15.60:0/2648419658 wait complete. 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face34eb640 1 Processor -- start 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face34eb640 1 -- start start 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face34eb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face34eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facdc0ffca0 0x7facdc195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face34eb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1961a0 con 0x7facdc0feaa0 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face34eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc196310 con 0x7facdc0ffca0 2024-09-21T10:46:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face1287640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face1287640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38358/0 (socket says 172.21.15.60:38358) 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face1287640 1 -- 172.21.15.60:0/3952019325 learned_addr learned my addr 172.21.15.60:0/3952019325 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.982+0000 7face0a86640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facdc0ffca0 0x7facdc195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7face1287640 1 -- 172.21.15.60:0/3952019325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facdc0ffca0 msgr2=0x7facdc195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7face1287640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facdc0ffca0 0x7facdc195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7face1287640 1 -- 172.21.15.60:0/3952019325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8009560 con 0x7facdc0feaa0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7face1287640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc195690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facd802a9c0 tx=0x7facd80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd8004aa0 con 0x7facdc0feaa0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc19ad50 con 0x7facdc0feaa0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facd8005d50 con 0x7facdc0feaa0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd80039e0 con 0x7facdc0feaa0 2024-09-21T10:46:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.983+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc19b260 con 0x7facdc0feaa0 2024-09-21T10:46:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.984+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc1076b0 con 0x7facdc0feaa0 2024-09-21T10:46:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.985+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7facd8031c00 con 0x7facdc0feaa0 2024-09-21T10:46:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.985+0000 7facd27fc640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7facc807b270 0x7facc807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.986+0000 7face0a86640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7facc807b270 0x7facc807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.986+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7facd80bf2e0 con 0x7facdc0feaa0 2024-09-21T10:46:12.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.986+0000 7face0a86640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7facc807b270 0x7facc807d730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7facdc196bb0 tx=0x7faccc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:12.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:12.990+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7facd80823a0 con 0x7facdc0feaa0 2024-09-21T10:46:13.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.196+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7facdc068bf0 con 0x7facc807b270 2024-09-21T10:46:13.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.197+0000 7facd27fc640 1 -- 172.21.15.60:0/3952019325 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7facdc068bf0 con 0x7facc807b270 2024-09-21T10:46:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.199+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7facc807b270 msgr2=0x7facc807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7facc807b270 0x7facc807d730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7facdc196bb0 tx=0x7faccc005f90 comp rx=0 tx=0).stop 2024-09-21T10:46:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 msgr2=0x7facdc195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc195690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facd802a9c0 tx=0x7facd80055a0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 shutdown_connections 2024-09-21T10:46:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7facc807b270 0x7facc807d730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7facdc0ffca0 0x7facdc195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 --2- 172.21.15.60:0/3952019325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facdc0feaa0 0x7facdc195690 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 >> 172.21.15.60:0/3952019325 conn(0x7facdc0fa250 msgr2=0x7facdc0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 shutdown_connections 2024-09-21T10:46:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.200+0000 7face34eb640 1 -- 172.21.15.60:0/3952019325 wait complete. 2024-09-21T10:46:13.211 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.284+0000 7f2b5909e640 1 -- 172.21.15.60:0/3986144112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 msgr2=0x7f2b540feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.284+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3986144112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b540feef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009880 tx=0x7f2b4402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.284+0000 7f2b5909e640 1 -- 172.21.15.60:0/3986144112 shutdown_connections 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.284+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3986144112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 0x7f2b54100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.284+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3986144112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b540feef0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.284+0000 7f2b5909e640 1 -- 172.21.15.60:0/3986144112 >> 172.21.15.60:0/3986144112 conn(0x7f2b540fa280 msgr2=0x7f2b540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.285+0000 7f2b5909e640 1 -- 172.21.15.60:0/3986144112 shutdown_connections 2024-09-21T10:46:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.285+0000 7f2b5909e640 1 -- 172.21.15.60:0/3986144112 wait complete. 2024-09-21T10:46:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.285+0000 7f2b5909e640 1 Processor -- start 2024-09-21T10:46:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.285+0000 7f2b5909e640 1 -- start start 2024-09-21T10:46:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5909e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b54197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5909e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 0x7f2b54197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5909e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54198390 con 0x7f2b540feaf0 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5909e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54198500 con 0x7f2b540ffcf0 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b52d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b54197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 0x7f2b54197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b52d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b54197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38370/0 (socket says 172.21.15.60:38370) 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b52d9d640 1 -- 172.21.15.60:0/3858552778 learned_addr learned my addr 172.21.15.60:0/3858552778 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5259c640 1 -- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 msgr2=0x7f2b54197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5259c640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b54197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5259c640 1 -- 172.21.15.60:0/3858552778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009560 con 0x7f2b540ffcf0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.286+0000 7f2b5259c640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 0x7f2b54197dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c005fd0 tx=0x7f2b3c00dd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.287+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b3c009a30 con 0x7f2b540ffcf0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.287+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b3c0044f0 con 0x7f2b540ffcf0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.287+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5419cfa0 con 0x7f2b540ffcf0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.287+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b3c003e40 con 0x7f2b540ffcf0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.287+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5419d4c0 con 0x7f2b540ffcf0 2024-09-21T10:46:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.288+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b541076e0 con 0x7f2b540ffcf0 2024-09-21T10:46:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.289+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2b3c009b90 con 0x7f2b540ffcf0 2024-09-21T10:46:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.289+0000 7f2b4bfff640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b4007b220 0x7f2b4007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.289+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2b3c09dbf0 con 0x7f2b540ffcf0 2024-09-21T10:46:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.289+0000 7f2b52d9d640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b4007b220 0x7f2b4007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.290+0000 7f2b52d9d640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b4007b220 0x7f2b4007d6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b440314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.293+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2b3c060d10 con 0x7f2b540ffcf0 2024-09-21T10:46:13.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.498+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b540fc430 con 0x7f2b4007b220 2024-09-21T10:46:13.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.500+0000 7f2b4bfff640 1 -- 172.21.15.60:0/3858552778 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2b540fc430 con 0x7f2b4007b220 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b4007b220 msgr2=0x7f2b4007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b4007b220 0x7f2b4007d6e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b440314e0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 msgr2=0x7f2b54197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 0x7f2b54197dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c005fd0 tx=0x7f2b3c00dd60 comp rx=0 tx=0).stop 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 shutdown_connections 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b4007b220 0x7f2b4007d6e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b540ffcf0 0x7f2b54197dc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 --2- 172.21.15.60:0/3858552778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b540feaf0 0x7f2b54197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 >> 172.21.15.60:0/3858552778 conn(0x7f2b540fa280 msgr2=0x7f2b540fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:13.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 shutdown_connections 2024-09-21T10:46:13.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.502+0000 7f2b5909e640 1 -- 172.21.15.60:0/3858552778 wait complete. 2024-09-21T10:46:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 -- 172.21.15.60:0/1347056241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 msgr2=0x7f380c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 --2- 172.21.15.60:0/1347056241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c100120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009880 tx=0x7f37fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 -- 172.21.15.60:0/1347056241 shutdown_connections 2024-09-21T10:46:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 --2- 172.21.15.60:0/1347056241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c100120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 --2- 172.21.15.60:0/1347056241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 0x7f380c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 -- 172.21.15.60:0/1347056241 >> 172.21.15.60:0/1347056241 conn(0x7f380c0fa250 msgr2=0x7f380c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 -- 172.21.15.60:0/1347056241 shutdown_connections 2024-09-21T10:46:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.587+0000 7f38136e7640 1 -- 172.21.15.60:0/1347056241 wait complete. 2024-09-21T10:46:13.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:13.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:13.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:13.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:46:13.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:46:13.590 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T10:46:13.591 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:13 smithi060 ceph-mon[93270]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.588+0000 7f38136e7640 1 Processor -- start 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.588+0000 7f38136e7640 1 -- start start 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.588+0000 7f38136e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 0x7f380c1944c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.588+0000 7f38136e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c194a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.588+0000 7f38136e7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c194fd0 con 0x7f380c0ffca0 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.588+0000 7f38136e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c195140 con 0x7f380c0feaa0 2024-09-21T10:46:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c194a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3811483640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 0x7f380c1944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c194a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38392/0 (socket says 172.21.15.60:38392) 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3811483640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 0x7f380c1944c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.60:52832/0 (socket says 172.21.15.60:52832) 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 -- 172.21.15.60:0/1040294100 learned_addr learned my addr 172.21.15.60:0/1040294100 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 -- 172.21.15.60:0/1040294100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 msgr2=0x7f380c1944c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 0x7f380c1944c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 -- 172.21.15.60:0/1040294100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc009560 con 0x7f380c0ffca0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f3810c82640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c194a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37fc005520 tx=0x7f37fc005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37fc004aa0 con 0x7f380c0ffca0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c199b80 con 0x7f380c0ffca0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37fc004c00 con 0x7f380c0ffca0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37fc003b10 con 0x7f380c0ffca0 2024-09-21T10:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.589+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c19a070 con 0x7f380c0ffca0 2024-09-21T10:46:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.590+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c18e620 con 0x7f380c0ffca0 2024-09-21T10:46:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.592+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f37fc003c70 con 0x7f380c0ffca0 2024-09-21T10:46:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.592+0000 7f38027fc640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f37f807b270 0x7f37f807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.592+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f37fc0bf3e0 con 0x7f380c0ffca0 2024-09-21T10:46:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.592+0000 7f3811483640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f37f807b270 0x7f37f807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.593+0000 7f3811483640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f37f807b270 0x7f37f807d730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f380c0ffb00 tx=0x7f3808009720 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.597+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f37fc082580 con 0x7f380c0ffca0 2024-09-21T10:46:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.794+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f380c02c450 con 0x7f37f807b270 2024-09-21T10:46:13.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.803+0000 7f38027fc640 1 -- 172.21.15.60:0/1040294100 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f380c02c450 con 0x7f37f807b270 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (12m) 39s ago 14m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (5m) 39s ago 14m 8376k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (4m) 4s ago 13m 7600k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (2m) 39s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (2m) 4s ago 13m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (12m) 39s ago 13m 86.6M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (7m) 39s ago 7m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (7m) 39s ago 7m 16.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (7m) 4s ago 7m 18.3M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:46:13.806 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (7m) 4s ago 7m 20.5M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (4m) 39s ago 15m 516M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (3m) 4s ago 13m 454M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (3m) 39s ago 15m 47.5M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (3m) 4s ago 13m 39.2M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (14m) 39s ago 14m 16.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (13m) 4s ago 13m 15.3M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (119s) 39s ago 11m 103M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (81s) 39s ago 11m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (45s) 39s ago 10m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (8s) 4s ago 10m 12.0M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (9m) 4s ago 9m 264M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 89d6a82e0b67 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (9m) 4s ago 9m 241M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:46:13.807 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (3m) 39s ago 13m 66.5M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:46:13.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f37f807b270 msgr2=0x7f37f807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f37f807b270 0x7f37f807d730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f380c0ffb00 tx=0x7f3808009720 comp rx=0 tx=0).stop 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 msgr2=0x7f380c194a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c194a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37fc005520 tx=0x7f37fc005550 comp rx=0 tx=0).stop 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 shutdown_connections 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f37f807b270 0x7f37f807d730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f380c0ffca0 0x7f380c194a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 --2- 172.21.15.60:0/1040294100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f380c0feaa0 0x7f380c1944c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 >> 172.21.15.60:0/1040294100 conn(0x7f380c0fa250 msgr2=0x7f380c103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 shutdown_connections 2024-09-21T10:46:13.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.806+0000 7f38136e7640 1 -- 172.21.15.60:0/1040294100 wait complete. 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:13.861 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:13.862 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T10:46:13.862 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T10:46:13.862 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-mon[78695]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 -- 172.21.15.60:0/3065857477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 msgr2=0x7f1450101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 --2- 172.21.15.60:0/3065857477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450101210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1444009c20 tx=0x7f144402a970 comp rx=0 tx=0).stop 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 -- 172.21.15.60:0/3065857477 shutdown_connections 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 --2- 172.21.15.60:0/3065857477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450101210 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 --2- 172.21.15.60:0/3065857477 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14500ffb90 0x7f14500fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 -- 172.21.15.60:0/3065857477 >> 172.21.15.60:0/3065857477 conn(0x7f14500fb320 msgr2=0x7f14500fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 -- 172.21.15.60:0/3065857477 shutdown_connections 2024-09-21T10:46:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.890+0000 7f1457e48640 1 -- 172.21.15.60:0/3065857477 wait complete. 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1457e48640 1 Processor -- start 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1457e48640 1 -- start start 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1457e48640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14500ffb90 0x7f1450195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1457e48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1457e48640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1450196240 con 0x7f1450100d90 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1457e48640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14501963b0 con 0x7f14500ffb90 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f14553e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f14553e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38410/0 (socket says 172.21.15.60:38410) 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f14553e3640 1 -- 172.21.15.60:0/2960428271 learned_addr learned my addr 172.21.15.60:0/2960428271 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.891+0000 7f1455be4640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14500ffb90 0x7f1450195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f14553e3640 1 -- 172.21.15.60:0/2960428271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14500ffb90 msgr2=0x7f1450195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f14553e3640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14500ffb90 0x7f1450195730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f14553e3640 1 -- 172.21.15.60:0/2960428271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444009900 con 0x7f1450100d90 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f14553e3640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450195c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1444009d40 tx=0x7f144402f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1444030840 con 0x7f1450100d90 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145019adf0 con 0x7f1450100d90 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1444004040 con 0x7f1450100d90 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f144403a640 con 0x7f1450100d90 2024-09-21T10:46:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.892+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145019b330 con 0x7f1450100d90 2024-09-21T10:46:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.894+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1450100010 con 0x7f1450100d90 2024-09-21T10:46:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.894+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f144400a040 con 0x7f1450100d90 2024-09-21T10:46:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.895+0000 7f144effd640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f143807b270 0x7f143807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.895+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f144402c040 con 0x7f1450100d90 2024-09-21T10:46:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.895+0000 7f1455be4640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f143807b270 0x7f143807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.895+0000 7f1455be4640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f143807b270 0x7f143807d730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1450100bf0 tx=0x7f1448009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:13.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:13.899+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1444082b30 con 0x7f1450100d90 2024-09-21T10:46:14.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.161+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1450108820 con 0x7f1450100d90 2024-09-21T10:46:14.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.162+0000 7f144effd640 1 -- 172.21.15.60:0/2960428271 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f1444085c50 con 0x7f1450100d90 2024-09-21T10:46:14.164 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2, 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:14.165 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:46:14.166 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 6, 2024-09-21T10:46:14.166 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 7 2024-09-21T10:46:14.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:46:14.166 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f143807b270 msgr2=0x7f143807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f143807b270 0x7f143807d730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1450100bf0 tx=0x7f1448009110 comp rx=0 tx=0).stop 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 msgr2=0x7f1450195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450195c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1444009d40 tx=0x7f144402f730 comp rx=0 tx=0).stop 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 shutdown_connections 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f143807b270 0x7f143807d730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1450100d90 0x7f1450195c70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 --2- 172.21.15.60:0/2960428271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14500ffb90 0x7f1450195730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 >> 172.21.15.60:0/2960428271 conn(0x7f14500fb320 msgr2=0x7f1450103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:14.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 shutdown_connections 2024-09-21T10:46:14.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.164+0000 7f1457e48640 1 -- 172.21.15.60:0/2960428271 wait complete. 2024-09-21T10:46:14.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:13 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:46:13.857+0000 7f2ef92e1640 -1 osd.3 63 log_to_monitors true 2024-09-21T10:46:14.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 -- 172.21.15.60:0/1778662531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480ffca0 msgr2=0x7fae48100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 --2- 172.21.15.60:0/1778662531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480ffca0 0x7fae48100120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae38009880 tx=0x7fae3802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 -- 172.21.15.60:0/1778662531 shutdown_connections 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 --2- 172.21.15.60:0/1778662531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480ffca0 0x7fae48100120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 --2- 172.21.15.60:0/1778662531 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480feaa0 0x7fae480feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 -- 172.21.15.60:0/1778662531 >> 172.21.15.60:0/1778662531 conn(0x7fae480fa250 msgr2=0x7fae480fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 -- 172.21.15.60:0/1778662531 shutdown_connections 2024-09-21T10:46:14.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.248+0000 7fae4f78c640 1 -- 172.21.15.60:0/1778662531 wait complete. 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4f78c640 1 Processor -- start 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4f78c640 1 -- start start 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4f78c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 0x7fae48068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4f78c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480ffca0 0x7fae4819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4f78c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4819a8f0 con 0x7fae480feaa0 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4f78c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4819aa60 con 0x7fae480ffca0 2024-09-21T10:46:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4d528640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 0x7fae48068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4d528640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 0x7fae48068f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47350/0 (socket says 172.21.15.60:47350) 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4d528640 1 -- 172.21.15.60:0/3223007307 learned_addr learned my addr 172.21.15.60:0/3223007307 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.249+0000 7fae4cd27640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480ffca0 0x7fae4819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4d528640 1 -- 172.21.15.60:0/3223007307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480ffca0 msgr2=0x7fae4819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4d528640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480ffca0 0x7fae4819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4d528640 1 -- 172.21.15.60:0/3223007307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38009560 con 0x7fae480feaa0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4cd27640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480ffca0 0x7fae4819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4d528640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 0x7fae48068f60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae4400e940 tx=0x7fae4400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae440096e0 con 0x7fae480feaa0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae440044f0 con 0x7fae480feaa0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4819ad40 con 0x7fae480feaa0 2024-09-21T10:46:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae44010430 con 0x7fae480feaa0 2024-09-21T10:46:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.250+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4819b280 con 0x7fae480feaa0 2024-09-21T10:46:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.251+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4818e640 con 0x7fae480feaa0 2024-09-21T10:46:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.252+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fae4400cc90 con 0x7fae480feaa0 2024-09-21T10:46:14.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.252+0000 7fae3e7fc640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fae3407b270 0x7fae3407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.253+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fae44014070 con 0x7fae480feaa0 2024-09-21T10:46:14.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.253+0000 7fae4cd27640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fae3407b270 0x7fae3407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.253+0000 7fae4cd27640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fae3407b270 0x7fae3407d730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae38000c00 tx=0x7fae380314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:14.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.257+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fae44061820 con 0x7fae480feaa0 2024-09-21T10:46:14.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.488+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fae4802c4b0 con 0x7fae480feaa0 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.488+0000 7fae3e7fc640 1 -- 172.21.15.60:0/3223007307 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7fae44064940 con 0x7fae480feaa0 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:46:14.491 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:46:14.492 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:46:14.493 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:14.494 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:14.495 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:14.497 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:46:14.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fae3407b270 msgr2=0x7fae3407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fae3407b270 0x7fae3407d730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae38000c00 tx=0x7fae380314e0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 msgr2=0x7fae48068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 0x7fae48068f60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae4400e940 tx=0x7fae4400ee00 comp rx=0 tx=0).stop 2024-09-21T10:46:14.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 shutdown_connections 2024-09-21T10:46:14.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fae3407b270 0x7fae3407d730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae480ffca0 0x7fae4819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 --2- 172.21.15.60:0/3223007307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae480feaa0 0x7fae48068f60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 >> 172.21.15.60:0/3223007307 conn(0x7fae480fa250 msgr2=0x7fae48103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:14.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 shutdown_connections 2024-09-21T10:46:14.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.491+0000 7fae4f78c640 1 -- 172.21.15.60:0/3223007307 wait complete. 2024-09-21T10:46:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 -- 172.21.15.60:0/3217788762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 msgr2=0x7f28380fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 --2- 172.21.15.60:0/3217788762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f28380fee80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2828009880 tx=0x7f282802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 -- 172.21.15.60:0/3217788762 shutdown_connections 2024-09-21T10:46:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 --2- 172.21.15.60:0/3217788762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28380ffc80 0x7f2838100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 --2- 172.21.15.60:0/3217788762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f28380fee80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 -- 172.21.15.60:0/3217788762 >> 172.21.15.60:0/3217788762 conn(0x7f28380fa230 msgr2=0x7f28380fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 -- 172.21.15.60:0/3217788762 shutdown_connections 2024-09-21T10:46:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 -- 172.21.15.60:0/3217788762 wait complete. 2024-09-21T10:46:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 Processor -- start 2024-09-21T10:46:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.576+0000 7f283ea15640 1 -- start start 2024-09-21T10:46:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f283ea15640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f2838068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f283ea15640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28380ffc80 0x7f283819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f283ea15640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283819a960 con 0x7f28380fea80 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f283ea15640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283819aaa0 con 0x7f28380ffc80 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f2838068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f2838068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47366/0 (socket says 172.21.15.60:47366) 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 -- 172.21.15.60:0/1521196615 learned_addr learned my addr 172.21.15.60:0/1521196615 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f28377fe640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28380ffc80 0x7f283819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 -- 172.21.15.60:0/1521196615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28380ffc80 msgr2=0x7f283819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28380ffc80 0x7f283819a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 -- 172.21.15.60:0/1521196615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828009560 con 0x7f28380fea80 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f2837fff640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f2838068fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f282802a9c0 tx=0x7f28280054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828004aa0 con 0x7f28380fea80 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.577+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2828004c00 con 0x7f28380fea80 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.578+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283819acf0 con 0x7f28380fea80 2024-09-21T10:46:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.578+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828003a80 con 0x7f28380fea80 2024-09-21T10:46:14.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.578+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283819b260 con 0x7f28380fea80 2024-09-21T10:46:14.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.579+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283818e620 con 0x7f28380fea80 2024-09-21T10:46:14.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.579+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2828003cf0 con 0x7f28380fea80 2024-09-21T10:46:14.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.580+0000 7f28357fa640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f282007b270 0x7f282007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.580+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f28280bf490 con 0x7f28380fea80 2024-09-21T10:46:14.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.580+0000 7f28377fe640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f282007b270 0x7f282007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.581+0000 7f28377fe640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f282007b270 0x7f282007d730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f282c005fd0 tx=0x7f282c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.584+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2828082520 con 0x7f28380fea80 2024-09-21T10:46:14.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.791+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f283802c590 con 0x7f282007b270 2024-09-21T10:46:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.792+0000 7f28357fa640 1 -- 172.21.15.60:0/1521196615 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f283802c590 con 0x7f282007b270 2024-09-21T10:46:14.794 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "10/23 daemons upgraded", 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:46:14.795 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.795+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f282007b270 msgr2=0x7f282007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.795+0000 7f283ea15640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f282007b270 0x7f282007d730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f282c005fd0 tx=0x7f282c005850 comp rx=0 tx=0).stop 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.795+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 msgr2=0x7f2838068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.795+0000 7f283ea15640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f2838068fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f282802a9c0 tx=0x7f28280054f0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 shutdown_connections 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f282007b270 0x7f282007d730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28380ffc80 0x7f283819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 --2- 172.21.15.60:0/1521196615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28380fea80 0x7f2838068fb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 >> 172.21.15.60:0/1521196615 conn(0x7f28380fa230 msgr2=0x7f2838103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:14.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 shutdown_connections 2024-09-21T10:46:14.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.796+0000 7f283ea15640 1 -- 172.21.15.60:0/1521196615 wait complete. 2024-09-21T10:46:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.881+0000 7fdb78854640 1 -- 172.21.15.60:0/2154742038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 msgr2=0x7fdb740feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.881+0000 7fdb78854640 1 --2- 172.21.15.60:0/2154742038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb740feea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009880 tx=0x7fdb6402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 -- 172.21.15.60:0/2154742038 shutdown_connections 2024-09-21T10:46:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 --2- 172.21.15.60:0/2154742038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 0x7fdb74100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 --2- 172.21.15.60:0/2154742038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb740feea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 -- 172.21.15.60:0/2154742038 >> 172.21.15.60:0/2154742038 conn(0x7fdb740fa230 msgr2=0x7fdb740fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:14.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 -- 172.21.15.60:0/2154742038 shutdown_connections 2024-09-21T10:46:14.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 -- 172.21.15.60:0/2154742038 wait complete. 2024-09-21T10:46:14.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 Processor -- start 2024-09-21T10:46:14.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.882+0000 7fdb78854640 1 -- start start 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb78854640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb74195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb78854640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 0x7fdb74195c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb78854640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74196250 con 0x7fdb740feaa0 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb78854640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb741963c0 con 0x7fdb740ffca0 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb74195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb74195740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47380/0 (socket says 172.21.15.60:47380) 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 -- 172.21.15.60:0/1199399657 learned_addr learned my addr 172.21.15.60:0/1199399657 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb71d9b640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 0x7fdb74195c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 -- 172.21.15.60:0/1199399657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 msgr2=0x7fdb74195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 0x7fdb74195c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 -- 172.21.15.60:0/1199399657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64009560 con 0x7fdb740feaa0 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb71d9b640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 0x7fdb74195c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:46:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.883+0000 7fdb7259c640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb74195740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdb64005610 tx=0x7fdb64005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.884+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb64004ba0 con 0x7fdb740feaa0 2024-09-21T10:46:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.884+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb64004d00 con 0x7fdb740feaa0 2024-09-21T10:46:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.884+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb64003bd0 con 0x7fdb740feaa0 2024-09-21T10:46:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.884+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7419ae00 con 0x7fdb740feaa0 2024-09-21T10:46:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.884+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7419b2f0 con 0x7fdb740feaa0 2024-09-21T10:46:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.885+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb740fef20 con 0x7fdb740feaa0 2024-09-21T10:46:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.885+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fdb64031640 con 0x7fdb740feaa0 2024-09-21T10:46:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.886+0000 7fdb637fe640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdb5c07b270 0x7fdb5c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.886+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdb640bf610 con 0x7fdb740feaa0 2024-09-21T10:46:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.886+0000 7fdb71d9b640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdb5c07b270 0x7fdb5c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.886+0000 7fdb71d9b640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdb5c07b270 0x7fdb5c07d730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006fd0 tx=0x7fdb68008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:14.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:14.890+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdb640826a0 con 0x7fdb740feaa0 2024-09-21T10:46:15.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.155+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdb74107710 con 0x7fdb740feaa0 2024-09-21T10:46:15.158 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:15.158 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='client.44231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='osd.3 [v2:172.21.15.112:6800/2459793118,v1:172.21.15.112:6801/2459793118]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2960428271' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:15.159 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:14 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3223007307' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:46:15.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.156+0000 7fdb637fe640 1 -- 172.21.15.60:0/1199399657 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1216 (secure 0 0 0) 0x7fdb640857c0 con 0x7fdb740feaa0 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd.3 (root=default,host=smithi112) is down 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-21T10:46:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-21T10:46:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdb5c07b270 msgr2=0x7fdb5c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdb5c07b270 0x7fdb5c07d730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006fd0 tx=0x7fdb68008040 comp rx=0 tx=0).stop 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 msgr2=0x7fdb74195740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb74195740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdb64005610 tx=0x7fdb64005640 comp rx=0 tx=0).stop 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 shutdown_connections 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdb5c07b270 0x7fdb5c07d730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb740ffca0 0x7fdb74195c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 --2- 172.21.15.60:0/1199399657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb740feaa0 0x7fdb74195740 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 >> 172.21.15.60:0/1199399657 conn(0x7fdb740fa230 msgr2=0x7fdb740fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 shutdown_connections 2024-09-21T10:46:15.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:15.158+0000 7fdb78854640 1 -- 172.21.15.60:0/1199399657 wait complete. 2024-09-21T10:46:15.200 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:46:14.831+0000 7f2eed083640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='client.44231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='osd.3 [v2:172.21.15.112:6800/2459793118,v1:172.21.15.112:6801/2459793118]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2960428271' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:15.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:14 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3223007307' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: osdmap e66: 6 total, 5 up, 6 in 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: from='osd.3 [v2:172.21.15.112:6800/2459793118,v1:172.21.15.112:6801/2459793118]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:15 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1199399657' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:46:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-21T10:46:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T10:46:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: osdmap e66: 6 total, 5 up, 6 in 2024-09-21T10:46:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: from='osd.3 [v2:172.21.15.112:6800/2459793118,v1:172.21.15.112:6801/2459793118]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:16.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:15 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1199399657' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:46:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:16 smithi112 ceph-mon[78695]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:46:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:16 smithi112 ceph-mon[78695]: osd.3 [v2:172.21.15.112:6800/2459793118,v1:172.21.15.112:6801/2459793118] boot 2024-09-21T10:46:16.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:16 smithi112 ceph-mon[78695]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T10:46:16.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:16 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T10:46:16.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:16 smithi112 ceph-mon[78695]: osdmap e68: 6 total, 6 up, 6 in 2024-09-21T10:46:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:16 smithi060 ceph-mon[93270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:46:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:16 smithi060 ceph-mon[93270]: osd.3 [v2:172.21.15.112:6800/2459793118,v1:172.21.15.112:6801/2459793118] boot 2024-09-21T10:46:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:16 smithi060 ceph-mon[93270]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T10:46:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:16 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T10:46:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:16 smithi060 ceph-mon[93270]: osdmap e68: 6 total, 6 up, 6 in 2024-09-21T10:46:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:17 smithi060 ceph-mon[93270]: pgmap v121: 65 pgs: 10 peering, 17 active+undersized, 11 active+undersized+degraded, 27 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-09-21T10:46:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:17 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:18.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:17 smithi112 ceph-mon[78695]: pgmap v121: 65 pgs: 10 peering, 17 active+undersized, 11 active+undersized+degraded, 27 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-09-21T10:46:18.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:17 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:19 smithi060 ceph-mon[93270]: pgmap v123: 65 pgs: 10 peering, 17 active+undersized, 11 active+undersized+degraded, 27 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-09-21T10:46:20.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:19 smithi112 ceph-mon[78695]: pgmap v123: 65 pgs: 10 peering, 17 active+undersized, 11 active+undersized+degraded, 27 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-09-21T10:46:21.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:20 smithi060 ceph-mon[93270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded) 2024-09-21T10:46:21.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:20 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:46:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:20 smithi112 ceph-mon[78695]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/222 objects degraded (14.414%), 11 pgs degraded) 2024-09-21T10:46:21.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:20 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:46:22.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:21 smithi060 ceph-mon[93270]: pgmap v124: 65 pgs: 10 peering, 55 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:21 smithi112 ceph-mon[78695]: pgmap v124: 65 pgs: 10 peering, 55 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:23 smithi060 ceph-mon[93270]: pgmap v125: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:24.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:23 smithi112 ceph-mon[78695]: pgmap v125: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:26.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:25 smithi060 ceph-mon[93270]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:26.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:25 smithi112 ceph-mon[78695]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:28.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:27 smithi060 ceph-mon[93270]: pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:28.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T10:46:28.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:27 smithi112 ceph-mon[78695]: pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:28.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T10:46:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:28 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T10:46:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:28 smithi060 ceph-mon[93270]: Upgrade: osd.4 is safe to restart 2024-09-21T10:46:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:28 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:28 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:46:29.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:28 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:29.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:28 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T10:46:29.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:28 smithi112 ceph-mon[78695]: Upgrade: osd.4 is safe to restart 2024-09-21T10:46:29.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:28 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:29.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:28 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:46:29.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:28 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:30.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:29 smithi112 ceph-mon[78695]: pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:30.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:29 smithi112 ceph-mon[78695]: Upgrade: Updating osd.4 2024-09-21T10:46:30.271 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:30.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T10:46:30.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:46:30.272 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:29 smithi112 ceph-mon[78695]: Deploying daemon osd.4 on smithi112 2024-09-21T10:46:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:29 smithi060 ceph-mon[93270]: pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:29 smithi060 ceph-mon[93270]: Upgrade: Updating osd.4 2024-09-21T10:46:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T10:46:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:46:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:29 smithi060 ceph-mon[93270]: Deploying daemon osd.4 on smithi112 2024-09-21T10:46:32.125 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:31 smithi112 ceph-mon[78695]: pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:32.126 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:31 smithi112 systemd[1]: Stopping Ceph osd.4 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:46:32.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:31 smithi060 ceph-mon[93270]: pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:32.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:32 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[47743]: 2024-09-21T10:46:32.122+0000 7fdac017d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:46:32.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:32 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[47743]: 2024-09-21T10:46:32.122+0000 7fdac017d640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-21T10:46:32.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:32 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[47743]: 2024-09-21T10:46:32.122+0000 7fdac017d640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:46:33.379 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:32 smithi112 ceph-mon[78695]: osd.4 marked itself down and dead 2024-09-21T10:46:33.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:32 smithi060 ceph-mon[93270]: osd.4 marked itself down and dead 2024-09-21T10:46:33.641 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:33 smithi112 podman[92246]: 2024-09-21 10:46:33.377808296 +0000 UTC m=+1.353625300 container died 89d6a82e0b67df6f8fd3332d09ab634b4c042f4af73a6c7bf95086f84aee0d71 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-6a1bdf8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:33.950 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:33 smithi112 podman[92246]: 2024-09-21 10:46:33.739736635 +0000 UTC m=+1.715553630 container cleanup 89d6a82e0b67df6f8fd3332d09ab634b4c042f4af73a6c7bf95086f84aee0d71 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=reef-6a1bdf8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T10:46:33.950 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:33 smithi112 bash[92246]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4 2024-09-21T10:46:34.344 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:33 smithi112 ceph-mon[78695]: pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:34.344 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:33 smithi112 ceph-mon[78695]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:46:34.344 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:33 smithi112 ceph-mon[78695]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T10:46:34.344 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:33 smithi112 podman[92266]: 2024-09-21 10:46:33.99113059 +0000 UTC m=+0.608854119 container remove 89d6a82e0b67df6f8fd3332d09ab634b4c042f4af73a6c7bf95086f84aee0d71 (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, RELEASE=reef-6a1bdf8, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T10:46:34.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:33 smithi060 ceph-mon[93270]: pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail 2024-09-21T10:46:34.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:33 smithi060 ceph-mon[93270]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:46:34.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:33 smithi060 ceph-mon[93270]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T10:46:34.613 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:34 smithi112 podman[92354]: 2024-09-21 10:46:34.24512683 +0000 UTC m=+0.015413598 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:46:34.613 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:34 smithi112 podman[92354]: 2024-09-21 10:46:34.375327108 +0000 UTC m=+0.145613863 container create b8753082aafc4e924917ec62748b319a195339d319e1e06b5c2a9dd32687bc25 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T10:46:34.613 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:34 smithi112 podman[92354]: 2024-09-21 10:46:34.611440175 +0000 UTC m=+0.381726941 container init b8753082aafc4e924917ec62748b319a195339d319e1e06b5c2a9dd32687bc25 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True) 2024-09-21T10:46:34.951 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:34 smithi112 podman[92354]: 2024-09-21 10:46:34.614882582 +0000 UTC m=+0.385169338 container start b8753082aafc4e924917ec62748b319a195339d319e1e06b5c2a9dd32687bc25 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T10:46:34.951 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:34 smithi112 podman[92354]: 2024-09-21 10:46:34.694912455 +0000 UTC m=+0.465199236 container attach b8753082aafc4e924917ec62748b319a195339d319e1e06b5c2a9dd32687bc25 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:46:34.951 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:34 smithi112 podman[92354]: 2024-09-21 10:46:34.798287946 +0000 UTC m=+0.568574707 container died b8753082aafc4e924917ec62748b319a195339d319e1e06b5c2a9dd32687bc25 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:46:35.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:34 smithi060 ceph-mon[93270]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T10:46:35.358 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:34 smithi112 ceph-mon[78695]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T10:46:35.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 podman[92377]: 2024-09-21 10:46:35.356612274 +0000 UTC m=+0.552568428 container remove b8753082aafc4e924917ec62748b319a195339d319e1e06b5c2a9dd32687bc25 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:46:35.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T10:46:35.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 systemd[1]: Stopped Ceph osd.4 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:46:35.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.4.service: Consumed 1min 236ms CPU time. 2024-09-21T10:46:35.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 systemd[1]: Starting Ceph osd.4 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:46:36.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:35 smithi112 ceph-mon[78695]: pgmap v133: 65 pgs: 3 active+undersized, 8 peering, 3 stale+active+clean, 2 active+undersized+degraded, 49 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 5/222 objects degraded (2.252%) 2024-09-21T10:46:36.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:35 smithi112 ceph-mon[78695]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T10:46:36.050 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:35 smithi112 ceph-mon[78695]: Health check failed: Degraded data redundancy: 5/222 objects degraded (2.252%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:36.050 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 podman[92472]: 2024-09-21 10:46:35.68309717 +0000 UTC m=+0.015506476 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:46:36.050 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:35 smithi112 podman[92472]: 2024-09-21 10:46:35.941128969 +0000 UTC m=+0.273538261 container create 97bbe7c3675350beb55b6eb7cba7d87084021c94f1aecd71162e4272e1aa5ffa (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=) 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 podman[92472]: 2024-09-21 10:46:36.161163025 +0000 UTC m=+0.493572327 container init 97bbe7c3675350beb55b6eb7cba7d87084021c94f1aecd71162e4272e1aa5ffa (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 podman[92472]: 2024-09-21 10:46:36.165120848 +0000 UTC m=+0.497530144 container start 97bbe7c3675350beb55b6eb7cba7d87084021c94f1aecd71162e4272e1aa5ffa (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 podman[92472]: 2024-09-21 10:46:36.235778412 +0000 UTC m=+0.568187718 container attach 97bbe7c3675350beb55b6eb7cba7d87084021c94f1aecd71162e4272e1aa5ffa (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 bash[92472]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:36.311 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:36 smithi112 bash[92472]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:36.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:35 smithi060 ceph-mon[93270]: pgmap v133: 65 pgs: 3 active+undersized, 8 peering, 3 stale+active+clean, 2 active+undersized+degraded, 49 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 5/222 objects degraded (2.252%) 2024-09-21T10:46:36.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:35 smithi060 ceph-mon[93270]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T10:46:36.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:35 smithi060 ceph-mon[93270]: Health check failed: Degraded data redundancy: 5/222 objects degraded (2.252%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:38.251 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:37 smithi060 ceph-mon[93270]: pgmap v134: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-09-21T10:46:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:37 smithi112 ceph-mon[78695]: pgmap v134: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T10:46:39.419 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T10:46:39.420 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T10:46:39.420 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T10:46:39.420 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate[92487]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 bash[92472]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T10:46:39.701 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:39 smithi112 podman[92472]: 2024-09-21 10:46:39.445772056 +0000 UTC m=+3.778181348 container died 97bbe7c3675350beb55b6eb7cba7d87084021c94f1aecd71162e4272e1aa5ffa (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T10:46:40.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:39 smithi060 ceph-mon[93270]: pgmap v135: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-09-21T10:46:40.249 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:39 smithi112 ceph-mon[78695]: pgmap v135: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 28/222 objects degraded (12.613%) 2024-09-21T10:46:40.250 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 podman[92699]: 2024-09-21 10:46:40.047684149 +0000 UTC m=+0.595482620 container remove 97bbe7c3675350beb55b6eb7cba7d87084021c94f1aecd71162e4272e1aa5ffa (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T10:46:40.569 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 podman[92758]: 2024-09-21 10:46:40.248542866 +0000 UTC m=+0.110200464 container create fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:46:40.569 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 podman[92758]: 2024-09-21 10:46:40.15363032 +0000 UTC m=+0.015287926 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:46:40.569 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 podman[92758]: 2024-09-21 10:46:40.467376847 +0000 UTC m=+0.329034456 container init fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T10:46:40.569 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 podman[92758]: 2024-09-21 10:46:40.470590754 +0000 UTC m=+0.332248353 container start fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:46:40.569 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 ceph-osd[92777]: -- 172.21.15.112:0/3678741819 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5628f9c661e0 con 0x5628f9c62000 2024-09-21T10:46:40.569 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 bash[92758]: fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da 2024-09-21T10:46:40.950 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:40 smithi112 systemd[1]: Started Ceph osd.4 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:46:41.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:40 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:41.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:41.293 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:41.294 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:40 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 28/222 objects degraded (12.613%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:41.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:42.200 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:42 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:46:42.096+0000 7f74f74df640 -1 Falling back to public interface 2024-09-21T10:46:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:41 smithi112 ceph-mon[78695]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:42.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:41 smithi112 ceph-mon[78695]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T10:46:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:41 smithi060 ceph-mon[93270]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:42.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:41 smithi060 ceph-mon[93270]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T10:46:44.314 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:44.314 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:46:44.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.315 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:45.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 -- 172.21.15.60:0/3097303875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 msgr2=0x7f71c8100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 --2- 172.21.15.60:0/3097303875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8100120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009880 tx=0x7f71bc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 -- 172.21.15.60:0/3097303875 shutdown_connections 2024-09-21T10:46:45.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 --2- 172.21.15.60:0/3097303875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8100120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 --2- 172.21.15.60:0/3097303875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c80feaa0 0x7f71c80feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 -- 172.21.15.60:0/3097303875 >> 172.21.15.60:0/3097303875 conn(0x7f71c80fa250 msgr2=0x7f71c80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:45.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 -- 172.21.15.60:0/3097303875 shutdown_connections 2024-09-21T10:46:45.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.252+0000 7f71cebd1640 1 -- 172.21.15.60:0/3097303875 wait complete. 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cebd1640 1 Processor -- start 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cebd1640 1 -- start start 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cebd1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c80feaa0 0x7f71c81955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cebd1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cebd1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81960f0 con 0x7f71c80ffca0 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cebd1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8196260 con 0x7f71c80feaa0 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39100/0 (socket says 172.21.15.60:39100) 2024-09-21T10:46:45.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71c7fff640 1 -- 172.21.15.60:0/2444875687 learned_addr learned my addr 172.21.15.60:0/2444875687 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.253+0000 7f71cc96d640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c80feaa0 0x7f71c81955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c7fff640 1 -- 172.21.15.60:0/2444875687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c80feaa0 msgr2=0x7f71c81955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c7fff640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c80feaa0 0x7f71c81955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c7fff640 1 -- 172.21.15.60:0/2444875687 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009560 con 0x7f71c80ffca0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c7fff640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8195b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71bc005520 tx=0x7f71bc005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71bc004aa0 con 0x7f71c80ffca0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71bc004c00 con 0x7f71c80ffca0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c819aca0 con 0x7f71c80ffca0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71bc003b10 con 0x7f71c80ffca0 2024-09-21T10:46:45.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.254+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c819b190 con 0x7f71c80ffca0 2024-09-21T10:46:45.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.255+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c8107690 con 0x7f71c80ffca0 2024-09-21T10:46:45.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.256+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f71bc003c70 con 0x7f71c80ffca0 2024-09-21T10:46:45.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.257+0000 7f71c5ffb640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f71b007b270 0x7f71b007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.257+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f71bc0bf3e0 con 0x7f71c80ffca0 2024-09-21T10:46:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.257+0000 7f71cc96d640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f71b007b270 0x7f71b007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.257+0000 7f71cc96d640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f71b007b270 0x7f71b007d730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71b8005fd0 tx=0x7f71b800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.261+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f71bc082580 con 0x7f71c80ffca0 2024-09-21T10:46:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.468+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71c8068bb0 con 0x7f71b007b270 2024-09-21T10:46:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.469+0000 7f71c5ffb640 1 -- 172.21.15.60:0/2444875687 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f71c8068bb0 con 0x7f71b007b270 2024-09-21T10:46:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f71b007b270 msgr2=0x7f71b007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f71b007b270 0x7f71b007d730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71b8005fd0 tx=0x7f71b800b410 comp rx=0 tx=0).stop 2024-09-21T10:46:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 msgr2=0x7f71c8195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8195b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71bc005520 tx=0x7f71bc005550 comp rx=0 tx=0).stop 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 shutdown_connections 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f71b007b270 0x7f71b007d730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c80ffca0 0x7f71c8195b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 --2- 172.21.15.60:0/2444875687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c80feaa0 0x7f71c81955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 >> 172.21.15.60:0/2444875687 conn(0x7f71c80fa250 msgr2=0x7f71c80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 shutdown_connections 2024-09-21T10:46:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.472+0000 7f71cebd1640 1 -- 172.21.15.60:0/2444875687 wait complete. 2024-09-21T10:46:45.484 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.561+0000 7f511a96b640 1 -- 172.21.15.60:0/1443182923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 msgr2=0x7f51141053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.561+0000 7f511a96b640 1 --2- 172.21.15.60:0/1443182923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51141053a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f51080098b0 tx=0x7f510802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.561+0000 7f511a96b640 1 -- 172.21.15.60:0/1443182923 shutdown_connections 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.561+0000 7f511a96b640 1 --2- 172.21.15.60:0/1443182923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51141053a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.561+0000 7f511a96b640 1 --2- 172.21.15.60:0/1443182923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114100680 0x7f5114102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.561+0000 7f511a96b640 1 -- 172.21.15.60:0/1443182923 >> 172.21.15.60:0/1443182923 conn(0x7f51140fa280 msgr2=0x7f51140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.562+0000 7f511a96b640 1 -- 172.21.15.60:0/1443182923 shutdown_connections 2024-09-21T10:46:45.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.562+0000 7f511a96b640 1 -- 172.21.15.60:0/1443182923 wait complete. 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.562+0000 7f511a96b640 1 Processor -- start 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.562+0000 7f511a96b640 1 -- start start 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f511a96b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114100680 0x7f51140fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f511a96b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51140fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f511a96b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140feb70 con 0x7f5114102fb0 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f511a96b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140fece0 con 0x7f5114100680 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51140fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51140fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39128/0 (socket says 172.21.15.60:39128) 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 -- 172.21.15.60:0/2690730152 learned_addr learned my addr 172.21.15.60:0/2690730152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f5113fff640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114100680 0x7f51140fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 -- 172.21.15.60:0/2690730152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114100680 msgr2=0x7f51140fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114100680 0x7f51140fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 -- 172.21.15.60:0/2690730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108009560 con 0x7f5114102fb0 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.563+0000 7f51137fe640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51140fe630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f510802a9f0 tx=0x7f51080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.564+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5108004aa0 con 0x7f5114102fb0 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.564+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5108004c00 con 0x7f5114102fb0 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.564+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51140fef60 con 0x7f5114102fb0 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.564+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5108003a80 con 0x7f5114102fb0 2024-09-21T10:46:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.564+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51140ff450 con 0x7f5114102fb0 2024-09-21T10:46:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.565+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51141087e0 con 0x7f5114102fb0 2024-09-21T10:46:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.566+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5108003cf0 con 0x7f5114102fb0 2024-09-21T10:46:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.567+0000 7f51117fa640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f50fc07b270 0x7f50fc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.567+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f51080bf440 con 0x7f5114102fb0 2024-09-21T10:46:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.567+0000 7f5113fff640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f50fc07b270 0x7f50fc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.567+0000 7f5113fff640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f50fc07b270 0x7f50fc07d730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f510400bbe0 tx=0x7f510400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:45.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.571+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f5108082580 con 0x7f5114102fb0 2024-09-21T10:46:45.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.775+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5114103a30 con 0x7f50fc07b270 2024-09-21T10:46:45.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.776+0000 7f51117fa640 1 -- 172.21.15.60:0/2690730152 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5114103a30 con 0x7f50fc07b270 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.778+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f50fc07b270 msgr2=0x7f50fc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.778+0000 7f511a96b640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f50fc07b270 0x7f50fc07d730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f510400bbe0 tx=0x7f510400b390 comp rx=0 tx=0).stop 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.778+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 msgr2=0x7f51140fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.778+0000 7f511a96b640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51140fe630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f510802a9f0 tx=0x7f51080055a0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 shutdown_connections 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f50fc07b270 0x7f50fc07d730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5114102fb0 0x7f51140fe630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 --2- 172.21.15.60:0/2690730152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5114100680 0x7f51140fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 >> 172.21.15.60:0/2690730152 conn(0x7f51140fa280 msgr2=0x7f51140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:45.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 shutdown_connections 2024-09-21T10:46:45.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.779+0000 7f511a96b640 1 -- 172.21.15.60:0/2690730152 wait complete. 2024-09-21T10:46:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.861+0000 7fbd781e9640 1 -- 172.21.15.60:0/4178452486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fed60 msgr2=0x7fbd700ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.861+0000 7fbd781e9640 1 --2- 172.21.15.60:0/4178452486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fed60 0x7fbd700ff1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009880 tx=0x7fbd6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.861+0000 7fbd781e9640 1 -- 172.21.15.60:0/4178452486 shutdown_connections 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.861+0000 7fbd781e9640 1 --2- 172.21.15.60:0/4178452486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fed60 0x7fbd700ff1c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.861+0000 7fbd781e9640 1 --2- 172.21.15.60:0/4178452486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd700fe420 0x7fbd700fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.861+0000 7fbd781e9640 1 -- 172.21.15.60:0/4178452486 >> 172.21.15.60:0/4178452486 conn(0x7fbd700fa250 msgr2=0x7fbd700fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 -- 172.21.15.60:0/4178452486 shutdown_connections 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 -- 172.21.15.60:0/4178452486 wait complete. 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 Processor -- start 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 -- start start 2024-09-21T10:46:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 0x7fbd701977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd700fed60 0x7fbd70197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd701982d0 con 0x7fbd700fe420 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.862+0000 7fbd781e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70198440 con 0x7fbd700fed60 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 0x7fbd701977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 0x7fbd701977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39134/0 (socket says 172.21.15.60:39134) 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 -- 172.21.15.60:0/1966719195 learned_addr learned my addr 172.21.15.60:0/1966719195 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:45.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75784640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd700fed60 0x7fbd70197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 -- 172.21.15.60:0/1966719195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd700fed60 msgr2=0x7fbd70197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd700fed60 0x7fbd70197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 -- 172.21.15.60:0/1966719195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009560 con 0x7fbd700fe420 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd75f85640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 0x7fbd701977c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400d900 tx=0x7fbd6400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd64009c00 con 0x7fbd700fe420 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd64009d60 con 0x7fbd700fe420 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7019cee0 con 0x7fbd700fe420 2024-09-21T10:46:45.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd640049d0 con 0x7fbd700fe420 2024-09-21T10:46:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.863+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7019d3a0 con 0x7fbd700fe420 2024-09-21T10:46:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.865+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd54005280 con 0x7fbd700fe420 2024-09-21T10:46:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.866+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fbd640051b0 con 0x7fbd700fe420 2024-09-21T10:46:45.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.866+0000 7fbd62ffd640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd5c07b270 0x7fbd5c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:45.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.867+0000 7fbd75784640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd5c07b270 0x7fbd5c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:45.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.867+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbd6409e600 con 0x7fbd700fe420 2024-09-21T10:46:45.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.867+0000 7fbd75784640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd5c07b270 0x7fbd5c07d730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c000c00 tx=0x7fbd6c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:45.870+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fbd640616b0 con 0x7fbd700fe420 2024-09-21T10:46:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.066+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd54000bf0 con 0x7fbd5c07b270 2024-09-21T10:46:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.076+0000 7fbd62ffd640 1 -- 172.21.15.60:0/1966719195 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbd54000bf0 con 0x7fbd5c07b270 2024-09-21T10:46:46.079 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:46:46.079 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (12m) 71s ago 14m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:46:46.079 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (5m) 71s ago 14m 8376k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:46:46.079 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (5m) 2s ago 13m 8132k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:46:46.079 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (2m) 71s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (2m) 2s ago 13m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (12m) 71s ago 14m 86.6M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (8m) 71s ago 8m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (8m) 71s ago 8m 16.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (8m) 2s ago 8m 18.5M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (8m) 2s ago 8m 20.8M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (5m) 71s ago 15m 516M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (4m) 2s ago 13m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (3m) 71s ago 16m 47.5M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (3m) 2s ago 13m 40.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (14m) 71s ago 14m 16.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (13m) 2s ago 13m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (2m) 71s ago 12m 103M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (114s) 71s ago 11m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:46:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (77s) 71s ago 11m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:46:46.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (40s) 2s ago 10m 104M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:46:46.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (5s) 2s ago 10m 11.7M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:46:46.081 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (10m) 2s ago 10m 241M 2240M 18.2.4-871-g6a1bdf85 0adab276c97e 86a7a0802890 2024-09-21T10:46:46.081 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (4m) 71s ago 14m 66.5M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:46:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd5c07b270 msgr2=0x7fbd5c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd5c07b270 0x7fbd5c07d730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c000c00 tx=0x7fbd6c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 msgr2=0x7fbd701977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 0x7fbd701977c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400d900 tx=0x7fbd6400ddc0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 shutdown_connections 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbd5c07b270 0x7fbd5c07d730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd700fed60 0x7fbd70197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 --2- 172.21.15.60:0/1966719195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd700fe420 0x7fbd701977c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 >> 172.21.15.60:0/1966719195 conn(0x7fbd700fa250 msgr2=0x7fbd700fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 shutdown_connections 2024-09-21T10:46:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.078+0000 7fbd781e9640 1 -- 172.21.15.60:0/1966719195 wait complete. 2024-09-21T10:46:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 -- 172.21.15.60:0/2196549066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4100630 msgr2=0x7f19a4102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 --2- 172.21.15.60:0/2196549066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4100630 0x7f19a4102a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19940098b0 tx=0x7f199402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 -- 172.21.15.60:0/2196549066 shutdown_connections 2024-09-21T10:46:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 --2- 172.21.15.60:0/2196549066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a4102f60 0x7f19a4105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 --2- 172.21.15.60:0/2196549066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4100630 0x7f19a4102a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 -- 172.21.15.60:0/2196549066 >> 172.21.15.60:0/2196549066 conn(0x7f19a40fa250 msgr2=0x7f19a40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:46.166 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:46 smithi060 ceph-mon[93270]: pgmap v138: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:46.166 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:46 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 -- 172.21.15.60:0/2196549066 shutdown_connections 2024-09-21T10:46:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 -- 172.21.15.60:0/2196549066 wait complete. 2024-09-21T10:46:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.162+0000 7f19a9628640 1 Processor -- start 2024-09-21T10:46:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a9628640 1 -- start start 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a9628640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a4100630 0x7f19a40fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a9628640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 0x7f19a40fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a9628640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40feb20 con 0x7f19a4102f60 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a9628640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40fec90 con 0x7f19a4100630 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 0x7f19a40fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 0x7f19a40fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39146/0 (socket says 172.21.15.60:39146) 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a27fc640 1 -- 172.21.15.60:0/8009905 learned_addr learned my addr 172.21.15.60:0/8009905 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a2ffd640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a4100630 0x7f19a40fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a27fc640 1 -- 172.21.15.60:0/8009905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a4100630 msgr2=0x7f19a40fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a27fc640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a4100630 0x7f19a40fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.163+0000 7f19a27fc640 1 -- 172.21.15.60:0/8009905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009560 con 0x7f19a4102f60 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.164+0000 7f19a27fc640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 0x7f19a40fe5e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f199800e970 tx=0x7f199800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.164+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f199800cc90 con 0x7f19a4102f60 2024-09-21T10:46:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.164+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f199800cdf0 con 0x7f19a4102f60 2024-09-21T10:46:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.164+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a40fef70 con 0x7f19a4102f60 2024-09-21T10:46:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.164+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1998010430 con 0x7f19a4102f60 2024-09-21T10:46:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.164+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a419d6c0 con 0x7f19a4102f60 2024-09-21T10:46:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.165+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a41087e0 con 0x7f19a4102f60 2024-09-21T10:46:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.166+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f19980046c0 con 0x7f19a4102f60 2024-09-21T10:46:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.166+0000 7f198bfff640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f198c07b270 0x7f198c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.166+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1998014070 con 0x7f19a4102f60 2024-09-21T10:46:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.166+0000 7f19a2ffd640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f198c07b270 0x7f198c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.167+0000 7f19a2ffd640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f198c07b270 0x7f198c07d730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1994006010 tx=0x7f19940314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.171+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1998061890 con 0x7f19a4102f60 2024-09-21T10:46:46.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:46 smithi112 ceph-mon[78695]: pgmap v138: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:46.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:46 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:46.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.436+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19a41089c0 con 0x7f19a4102f60 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.437+0000 7f198bfff640 1 -- 172.21.15.60:0/8009905 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f19980649b0 con 0x7f19a4102f60 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:46:46.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 1, 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 5, 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 8 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:46:46.441 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f198c07b270 msgr2=0x7f198c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f198c07b270 0x7f198c07d730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1994006010 tx=0x7f19940314e0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 msgr2=0x7f19a40fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 0x7f19a40fe5e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f199800e970 tx=0x7f199800ee30 comp rx=0 tx=0).stop 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 shutdown_connections 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f198c07b270 0x7f198c07d730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a4102f60 0x7f19a40fe5e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 --2- 172.21.15.60:0/8009905 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19a4100630 0x7f19a40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 >> 172.21.15.60:0/8009905 conn(0x7f19a40fa250 msgr2=0x7f19a40fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 shutdown_connections 2024-09-21T10:46:46.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.439+0000 7f19a9628640 1 -- 172.21.15.60:0/8009905 wait complete. 2024-09-21T10:46:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/703124840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 msgr2=0x7f0cbc0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/703124840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc0fff90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009880 tx=0x7f0cac02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/703124840 shutdown_connections 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/703124840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cbc100d90 0x7f0cbc101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/703124840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc0fff90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/703124840 >> 172.21.15.60:0/703124840 conn(0x7f0cbc0fb320 msgr2=0x7f0cbc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/703124840 shutdown_connections 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/703124840 wait complete. 2024-09-21T10:46:46.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.523+0000 7f0cc1a1d640 1 Processor -- start 2024-09-21T10:46:46.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cc1a1d640 1 -- start start 2024-09-21T10:46:46.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cc1a1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cc1a1d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cbc100d90 0x7f0cbc195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cc1a1d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc1961a0 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cc1a1d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc196310 con 0x7f0cbc100d90 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39152/0 (socket says 172.21.15.60:39152) 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 -- 172.21.15.60:0/3780259593 learned_addr learned my addr 172.21.15.60:0/3780259593 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cba7fc640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cbc100d90 0x7f0cbc195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 -- 172.21.15.60:0/3780259593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cbc100d90 msgr2=0x7f0cbc195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cbc100d90 0x7f0cbc195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 -- 172.21.15.60:0/3780259593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac009560 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.524+0000 7f0cbaffd640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc195690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004650 tx=0x7f0cac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.525+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cac004aa0 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.525+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cac005d50 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.525+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc19ad00 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.525+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cac0039e0 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.525+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc19b220 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.526+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc18f730 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.527+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0cac031c00 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.527+0000 7f0cc0a1b640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ca807b270 0x7f0ca807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.527+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f0cac0bf320 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.527+0000 7f0cba7fc640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ca807b270 0x7f0ca807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.528+0000 7f0cba7fc640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ca807b270 0x7f0ca807d730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc196b60 tx=0x7f0ca4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:46.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.532+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f0cac082460 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.758+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0cbc02c480 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.759+0000 7f0cc0a1b640 1 -- 172.21.15.60:0/3780259593 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f0cac085580 con 0x7f0cbc0ffb90 2024-09-21T10:46:46.762 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:46:46.762 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:46:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:46:46.764 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:46:46.765 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:46.766 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:46.766 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:46:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:46:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ca807b270 msgr2=0x7f0ca807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ca807b270 0x7f0ca807d730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc196b60 tx=0x7f0ca4005f90 comp rx=0 tx=0).stop 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 msgr2=0x7f0cbc195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc195690 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004650 tx=0x7f0cac0055a0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 shutdown_connections 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ca807b270 0x7f0ca807d730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cbc100d90 0x7f0cbc195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 --2- 172.21.15.60:0/3780259593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cbc0ffb90 0x7f0cbc195690 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 >> 172.21.15.60:0/3780259593 conn(0x7f0cbc0fb320 msgr2=0x7f0cbc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 shutdown_connections 2024-09-21T10:46:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.761+0000 7f0cc1a1d640 1 -- 172.21.15.60:0/3780259593 wait complete. 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 -- 172.21.15.60:0/1029082199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148102fb0 msgr2=0x7f01481053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 --2- 172.21.15.60:0/1029082199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148102fb0 0x7f01481053a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f013c0098b0 tx=0x7f013c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 -- 172.21.15.60:0/1029082199 shutdown_connections 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 --2- 172.21.15.60:0/1029082199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148102fb0 0x7f01481053a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 --2- 172.21.15.60:0/1029082199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0148100680 0x7f0148102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 -- 172.21.15.60:0/1029082199 >> 172.21.15.60:0/1029082199 conn(0x7f01480fa280 msgr2=0x7f01480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 -- 172.21.15.60:0/1029082199 shutdown_connections 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.845+0000 7f014effd640 1 -- 172.21.15.60:0/1029082199 wait complete. 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014effd640 1 Processor -- start 2024-09-21T10:46:46.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014effd640 1 -- start start 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 0x7f01481956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0148102fb0 0x7f0148195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014effd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148196200 con 0x7f0148100680 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014effd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148196370 con 0x7f0148102fb0 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014cd99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 0x7f01481956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014cd99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 0x7f01481956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39172/0 (socket says 172.21.15.60:39172) 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.846+0000 7f014cd99640 1 -- 172.21.15.60:0/2210528740 learned_addr learned my addr 172.21.15.60:0/2210528740 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f0147fff640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0148102fb0 0x7f0148195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f014cd99640 1 -- 172.21.15.60:0/2210528740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0148102fb0 msgr2=0x7f0148195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f014cd99640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0148102fb0 0x7f0148195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:46.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f014cd99640 1 -- 172.21.15.60:0/2210528740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009560 con 0x7f0148100680 2024-09-21T10:46:46.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f014cd99640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 0x7f01481956f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f013800d900 tx=0x7f013800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:46.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0138009c00 con 0x7f0148100680 2024-09-21T10:46:46.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014819ae10 con 0x7f0148100680 2024-09-21T10:46:46.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0138009d60 con 0x7f0148100680 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01380049d0 con 0x7f0148100680 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.847+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014819b2d0 con 0x7f0148100680 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.848+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148100a60 con 0x7f0148100680 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.849+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0138004020 con 0x7f0148100680 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.849+0000 7f0145ffb640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f013007b270 0x7f013007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.850+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f013809e1a0 con 0x7f0148100680 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.850+0000 7f0147fff640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f013007b270 0x7f013007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:46.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.850+0000 7f0147fff640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f013007b270 0x7f013007d730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f013c009880 tx=0x7f013c004260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:46.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:46.854+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f0138061110 con 0x7f0148100680 2024-09-21T10:46:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.062+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0148103a30 con 0x7f013007b270 2024-09-21T10:46:47.066 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:47 smithi060 ceph-mon[93270]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:47.066 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:47 smithi060 ceph-mon[93270]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:47.066 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:47 smithi060 ceph-mon[93270]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:47.066 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:47 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/8009905' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:47.066 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:47 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3780259593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.064+0000 7f0145ffb640 1 -- 172.21.15.60:0/2210528740 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0148103a30 con 0x7f013007b270 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:46:47.067 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:46:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:46:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:46:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "11/23 daemons upgraded", 2024-09-21T10:46:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:46:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:46:47.068 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:46:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f013007b270 msgr2=0x7f013007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f013007b270 0x7f013007d730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f013c009880 tx=0x7f013c004260 comp rx=0 tx=0).stop 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 msgr2=0x7f01481956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 0x7f01481956f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f013800d900 tx=0x7f013800ddc0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 shutdown_connections 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f013007b270 0x7f013007d730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0148102fb0 0x7f0148195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 --2- 172.21.15.60:0/2210528740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148100680 0x7f01481956f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 >> 172.21.15.60:0/2210528740 conn(0x7f01480fa280 msgr2=0x7f01480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 shutdown_connections 2024-09-21T10:46:47.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.066+0000 7f014effd640 1 -- 172.21.15.60:0/2210528740 wait complete. 2024-09-21T10:46:47.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 -- 172.21.15.60:0/3295297723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 msgr2=0x7ff88c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:47.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 --2- 172.21.15.60:0/3295297723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c101210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff880009880 tx=0x7ff88002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 -- 172.21.15.60:0/3295297723 shutdown_connections 2024-09-21T10:46:47.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 --2- 172.21.15.60:0/3295297723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c101210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 --2- 172.21.15.60:0/3295297723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 0x7ff88c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 -- 172.21.15.60:0/3295297723 >> 172.21.15.60:0/3295297723 conn(0x7ff88c0fb320 msgr2=0x7ff88c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:47.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 -- 172.21.15.60:0/3295297723 shutdown_connections 2024-09-21T10:46:47.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.150+0000 7ff8910b7640 1 -- 172.21.15.60:0/3295297723 wait complete. 2024-09-21T10:46:47.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff8910b7640 1 Processor -- start 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff8910b7640 1 -- start start 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff8910b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 0x7ff88c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff8910b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff8910b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c198340 con 0x7ff88c100d90 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff8910b7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c1984b0 con 0x7ff88c0ffb90 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff88a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff88a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39184/0 (socket says 172.21.15.60:39184) 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.151+0000 7ff88a59c640 1 -- 172.21.15.60:0/1344945821 learned_addr learned my addr 172.21.15.60:0/1344945821 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:46:47.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff88ad9d640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 0x7ff88c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff88a59c640 1 -- 172.21.15.60:0/1344945821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 msgr2=0x7ff88c197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff88a59c640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 0x7ff88c197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff88a59c640 1 -- 172.21.15.60:0/1344945821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009560 con 0x7ff88c100d90 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff88ad9d640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 0x7ff88c197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff88a59c640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c197d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff8800055a0 tx=0x7ff8800055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff880004b20 con 0x7ff88c100d90 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c19cef0 con 0x7ff88c100d90 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff880004c80 con 0x7ff88c100d90 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff880003bc0 con 0x7ff88c100d90 2024-09-21T10:46:47.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.152+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c19d430 con 0x7ff88c100d90 2024-09-21T10:46:47.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.153+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c074480 con 0x7ff88c100d90 2024-09-21T10:46:47.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.154+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff880003d20 con 0x7ff88c100d90 2024-09-21T10:46:47.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.154+0000 7ff873fff640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff87407b270 0x7ff87407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:46:47.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.155+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff8800bf4e0 con 0x7ff88c100d90 2024-09-21T10:46:47.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.155+0000 7ff88ad9d640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff87407b270 0x7ff87407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:46:47.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.155+0000 7ff88ad9d640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff87407b270 0x7ff87407d730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009fd0 tx=0x7ff87c009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:46:47.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.159+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ff880082620 con 0x7ff88c100d90 2024-09-21T10:46:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:47 smithi112 ceph-mon[78695]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:47 smithi112 ceph-mon[78695]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:47 smithi112 ceph-mon[78695]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:47 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/8009905' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:47.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:47 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3780259593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:46:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.448+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff88c0731e0 con 0x7ff88c100d90 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.448+0000 7ff873fff640 1 -- 172.21.15.60:0/1344945821 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1050 (secure 0 0 0) 0x7ff880085740 con 0x7ff88c100d90 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: osd.4 (root=default,host=smithi112) is down 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-21T10:46:47.452 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-21T10:46:47.453 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff87407b270 msgr2=0x7ff87407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff87407b270 0x7ff87407d730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009fd0 tx=0x7ff87c009680 comp rx=0 tx=0).stop 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 msgr2=0x7ff88c197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c197d70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff8800055a0 tx=0x7ff8800055d0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 shutdown_connections 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff87407b270 0x7ff87407d730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff88c100d90 0x7ff88c197d70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 --2- 172.21.15.60:0/1344945821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff88c0ffb90 0x7ff88c197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:46:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 >> 172.21.15.60:0/1344945821 conn(0x7ff88c0fb320 msgr2=0x7ff88c0fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:46:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 shutdown_connections 2024-09-21T10:46:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:46:47.451+0000 7ff8910b7640 1 -- 172.21.15.60:0/1344945821 wait complete. 2024-09-21T10:46:48.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: pgmap v139: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:48.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:48.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:48.368 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T10:46:48.369 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1344945821' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:46:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: pgmap v139: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T10:46:48.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:48 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1344945821' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:46:48.700 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:48 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:46:48.366+0000 7f74f74df640 -1 osd.4 68 log_to_monitors true 2024-09-21T10:46:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:49 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T10:46:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:49 smithi060 ceph-mon[93270]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T10:46:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:49 smithi060 ceph-mon[93270]: from='osd.4 [v2:172.21.15.112:6808/4046300887,v1:172.21.15.112:6809/4046300887]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T10:46:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:49 smithi060 ceph-mon[93270]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T10:46:49.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:49 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T10:46:49.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:49 smithi112 ceph-mon[78695]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T10:46:49.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:49 smithi112 ceph-mon[78695]: from='osd.4 [v2:172.21.15.112:6808/4046300887,v1:172.21.15.112:6809/4046300887]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T10:46:49.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:49 smithi112 ceph-mon[78695]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T10:46:50.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:50 smithi112 ceph-mon[78695]: pgmap v140: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:50.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:50 smithi112 ceph-mon[78695]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T10:46:50.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:50 smithi112 ceph-mon[78695]: osdmap e71: 6 total, 5 up, 6 in 2024-09-21T10:46:50.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:50 smithi112 ceph-mon[78695]: from='osd.4 [v2:172.21.15.112:6808/4046300887,v1:172.21.15.112:6809/4046300887]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:50.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:50 smithi112 ceph-mon[78695]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:50.352 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:50 smithi112 ceph-mon[78695]: from='osd.4 ' entity='osd.4' 2024-09-21T10:46:50.353 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:46:49 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:46:49.956+0000 7f74eb281640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:46:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:50 smithi060 ceph-mon[93270]: pgmap v140: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:50 smithi060 ceph-mon[93270]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T10:46:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:50 smithi060 ceph-mon[93270]: osdmap e71: 6 total, 5 up, 6 in 2024-09-21T10:46:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:50 smithi060 ceph-mon[93270]: from='osd.4 [v2:172.21.15.112:6808/4046300887,v1:172.21.15.112:6809/4046300887]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:50 smithi060 ceph-mon[93270]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:46:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:50 smithi060 ceph-mon[93270]: from='osd.4 ' entity='osd.4' 2024-09-21T10:46:51.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:51 smithi112 ceph-mon[78695]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:46:51.371 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:51 smithi112 ceph-mon[78695]: osd.4 [v2:172.21.15.112:6808/4046300887,v1:172.21.15.112:6809/4046300887] boot 2024-09-21T10:46:51.371 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:51 smithi112 ceph-mon[78695]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T10:46:51.371 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:51 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T10:46:51.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:51 smithi060 ceph-mon[93270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:46:51.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:51 smithi060 ceph-mon[93270]: osd.4 [v2:172.21.15.112:6808/4046300887,v1:172.21.15.112:6809/4046300887] boot 2024-09-21T10:46:51.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:51 smithi060 ceph-mon[93270]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T10:46:51.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:51 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T10:46:52.153 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:52 smithi112 ceph-mon[78695]: pgmap v142: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:52.154 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:52 smithi112 ceph-mon[78695]: osdmap e73: 6 total, 6 up, 6 in 2024-09-21T10:46:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:52 smithi060 ceph-mon[93270]: pgmap v142: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:52 smithi060 ceph-mon[93270]: osdmap e73: 6 total, 6 up, 6 in 2024-09-21T10:46:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:54 smithi060 ceph-mon[93270]: pgmap v145: 65 pgs: 1 peering, 19 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:54 smithi112 ceph-mon[78695]: pgmap v145: 65 pgs: 1 peering, 19 active+undersized, 14 active+undersized+degraded, 31 active+clean; 194 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-21T10:46:55.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:55 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 23/222 objects degraded (10.360%), 9 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:55.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:55 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 23/222 objects degraded (10.360%), 9 pgs degraded (PG_DEGRADED) 2024-09-21T10:46:56.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:56 smithi060 ceph-mon[93270]: pgmap v146: 65 pgs: 1 peering, 8 active+undersized, 9 active+undersized+degraded, 47 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-21T10:46:56.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:56 smithi112 ceph-mon[78695]: pgmap v146: 65 pgs: 1 peering, 8 active+undersized, 9 active+undersized+degraded, 47 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 23/222 objects degraded (10.360%) 2024-09-21T10:46:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:57 smithi060 ceph-mon[93270]: pgmap v147: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:46:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:57 smithi060 ceph-mon[93270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/222 objects degraded (10.360%), 9 pgs degraded) 2024-09-21T10:46:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:57 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:46:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:57 smithi112 ceph-mon[78695]: pgmap v147: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:46:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:57 smithi112 ceph-mon[78695]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/222 objects degraded (10.360%), 9 pgs degraded) 2024-09-21T10:46:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:57 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:47:00.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:59 smithi060 ceph-mon[93270]: pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:00.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:00.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:46:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:59 smithi112 ceph-mon[78695]: pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:46:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:02.120 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:01 smithi112 ceph-mon[78695]: pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:02.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:01 smithi060 ceph-mon[93270]: pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:02 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T10:47:03.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:02 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T10:47:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:03 smithi112 ceph-mon[78695]: pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:03 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T10:47:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:03 smithi112 ceph-mon[78695]: Upgrade: osd.5 is safe to restart 2024-09-21T10:47:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:03.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T10:47:03.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:03 smithi060 ceph-mon[93270]: pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:03 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T10:47:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:03 smithi060 ceph-mon[93270]: Upgrade: osd.5 is safe to restart 2024-09-21T10:47:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T10:47:04.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:05.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:04 smithi112 ceph-mon[78695]: Upgrade: Updating osd.5 2024-09-21T10:47:05.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:04 smithi112 ceph-mon[78695]: Deploying daemon osd.5 on smithi112 2024-09-21T10:47:05.084 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:04 smithi060 ceph-mon[93270]: Upgrade: Updating osd.5 2024-09-21T10:47:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:04 smithi060 ceph-mon[93270]: Deploying daemon osd.5 on smithi112 2024-09-21T10:47:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:05.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:05 smithi112 ceph-mon[78695]: pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:05 smithi060 ceph-mon[93270]: pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:06.951 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:06 smithi112 systemd[1]: Stopping Ceph osd.5 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:47:07.387 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:06 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[54164]: 2024-09-21T10:47:06.994+0000 7fe427ec9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:47:07.387 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:06 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[54164]: 2024-09-21T10:47:06.994+0000 7fe427ec9640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-21T10:47:07.387 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:06 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[54164]: 2024-09-21T10:47:06.994+0000 7fe427ec9640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:47:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:07 smithi060 ceph-mon[93270]: pgmap v152: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:07 smithi060 ceph-mon[93270]: osd.5 marked itself down and dead 2024-09-21T10:47:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:07 smithi112 ceph-mon[78695]: pgmap v152: 65 pgs: 65 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:07 smithi112 ceph-mon[78695]: osd.5 marked itself down and dead 2024-09-21T10:47:08.630 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:08 smithi112 podman[97416]: 2024-09-21 10:47:08.353811369 +0000 UTC m=+1.464077615 container died 86a7a080289067bae3a4f3cdc28285d05edfa47c572dab48bd31ca70857faeae (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-6a1bdf8, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T10:47:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:08 smithi112 ceph-mon[78695]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:47:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:08 smithi112 ceph-mon[78695]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-21T10:47:08.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:08 smithi112 ceph-mon[78695]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T10:47:08.951 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:08 smithi112 podman[97416]: 2024-09-21 10:47:08.74459013 +0000 UTC m=+1.854856369 container cleanup 86a7a080289067bae3a4f3cdc28285d05edfa47c572dab48bd31ca70857faeae (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=reef-6a1bdf8) 2024-09-21T10:47:08.951 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:08 smithi112 bash[97416]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5 2024-09-21T10:47:09.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:08 smithi060 ceph-mon[93270]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T10:47:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:08 smithi060 ceph-mon[93270]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-21T10:47:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:08 smithi060 ceph-mon[93270]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T10:47:09.356 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:08 smithi112 podman[97431]: 2024-09-21 10:47:08.995921534 +0000 UTC m=+0.633866189 container remove 86a7a080289067bae3a4f3cdc28285d05edfa47c572dab48bd31ca70857faeae (image=quay.ceph.io/ceph-ci/ceph@sha256:de4fa798d334aaeb6a820ab2dad2fbcb86bcd7f118d94ed3a02ce126be31cec6, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, RELEASE=reef-6a1bdf8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:47:09.609 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:09 smithi112 podman[97519]: 2024-09-21 10:47:09.256991377 +0000 UTC m=+0.015633132 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:47:09.609 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:09 smithi112 podman[97519]: 2024-09-21 10:47:09.371824084 +0000 UTC m=+0.130465823 container create 493a54d3d808f6697214022cfc0e16a9a293c68544fa6e856b251969682db587 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T10:47:09.609 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:09 smithi112 podman[97519]: 2024-09-21 10:47:09.607708504 +0000 UTC m=+0.366350247 container init 493a54d3d808f6697214022cfc0e16a9a293c68544fa6e856b251969682db587 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T10:47:09.870 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:09 smithi112 podman[97519]: 2024-09-21 10:47:09.611259909 +0000 UTC m=+0.369901657 container start 493a54d3d808f6697214022cfc0e16a9a293c68544fa6e856b251969682db587 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:47:09.871 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:09 smithi112 podman[97519]: 2024-09-21 10:47:09.699424686 +0000 UTC m=+0.458066445 container attach 493a54d3d808f6697214022cfc0e16a9a293c68544fa6e856b251969682db587 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:47:09.871 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:09 smithi112 podman[97519]: 2024-09-21 10:47:09.804190769 +0000 UTC m=+0.562832509 container died 493a54d3d808f6697214022cfc0e16a9a293c68544fa6e856b251969682db587 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS) 2024-09-21T10:47:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:09 smithi060 ceph-mon[93270]: pgmap v154: 65 pgs: 13 stale+active+clean, 52 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:09 smithi060 ceph-mon[93270]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T10:47:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:09 smithi112 ceph-mon[78695]: pgmap v154: 65 pgs: 13 stale+active+clean, 52 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:09 smithi112 ceph-mon[78695]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T10:47:10.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 podman[97542]: 2024-09-21 10:47:10.361315675 +0000 UTC m=+0.546552778 container remove 493a54d3d808f6697214022cfc0e16a9a293c68544fa6e856b251969682db587 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T10:47:10.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T10:47:10.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 systemd[1]: Stopped Ceph osd.5 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:47:10.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.5.service: Consumed 1min 1.674s CPU time. 2024-09-21T10:47:10.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 systemd[1]: Starting Ceph osd.5 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:47:11.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:10 smithi112 ceph-mon[78695]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T10:47:11.091 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:10 smithi112 ceph-mon[78695]: Health check failed: Degraded data redundancy: 24/222 objects degraded (10.811%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T10:47:11.091 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 podman[97640]: 2024-09-21 10:47:10.695551134 +0000 UTC m=+0.015399052 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:47:11.091 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:10 smithi112 podman[97640]: 2024-09-21 10:47:10.795355594 +0000 UTC m=+0.115203514 container create ebdc070f637308c9439ad3b055401e3a8b4f9ca545045808098f156e3271a1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T10:47:11.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:10 smithi060 ceph-mon[93270]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T10:47:11.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:10 smithi060 ceph-mon[93270]: Health check failed: Degraded data redundancy: 24/222 objects degraded (10.811%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T10:47:11.450 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 podman[97640]: 2024-09-21 10:47:11.089593013 +0000 UTC m=+0.409440940 container init ebdc070f637308c9439ad3b055401e3a8b4f9ca545045808098f156e3271a1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T10:47:11.450 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 podman[97640]: 2024-09-21 10:47:11.09307501 +0000 UTC m=+0.412922935 container start ebdc070f637308c9439ad3b055401e3a8b4f9ca545045808098f156e3271a1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T10:47:11.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:11.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:11.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 bash[97640]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:11.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 bash[97640]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:11.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:11 smithi112 podman[97640]: 2024-09-21 10:47:11.27298451 +0000 UTC m=+0.592832431 container attach ebdc070f637308c9439ad3b055401e3a8b4f9ca545045808098f156e3271a1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T10:47:12.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:11 smithi060 ceph-mon[93270]: pgmap v156: 65 pgs: 9 active+undersized, 3 peering, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 24/222 objects degraded (10.811%) 2024-09-21T10:47:12.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:11 smithi112 ceph-mon[78695]: pgmap v156: 65 pgs: 9 active+undersized, 3 peering, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 24/222 objects degraded (10.811%) 2024-09-21T10:47:14.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:13 smithi060 ceph-mon[93270]: pgmap v157: 65 pgs: 13 active+undersized, 3 peering, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:14.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:14.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:14.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:13 smithi112 ceph-mon[78695]: pgmap v157: 65 pgs: 13 active+undersized, 3 peering, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:14.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:14.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T10:47:14.201 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T10:47:14.687 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T10:47:14.688 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T10:47:14.688 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate[97655]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T10:47:14.688 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 bash[97640]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T10:47:14.688 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 podman[97640]: 2024-09-21 10:47:14.391332161 +0000 UTC m=+3.711180080 container died ebdc070f637308c9439ad3b055401e3a8b4f9ca545045808098f156e3271a1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:47:15.312 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:14 smithi112 ceph-mon[78695]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T10:47:15.312 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:14 smithi112 podman[97870]: 2024-09-21 10:47:14.98540085 +0000 UTC m=+0.586384304 container remove ebdc070f637308c9439ad3b055401e3a8b4f9ca545045808098f156e3271a1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T10:47:15.312 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 podman[97932]: 2024-09-21 10:47:15.092261208 +0000 UTC m=+0.016018343 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:47:15.312 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 podman[97932]: 2024-09-21 10:47:15.194618382 +0000 UTC m=+0.118375559 container create deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:47:15.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:14 smithi060 ceph-mon[93270]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T10:47:15.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 podman[97932]: 2024-09-21 10:47:15.455653185 +0000 UTC m=+0.379410329 container init deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T10:47:15.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 podman[97932]: 2024-09-21 10:47:15.458813537 +0000 UTC m=+0.382570683 container start deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T10:47:15.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 ceph-osd[97951]: -- 172.21.15.112:0/1227397400 <== mon.1 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb359a01e0 con 0x55cb34b93c00 2024-09-21T10:47:15.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 bash[97932]: deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 2024-09-21T10:47:15.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:15 smithi112 systemd[1]: Started Ceph osd.5 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:47:16.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:15 smithi112 ceph-mon[78695]: pgmap v158: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:16.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:16.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:16.291 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:16.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:15 smithi060 ceph-mon[93270]: pgmap v158: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:16.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:16.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:16.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 -- 172.21.15.60:0/4086549557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774102f60 msgr2=0x7ff774105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 --2- 172.21.15.60:0/4086549557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774102f60 0x7ff774105350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0098b0 tx=0x7ff75c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 -- 172.21.15.60:0/4086549557 shutdown_connections 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 --2- 172.21.15.60:0/4086549557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774102f60 0x7ff774105350 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 --2- 172.21.15.60:0/4086549557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff774100630 0x7ff774102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 -- 172.21.15.60:0/4086549557 >> 172.21.15.60:0/4086549557 conn(0x7ff7740fa250 msgr2=0x7ff7740fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 -- 172.21.15.60:0/4086549557 shutdown_connections 2024-09-21T10:47:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.549+0000 7ff77b10d640 1 -- 172.21.15.60:0/4086549557 wait complete. 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff77b10d640 1 Processor -- start 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff77b10d640 1 -- start start 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff77b10d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 0x7ff774195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff77b10d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff774102f60 0x7ff774195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff77b10d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff774196180 con 0x7ff774100630 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff77b10d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7741962f0 con 0x7ff774102f60 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff778ea9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 0x7ff774195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff778ea9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 0x7ff774195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37258/0 (socket says 172.21.15.60:37258) 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.550+0000 7ff778ea9640 1 -- 172.21.15.60:0/893652425 learned_addr learned my addr 172.21.15.60:0/893652425 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff773fff640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff774102f60 0x7ff774195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff778ea9640 1 -- 172.21.15.60:0/893652425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff774102f60 msgr2=0x7ff774195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff778ea9640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff774102f60 0x7ff774195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff778ea9640 1 -- 172.21.15.60:0/893652425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c009560 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff778ea9640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 0x7ff774195670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff76400e9a0 tx=0x7ff76400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff76400cd50 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff76400ceb0 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff764010660 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.551+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77419ad90 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.552+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77419b2d0 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.553+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7741087b0 con 0x7ff774100630 2024-09-21T10:47:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.553+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff7640048a0 con 0x7ff774100630 2024-09-21T10:47:17.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.554+0000 7ff771ffb640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff76007b270 0x7ff76007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:17.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.554+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff764014070 con 0x7ff774100630 2024-09-21T10:47:17.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.554+0000 7ff773fff640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff76007b270 0x7ff76007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:17.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.554+0000 7ff773fff640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff76007b270 0x7ff76007d730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009880 tx=0x7ff75c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:17.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.558+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ff764064ff0 con 0x7ff774100630 2024-09-21T10:47:17.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:17 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:47:17.356+0000 7ff1f6a21640 -1 Falling back to public interface 2024-09-21T10:47:17.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.765+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7741039c0 con 0x7ff76007b270 2024-09-21T10:47:17.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.766+0000 7ff771ffb640 1 -- 172.21.15.60:0/893652425 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff7741039c0 con 0x7ff76007b270 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff76007b270 msgr2=0x7ff76007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff76007b270 0x7ff76007d730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009880 tx=0x7ff75c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 msgr2=0x7ff774195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 0x7ff774195670 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff76400e9a0 tx=0x7ff76400eda0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 shutdown_connections 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff76007b270 0x7ff76007d730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff774102f60 0x7ff774195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 --2- 172.21.15.60:0/893652425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff774100630 0x7ff774195670 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 >> 172.21.15.60:0/893652425 conn(0x7ff7740fa250 msgr2=0x7ff7740fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 shutdown_connections 2024-09-21T10:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.769+0000 7ff77b10d640 1 -- 172.21.15.60:0/893652425 wait complete. 2024-09-21T10:47:17.780 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.853+0000 7f8a85997640 1 -- 172.21.15.60:0/1474135838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 msgr2=0x7f8a80100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.853+0000 7f8a85997640 1 --2- 172.21.15.60:0/1474135838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80100170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009880 tx=0x7f8a7402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 -- 172.21.15.60:0/1474135838 shutdown_connections 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 --2- 172.21.15.60:0/1474135838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80100170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 --2- 172.21.15.60:0/1474135838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a800feaf0 0x7f8a800feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 -- 172.21.15.60:0/1474135838 >> 172.21.15.60:0/1474135838 conn(0x7f8a800fa280 msgr2=0x7f8a800fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 -- 172.21.15.60:0/1474135838 shutdown_connections 2024-09-21T10:47:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 -- 172.21.15.60:0/1474135838 wait complete. 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.854+0000 7f8a85997640 1 Processor -- start 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a85997640 1 -- start start 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a85997640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a800feaf0 0x7f8a80195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a85997640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a85997640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80196220 con 0x7f8a800ffcf0 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a85997640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80196390 con 0x7f8a800feaf0 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37274/0 (socket says 172.21.15.60:37274) 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 -- 172.21.15.60:0/3270170292 learned_addr learned my addr 172.21.15.60:0/3270170292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7effd640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a800feaf0 0x7f8a80195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 -- 172.21.15.60:0/3270170292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a800feaf0 msgr2=0x7f8a80195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a800feaf0 0x7f8a80195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 -- 172.21.15.60:0/3270170292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a74009560 con 0x7f8a800ffcf0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.855+0000 7f8a7e7fc640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80195c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a740055a0 tx=0x7f8a740055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.856+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a74004aa0 con 0x7f8a800ffcf0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.856+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8019add0 con 0x7f8a800ffcf0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.856+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a74004c00 con 0x7f8a800ffcf0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.856+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a74003a80 con 0x7f8a800ffcf0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.856+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8019b2c0 con 0x7f8a800ffcf0 2024-09-21T10:47:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.857+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a80107700 con 0x7f8a800ffcf0 2024-09-21T10:47:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.857+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8a74031c70 con 0x7f8a800ffcf0 2024-09-21T10:47:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.858+0000 7f8a84995640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8a6807b270 0x7f8a6807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.858+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f8a740bf420 con 0x7f8a800ffcf0 2024-09-21T10:47:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.858+0000 7f8a7effd640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8a6807b270 0x7f8a6807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.859+0000 7f8a7effd640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8a6807b270 0x7f8a6807d730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fd0 tx=0x7f8a7000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:17.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:17.863+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f8a74082560 con 0x7f8a800ffcf0 2024-09-21T10:47:18.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.069+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a800683d0 con 0x7f8a6807b270 2024-09-21T10:47:18.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.070+0000 7f8a84995640 1 -- 172.21.15.60:0/3270170292 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8a800683d0 con 0x7f8a6807b270 2024-09-21T10:47:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.072+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8a6807b270 msgr2=0x7f8a6807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.072+0000 7f8a85997640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8a6807b270 0x7f8a6807d730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a70005fd0 tx=0x7f8a7000b390 comp rx=0 tx=0).stop 2024-09-21T10:47:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.072+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 msgr2=0x7f8a80195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.072+0000 7f8a85997640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80195c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a740055a0 tx=0x7f8a740055d0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 shutdown_connections 2024-09-21T10:47:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8a6807b270 0x7f8a6807d730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a800ffcf0 0x7f8a80195c50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 --2- 172.21.15.60:0/3270170292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a800feaf0 0x7f8a80195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 >> 172.21.15.60:0/3270170292 conn(0x7f8a800fa280 msgr2=0x7f8a80067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:18.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 shutdown_connections 2024-09-21T10:47:18.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.073+0000 7f8a85997640 1 -- 172.21.15.60:0/3270170292 wait complete. 2024-09-21T10:47:18.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 -- 172.21.15.60:0/4286366106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980ffaa0 msgr2=0x7f4c980fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/4286366106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980ffaa0 0x7f4c980fff20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009880 tx=0x7f4c8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 -- 172.21.15.60:0/4286366106 shutdown_connections 2024-09-21T10:47:18.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/4286366106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980ffaa0 0x7f4c980fff20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/4286366106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c980fe8a0 0x7f4c980feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 -- 172.21.15.60:0/4286366106 >> 172.21.15.60:0/4286366106 conn(0x7f4c980fa010 msgr2=0x7f4c980fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:18.160 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:17 smithi060 ceph-mon[93270]: pgmap v159: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:18.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 -- 172.21.15.60:0/4286366106 shutdown_connections 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 -- 172.21.15.60:0/4286366106 wait complete. 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.157+0000 7f4c9eba1640 1 Processor -- start 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9eba1640 1 -- start start 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9eba1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 0x7f4c98195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9eba1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c980ffaa0 0x7f4c98195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9eba1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98195f60 con 0x7f4c980fe8a0 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9eba1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c981960d0 con 0x7f4c980ffaa0 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 0x7f4c98195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 0x7f4c98195450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37280/0 (socket says 172.21.15.60:37280) 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 -- 172.21.15.60:0/2750416949 learned_addr learned my addr 172.21.15.60:0/2750416949 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9d39e640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c980ffaa0 0x7f4c98195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 -- 172.21.15.60:0/2750416949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c980ffaa0 msgr2=0x7f4c98195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c980ffaa0 0x7f4c98195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 -- 172.21.15.60:0/2750416949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009560 con 0x7f4c980fe8a0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.158+0000 7f4c9db9f640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 0x7f4c98195450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000e970 tx=0x7f4c9000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.159+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c900096e0 con 0x7f4c980fe8a0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.159+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9819ab70 con 0x7f4c980fe8a0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.159+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c900044f0 con 0x7f4c980fe8a0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.159+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c90010430 con 0x7f4c980fe8a0 2024-09-21T10:47:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.159+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9819b090 con 0x7f4c980fe8a0 2024-09-21T10:47:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.160+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c981074b0 con 0x7f4c980fe8a0 2024-09-21T10:47:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.161+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f4c9000cc90 con 0x7f4c980fe8a0 2024-09-21T10:47:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.162+0000 7f4c96ffd640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4c8007b270 0x7f4c8007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.162+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4c90014070 con 0x7f4c980fe8a0 2024-09-21T10:47:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.162+0000 7f4c9d39e640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4c8007b270 0x7f4c8007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.162+0000 7f4c9d39e640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4c8007b270 0x7f4c8007d730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c000c00 tx=0x7f4c8c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.166+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f4c90061950 con 0x7f4c980fe8a0 2024-09-21T10:47:18.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:17 smithi112 ceph-mon[78695]: pgmap v159: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:18.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.360+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c980683f0 con 0x7f4c8007b270 2024-09-21T10:47:18.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.370+0000 7f4c96ffd640 1 -- 172.21.15.60:0/2750416949 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4c980683f0 con 0x7f4c8007b270 2024-09-21T10:47:18.372 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:47:18.372 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (13m) 104s ago 15m 24.6M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:47:18.372 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (6m) 104s ago 15m 8376k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:47:18.372 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (5m) 35s ago 14m 8132k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (3m) 104s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (3m) 35s ago 14m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (13m) 104s ago 14m 86.6M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (8m) 104s ago 8m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (9m) 104s ago 9m 16.4M - 18.2.4-871-g6a1bdf85 0adab276c97e 0c121be0f253 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (8m) 35s ago 8m 18.5M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (9m) 35s ago 9m 20.8M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (5m) 104s ago 16m 516M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (4m) 35s ago 14m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (4m) 104s ago 16m 47.5M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (4m) 35s ago 14m 40.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (15m) 104s ago 15m 16.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:47:18.373 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (14m) 35s ago 14m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (3m) 104s ago 12m 103M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (2m) 104s ago 12m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (109s) 104s ago 11m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (72s) 35s ago 11m 104M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (38s) 35s ago 10m 11.7M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 starting - - - 2240M 2024-09-21T10:47:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (4m) 104s ago 14m 66.5M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4c8007b270 msgr2=0x7f4c8007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4c8007b270 0x7f4c8007d730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c000c00 tx=0x7f4c8c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 msgr2=0x7f4c98195450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 0x7f4c98195450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000e970 tx=0x7f4c9000ee30 comp rx=0 tx=0).stop 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 shutdown_connections 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f4c8007b270 0x7f4c8007d730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c980ffaa0 0x7f4c98195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 --2- 172.21.15.60:0/2750416949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c980fe8a0 0x7f4c98195450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 >> 172.21.15.60:0/2750416949 conn(0x7f4c980fa010 msgr2=0x7f4c98067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 shutdown_connections 2024-09-21T10:47:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.372+0000 7f4c9eba1640 1 -- 172.21.15.60:0/2750416949 wait complete. 2024-09-21T10:47:18.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 -- 172.21.15.60:0/1541294760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c100d90 msgr2=0x7f538c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 --2- 172.21.15.60:0/1541294760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c100d90 0x7f538c101210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5378009880 tx=0x7f537802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 -- 172.21.15.60:0/1541294760 shutdown_connections 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 --2- 172.21.15.60:0/1541294760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c100d90 0x7f538c101210 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 --2- 172.21.15.60:0/1541294760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f538c0ffb90 0x7f538c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 -- 172.21.15.60:0/1541294760 >> 172.21.15.60:0/1541294760 conn(0x7f538c0fb320 msgr2=0x7f538c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 -- 172.21.15.60:0/1541294760 shutdown_connections 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.457+0000 7f5392bef640 1 -- 172.21.15.60:0/1541294760 wait complete. 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f5392bef640 1 Processor -- start 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f5392bef640 1 -- start start 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f5392bef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 0x7f538c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f5392bef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f538c100d90 0x7f538c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f5392bef640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c072de0 con 0x7f538c0ffb90 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f5392bef640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c072f50 con 0x7f538c100d90 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f539098b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 0x7f538c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f539098b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 0x7f538c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37302/0 (socket says 172.21.15.60:37302) 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f539098b640 1 -- 172.21.15.60:0/940767826 learned_addr learned my addr 172.21.15.60:0/940767826 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f538bfff640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f538c100d90 0x7f538c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f539098b640 1 -- 172.21.15.60:0/940767826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f538c100d90 msgr2=0x7f538c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f539098b640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f538c100d90 0x7f538c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.458+0000 7f539098b640 1 -- 172.21.15.60:0/940767826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378009560 con 0x7f538c0ffb90 2024-09-21T10:47:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.459+0000 7f539098b640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 0x7f538c074250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f538000e940 tx=0x7f538000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.459+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53800096e0 con 0x7f538c0ffb90 2024-09-21T10:47:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.459+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53800044f0 con 0x7f538c0ffb90 2024-09-21T10:47:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.459+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c073230 con 0x7f538c0ffb90 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.459+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5380010430 con 0x7f538c0ffb90 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.459+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c19d690 con 0x7f538c0ffb90 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.460+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c0fff90 con 0x7f538c0ffb90 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.461+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f538000cc90 con 0x7f538c0ffb90 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.461+0000 7f5389ffb640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f537c07b270 0x7f537c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.461+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5380014070 con 0x7f538c0ffb90 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.461+0000 7f538bfff640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f537c07b270 0x7f537c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.462+0000 7f538bfff640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f537c07b270 0x7f537c07d730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f53780314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.466+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f5380061760 con 0x7f538c0ffb90 2024-09-21T10:47:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.732+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f538c02c480 con 0x7f538c0ffb90 2024-09-21T10:47:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.733+0000 7f5389ffb640 1 -- 172.21.15.60:0/940767826 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+728 (secure 0 0 0) 0x7f5380064880 con 0x7f538c0ffb90 2024-09-21T10:47:18.735 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:47:18.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:47:18.735 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:47:18.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 5 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 4, 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 9 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:47:18.736 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:47:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f537c07b270 msgr2=0x7f537c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f537c07b270 0x7f537c07d730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5378000c00 tx=0x7f53780314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 msgr2=0x7f538c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 0x7f538c074250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f538000e940 tx=0x7f538000ee00 comp rx=0 tx=0).stop 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 shutdown_connections 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f537c07b270 0x7f537c07d730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f538c100d90 0x7f538c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 --2- 172.21.15.60:0/940767826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f538c0ffb90 0x7f538c074250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 >> 172.21.15.60:0/940767826 conn(0x7f538c0fb320 msgr2=0x7f538c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 shutdown_connections 2024-09-21T10:47:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.735+0000 7f5392bef640 1 -- 172.21.15.60:0/940767826 wait complete. 2024-09-21T10:47:18.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 -- 172.21.15.60:0/2385946818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c100680 msgr2=0x7f487c102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 --2- 172.21.15.60:0/2385946818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c100680 0x7f487c102a70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f486c0098b0 tx=0x7f486c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 -- 172.21.15.60:0/2385946818 shutdown_connections 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 --2- 172.21.15.60:0/2385946818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f487c102fb0 0x7f487c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 --2- 172.21.15.60:0/2385946818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c100680 0x7f487c102a70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 -- 172.21.15.60:0/2385946818 >> 172.21.15.60:0/2385946818 conn(0x7f487c0fa280 msgr2=0x7f487c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 -- 172.21.15.60:0/2385946818 shutdown_connections 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.819+0000 7f4882a53640 1 -- 172.21.15.60:0/2385946818 wait complete. 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f4882a53640 1 Processor -- start 2024-09-21T10:47:18.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f4882a53640 1 -- start start 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f4882a53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f487c100680 0x7f487c0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f4882a53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 0x7f487c0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f4882a53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0feb70 con 0x7f487c102fb0 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f4882a53640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0fece0 con 0x7f487c100680 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 0x7f487c0fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 0x7f487c0fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37324/0 (socket says 172.21.15.60:37324) 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487b7fe640 1 -- 172.21.15.60:0/3385786701 learned_addr learned my addr 172.21.15.60:0/3385786701 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487bfff640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f487c100680 0x7f487c0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487b7fe640 1 -- 172.21.15.60:0/3385786701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f487c100680 msgr2=0x7f487c0fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487b7fe640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f487c100680 0x7f487c0fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:18.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.820+0000 7f487b7fe640 1 -- 172.21.15.60:0/3385786701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c009560 con 0x7f487c102fb0 2024-09-21T10:47:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.821+0000 7f487b7fe640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 0x7f487c0fe630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f487000e970 tx=0x7f487000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.821+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487000cc90 con 0x7f487c102fb0 2024-09-21T10:47:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.821+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f487000cdf0 con 0x7f487c102fb0 2024-09-21T10:47:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.821+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c0fefc0 con 0x7f487c102fb0 2024-09-21T10:47:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.821+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4870010430 con 0x7f487c102fb0 2024-09-21T10:47:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.821+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c19d770 con 0x7f487c102fb0 2024-09-21T10:47:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.822+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c108830 con 0x7f487c102fb0 2024-09-21T10:47:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.823+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f48700046c0 con 0x7f487c102fb0 2024-09-21T10:47:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.823+0000 7f48797fa640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f486407b270 0x7f486407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.823+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4870014070 con 0x7f487c102fb0 2024-09-21T10:47:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.823+0000 7f487bfff640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f486407b270 0x7f486407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.824+0000 7f487bfff640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f486407b270 0x7f486407d730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f486c006010 tx=0x7f486c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:18.827+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f4870061870 con 0x7f487c102fb0 2024-09-21T10:47:19.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.057+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f487c19dab0 con 0x7f487c102fb0 2024-09-21T10:47:19.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.057+0000 7f48797fa640 1 -- 172.21.15.60:0/3385786701 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f4870064990 con 0x7f487c102fb0 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:e15 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 15 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:38:28.451343+0000 2024-09-21T10:47:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 45 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=14544} 2024-09-21T10:47:19.061 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{0:14544} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.60:6828/4161459268,v1:172.21.15.60:6829/4161459268] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:47:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:19.063 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:14556} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/524330333,v1:172.21.15.60:6827/524330333] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:47:19.063 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:24329} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:47:19.063 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:47:19.063 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 15 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f486407b270 msgr2=0x7f486407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f486407b270 0x7f486407d730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f486c006010 tx=0x7f486c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 msgr2=0x7f487c0fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 0x7f487c0fe630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f487000e970 tx=0x7f487000ee30 comp rx=0 tx=0).stop 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 shutdown_connections 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f486407b270 0x7f486407d730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f487c102fb0 0x7f487c0fe630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 --2- 172.21.15.60:0/3385786701 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f487c100680 0x7f487c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.060+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 >> 172.21.15.60:0/3385786701 conn(0x7f487c0fa280 msgr2=0x7f487c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.061+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 shutdown_connections 2024-09-21T10:47:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.061+0000 7f4882a53640 1 -- 172.21.15.60:0/3385786701 wait complete. 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 -- 172.21.15.60:0/2263501911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3734100d90 msgr2=0x7f3734101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 --2- 172.21.15.60:0/2263501911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3734100d90 0x7f3734101210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3728009880 tx=0x7f372802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 -- 172.21.15.60:0/2263501911 shutdown_connections 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 --2- 172.21.15.60:0/2263501911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3734100d90 0x7f3734101210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 --2- 172.21.15.60:0/2263501911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37340ffb90 0x7f37340fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 -- 172.21.15.60:0/2263501911 >> 172.21.15.60:0/2263501911 conn(0x7f37340fb320 msgr2=0x7f37340fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 -- 172.21.15.60:0/2263501911 shutdown_connections 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.145+0000 7f3739857640 1 -- 172.21.15.60:0/2263501911 wait complete. 2024-09-21T10:47:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3739857640 1 Processor -- start 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3739857640 1 -- start start 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3739857640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 0x7f37341977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3739857640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3734100d90 0x7f3734197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3739857640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734198300 con 0x7f37340ffb90 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3739857640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734198470 con 0x7f3734100d90 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 0x7f37341977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 0x7f37341977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37332/0 (socket says 172.21.15.60:37332) 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f3732ffd640 1 -- 172.21.15.60:0/3185604010 learned_addr learned my addr 172.21.15.60:0/3185604010 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.146+0000 7f37327fc640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3734100d90 0x7f3734197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3732ffd640 1 -- 172.21.15.60:0/3185604010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3734100d90 msgr2=0x7f3734197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3732ffd640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3734100d90 0x7f3734197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3732ffd640 1 -- 172.21.15.60:0/3185604010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3728009560 con 0x7f37340ffb90 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3732ffd640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 0x7f37341977f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f372400d720 tx=0x7f372400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37240041f0 con 0x7f37340ffb90 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3724004350 con 0x7f37340ffb90 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373419cf10 con 0x7f37340ffb90 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3724003df0 con 0x7f37340ffb90 2024-09-21T10:47:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.147+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373419d450 con 0x7f37340ffb90 2024-09-21T10:47:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.148+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340fff90 con 0x7f37340ffb90 2024-09-21T10:47:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.149+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f37240035f0 con 0x7f37340ffb90 2024-09-21T10:47:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.149+0000 7f3738855640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f371c07b220 0x7f371c07d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.150+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f372409dcf0 con 0x7f37340ffb90 2024-09-21T10:47:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.150+0000 7f37327fc640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f371c07b220 0x7f371c07d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.150+0000 7f37327fc640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f371c07b220 0x7f371c07d6e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f37280314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.154+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f3724060db0 con 0x7f37340ffb90 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/940767826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.322 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:18 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.361+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f373402c5d0 con 0x7f371c07b220 2024-09-21T10:47:19.363 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:19.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:19.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/940767826' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:19.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.364 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:18 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.362+0000 7f3738855640 1 -- 172.21.15.60:0/3185604010 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f373402c5d0 con 0x7f371c07b220 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "12/23 daemons upgraded", 2024-09-21T10:47:19.365 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T10:47:19.366 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:47:19.366 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:47:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f371c07b220 msgr2=0x7f371c07d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f371c07b220 0x7f371c07d6e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f37280314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 msgr2=0x7f37341977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 0x7f37341977f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f372400d720 tx=0x7f372400dbe0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 shutdown_connections 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f371c07b220 0x7f371c07d6e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3734100d90 0x7f3734197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 --2- 172.21.15.60:0/3185604010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37340ffb90 0x7f37341977f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 >> 172.21.15.60:0/3185604010 conn(0x7f37340fb320 msgr2=0x7f3734072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 shutdown_connections 2024-09-21T10:47:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.365+0000 7f3739857640 1 -- 172.21.15.60:0/3185604010 wait complete. 2024-09-21T10:47:19.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 -- 172.21.15.60:0/1233154466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660103030 msgr2=0x7fe660105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 --2- 172.21.15.60:0/1233154466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660103030 0x7fe660105420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe654009880 tx=0x7fe65402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 -- 172.21.15.60:0/1233154466 shutdown_connections 2024-09-21T10:47:19.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 --2- 172.21.15.60:0/1233154466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660103030 0x7fe660105420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 --2- 172.21.15.60:0/1233154466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe660100700 0x7fe660102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 -- 172.21.15.60:0/1233154466 >> 172.21.15.60:0/1233154466 conn(0x7fe6600fa280 msgr2=0x7fe6600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 -- 172.21.15.60:0/1233154466 shutdown_connections 2024-09-21T10:47:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 -- 172.21.15.60:0/1233154466 wait complete. 2024-09-21T10:47:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.449+0000 7fe667ed1640 1 Processor -- start 2024-09-21T10:47:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe667ed1640 1 -- start start 2024-09-21T10:47:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe667ed1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 0x7fe660100060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe667ed1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe660103030 0x7fe6600fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe667ed1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600febf0 con 0x7fe660100700 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe667ed1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600fed60 con 0x7fe660103030 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 0x7fe660100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 0x7fe660100060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37358/0 (socket says 172.21.15.60:37358) 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 -- 172.21.15.60:0/3812438382 learned_addr learned my addr 172.21.15.60:0/3812438382 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe66546c640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe660103030 0x7fe6600fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 -- 172.21.15.60:0/3812438382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe660103030 msgr2=0x7fe6600fe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe660103030 0x7fe6600fe6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 -- 172.21.15.60:0/3812438382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654009560 con 0x7fe660100700 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.450+0000 7fe665c6d640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 0x7fe660100060 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe65000eb40 tx=0x7fe65000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.451+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe650010430 con 0x7fe660100700 2024-09-21T10:47:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.451+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe650010a50 con 0x7fe660100700 2024-09-21T10:47:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.451+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe650018b30 con 0x7fe660100700 2024-09-21T10:47:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.451+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6600ff040 con 0x7fe660100700 2024-09-21T10:47:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.451+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66019d710 con 0x7fe660100700 2024-09-21T10:47:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.452+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe660109160 con 0x7fe660100700 2024-09-21T10:47:19.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.452+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe650018d20 con 0x7fe660100700 2024-09-21T10:47:19.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.453+0000 7fe65effd640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe64807b270 0x7fe64807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:19.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.453+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe650014070 con 0x7fe660100700 2024-09-21T10:47:19.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.453+0000 7fe66546c640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe64807b270 0x7fe64807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:19.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.454+0000 7fe66546c640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe64807b270 0x7fe64807d730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe654006010 tx=0x7fe6540314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:19.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.457+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fe650061a70 con 0x7fe660100700 2024-09-21T10:47:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.721+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe660100ae0 con 0x7fe660100700 2024-09-21T10:47:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.721+0000 7fe65effd640 1 -- 172.21.15.60:0/3812438382 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1179 (secure 0 0 0) 0x7fe650064b90 con 0x7fe660100700 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout: osd.5 (root=default,host=smithi112) is down 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-21T10:47:19.724 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-21T10:47:19.725 INFO:teuthology.orchestra.run.smithi060.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe64807b270 msgr2=0x7fe64807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe64807b270 0x7fe64807d730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe654006010 tx=0x7fe6540314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 msgr2=0x7fe660100060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 0x7fe660100060 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe65000eb40 tx=0x7fe65000c2d0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 shutdown_connections 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe64807b270 0x7fe64807d730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe660103030 0x7fe6600fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 --2- 172.21.15.60:0/3812438382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe660100700 0x7fe660100060 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:19.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.723+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 >> 172.21.15.60:0/3812438382 conn(0x7fe6600fa280 msgr2=0x7fe6600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:19.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.724+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 shutdown_connections 2024-09-21T10:47:19.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:19.724+0000 7fe667ed1640 1 -- 172.21.15.60:0/3812438382 wait complete. 2024-09-21T10:47:20.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:19 smithi112 ceph-mon[78695]: pgmap v160: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:20.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:19 smithi112 ceph-mon[78695]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:20.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:19 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3385786701' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:47:20.283 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:19 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3812438382' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:47:20.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:19 smithi060 ceph-mon[93270]: pgmap v160: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:20.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:19 smithi060 ceph-mon[93270]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:20.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:19 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3385786701' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:47:20.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:19 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3812438382' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:47:21.325 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:20 smithi112 ceph-mon[78695]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:21.325 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:20 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T10:47:21.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:20 smithi060 ceph-mon[93270]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:21.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:20 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T10:47:22.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:21 smithi060 ceph-mon[93270]: pgmap v161: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:21 smithi112 ceph-mon[78695]: pgmap v161: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:23.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:23.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:47:23.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T10:47:23.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T10:47:23.367 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-21T10:47:23.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T10:47:23.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T10:47:23.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-21T10:47:23.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:23 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:47:23.363+0000 7ff1f6a21640 -1 osd.5 73 log_to_monitors true 2024-09-21T10:47:24.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all osd 2024-09-21T10:47:24.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: Upgrade: Setting require_osd_release to 19 squid 2024-09-21T10:47:24.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: pgmap v162: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:24.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-21T10:47:24.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-21T10:47:24.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T10:47:24.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.xjabvh"]} : dispatch 2024-09-21T10:47:24.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: from='osd.5 [v2:172.21.15.112:6816/1334725749,v1:172.21.15.112:6817/1334725749]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T10:47:24.144 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:24 smithi060 ceph-mon[93270]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T10:47:24.450 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:47:24.228+0000 7ff1ee7cb640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T10:47:24.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all osd 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: Upgrade: Setting require_osd_release to 19 squid 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: pgmap v162: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.xjabvh"]} : dispatch 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: from='osd.5 [v2:172.21.15.112:6816/1334725749,v1:172.21.15.112:6817/1334725749]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T10:47:24.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:24 smithi112 ceph-mon[78695]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: Upgrade: It appears safe to stop mds.cephfs.smithi060.xjabvh 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: osdmap e77: 6 total, 5 up, 6 in 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: from='osd.5 [v2:172.21.15.112:6816/1334725749,v1:172.21.15.112:6817/1334725749]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:47:25.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:25.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: Upgrade: It appears safe to stop mds.cephfs.smithi060.xjabvh 2024-09-21T10:47:25.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T10:47:25.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: osdmap e77: 6 total, 5 up, 6 in 2024-09-21T10:47:25.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: from='osd.5 [v2:172.21.15.112:6816/1334725749,v1:172.21.15.112:6817/1334725749]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:47:25.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-21T10:47:25.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:25.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.xjabvh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:47:25.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: pgmap v165: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: Upgrade: Updating mds.cephfs.smithi060.xjabvh 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: Deploying daemon mds.cephfs.smithi060.xjabvh on smithi060 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: osd.5 [v2:172.21.15.112:6816/1334725749,v1:172.21.15.112:6817/1334725749] boot 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T10:47:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T10:47:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: pgmap v165: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-21T10:47:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: Upgrade: Updating mds.cephfs.smithi060.xjabvh 2024-09-21T10:47:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: Deploying daemon mds.cephfs.smithi060.xjabvh on smithi060 2024-09-21T10:47:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T10:47:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: osd.5 [v2:172.21.15.112:6816/1334725749,v1:172.21.15.112:6817/1334725749] boot 2024-09-21T10:47:26.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T10:47:26.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T10:47:27.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:27 smithi112 ceph-mon[78695]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T10:47:27.664 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:27 smithi112 ceph-mon[78695]: pgmap v168: 65 pgs: 4 peering, 14 active+undersized, 10 active+undersized+degraded, 37 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-21T10:47:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:27 smithi060 ceph-mon[93270]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T10:47:27.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:27 smithi060 ceph-mon[93270]: pgmap v168: 65 pgs: 4 peering, 14 active+undersized, 10 active+undersized+degraded, 37 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-21T10:47:28.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:28 smithi060 ceph-mon[93270]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T10:47:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:28 smithi060 ceph-mon[93270]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T10:47:28.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:28 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 2 up:standby 2024-09-21T10:47:28.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:28 smithi112 ceph-mon[78695]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T10:47:28.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:28 smithi112 ceph-mon[78695]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T10:47:28.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:28 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 2 up:standby 2024-09-21T10:47:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:29 smithi060 ceph-mon[93270]: pgmap v170: 65 pgs: 4 peering, 14 active+undersized, 10 active+undersized+degraded, 37 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-21T10:47:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:30.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:47:30.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:29 smithi112 ceph-mon[78695]: pgmap v170: 65 pgs: 4 peering, 14 active+undersized, 10 active+undersized+degraded, 37 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-21T10:47:30.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:30.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:30.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:47:31.070 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:30 smithi060 ceph-mon[93270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded) 2024-09-21T10:47:31.070 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:30 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:47:31.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:30 smithi112 ceph-mon[78695]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/222 objects degraded (11.712%), 10 pgs degraded) 2024-09-21T10:47:31.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:30 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:47:32.164 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:31 smithi060 ceph-mon[93270]: pgmap v171: 65 pgs: 4 peering, 61 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:32.164 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:32.164 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:32.164 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:31 smithi112 ceph-mon[78695]: pgmap v171: 65 pgs: 4 peering, 61 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:32.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:32.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:32.887 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:32 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:boot 2024-09-21T10:47:32.887 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:32 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:47:32.888 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:32 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:47:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:32 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:boot 2024-09-21T10:47:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:32 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi060.lljnqu=up:active} 3 up:standby 2024-09-21T10:47:32.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:32 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:47:33.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:33 smithi060 ceph-mon[93270]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:34.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:33 smithi112 ceph-mon[78695]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:36.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:35 smithi060 ceph-mon[93270]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:36.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:35 smithi112 ceph-mon[78695]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:37.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:37 smithi060 ceph-mon[93270]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:37.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.562 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:37 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:37 smithi112 ceph-mon[78695]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:37.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:37 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:40.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:39 smithi060 ceph-mon[93270]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:40.015 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:39 smithi112 ceph-mon[78695]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:40.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:41 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.lljnqu"]} : dispatch 2024-09-21T10:47:41.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:47:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:41.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:41 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi060.lljnqu"]} : dispatch 2024-09-21T10:47:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:42 smithi060 ceph-mon[93270]: Upgrade: It appears safe to stop mds.cephfs.smithi060.lljnqu 2024-09-21T10:47:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:42 smithi060 ceph-mon[93270]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:47:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:42.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:42 smithi112 ceph-mon[78695]: Upgrade: It appears safe to stop mds.cephfs.smithi060.lljnqu 2024-09-21T10:47:42.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:42 smithi112 ceph-mon[78695]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:42.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:42.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi060.lljnqu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:47:42.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:47:43.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:43 smithi112 ceph-mon[78695]: Upgrade: Updating mds.cephfs.smithi060.lljnqu 2024-09-21T10:47:43.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:43 smithi112 ceph-mon[78695]: Deploying daemon mds.cephfs.smithi060.lljnqu on smithi060 2024-09-21T10:47:43.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:43 smithi060 ceph-mon[93270]: Upgrade: Updating mds.cephfs.smithi060.lljnqu 2024-09-21T10:47:43.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:43 smithi060 ceph-mon[93270]: Deploying daemon mds.cephfs.smithi060.lljnqu on smithi060 2024-09-21T10:47:43.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:43 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[93266]: 2024-09-21T10:47:43.474+0000 7fc063d9b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: Standby daemon mds.cephfs.smithi112.worwat assigned to filesystem cephfs as rank 0 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi112.worwat=up:replay} 2 up:standby 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:47:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:47:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:47:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T10:47:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: Standby daemon mds.cephfs.smithi112.worwat assigned to filesystem cephfs as rank 0 2024-09-21T10:47:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:47:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T10:47:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi112.worwat=up:replay} 2 up:standby 2024-09-21T10:47:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:44.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:47:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:45 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:47:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:45 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:47:46.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:46 smithi060 ceph-mon[93270]: pgmap v179: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-21T10:47:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:46 smithi112 ceph-mon[78695]: pgmap v179: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-21T10:47:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:48 smithi060 ceph-mon[93270]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-09-21T10:47:48.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:48 smithi112 ceph-mon[78695]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-09-21T10:47:49.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.817+0000 7f339bcc3640 1 -- 172.21.15.60:0/319936731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 msgr2=0x7f3394105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:49.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.817+0000 7f339bcc3640 1 --2- 172.21.15.60:0/319936731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394105350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f33900098b0 tx=0x7f339002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:47:49.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.817+0000 7f339bcc3640 1 -- 172.21.15.60:0/319936731 shutdown_connections 2024-09-21T10:47:49.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.817+0000 7f339bcc3640 1 --2- 172.21.15.60:0/319936731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394105350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:49.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.817+0000 7f339bcc3640 1 --2- 172.21.15.60:0/319936731 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394100630 0x7f3394102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:49.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.817+0000 7f339bcc3640 1 -- 172.21.15.60:0/319936731 >> 172.21.15.60:0/319936731 conn(0x7f33940fa250 msgr2=0x7f33940fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.818+0000 7f339bcc3640 1 -- 172.21.15.60:0/319936731 shutdown_connections 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.818+0000 7f339bcc3640 1 -- 172.21.15.60:0/319936731 wait complete. 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.818+0000 7f339bcc3640 1 Processor -- start 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.818+0000 7f339bcc3640 1 -- start start 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339bcc3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394100630 0x7f3394195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339bcc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339bcc3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394196180 con 0x7f3394102f60 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339bcc3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941962f0 con 0x7f3394100630 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f3399a5f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394100630 0x7f3394195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:49.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56188/0 (socket says 172.21.15.60:56188) 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 -- 172.21.15.60:0/2524686463 learned_addr learned my addr 172.21.15.60:0/2524686463 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 -- 172.21.15.60:0/2524686463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394100630 msgr2=0x7f3394195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394100630 0x7f3394195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 -- 172.21.15.60:0/2524686463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009560 con 0x7f3394102f60 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f339925e640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394195bb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3390004650 tx=0x7f33900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.819+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3390004aa0 con 0x7f3394102f60 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.820+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339419ad30 con 0x7f3394102f60 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.820+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3390005d50 con 0x7f3394102f60 2024-09-21T10:47:49.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.820+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33900039e0 con 0x7f3394102f60 2024-09-21T10:47:49.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.820+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339419b2a0 con 0x7f3394102f60 2024-09-21T10:47:49.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.821+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33941087b0 con 0x7f3394102f60 2024-09-21T10:47:49.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.821+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3390031c00 con 0x7f3394102f60 2024-09-21T10:47:49.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.822+0000 7f3386ffd640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f338007b270 0x7f338007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:49.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.822+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f33900bf400 con 0x7f3394102f60 2024-09-21T10:47:49.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.822+0000 7f3399a5f640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f338007b270 0x7f338007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:49.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.822+0000 7f3399a5f640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f338007b270 0x7f338007d730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3388009bd0 tx=0x7f3388005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:49.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:49.826+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f3390082470 con 0x7f3394102f60 2024-09-21T10:47:50.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.032+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33941039c0 con 0x7f338007b270 2024-09-21T10:47:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.034+0000 7f3386ffd640 1 -- 172.21.15.60:0/2524686463 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f33941039c0 con 0x7f338007b270 2024-09-21T10:47:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f338007b270 msgr2=0x7f338007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f338007b270 0x7f338007d730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3388009bd0 tx=0x7f3388005f90 comp rx=0 tx=0).stop 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 msgr2=0x7f3394195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394195bb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3390004650 tx=0x7f33900055a0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 shutdown_connections 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f338007b270 0x7f338007d730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3394102f60 0x7f3394195bb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 --2- 172.21.15.60:0/2524686463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3394100630 0x7f3394195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 >> 172.21.15.60:0/2524686463 conn(0x7f33940fa250 msgr2=0x7f33940fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 shutdown_connections 2024-09-21T10:47:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.036+0000 7f339bcc3640 1 -- 172.21.15.60:0/2524686463 wait complete. 2024-09-21T10:47:50.047 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:47:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 -- 172.21.15.60:0/1256826377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0ffcf0 msgr2=0x7efbfc100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 --2- 172.21.15.60:0/1256826377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0ffcf0 0x7efbfc100170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009880 tx=0x7efbf002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 -- 172.21.15.60:0/1256826377 shutdown_connections 2024-09-21T10:47:50.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 --2- 172.21.15.60:0/1256826377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0ffcf0 0x7efbfc100170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 --2- 172.21.15.60:0/1256826377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0feaf0 0x7efbfc0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 -- 172.21.15.60:0/1256826377 >> 172.21.15.60:0/1256826377 conn(0x7efbfc0fa280 msgr2=0x7efbfc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:50.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 -- 172.21.15.60:0/1256826377 shutdown_connections 2024-09-21T10:47:50.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.122+0000 7efc022ed640 1 -- 172.21.15.60:0/1256826377 wait complete. 2024-09-21T10:47:50.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efc022ed640 1 Processor -- start 2024-09-21T10:47:50.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efc022ed640 1 -- start start 2024-09-21T10:47:50.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efc022ed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 0x7efbfc194570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efc022ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0ffcf0 0x7efbfc194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efc022ed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc195080 con 0x7efbfc0feaf0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efc022ed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1951f0 con 0x7efbfc0ffcf0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 0x7efbfc194570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 0x7efbfc194570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56208/0 (socket says 172.21.15.60:56208) 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efbfbfff640 1 -- 172.21.15.60:0/2105066717 learned_addr learned my addr 172.21.15.60:0/2105066717 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.123+0000 7efbfb7fe640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0ffcf0 0x7efbfc194ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbfbfff640 1 -- 172.21.15.60:0/2105066717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0ffcf0 msgr2=0x7efbfc194ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbfbfff640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0ffcf0 0x7efbfc194ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbfbfff640 1 -- 172.21.15.60:0/2105066717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0009560 con 0x7efbfc0feaf0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbfbfff640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 0x7efbfc194570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efbec00d720 tx=0x7efbec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbec0041f0 con 0x7efbfc0feaf0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efbec004350 con 0x7efbfc0feaf0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc199c90 con 0x7efbfc0feaf0 2024-09-21T10:47:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbec003df0 con 0x7efbfc0feaf0 2024-09-21T10:47:50.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.124+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc19a1b0 con 0x7efbfc0feaf0 2024-09-21T10:47:50.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.125+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc18e670 con 0x7efbfc0feaf0 2024-09-21T10:47:50.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.126+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7efbec0035f0 con 0x7efbfc0feaf0 2024-09-21T10:47:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.126+0000 7efbf97fa640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7efbe407b270 0x7efbe407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.127+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efbec09dc80 con 0x7efbfc0feaf0 2024-09-21T10:47:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.127+0000 7efbfb7fe640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7efbe407b270 0x7efbe407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.127+0000 7efbfb7fe640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7efbe407b270 0x7efbe407d730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000c00 tx=0x7efbf00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.131+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7efbec060d70 con 0x7efbfc0feaf0 2024-09-21T10:47:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.339+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efbfc02c610 con 0x7efbe407b270 2024-09-21T10:47:50.342 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:50 smithi060 ceph-mon[93270]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-09-21T10:47:50.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.340+0000 7efbf97fa640 1 -- 172.21.15.60:0/2105066717 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efbfc02c610 con 0x7efbe407b270 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7efbe407b270 msgr2=0x7efbe407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7efbe407b270 0x7efbe407d730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000c00 tx=0x7efbf00314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 msgr2=0x7efbfc194570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 0x7efbfc194570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efbec00d720 tx=0x7efbec00dbe0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 shutdown_connections 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7efbe407b270 0x7efbe407d730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0ffcf0 0x7efbfc194ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 --2- 172.21.15.60:0/2105066717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efbfc0feaf0 0x7efbfc194570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 >> 172.21.15.60:0/2105066717 conn(0x7efbfc0fa280 msgr2=0x7efbfc1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 shutdown_connections 2024-09-21T10:47:50.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.342+0000 7efc022ed640 1 -- 172.21.15.60:0/2105066717 wait complete. 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.426+0000 7f109d9ff640 1 -- 172.21.15.60:0/2874603239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098102d90 msgr2=0x7f1098105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.426+0000 7f109d9ff640 1 --2- 172.21.15.60:0/2874603239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098102d90 0x7f1098105180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f108c0098b0 tx=0x7f108c02a4d0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.426+0000 7f109d9ff640 1 -- 172.21.15.60:0/2874603239 shutdown_connections 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.426+0000 7f109d9ff640 1 --2- 172.21.15.60:0/2874603239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098102d90 0x7f1098105180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.426+0000 7f109d9ff640 1 --2- 172.21.15.60:0/2874603239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1098100460 0x7f1098102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.426+0000 7f109d9ff640 1 -- 172.21.15.60:0/2874603239 >> 172.21.15.60:0/2874603239 conn(0x7f10980fa080 msgr2=0x7f10980fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 -- 172.21.15.60:0/2874603239 shutdown_connections 2024-09-21T10:47:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 -- 172.21.15.60:0/2874603239 wait complete. 2024-09-21T10:47:50.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 Processor -- start 2024-09-21T10:47:50.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 -- start start 2024-09-21T10:47:50.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 0x7f1098195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1098102d90 0x7f1098195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098196030 con 0x7f1098100460 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.427+0000 7f109d9ff640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10981961a0 con 0x7f1098102d90 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 0x7f1098195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 0x7f1098195520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56236/0 (socket says 172.21.15.60:56236) 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 -- 172.21.15.60:0/544175097 learned_addr learned my addr 172.21.15.60:0/544175097 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f10967fc640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1098102d90 0x7f1098195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 -- 172.21.15.60:0/544175097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1098102d90 msgr2=0x7f1098195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1098102d90 0x7f1098195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 -- 172.21.15.60:0/544175097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c009560 con 0x7f1098100460 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f1096ffd640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 0x7f1098195520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f108800d720 tx=0x7f108800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10880051f0 con 0x7f1098100460 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1088009ce0 con 0x7f1098100460 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109819abf0 con 0x7f1098100460 2024-09-21T10:47:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1088010460 con 0x7f1098100460 2024-09-21T10:47:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.428+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109819b110 con 0x7f1098100460 2024-09-21T10:47:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.429+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10981085e0 con 0x7f1098100460 2024-09-21T10:47:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.430+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1088005350 con 0x7f1098100460 2024-09-21T10:47:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.431+0000 7f109c9fd640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f108007b270 0x7f108007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.431+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f108809de50 con 0x7f1098100460 2024-09-21T10:47:50.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.431+0000 7f10967fc640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f108007b270 0x7f108007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.431+0000 7f10967fc640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f108007b270 0x7f108007d730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f108c009880 tx=0x7f108c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:50.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.435+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1088060ec0 con 0x7f1098100460 2024-09-21T10:47:50.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:50 smithi112 ceph-mon[78695]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-09-21T10:47:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.635+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1098103810 con 0x7f108007b270 2024-09-21T10:47:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.645+0000 7f109c9fd640 1 -- 172.21.15.60:0/544175097 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1098103810 con 0x7f108007b270 2024-09-21T10:47:50.647 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:47:50.647 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (13m) 14s ago 15m 24.8M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:47:50.647 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (6m) 14s ago 15m 8900k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (6m) 32s ago 14m 8363k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (4m) 14s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (3m) 32s ago 14m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (13m) 14s ago 15m 86.7M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (9m) 14s ago 9m 156M - 18.2.4-871-g6a1bdf85 0adab276c97e ea5e2c1b7c37 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (19s) 14s ago 9m 11.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (9m) 32s ago 9m 18.8M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (9m) 32s ago 9m 21.0M - 18.2.4-871-g6a1bdf85 0adab276c97e 03461f866d9e 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (6m) 14s ago 16m 520M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (5m) 32s ago 14m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (5m) 14s ago 17m 49.8M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:47:50.648 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (4m) 32s ago 14m 37.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (15m) 14s ago 15m 16.9M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (14m) 32s ago 14m 15.2M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (3m) 14s ago 13m 106M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (2m) 14s ago 12m 104M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (2m) 14s ago 12m 90.3M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (104s) 32s ago 11m 106M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (70s) 32s ago 11m 111M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (35s) 32s ago 11m 12.1M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:47:50.649 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (5m) 14s ago 15m 63.6M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f108007b270 msgr2=0x7f108007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f108007b270 0x7f108007d730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f108c009880 tx=0x7f108c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 msgr2=0x7f1098195520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 0x7f1098195520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f108800d720 tx=0x7f108800dbe0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 shutdown_connections 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f108007b270 0x7f108007d730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1098102d90 0x7f1098195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 --2- 172.21.15.60:0/544175097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1098100460 0x7f1098195520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 >> 172.21.15.60:0/544175097 conn(0x7f10980fa080 msgr2=0x7f10980fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 shutdown_connections 2024-09-21T10:47:50.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.647+0000 7f109d9ff640 1 -- 172.21.15.60:0/544175097 wait complete. 2024-09-21T10:47:50.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 -- 172.21.15.60:0/2562082887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 msgr2=0x7f987c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 --2- 172.21.15.60:0/2562082887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c101210 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f986c009880 tx=0x7f986c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 -- 172.21.15.60:0/2562082887 shutdown_connections 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 --2- 172.21.15.60:0/2562082887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c101210 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 --2- 172.21.15.60:0/2562082887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 0x7f987c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 -- 172.21.15.60:0/2562082887 >> 172.21.15.60:0/2562082887 conn(0x7f987c0fb320 msgr2=0x7f987c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 -- 172.21.15.60:0/2562082887 shutdown_connections 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.730+0000 7f9883940640 1 -- 172.21.15.60:0/2562082887 wait complete. 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9883940640 1 Processor -- start 2024-09-21T10:47:50.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9883940640 1 -- start start 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9883940640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 0x7f987c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9883940640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9883940640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c196140 con 0x7f987c100d90 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9883940640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c1962b0 con 0x7f987c0ffb90 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56258/0 (socket says 172.21.15.60:56258) 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 -- 172.21.15.60:0/1693041695 learned_addr learned my addr 172.21.15.60:0/1693041695 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f98816dc640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 0x7f987c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 -- 172.21.15.60:0/1693041695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 msgr2=0x7f987c195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:50.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 0x7f987c195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 -- 172.21.15.60:0/1693041695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009560 con 0x7f987c100d90 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f98816dc640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 0x7f987c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.731+0000 7f9880edb640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c195b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f986c0055a0 tx=0x7f986c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.732+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f986c004aa0 con 0x7f987c100d90 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.732+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f986c004c00 con 0x7f987c100d90 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.732+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c19acf0 con 0x7f987c100d90 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.732+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f986c003b10 con 0x7f987c100d90 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.732+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c19b260 con 0x7f987c100d90 2024-09-21T10:47:50.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.733+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c18f730 con 0x7f987c100d90 2024-09-21T10:47:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.733+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f986c031d20 con 0x7f987c100d90 2024-09-21T10:47:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.734+0000 7f98727fc640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f986807b270 0x7f986807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.734+0000 7f98816dc640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f986807b270 0x7f986807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.734+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f986c0bf3b0 con 0x7f987c100d90 2024-09-21T10:47:50.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.735+0000 7f98816dc640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f986807b270 0x7f986807d730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f987c100bf0 tx=0x7f9878005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:50.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:50.739+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f986c082560 con 0x7f987c100d90 2024-09-21T10:47:51.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.002+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f987c1087a0 con 0x7f987c100d90 2024-09-21T10:47:51.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.002+0000 7f98727fc640 1 -- 172.21.15.60:0/1693041695 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f986c085680 con 0x7f987c100d90 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2, 2024-09-21T10:47:51.005 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T10:47:51.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:47:51.006 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:47:51.006 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 2, 2024-09-21T10:47:51.006 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 11 2024-09-21T10:47:51.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:47:51.006 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f986807b270 msgr2=0x7f986807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f986807b270 0x7f986807d730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f987c100bf0 tx=0x7f9878005f90 comp rx=0 tx=0).stop 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 msgr2=0x7f987c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c195b70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f986c0055a0 tx=0x7f986c0055d0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 shutdown_connections 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f986807b270 0x7f986807d730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f987c100d90 0x7f987c195b70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 --2- 172.21.15.60:0/1693041695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f987c0ffb90 0x7f987c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 >> 172.21.15.60:0/1693041695 conn(0x7f987c0fb320 msgr2=0x7f987c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.004+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 shutdown_connections 2024-09-21T10:47:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.005+0000 7f9883940640 1 -- 172.21.15.60:0/1693041695 wait complete. 2024-09-21T10:47:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 -- 172.21.15.60:0/2453891342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0ffcf0 msgr2=0x7f42fc100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 --2- 172.21.15.60:0/2453891342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0ffcf0 0x7f42fc100170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009880 tx=0x7f42f002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 -- 172.21.15.60:0/2453891342 shutdown_connections 2024-09-21T10:47:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 --2- 172.21.15.60:0/2453891342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0ffcf0 0x7f42fc100170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 --2- 172.21.15.60:0/2453891342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42fc0feaf0 0x7f42fc0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 -- 172.21.15.60:0/2453891342 >> 172.21.15.60:0/2453891342 conn(0x7f42fc0fa280 msgr2=0x7f42fc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 -- 172.21.15.60:0/2453891342 shutdown_connections 2024-09-21T10:47:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 -- 172.21.15.60:0/2453891342 wait complete. 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.088+0000 7f43044c3640 1 Processor -- start 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f43044c3640 1 -- start start 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f43044c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 0x7f42fc102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f43044c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42fc0ffcf0 0x7f42fc1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f43044c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc101610 con 0x7f42fc0feaf0 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f43044c3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc101780 con 0x7f42fc0ffcf0 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 0x7f42fc102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 0x7f42fc102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56278/0 (socket says 172.21.15.60:56278) 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 -- 172.21.15.60:0/3847977010 learned_addr learned my addr 172.21.15.60:0/3847977010 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f4301a5e640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42fc0ffcf0 0x7f42fc1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 -- 172.21.15.60:0/3847977010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42fc0ffcf0 msgr2=0x7f42fc1010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42fc0ffcf0 0x7f42fc1010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 -- 172.21.15.60:0/3847977010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009560 con 0x7f42fc0feaf0 2024-09-21T10:47:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.089+0000 7f430225f640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 0x7f42fc102a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42f800e940 tx=0x7f42f800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.090+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f80096e0 con 0x7f42fc0feaf0 2024-09-21T10:47:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.090+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42fc101a60 con 0x7f42fc0feaf0 2024-09-21T10:47:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.090+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42f80044f0 con 0x7f42fc0feaf0 2024-09-21T10:47:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.090+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f8010430 con 0x7f42fc0feaf0 2024-09-21T10:47:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.090+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc19d730 con 0x7f42fc0feaf0 2024-09-21T10:47:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.091+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42fc1080d0 con 0x7f42fc0feaf0 2024-09-21T10:47:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.092+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f42f800cc90 con 0x7f42fc0feaf0 2024-09-21T10:47:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.093+0000 7f42ef7fe640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f42e807b270 0x7f42e807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.093+0000 7f4301a5e640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f42e807b270 0x7f42e807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.093+0000 7f4301a5e640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f42e807b270 0x7f42e807d730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:51.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.094+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f42f8014070 con 0x7f42fc0feaf0 2024-09-21T10:47:51.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.100+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f42fc1080d0 con 0x7f42fc0feaf0 2024-09-21T10:47:51.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.332+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f42fc108060 con 0x7f42fc0feaf0 2024-09-21T10:47:51.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:51 smithi060 ceph-mon[93270]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:51.335 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:51 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1693041695' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:51.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.332+0000 7f42ef7fe640 1 -- 172.21.15.60:0/3847977010 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1746 (secure 0 0 0) 0x7f42f8061730 con 0x7f42fc0feaf0 2024-09-21T10:47:51.335 INFO:teuthology.orchestra.run.smithi060.stdout:e20 2024-09-21T10:47:51.335 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T10:47:51:088035+0000 2024-09-21T10:47:51.335 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:47:51.335 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:47:51.335 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 20 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:47:50.493066+0000 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:47:51.336 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 81 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=24329} 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:47:51.337 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 0 members: 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{0:24329} state up:reconnect seq 145 join_fscid=1 addr [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:24343} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:47:51.338 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:34402} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 20 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f42e807b270 msgr2=0x7f42e807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f42e807b270 0x7f42e807d730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f00314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 msgr2=0x7f42fc102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 0x7f42fc102a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42f800e940 tx=0x7f42f800ee00 comp rx=0 tx=0).stop 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 shutdown_connections 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f42e807b270 0x7f42e807d730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42fc0ffcf0 0x7f42fc1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 --2- 172.21.15.60:0/3847977010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42fc0feaf0 0x7f42fc102a80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 >> 172.21.15.60:0/3847977010 conn(0x7f42fc0fa280 msgr2=0x7f42fc067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 shutdown_connections 2024-09-21T10:47:51.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.335+0000 7f43044c3640 1 -- 172.21.15.60:0/3847977010 wait complete. 2024-09-21T10:47:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 -- 172.21.15.60:0/3998978495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 msgr2=0x7fb8f0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/3998978495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0102ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009880 tx=0x7fb8e002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 -- 172.21.15.60:0/3998978495 shutdown_connections 2024-09-21T10:47:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/3998978495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 0x7fb8f01053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/3998978495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0102ac0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 -- 172.21.15.60:0/3998978495 >> 172.21.15.60:0/3998978495 conn(0x7fb8f00fa250 msgr2=0x7fb8f00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:51.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 -- 172.21.15.60:0/3998978495 shutdown_connections 2024-09-21T10:47:51.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.420+0000 7fb8f67f6640 1 -- 172.21.15.60:0/3998978495 wait complete. 2024-09-21T10:47:51.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8f67f6640 1 Processor -- start 2024-09-21T10:47:51.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8f67f6640 1 -- start start 2024-09-21T10:47:51.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8f67f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8f67f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 0x7fb8f0195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8f67f6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0196110 con 0x7fb8f01006d0 2024-09-21T10:47:51.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8f67f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0196280 con 0x7fb8f0103000 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.421+0000 7fb8effff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8effff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56300/0 (socket says 172.21.15.60:56300) 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8effff640 1 -- 172.21.15.60:0/2358409934 learned_addr learned my addr 172.21.15.60:0/2358409934 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ef7fe640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 0x7fb8f0195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ef7fe640 1 -- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 msgr2=0x7fb8f0195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ef7fe640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ef7fe640 1 -- 172.21.15.60:0/2358409934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009560 con 0x7fb8f0103000 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8effff640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ef7fe640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 0x7fb8f0195b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400e940 tx=0x7fb8e400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e4009640 con 0x7fb8f0103000 2024-09-21T10:47:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f019ad20 con 0x7fb8f0103000 2024-09-21T10:47:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8e400cc90 con 0x7fb8f0103000 2024-09-21T10:47:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e4018810 con 0x7fb8f0103000 2024-09-21T10:47:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.422+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f019b2f0 con 0x7fb8f0103000 2024-09-21T10:47:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.423+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f01087b0 con 0x7fb8f0103000 2024-09-21T10:47:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.424+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fb8e4018a40 con 0x7fb8f0103000 2024-09-21T10:47:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.424+0000 7fb8ed7fa640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb8d807b270 0x7fb8d807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.425+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb8e4014070 con 0x7fb8f0103000 2024-09-21T10:47:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.425+0000 7fb8effff640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb8d807b270 0x7fb8d807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.425+0000 7fb8effff640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb8d807b270 0x7fb8d807d730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0000c00 tx=0x7fb8e00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:51.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.429+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fb8e4061730 con 0x7fb8f0103000 2024-09-21T10:47:51.448 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:51 smithi112 ceph-mon[78695]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:51.448 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:51 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1693041695' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:47:51.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.644+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f01039a0 con 0x7fb8d807b270 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.645+0000 7fb8ed7fa640 1 -- 172.21.15.60:0/2358409934 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb8f01039a0 con 0x7fb8d807b270 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:47:51.647 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-09-21T10:47:51.648 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:47:51.648 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:47:51.648 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "13/23 daemons upgraded", 2024-09-21T10:47:51.648 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T10:47:51.648 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:47:51.648 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.648+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb8d807b270 msgr2=0x7fb8d807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.648+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb8d807b270 0x7fb8d807d730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0000c00 tx=0x7fb8e00314e0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.648+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 msgr2=0x7fb8f0195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.648+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 0x7fb8f0195b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400e940 tx=0x7fb8e400ee00 comp rx=0 tx=0).stop 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 shutdown_connections 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb8d807b270 0x7fb8d807d730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8f0103000 0x7fb8f0195b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 --2- 172.21.15.60:0/2358409934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f01006d0 0x7fb8f0195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 >> 172.21.15.60:0/2358409934 conn(0x7fb8f00fa250 msgr2=0x7fb8f00fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 shutdown_connections 2024-09-21T10:47:51.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.649+0000 7fb8f67f6640 1 -- 172.21.15.60:0/2358409934 wait complete. 2024-09-21T10:47:51.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 -- 172.21.15.60:0/1350952249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 msgr2=0x7f0ee80feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1350952249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee80feea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009880 tx=0x7f0edc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 -- 172.21.15.60:0/1350952249 shutdown_connections 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1350952249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80ffca0 0x7f0ee8100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1350952249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee80feea0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 -- 172.21.15.60:0/1350952249 >> 172.21.15.60:0/1350952249 conn(0x7f0ee80fa250 msgr2=0x7f0ee80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 -- 172.21.15.60:0/1350952249 shutdown_connections 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.732+0000 7f0eeecac640 1 -- 172.21.15.60:0/1350952249 wait complete. 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeecac640 1 Processor -- start 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeecac640 1 -- start start 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeecac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee8102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeecac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80ffca0 0x7f0ee8101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeecac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee81015c0 con 0x7f0ee80feaa0 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeecac640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8101730 con 0x7f0ee80ffca0 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeca48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee8102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeca48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee8102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56322/0 (socket says 172.21.15.60:56322) 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0eeca48640 1 -- 172.21.15.60:0/1808434252 learned_addr learned my addr 172.21.15.60:0/1808434252 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.733+0000 7f0ee7fff640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80ffca0 0x7f0ee8101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0eeca48640 1 -- 172.21.15.60:0/1808434252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80ffca0 msgr2=0x7f0ee8101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0eeca48640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80ffca0 0x7f0ee8101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:51.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0eeca48640 1 -- 172.21.15.60:0/1808434252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009560 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0eeca48640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee8102a30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0edc02a9c0 tx=0x7f0edc0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0edc004aa0 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0edc004c00 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee81019b0 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0edc003a80 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.734+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee819d690 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.735+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee81076b0 con 0x7f0ee80feaa0 2024-09-21T10:47:51.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.736+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0edc003cf0 con 0x7f0ee80feaa0 2024-09-21T10:47:51.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.736+0000 7f0ee5ffb640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ed807b270 0x7f0ed807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:47:51.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.737+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0edc0bf4d0 con 0x7f0ee80feaa0 2024-09-21T10:47:51.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.737+0000 7f0ee7fff640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ed807b270 0x7f0ed807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:47:51.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.737+0000 7f0ee7fff640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ed807b270 0x7f0ed807d730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0ee81027b0 tx=0x7f0ed400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:47:51.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:51.741+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f0edc082520 con 0x7f0ee80feaa0 2024-09-21T10:47:52.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.002+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0ee819d820 con 0x7f0ee80feaa0 2024-09-21T10:47:52.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.003+0000 7f0ee5ffb640 1 -- 172.21.15.60:0/1808434252 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f0edc085640 con 0x7f0ee80feaa0 2024-09-21T10:47:52.005 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-21T10:47:52.005 INFO:teuthology.orchestra.run.smithi060.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T10:47:52.005 INFO:teuthology.orchestra.run.smithi060.stdout: fs cephfs is degraded 2024-09-21T10:47:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ed807b270 msgr2=0x7f0ed807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ed807b270 0x7f0ed807d730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0ee81027b0 tx=0x7f0ed400b390 comp rx=0 tx=0).stop 2024-09-21T10:47:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 msgr2=0x7f0ee8102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:47:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee8102a30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0edc02a9c0 tx=0x7f0edc0054f0 comp rx=0 tx=0).stop 2024-09-21T10:47:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 shutdown_connections 2024-09-21T10:47:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ed807b270 0x7f0ed807d730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ee80ffca0 0x7f0ee8101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 --2- 172.21.15.60:0/1808434252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ee80feaa0 0x7f0ee8102a30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:47:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 >> 172.21.15.60:0/1808434252 conn(0x7f0ee80fa250 msgr2=0x7f0ee80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:47:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 shutdown_connections 2024-09-21T10:47:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:47:52.005+0000 7f0eeecac640 1 -- 172.21.15.60:0/1808434252 wait complete. 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: reconnect by client.14588 v1:172.21.15.112:0/3195548319 after 0 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: reconnect by client.14582 v1:192.168.0.1:0/1778017099 after 0.000999974 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:reconnect 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi112.worwat=up:reconnect} 2 up:standby 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3847977010' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:47:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:52 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1808434252' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:47:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-21T10:47:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: reconnect by client.14588 v1:172.21.15.112:0/3195548319 after 0 2024-09-21T10:47:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: reconnect by client.14582 v1:192.168.0.1:0/1778017099 after 0.000999974 2024-09-21T10:47:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:reconnect 2024-09-21T10:47:52.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi112.worwat=up:reconnect} 2 up:standby 2024-09-21T10:47:52.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3847977010' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:47:52.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:52 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1808434252' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:47:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:53 smithi060 ceph-mon[93270]: from='client.44333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:53 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:rejoin 2024-09-21T10:47:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:53 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi112.worwat=up:rejoin} 2 up:standby 2024-09-21T10:47:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:53 smithi060 ceph-mon[93270]: daemon mds.cephfs.smithi112.worwat is now active in filesystem cephfs as rank 0 2024-09-21T10:47:53.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:53 smithi112 ceph-mon[78695]: from='client.44333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:47:53.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:53 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:rejoin 2024-09-21T10:47:53.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:53 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi112.worwat=up:rejoin} 2 up:standby 2024-09-21T10:47:53.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:53 smithi112 ceph-mon[78695]: daemon mds.cephfs.smithi112.worwat is now active in filesystem cephfs as rank 0 2024-09-21T10:47:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:54 smithi060 ceph-mon[93270]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T10:47:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:54 smithi060 ceph-mon[93270]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:47:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:54 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:47:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:54 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:active 2024-09-21T10:47:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:54 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi112.worwat=up:active} 2 up:standby 2024-09-21T10:47:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:54 smithi112 ceph-mon[78695]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T10:47:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:54 smithi112 ceph-mon[78695]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:47:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:54 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:47:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:54 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6824/603063981,v1:172.21.15.112:6825/603063981] up:active 2024-09-21T10:47:54.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:54 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi112.worwat=up:active} 2 up:standby 2024-09-21T10:47:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:56 smithi060 ceph-mon[93270]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T10:47:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:56 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:56 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:56 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:56.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:56 smithi112 ceph-mon[78695]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T10:47:56.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:56 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:56.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:56 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:47:56.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:56 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:47:57.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:57 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] up:boot 2024-09-21T10:47:57.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:57 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi112.worwat=up:active} 3 up:standby 2024-09-21T10:47:57.438 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:47:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:57 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] up:boot 2024-09-21T10:47:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:57 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi112.worwat=up:active} 3 up:standby 2024-09-21T10:47:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:47:58.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:58 smithi060 ceph-mon[93270]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T10:47:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:58 smithi112 ceph-mon[78695]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T10:48:00.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:59 smithi060 ceph-mon[93270]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T10:48:00.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:00.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:47:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:59 smithi112 ceph-mon[78695]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T10:48:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:00.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:47:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:01.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:01 smithi060 ceph-mon[93270]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T10:48:01.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:01 smithi112 ceph-mon[78695]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T10:48:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:01.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:03.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:03 smithi060 ceph-mon[93270]: pgmap v188: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-09-21T10:48:03.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:03 smithi112 ceph-mon[78695]: pgmap v188: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:04.856 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:04.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:04.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:04.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:04.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi112.worwat"]} : dispatch 2024-09-21T10:48:04.857 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:04 smithi112 ceph-mon[78695]: Upgrade: It appears safe to stop mds.cephfs.smithi112.worwat 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:05.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:05.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:05.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:05.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi112.worwat"]} : dispatch 2024-09-21T10:48:05.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:04 smithi060 ceph-mon[93270]: Upgrade: It appears safe to stop mds.cephfs.smithi112.worwat 2024-09-21T10:48:05.892 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:05 smithi112 ceph-mon[78695]: pgmap v189: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-09-21T10:48:05.893 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:05 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:05.893 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:05 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:48:05.893 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:05 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:05 smithi060 ceph-mon[93270]: pgmap v189: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-09-21T10:48:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.worwat", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:48:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:05 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:06.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:06 smithi112 ceph-mon[78695]: Upgrade: Updating mds.cephfs.smithi112.worwat 2024-09-21T10:48:06.875 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:06 smithi112 ceph-mon[78695]: Deploying daemon mds.cephfs.smithi112.worwat on smithi112 2024-09-21T10:48:07.119 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:06 smithi060 ceph-mon[93270]: Upgrade: Updating mds.cephfs.smithi112.worwat 2024-09-21T10:48:07.119 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:06 smithi060 ceph-mon[93270]: Deploying daemon mds.cephfs.smithi112.worwat on smithi112 2024-09-21T10:48:07.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[93266]: 2024-09-21T10:48:07.116+0000 7fc063d9b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:48:07.450 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:48:07.137+0000 7f2ed5039640 -1 bdev(0x55616d670c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2024-09-21T10:48:07.450 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:48:07.138+0000 7f2ed4037640 -1 bdev(0x55616d670c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-21T10:48:07.450 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:48:07.141+0000 7f2ed783e640 -1 bdev(0x55616d670c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: pgmap v190: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: Standby daemon mds.cephfs.smithi112.urlyzu assigned to filesystem cephfs as rank 0 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T10:48:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:07 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi112.urlyzu=up:replay} 2 up:standby 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: pgmap v190: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: Standby daemon mds.cephfs.smithi112.urlyzu assigned to filesystem cephfs as rank 0 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:48:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T10:48:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:07 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi112.urlyzu=up:replay} 2 up:standby 2024-09-21T10:48:10.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:09 smithi060 ceph-mon[93270]: pgmap v192: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 5.4 KiB/s wr, 2 op/s 2024-09-21T10:48:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:09 smithi112 ceph-mon[78695]: pgmap v192: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 5.4 KiB/s wr, 2 op/s 2024-09-21T10:48:12.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:11 smithi060 ceph-mon[93270]: pgmap v193: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-21T10:48:12.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:11 smithi112 ceph-mon[78695]: pgmap v193: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 6.4 MiB/s rd, 5.4 KiB/s wr, 4 op/s 2024-09-21T10:48:14.143 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:13 smithi060 ceph-mon[93270]: pgmap v194: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-21T10:48:14.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:13 smithi112 ceph-mon[78695]: pgmap v194: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-21T10:48:15.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:15.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:15.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:15.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:16.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:15 smithi112 ceph-mon[78695]: pgmap v195: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-21T10:48:16.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:15 smithi112 ceph-mon[78695]: reconnect by client.14588 v1:172.21.15.112:0/3195548319 after 0 2024-09-21T10:48:16.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:15 smithi112 ceph-mon[78695]: reconnect by client.14582 v1:192.168.0.1:0/1778017099 after 0 2024-09-21T10:48:16.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:15 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:reconnect 2024-09-21T10:48:16.112 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:15 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi112.urlyzu=up:reconnect} 2 up:standby 2024-09-21T10:48:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:15 smithi060 ceph-mon[93270]: pgmap v195: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-21T10:48:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:15 smithi060 ceph-mon[93270]: reconnect by client.14588 v1:172.21.15.112:0/3195548319 after 0 2024-09-21T10:48:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:15 smithi060 ceph-mon[93270]: reconnect by client.14582 v1:192.168.0.1:0/1778017099 after 0 2024-09-21T10:48:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:15 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:reconnect 2024-09-21T10:48:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:15 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi112.urlyzu=up:reconnect} 2 up:standby 2024-09-21T10:48:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:16 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:rejoin 2024-09-21T10:48:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:16 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi112.urlyzu=up:rejoin} 2 up:standby 2024-09-21T10:48:17.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:16 smithi060 ceph-mon[93270]: daemon mds.cephfs.smithi112.urlyzu is now active in filesystem cephfs as rank 0 2024-09-21T10:48:17.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:16 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:rejoin 2024-09-21T10:48:17.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:16 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi112.urlyzu=up:rejoin} 2 up:standby 2024-09-21T10:48:17.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:16 smithi112 ceph-mon[78695]: daemon mds.cephfs.smithi112.urlyzu is now active in filesystem cephfs as rank 0 2024-09-21T10:48:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:17 smithi112 ceph-mon[78695]: pgmap v196: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T10:48:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:17 smithi112 ceph-mon[78695]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:48:17.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:17 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:48:17.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:17 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:active 2024-09-21T10:48:17.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:17 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi112.urlyzu=up:active} 2 up:standby 2024-09-21T10:48:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:17 smithi060 ceph-mon[93270]: pgmap v196: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T10:48:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:17 smithi060 ceph-mon[93270]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:48:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:17 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:48:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:17 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] up:active 2024-09-21T10:48:18.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:17 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi112.urlyzu=up:active} 2 up:standby 2024-09-21T10:48:20.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: pgmap v197: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 91 B/s wr, 5 op/s 2024-09-21T10:48:20.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:20.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:20.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:20.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] up:boot 2024-09-21T10:48:20.175 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi112.urlyzu=up:active} 3 up:standby 2024-09-21T10:48:20.176 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"} : dispatch 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: pgmap v197: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 91 B/s wr, 5 op/s 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] up:boot 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi112.urlyzu=up:active} 3 up:standby 2024-09-21T10:48:20.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.worwat"} : dispatch 2024-09-21T10:48:21.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:21 smithi060 ceph-mon[93270]: pgmap v198: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T10:48:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:21.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 -- 172.21.15.60:0/4093559220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 msgr2=0x7fc8680feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/4093559220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc8680feef0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc858009880 tx=0x7fc85802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 -- 172.21.15.60:0/4093559220 shutdown_connections 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/4093559220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8680ffcf0 0x7fc868100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/4093559220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc8680feef0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 -- 172.21.15.60:0/4093559220 >> 172.21.15.60:0/4093559220 conn(0x7fc8680fa280 msgr2=0x7fc8680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 -- 172.21.15.60:0/4093559220 shutdown_connections 2024-09-21T10:48:22.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.098+0000 7fc86cdc0640 1 -- 172.21.15.60:0/4093559220 wait complete. 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86cdc0640 1 Processor -- start 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86cdc0640 1 -- start start 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86cdc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc868108b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86cdc0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8680ffcf0 0x7fc868107150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86cdc0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868107690 con 0x7fc8680feaf0 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86cdc0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868107800 con 0x7fc8680ffcf0 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc868108b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc868108b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57372/0 (socket says 172.21.15.60:57372) 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc86659c640 1 -- 172.21.15.60:0/612644962 learned_addr learned my addr 172.21.15.60:0/612644962 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:22.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.099+0000 7fc865d9b640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8680ffcf0 0x7fc868107150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc86659c640 1 -- 172.21.15.60:0/612644962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8680ffcf0 msgr2=0x7fc868107150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc86659c640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8680ffcf0 0x7fc868107150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc86659c640 1 -- 172.21.15.60:0/612644962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009560 con 0x7fc8680feaf0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc86659c640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc868108b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc85802a9c0 tx=0x7fc8580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc858004aa0 con 0x7fc8680feaf0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc868107a80 con 0x7fc8680feaf0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc858005d50 con 0x7fc8680feaf0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8580039e0 con 0x7fc8680feaf0 2024-09-21T10:48:22.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.100+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc868107f70 con 0x7fc8680feaf0 2024-09-21T10:48:22.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.101+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86818f7d0 con 0x7fc8680feaf0 2024-09-21T10:48:22.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.102+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc858031c00 con 0x7fc8680feaf0 2024-09-21T10:48:22.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.103+0000 7fc8577fe640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc85007b270 0x7fc85007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.103+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fc8580bf440 con 0x7fc8680feaf0 2024-09-21T10:48:22.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.103+0000 7fc865d9b640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc85007b270 0x7fc85007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.103+0000 7fc865d9b640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc85007b270 0x7fc85007d730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc868108880 tx=0x7fc85c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:22.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.107+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fc858082460 con 0x7fc8680feaf0 2024-09-21T10:48:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:21 smithi112 ceph-mon[78695]: pgmap v198: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T10:48:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:22.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.312+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc86802c450 con 0x7fc85007b270 2024-09-21T10:48:22.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.313+0000 7fc8577fe640 1 -- 172.21.15.60:0/612644962 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc86802c450 con 0x7fc85007b270 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.315+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc85007b270 msgr2=0x7fc85007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.315+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc85007b270 0x7fc85007d730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc868108880 tx=0x7fc85c005f90 comp rx=0 tx=0).stop 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.315+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 msgr2=0x7fc868108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.315+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc868108b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc85802a9c0 tx=0x7fc8580055a0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 shutdown_connections 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc85007b270 0x7fc85007d730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8680ffcf0 0x7fc868107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 --2- 172.21.15.60:0/612644962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8680feaf0 0x7fc868108b00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 >> 172.21.15.60:0/612644962 conn(0x7fc8680fa280 msgr2=0x7fc868103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:22.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 shutdown_connections 2024-09-21T10:48:22.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.316+0000 7fc86cdc0640 1 -- 172.21.15.60:0/612644962 wait complete. 2024-09-21T10:48:22.327 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:48:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 -- 172.21.15.60:0/2661127593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 msgr2=0x7f249c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/2661127593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c101210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2490009880 tx=0x7f249002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 -- 172.21.15.60:0/2661127593 shutdown_connections 2024-09-21T10:48:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/2661127593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c101210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/2661127593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 0x7f249c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 -- 172.21.15.60:0/2661127593 >> 172.21.15.60:0/2661127593 conn(0x7f249c0fb320 msgr2=0x7f249c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 -- 172.21.15.60:0/2661127593 shutdown_connections 2024-09-21T10:48:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.401+0000 7f24a0ca7640 1 -- 172.21.15.60:0/2661127593 wait complete. 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.402+0000 7f24a0ca7640 1 Processor -- start 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.402+0000 7f24a0ca7640 1 -- start start 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.402+0000 7f24a0ca7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 0x7f249c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.402+0000 7f24a0ca7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.402+0000 7f24a0ca7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c196140 con 0x7f249c100d90 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.402+0000 7f24a0ca7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c1962b0 con 0x7f249c0ffb90 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57382/0 (socket says 172.21.15.60:57382) 2024-09-21T10:48:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 -- 172.21.15.60:0/474965603 learned_addr learned my addr 172.21.15.60:0/474965603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f249a59c640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 0x7f249c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 -- 172.21.15.60:0/474965603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 msgr2=0x7f249c195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 0x7f249c195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 -- 172.21.15.60:0/474965603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490009560 con 0x7f249c100d90 2024-09-21T10:48:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f249a59c640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 0x7f249c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f2499d9b640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c195b70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24900055a0 tx=0x7f24900055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2490004aa0 con 0x7f249c100d90 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2490004c00 con 0x7f249c100d90 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2490003b10 con 0x7f249c100d90 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c19acf0 con 0x7f249c100d90 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.403+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c19b260 con 0x7f249c100d90 2024-09-21T10:48:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.405+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c18f730 con 0x7f249c100d90 2024-09-21T10:48:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.406+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2490031d20 con 0x7f249c100d90 2024-09-21T10:48:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.406+0000 7f248b7fe640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f248407b270 0x7f248407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.406+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f24900bf400 con 0x7f249c100d90 2024-09-21T10:48:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.406+0000 7f249a59c640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f248407b270 0x7f248407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.407+0000 7f249a59c640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f248407b270 0x7f248407d730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f249c100bf0 tx=0x7f248c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.411+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2490082560 con 0x7f249c100d90 2024-09-21T10:48:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.616+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f249c02c4f0 con 0x7f248407b270 2024-09-21T10:48:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.617+0000 7f248b7fe640 1 -- 172.21.15.60:0/474965603 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f249c02c4f0 con 0x7f248407b270 2024-09-21T10:48:22.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.619+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f248407b270 msgr2=0x7f248407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f248407b270 0x7f248407d730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f249c100bf0 tx=0x7f248c005f90 comp rx=0 tx=0).stop 2024-09-21T10:48:22.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 msgr2=0x7f249c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c195b70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24900055a0 tx=0x7f24900055d0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 shutdown_connections 2024-09-21T10:48:22.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f248407b270 0x7f248407d730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c100d90 0x7f249c195b70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 --2- 172.21.15.60:0/474965603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f249c0ffb90 0x7f249c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 >> 172.21.15.60:0/474965603 conn(0x7f249c0fb320 msgr2=0x7f249c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 shutdown_connections 2024-09-21T10:48:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.620+0000 7f24a0ca7640 1 -- 172.21.15.60:0/474965603 wait complete. 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 -- 172.21.15.60:0/2885595142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 msgr2=0x7f756c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 --2- 172.21.15.60:0/2885595142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c102a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75680098b0 tx=0x7f756802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 -- 172.21.15.60:0/2885595142 shutdown_connections 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 --2- 172.21.15.60:0/2885595142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f756c102f60 0x7f756c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 --2- 172.21.15.60:0/2885595142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c102a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 -- 172.21.15.60:0/2885595142 >> 172.21.15.60:0/2885595142 conn(0x7f756c0fa250 msgr2=0x7f756c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 -- 172.21.15.60:0/2885595142 shutdown_connections 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 -- 172.21.15.60:0/2885595142 wait complete. 2024-09-21T10:48:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.704+0000 7f7573fe4640 1 Processor -- start 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7573fe4640 1 -- start start 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7573fe4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7573fe4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f756c102f60 0x7f756c195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7573fe4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c196170 con 0x7f756c100630 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7573fe4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c1962e0 con 0x7f756c102f60 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57406/0 (socket says 172.21.15.60:57406) 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 -- 172.21.15.60:0/218630152 learned_addr learned my addr 172.21.15.60:0/218630152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f757157f640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f756c102f60 0x7f756c195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 -- 172.21.15.60:0/218630152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f756c102f60 msgr2=0x7f756c195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f756c102f60 0x7f756c195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 -- 172.21.15.60:0/218630152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568009560 con 0x7f756c100630 2024-09-21T10:48:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.705+0000 7f7571d80640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c195660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7568004650 tx=0x7f75680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.706+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7568004aa0 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.706+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7568005d50 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.706+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c19ad20 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.706+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75680039f0 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.706+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c19b240 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.707+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c1087e0 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.707+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f7568031c00 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.708+0000 7f7562ffd640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f755807b270 0x7f755807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.708+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f75680bf340 con 0x7f756c100630 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.708+0000 7f757157f640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f755807b270 0x7f755807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.708+0000 7f757157f640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f755807b270 0x7f755807d730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f756c196b80 tx=0x7f755c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:22.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.712+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f75680823e0 con 0x7f756c100630 2024-09-21T10:48:22.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.910+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f756c19b480 con 0x7f755807b270 2024-09-21T10:48:22.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.919+0000 7f7562ffd640 1 -- 172.21.15.60:0/218630152 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f756c19b480 con 0x7f755807b270 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (14m) 22s ago 16m 25.0M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (7m) 22s ago 16m 8925k - 18.2.4-871-g6a1bdf85 0adab276c97e fa8beb50b5be 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (7m) 1s ago 15m 8900k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (4m) 22s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (4m) 1s ago 15m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (14m) 22s ago 16m 87.4M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (28s) 22s ago 10m 11.0M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 db77ea321515 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (52s) 22s ago 10m 14.0M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:48:22.922 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (9m) 1s ago 9m 85.7M - 18.2.4-871-g6a1bdf85 0adab276c97e 2f8229e5dd58 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (6s) 1s ago 10m 15.5M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 75c0d10e7ca7 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (6m) 22s ago 17m 521M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (5m) 1s ago 15m 456M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (5m) 22s ago 17m 51.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (5m) 1s ago 15m 40.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (16m) 22s ago 16m 16.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (15m) 1s ago 15m 14.7M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (4m) 22s ago 13m 111M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (3m) 22s ago 13m 116M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (2m) 22s ago 12m 98.6M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (2m) 1s ago 12m 120M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (102s) 1s ago 12m 114M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (67s) 1s ago 11m 99.9M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:48:22.923 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (5m) 22s ago 15m 63.8M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f755807b270 msgr2=0x7f755807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f755807b270 0x7f755807d730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f756c196b80 tx=0x7f755c005f90 comp rx=0 tx=0).stop 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 msgr2=0x7f756c195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c195660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7568004650 tx=0x7f75680055a0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 shutdown_connections 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f755807b270 0x7f755807d730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f756c102f60 0x7f756c195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 --2- 172.21.15.60:0/218630152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c100630 0x7f756c195660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:22.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 >> 172.21.15.60:0/218630152 conn(0x7f756c0fa250 msgr2=0x7f756c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:22.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 shutdown_connections 2024-09-21T10:48:22.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:22.922+0000 7f7573fe4640 1 -- 172.21.15.60:0/218630152 wait complete. 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 -- 172.21.15.60:0/14196772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40ffca0 msgr2=0x7f23c4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/14196772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40ffca0 0x7f23c4100120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009880 tx=0x7f23b402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 -- 172.21.15.60:0/14196772 shutdown_connections 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/14196772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40ffca0 0x7f23c4100120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/14196772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c40feaa0 0x7f23c40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 -- 172.21.15.60:0/14196772 >> 172.21.15.60:0/14196772 conn(0x7f23c40fa250 msgr2=0x7f23c40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 -- 172.21.15.60:0/14196772 shutdown_connections 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.004+0000 7f23c9ad5640 1 -- 172.21.15.60:0/14196772 wait complete. 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c9ad5640 1 Processor -- start 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c9ad5640 1 -- start start 2024-09-21T10:48:23.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c9ad5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 0x7f23c4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c9ad5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c40ffca0 0x7f23c419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c9ad5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c419a8f0 con 0x7f23c40feaa0 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c9ad5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c419aa60 con 0x7f23c40ffca0 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 0x7f23c4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 0x7f23c4068f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57436/0 (socket says 172.21.15.60:57436) 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c37fe640 1 -- 172.21.15.60:0/3124591902 learned_addr learned my addr 172.21.15.60:0/3124591902 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.005+0000 7f23c2ffd640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c40ffca0 0x7f23c419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c37fe640 1 -- 172.21.15.60:0/3124591902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c40ffca0 msgr2=0x7f23c419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c37fe640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c40ffca0 0x7f23c419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c37fe640 1 -- 172.21.15.60:0/3124591902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4009560 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c37fe640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 0x7f23c4068f60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00e940 tx=0x7f23ac00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23ac0096e0 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c419ad40 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23ac0044f0 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23ac010430 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.006+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c419b280 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.007+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c418e640 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.008+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f23ac00cc90 con 0x7f23c40feaa0 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.009+0000 7f23c0ff9640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f23b007b270 0x7f23b007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.009+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f23ac014070 con 0x7f23c40feaa0 2024-09-21T10:48:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.009+0000 7f23c2ffd640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f23b007b270 0x7f23b007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.009+0000 7f23c2ffd640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f23b007b270 0x7f23b007d730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23b4000c00 tx=0x7f23b40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:23.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.015+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f23ac061760 con 0x7f23c40feaa0 2024-09-21T10:48:23.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.284+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f23c402c560 con 0x7f23c40feaa0 2024-09-21T10:48:23.287 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:23.287 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:23 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.285+0000 7f23c0ff9640 1 -- 172.21.15.60:0/3124591902 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+833 (secure 0 0 0) 0x7f23ac064880 con 0x7f23c40feaa0 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:48:23.288 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 1, 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:48:23.289 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 18.2.4-871-g6a1bdf85 (6a1bdf854bb5803efd58957907442aa01f41a8fc) reef (stable)": 1, 2024-09-21T10:48:23.290 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T10:48:23.290 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:48:23.290 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:48:23.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f23b007b270 msgr2=0x7f23b007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f23b007b270 0x7f23b007d730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23b4000c00 tx=0x7f23b40314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 msgr2=0x7f23c4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 0x7f23c4068f60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00e940 tx=0x7f23ac00ee00 comp rx=0 tx=0).stop 2024-09-21T10:48:23.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 shutdown_connections 2024-09-21T10:48:23.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f23b007b270 0x7f23b007d730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23c40ffca0 0x7f23c419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 --2- 172.21.15.60:0/3124591902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23c40feaa0 0x7f23c4068f60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 >> 172.21.15.60:0/3124591902 conn(0x7f23c40fa250 msgr2=0x7f23c4103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:23.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 shutdown_connections 2024-09-21T10:48:23.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.288+0000 7f23c9ad5640 1 -- 172.21.15.60:0/3124591902 wait complete. 2024-09-21T10:48:23.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.371+0000 7fa1a5660640 1 -- 172.21.15.60:0/813943452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a00ffbd0 msgr2=0x7fa1a00fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.371+0000 7fa1a5660640 1 --2- 172.21.15.60:0/813943452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a00fffd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa190009880 tx=0x7fa19002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 -- 172.21.15.60:0/813943452 shutdown_connections 2024-09-21T10:48:23.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 --2- 172.21.15.60:0/813943452 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 --2- 172.21.15.60:0/813943452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a00fffd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 -- 172.21.15.60:0/813943452 >> 172.21.15.60:0/813943452 conn(0x7fa1a00fb360 msgr2=0x7fa1a00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:23.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 -- 172.21.15.60:0/813943452 shutdown_connections 2024-09-21T10:48:23.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 -- 172.21.15.60:0/813943452 wait complete. 2024-09-21T10:48:23.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 Processor -- start 2024-09-21T10:48:23.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 -- start start 2024-09-21T10:48:23.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a0197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.372+0000 7fa1a5660640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0198450 con 0x7fa1a0100dd0 2024-09-21T10:48:23.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa1a5660640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01985c0 con 0x7fa1a00ffbd0 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57450/0 (socket says 172.21.15.60:57450) 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 -- 172.21.15.60:0/3834948206 learned_addr learned my addr 172.21.15.60:0/3834948206 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19effd640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a0197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 -- 172.21.15.60:0/3834948206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a00ffbd0 msgr2=0x7fa1a0197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a0197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 -- 172.21.15.60:0/3834948206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190009560 con 0x7fa1a0100dd0 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19effd640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa19e7fc640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0197e80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa18800b450 tx=0x7fa18800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa188011860 con 0x7fa1a0100dd0 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a019d060 con 0x7fa1a0100dd0 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa188011e80 con 0x7fa1a0100dd0 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18800f570 con 0x7fa1a0100dd0 2024-09-21T10:48:23.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.373+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a019d630 con 0x7fa1a0100dd0 2024-09-21T10:48:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.375+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0105710 con 0x7fa1a0100dd0 2024-09-21T10:48:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.375+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa1880103e0 con 0x7fa1a0100dd0 2024-09-21T10:48:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.376+0000 7fa197fff640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa18c07b270 0x7fa18c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.376+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa18809e1f0 con 0x7fa1a0100dd0 2024-09-21T10:48:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.376+0000 7fa19effd640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa18c07b270 0x7fa18c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.376+0000 7fa19effd640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa18c07b270 0x7fa18c07d730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa190009230 tx=0x7fa1900314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.380+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa188061160 con 0x7fa1a0100dd0 2024-09-21T10:48:23.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:23.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:23 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.614+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1a0108a40 con 0x7fa1a0100dd0 2024-09-21T10:48:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.615+0000 7fa197fff640 1 -- 172.21.15.60:0/3834948206 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1932 (secure 0 0 0) 0x7fa188064280 con 0x7fa1a0100dd0 2024-09-21T10:48:23.617 INFO:teuthology.orchestra.run.smithi060.stdout:e29 2024-09-21T10:48:23.617 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T10:48:18:826331+0000 2024-09-21T10:48:23.617 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:48:23.617 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:48:23.617 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 28 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:48:16.819689+0000 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:48:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 82 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=24343} 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:48:23.619 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 24343 members: 24343 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{0:24343} state up:active seq 151 join_fscid=1 addr [v2:172.21.15.112:6826/3978606848,v1:172.21.15.112:6827/3978606848] compat {c=[1],r=[1],i=[7ff]}] 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:23.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:23.621 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:48:23.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:23.621 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{-1:34402} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:23.621 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:23.621 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:23.621 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.617+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa18c07b270 msgr2=0x7fa18c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.617+0000 7fa1a5660640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa18c07b270 0x7fa18c07d730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa190009230 tx=0x7fa1900314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.617+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 msgr2=0x7fa1a0197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.617+0000 7fa1a5660640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0197e80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa18800b450 tx=0x7fa18800b910 comp rx=0 tx=0).stop 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 shutdown_connections 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa18c07b270 0x7fa18c07d730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1a0100dd0 0x7fa1a0197e80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 --2- 172.21.15.60:0/3834948206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa1a00ffbd0 0x7fa1a0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 >> 172.21.15.60:0/3834948206 conn(0x7fa1a00fb360 msgr2=0x7fa1a0072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 shutdown_connections 2024-09-21T10:48:23.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.618+0000 7fa1a5660640 1 -- 172.21.15.60:0/3834948206 wait complete. 2024-09-21T10:48:23.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 -- 172.21.15.60:0/3777183687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 msgr2=0x7f41bc0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 --2- 172.21.15.60:0/3777183687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc0fff90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009880 tx=0x7f41b002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 -- 172.21.15.60:0/3777183687 shutdown_connections 2024-09-21T10:48:23.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 --2- 172.21.15.60:0/3777183687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 0x7f41bc101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 --2- 172.21.15.60:0/3777183687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc0fff90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 -- 172.21.15.60:0/3777183687 >> 172.21.15.60:0/3777183687 conn(0x7f41bc0fb320 msgr2=0x7f41bc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 -- 172.21.15.60:0/3777183687 shutdown_connections 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.702+0000 7f41c1d40640 1 -- 172.21.15.60:0/3777183687 wait complete. 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41c1d40640 1 Processor -- start 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41c1d40640 1 -- start start 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41c1d40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41c1d40640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 0x7f41bc195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41c1d40640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc1961a0 con 0x7f41bc0ffb90 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41c1d40640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc196310 con 0x7f41bc100d90 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41bb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41bb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57464/0 (socket says 172.21.15.60:57464) 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41bb7fe640 1 -- 172.21.15.60:0/1108576778 learned_addr learned my addr 172.21.15.60:0/1108576778 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.703+0000 7f41baffd640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 0x7f41bc195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41bb7fe640 1 -- 172.21.15.60:0/1108576778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 msgr2=0x7f41bc195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41bb7fe640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 0x7f41bc195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41bb7fe640 1 -- 172.21.15.60:0/1108576778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0009560 con 0x7f41bc0ffb90 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41baffd640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 0x7f41bc195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41bb7fe640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc195690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f41b00054f0 tx=0x7f41b0005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41b0004aa0 con 0x7f41bc0ffb90 2024-09-21T10:48:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc19ad00 con 0x7f41bc0ffb90 2024-09-21T10:48:23.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41b0004c00 con 0x7f41bc0ffb90 2024-09-21T10:48:23.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41b0003ac0 con 0x7f41bc0ffb90 2024-09-21T10:48:23.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.704+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc19b220 con 0x7f41bc0ffb90 2024-09-21T10:48:23.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.705+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc18f730 con 0x7f41bc0ffb90 2024-09-21T10:48:23.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.706+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f41b0003d30 con 0x7f41bc0ffb90 2024-09-21T10:48:23.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.707+0000 7f41b8ff9640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f41a407b270 0x7f41a407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:23.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.707+0000 7f41baffd640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f41a407b270 0x7f41a407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:23.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.707+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f41b00bf5b0 con 0x7f41bc0ffb90 2024-09-21T10:48:23.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.707+0000 7f41baffd640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f41a407b270 0x7f41a407d730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0058c0 tx=0x7f41ac005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:23.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.711+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f41b00825a0 con 0x7f41bc0ffb90 2024-09-21T10:48:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.918+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41bc02c550 con 0x7f41a407b270 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.919+0000 7f41b8ff9640 1 -- 172.21.15.60:0/1108576778 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f41bc02c550 con 0x7f41a407b270 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr" 2024-09-21T10:48:23.922 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:48:23.923 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T10:48:23.923 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T10:48:23.923 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:48:23.923 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:48:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f41a407b270 msgr2=0x7f41a407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f41a407b270 0x7f41a407d730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0058c0 tx=0x7f41ac005850 comp rx=0 tx=0).stop 2024-09-21T10:48:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 msgr2=0x7f41bc195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc195690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f41b00054f0 tx=0x7f41b0005520 comp rx=0 tx=0).stop 2024-09-21T10:48:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 shutdown_connections 2024-09-21T10:48:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f41a407b270 0x7f41a407d730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f41bc100d90 0x7f41bc195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 --2- 172.21.15.60:0/1108576778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41bc0ffb90 0x7f41bc195690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 >> 172.21.15.60:0/1108576778 conn(0x7f41bc0fb320 msgr2=0x7f41bc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 shutdown_connections 2024-09-21T10:48:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:23.922+0000 7f41c1d40640 1 -- 172.21.15.60:0/1108576778 wait complete. 2024-09-21T10:48:24.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 -- 172.21.15.60:0/2885471800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0feaa0 msgr2=0x7f2b3c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:24.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 --2- 172.21.15.60:0/2885471800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0feaa0 0x7f2b3c0feea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009880 tx=0x7f2b3802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 -- 172.21.15.60:0/2885471800 shutdown_connections 2024-09-21T10:48:24.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 --2- 172.21.15.60:0/2885471800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 --2- 172.21.15.60:0/2885471800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0feaa0 0x7f2b3c0feea0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 -- 172.21.15.60:0/2885471800 >> 172.21.15.60:0/2885471800 conn(0x7f2b3c0fa250 msgr2=0x7f2b3c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 -- 172.21.15.60:0/2885471800 shutdown_connections 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 -- 172.21.15.60:0/2885471800 wait complete. 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 Processor -- start 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.006+0000 7f2b436ad640 1 -- start start 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b436ad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0feaa0 0x7f2b3c195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b436ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b436ad640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c196270 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b436ad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c1963e0 con 0x7f2b3c0feaa0 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57482/0 (socket says 172.21.15.60:57482) 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 -- 172.21.15.60:0/3939441123 learned_addr learned my addr 172.21.15.60:0/3939441123 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b41449640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0feaa0 0x7f2b3c195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 -- 172.21.15.60:0/3939441123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0feaa0 msgr2=0x7f2b3c195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0feaa0 0x7f2b3c195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 -- 172.21.15.60:0/3939441123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38009560 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b40c48640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c195ca0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00b450 tx=0x7f2b2c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2c011860 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b2c011e80 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c19ae10 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.007+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2c00f570 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.008+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c19b3b0 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.008+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c0fef20 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.009+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2b2c0103e0 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.010+0000 7f2b327fc640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:24.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.010+0000 7f2b41449640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:24.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.010+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f2b2c09dfe0 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.010+0000 7f2b41449640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009230 tx=0x7f2b380314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:24.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.014+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2b2c060fd0 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:24 smithi060 ceph-mon[93270]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:24 smithi060 ceph-mon[93270]: pgmap v199: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T10:48:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:24 smithi060 ceph-mon[93270]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:24 smithi060 ceph-mon[93270]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:24 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3124591902' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:24.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:24 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3834948206' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:48:24.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:24 smithi112 ceph-mon[78695]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:24.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:24 smithi112 ceph-mon[78695]: pgmap v199: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T10:48:24.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:24 smithi112 ceph-mon[78695]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:24.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:24 smithi112 ceph-mon[78695]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:24.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:24 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3124591902' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:24.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:24 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3834948206' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:48:24.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.279+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2b3c107710 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.279+0000 7f2b327fc640 1 -- 172.21.15.60:0/3939441123 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2b2c0640f0 con 0x7f2b3c0ffca0 2024-09-21T10:48:24.283 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 msgr2=0x7f2b2807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009230 tx=0x7f2b380314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 msgr2=0x7f2b3c195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c195ca0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00b450 tx=0x7f2b2c00b910 comp rx=0 tx=0).stop 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 shutdown_connections 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffca0 0x7f2b3c195ca0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 --2- 172.21.15.60:0/3939441123 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0feaa0 0x7f2b3c195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:24.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 >> 172.21.15.60:0/3939441123 conn(0x7f2b3c0fa250 msgr2=0x7f2b3c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 shutdown_connections 2024-09-21T10:48:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:24.282+0000 7f2b436ad640 1 -- 172.21.15.60:0/3939441123 wait complete. 2024-09-21T10:48:25.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:25 smithi112 ceph-mon[78695]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:25.372 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:25 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3939441123' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:48:25.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:25 smithi060 ceph-mon[93270]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:25.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:25 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3939441123' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:48:26.113 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: pgmap v200: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.114 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi112.urlyzu"]} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: pgmap v200: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:26.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi112.urlyzu"]} : dispatch 2024-09-21T10:48:27.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:27 smithi112 ceph-mon[78695]: Upgrade: It appears safe to stop mds.cephfs.smithi112.urlyzu 2024-09-21T10:48:27.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:27.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:48:27.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:27 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:27.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:27 smithi060 ceph-mon[93270]: Upgrade: It appears safe to stop mds.cephfs.smithi112.urlyzu 2024-09-21T10:48:27.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:27.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi112.urlyzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T10:48:27.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:27 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:28 smithi112 ceph-mon[78695]: pgmap v201: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T10:48:28.438 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:28 smithi112 ceph-mon[78695]: Upgrade: Updating mds.cephfs.smithi112.urlyzu 2024-09-21T10:48:28.439 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:28 smithi112 ceph-mon[78695]: Deploying daemon mds.cephfs.smithi112.urlyzu on smithi112 2024-09-21T10:48:28.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:28 smithi060 ceph-mon[93270]: pgmap v201: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T10:48:28.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:28 smithi060 ceph-mon[93270]: Upgrade: Updating mds.cephfs.smithi112.urlyzu 2024-09-21T10:48:28.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:28 smithi060 ceph-mon[93270]: Deploying daemon mds.cephfs.smithi112.urlyzu on smithi112 2024-09-21T10:48:29.070 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:28 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[93266]: 2024-09-21T10:48:28.708+0000 7fc063d9b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:48:29.070 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:48:28 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:48:28.735+0000 7f2edb846640 -1 bdev(0x55616d670c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: osdmap e83: 6 total, 6 up, 6 in 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: Standby daemon mds.cephfs.smithi060.xjabvh assigned to filesystem cephfs as rank 0 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi060.xjabvh=up:replay} 2 up:standby 2024-09-21T10:48:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T10:48:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T10:48:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: osdmap e83: 6 total, 6 up, 6 in 2024-09-21T10:48:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: Standby daemon mds.cephfs.smithi060.xjabvh assigned to filesystem cephfs as rank 0 2024-09-21T10:48:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T10:48:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T10:48:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi060.xjabvh=up:replay} 2 up:standby 2024-09-21T10:48:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:30.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:30 smithi060 ceph-mon[93270]: pgmap v202: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-21T10:48:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:48:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:30 smithi112 ceph-mon[78695]: pgmap v202: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-21T10:48:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:48:32.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:32 smithi060 ceph-mon[93270]: pgmap v204: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-21T10:48:32.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:32 smithi112 ceph-mon[78695]: pgmap v204: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-21T10:48:34.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:34 smithi112 ceph-mon[78695]: pgmap v205: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-21T10:48:34.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:34 smithi060 ceph-mon[93270]: pgmap v205: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-21T10:48:36.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:36 smithi060 ceph-mon[93270]: pgmap v206: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-21T10:48:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:36 smithi112 ceph-mon[78695]: pgmap v206: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-21T10:48:37.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:37 smithi060 ceph-mon[93270]: reconnect by client.14582 v1:192.168.0.1:0/1778017099 after 0 2024-09-21T10:48:37.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:37 smithi060 ceph-mon[93270]: reconnect by client.14588 v1:172.21.15.112:0/3195548319 after 0.00099999 2024-09-21T10:48:37.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:37 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:reconnect 2024-09-21T10:48:37.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:37 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi060.xjabvh=up:reconnect} 2 up:standby 2024-09-21T10:48:37.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:37 smithi112 ceph-mon[78695]: reconnect by client.14582 v1:192.168.0.1:0/1778017099 after 0 2024-09-21T10:48:37.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:37 smithi112 ceph-mon[78695]: reconnect by client.14588 v1:172.21.15.112:0/3195548319 after 0.00099999 2024-09-21T10:48:37.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:37 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:reconnect 2024-09-21T10:48:37.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:37 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi060.xjabvh=up:reconnect} 2 up:standby 2024-09-21T10:48:38.228 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:38 smithi112 ceph-mon[78695]: pgmap v207: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T10:48:38.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:38 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:rejoin 2024-09-21T10:48:38.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:38 smithi112 ceph-mon[78695]: fsmap cephfs:1/1 {0=cephfs.smithi060.xjabvh=up:rejoin} 2 up:standby 2024-09-21T10:48:38.229 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:38 smithi112 ceph-mon[78695]: daemon mds.cephfs.smithi060.xjabvh is now active in filesystem cephfs as rank 0 2024-09-21T10:48:38.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:38 smithi060 ceph-mon[93270]: pgmap v207: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T10:48:38.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:38 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:rejoin 2024-09-21T10:48:38.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:38 smithi060 ceph-mon[93270]: fsmap cephfs:1/1 {0=cephfs.smithi060.xjabvh=up:rejoin} 2 up:standby 2024-09-21T10:48:38.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:38 smithi060 ceph-mon[93270]: daemon mds.cephfs.smithi060.xjabvh is now active in filesystem cephfs as rank 0 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: Cluster is now healthy 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:active 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2 up:standby 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:39.212 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:39 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: Cluster is now healthy 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] up:active 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 2 up:standby 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:39.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:39 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:40.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:40 smithi060 ceph-mon[93270]: pgmap v208: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T10:48:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:40 smithi060 ceph-mon[93270]: mds.? [v2:172.21.15.112:6826/991928918,v1:172.21.15.112:6827/991928918] up:boot 2024-09-21T10:48:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:40 smithi060 ceph-mon[93270]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 3 up:standby 2024-09-21T10:48:40.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:48:40.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:40 smithi112 ceph-mon[78695]: pgmap v208: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-21T10:48:40.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:40 smithi112 ceph-mon[78695]: mds.? [v2:172.21.15.112:6826/991928918,v1:172.21.15.112:6827/991928918] up:boot 2024-09-21T10:48:40.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:40 smithi112 ceph-mon[78695]: fsmap cephfs:1 {0=cephfs.smithi060.xjabvh=up:active} 3 up:standby 2024-09-21T10:48:40.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "mds metadata", "who": "cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:48:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:42 smithi060 ceph-mon[93270]: pgmap v209: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 87 B/s wr, 6 op/s 2024-09-21T10:48:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:42 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:42 smithi112 ceph-mon[78695]: pgmap v209: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 87 B/s wr, 6 op/s 2024-09-21T10:48:42.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:42.370 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:42 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:44.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:44 smithi112 ceph-mon[78695]: pgmap v210: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T10:48:44.365 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:44.366 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:44 smithi060 ceph-mon[93270]: pgmap v210: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T10:48:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:44.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: pgmap v211: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:46.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.lljnqu"}]': finished 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.xjabvh"}]': finished 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.urlyzu"}]': finished 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.worwat"} : dispatch 2024-09-21T10:48:46.200 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.worwat"}]': finished 2024-09-21T10:48:46.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.201 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:46 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: pgmap v211: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.lljnqu"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.lljnqu"}]': finished 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.xjabvh"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi060.xjabvh"}]': finished 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.urlyzu"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.urlyzu"}]': finished 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.worwat"} : dispatch 2024-09-21T10:48:46.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi112.worwat"}]': finished 2024-09-21T10:48:46.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:46.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:46.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:46 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:47.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:47 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all mds 2024-09-21T10:48:47.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:47 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all rgw 2024-09-21T10:48:47.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:47 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T10:48:47.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:47 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:47.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:47 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:48:47.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:47 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:47.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:47 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all mds 2024-09-21T10:48:47.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:47 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all rgw 2024-09-21T10:48:47.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:47 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T10:48:47.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:47 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:47.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:47 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi060", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:48:47.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:47 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:48.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:48 smithi060 ceph-mon[93270]: pgmap v212: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T10:48:48.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:48 smithi060 ceph-mon[93270]: Upgrade: Updating ceph-exporter.smithi060 (1/2) 2024-09-21T10:48:48.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:48 smithi060 ceph-mon[93270]: Deploying daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:48:48.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:48 smithi112 ceph-mon[78695]: pgmap v212: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-21T10:48:48.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:48 smithi112 ceph-mon[78695]: Upgrade: Updating ceph-exporter.smithi060 (1/2) 2024-09-21T10:48:48.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:48 smithi112 ceph-mon[78695]: Deploying daemon ceph-exporter.smithi060 on smithi060 2024-09-21T10:48:50.304 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:50 smithi060 ceph-mon[93270]: pgmap v213: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T10:48:50.375 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:50 smithi112 ceph-mon[78695]: pgmap v213: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T10:48:51.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:51 smithi112 ceph-mon[78695]: pgmap v214: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T10:48:51.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:51 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:51.926 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:51 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:51 smithi060 ceph-mon[93270]: pgmap v214: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-21T10:48:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:51 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:51.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:51 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:53.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:52 smithi112 ceph-mon[78695]: Upgrade: Updating ceph-exporter.smithi112 (2/2) 2024-09-21T10:48:53.297 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:52 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:53.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:52 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:48:53.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:52 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:53.298 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:52 smithi112 ceph-mon[78695]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:48:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:52 smithi060 ceph-mon[93270]: Upgrade: Updating ceph-exporter.smithi112 (2/2) 2024-09-21T10:48:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:52 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:52 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi112", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T10:48:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:52 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:48:53.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:52 smithi060 ceph-mon[93270]: Deploying daemon ceph-exporter.smithi112 on smithi112 2024-09-21T10:48:54.060 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:53 smithi112 ceph-mon[78695]: pgmap v215: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-09-21T10:48:54.384 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:53 smithi060 ceph-mon[93270]: pgmap v215: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-09-21T10:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 -- 172.21.15.60:0/3918753321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 msgr2=0x7fc7cc0fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/3918753321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc0fe270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009880 tx=0x7fc7bc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 -- 172.21.15.60:0/3918753321 shutdown_connections 2024-09-21T10:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/3918753321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 0x7fc7cc101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/3918753321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc0fe270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 -- 172.21.15.60:0/3918753321 >> 172.21.15.60:0/3918753321 conn(0x7fc7cc0f99c0 msgr2=0x7fc7cc0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 -- 172.21.15.60:0/3918753321 shutdown_connections 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.381+0000 7fc7d19a0640 1 -- 172.21.15.60:0/3918753321 wait complete. 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.382+0000 7fc7d19a0640 1 Processor -- start 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.382+0000 7fc7d19a0640 1 -- start start 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7d19a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc100850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7d19a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 0x7fc7cc0feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7d19a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ff3e0 con 0x7fc7cc0fde70 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7d19a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0ff550 con 0x7fc7cc100ef0 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7caffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc100850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7caffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc100850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50108/0 (socket says 172.21.15.60:50108) 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7caffd640 1 -- 172.21.15.60:0/1443579085 learned_addr learned my addr 172.21.15.60:0/1443579085 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7c27fc640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 0x7fc7cc0feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:54.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7c27fc640 1 -- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 msgr2=0x7fc7cc100850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7c27fc640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc100850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7c27fc640 1 -- 172.21.15.60:0/1443579085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009560 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.383+0000 7fc7c27fc640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 0x7fc7cc0feea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400e970 tx=0x7fc7b400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.384+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b4009620 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.384+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0ff830 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.384+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7b40044f0 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.384+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b40049d0 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.384+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc19d6a0 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.385+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc18f730 con 0x7fc7cc100ef0 2024-09-21T10:48:54.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.385+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc7b400cc90 con 0x7fc7cc100ef0 2024-09-21T10:48:54.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.386+0000 7fc7d099e640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc7b807b270 0x7fc7b807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:54.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.386+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc7b4014070 con 0x7fc7cc100ef0 2024-09-21T10:48:54.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.386+0000 7fc7caffd640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc7b807b270 0x7fc7b807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:54.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.387+0000 7fc7caffd640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc7b807b270 0x7fc7b807d730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:54.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.391+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fc7b4061680 con 0x7fc7cc100ef0 2024-09-21T10:48:54.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.601+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7cc02c450 con 0x7fc7b807b270 2024-09-21T10:48:54.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.602+0000 7fc7d099e640 1 -- 172.21.15.60:0/1443579085 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc7cc02c450 con 0x7fc7b807b270 2024-09-21T10:48:54.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc7b807b270 msgr2=0x7fc7b807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc7b807b270 0x7fc7b807d730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc0314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 msgr2=0x7fc7cc0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 0x7fc7cc0feea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400e970 tx=0x7fc7b400ee30 comp rx=0 tx=0).stop 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 shutdown_connections 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc7b807b270 0x7fc7b807d730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7cc100ef0 0x7fc7cc0feea0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 --2- 172.21.15.60:0/1443579085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7cc0fde70 0x7fc7cc100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 >> 172.21.15.60:0/1443579085 conn(0x7fc7cc0f99c0 msgr2=0x7fc7cc1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 shutdown_connections 2024-09-21T10:48:54.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.604+0000 7fc7d19a0640 1 -- 172.21.15.60:0/1443579085 wait complete. 2024-09-21T10:48:54.615 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:48:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 -- 172.21.15.60:0/2717740387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 msgr2=0x7ff860102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 --2- 172.21.15.60:0/2717740387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff860102a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff8500098b0 tx=0x7ff85002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 -- 172.21.15.60:0/2717740387 shutdown_connections 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 --2- 172.21.15.60:0/2717740387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 0x7ff860105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 --2- 172.21.15.60:0/2717740387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff860102a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 -- 172.21.15.60:0/2717740387 >> 172.21.15.60:0/2717740387 conn(0x7ff8600fa250 msgr2=0x7ff8600fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 -- 172.21.15.60:0/2717740387 shutdown_connections 2024-09-21T10:48:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.689+0000 7ff866a49640 1 -- 172.21.15.60:0/2717740387 wait complete. 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.690+0000 7ff866a49640 1 Processor -- start 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.690+0000 7ff866a49640 1 -- start start 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.690+0000 7ff866a49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff8600fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.690+0000 7ff866a49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 0x7ff8600fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.690+0000 7ff866a49640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600feb20 con 0x7ff860100630 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.690+0000 7ff866a49640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600fec90 con 0x7ff860102f60 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff8600fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 0x7ff8600fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff8600fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50136/0 (socket says 172.21.15.60:50136) 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85ffff640 1 -- 172.21.15.60:0/1975545760 learned_addr learned my addr 172.21.15.60:0/1975545760 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85f7fe640 1 -- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 msgr2=0x7ff8600fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85f7fe640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff8600fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85f7fe640 1 -- 172.21.15.60:0/1975545760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850009560 con 0x7ff860102f60 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85f7fe640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 0x7ff8600fe5e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff85400e940 tx=0x7ff85400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff854009640 con 0x7ff860102f60 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600fef70 con 0x7ff860102f60 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff85400cc90 con 0x7ff860102f60 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff854018810 con 0x7ff860102f60 2024-09-21T10:48:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.691+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86019d6a0 con 0x7ff860102f60 2024-09-21T10:48:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.692+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8601087c0 con 0x7ff860102f60 2024-09-21T10:48:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.693+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff854018a40 con 0x7ff860102f60 2024-09-21T10:48:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.694+0000 7ff85d7fa640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff84807b270 0x7ff84807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.694+0000 7ff85ffff640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff84807b270 0x7ff84807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.694+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ff854014070 con 0x7ff860102f60 2024-09-21T10:48:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.694+0000 7ff85ffff640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff84807b270 0x7ff84807d730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff850000c00 tx=0x7ff8500314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.702+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ff854061770 con 0x7ff860102f60 2024-09-21T10:48:54.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.909+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff860103980 con 0x7ff84807b270 2024-09-21T10:48:54.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.911+0000 7ff85d7fa640 1 -- 172.21.15.60:0/1975545760 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7ff860103980 con 0x7ff84807b270 2024-09-21T10:48:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff84807b270 msgr2=0x7ff84807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff84807b270 0x7ff84807d730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff850000c00 tx=0x7ff8500314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 msgr2=0x7ff8600fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 0x7ff8600fe5e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff85400e940 tx=0x7ff85400ee00 comp rx=0 tx=0).stop 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 shutdown_connections 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff84807b270 0x7ff84807d730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff860102f60 0x7ff8600fe5e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 --2- 172.21.15.60:0/1975545760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff860100630 0x7ff8600fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 >> 172.21.15.60:0/1975545760 conn(0x7ff8600fa250 msgr2=0x7ff8600fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 shutdown_connections 2024-09-21T10:48:54.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.913+0000 7ff866a49640 1 -- 172.21.15.60:0/1975545760 wait complete. 2024-09-21T10:48:55.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.997+0000 7f31eda08640 1 -- 172.21.15.60:0/3104086681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e80ffb80 msgr2=0x7f31e80fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.997+0000 7f31eda08640 1 --2- 172.21.15.60:0/3104086681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e80ffb80 0x7f31e80fff80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009c20 tx=0x7f31d802a970 comp rx=0 tx=0).stop 2024-09-21T10:48:55.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.997+0000 7f31eda08640 1 -- 172.21.15.60:0/3104086681 shutdown_connections 2024-09-21T10:48:55.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.997+0000 7f31eda08640 1 --2- 172.21.15.60:0/3104086681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31e8100d80 0x7f31e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.997+0000 7f31eda08640 1 --2- 172.21.15.60:0/3104086681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e80ffb80 0x7f31e80fff80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.997+0000 7f31eda08640 1 -- 172.21.15.60:0/3104086681 >> 172.21.15.60:0/3104086681 conn(0x7f31e80fb310 msgr2=0x7f31e80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:55.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.998+0000 7f31eda08640 1 -- 172.21.15.60:0/3104086681 shutdown_connections 2024-09-21T10:48:55.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.998+0000 7f31eda08640 1 -- 172.21.15.60:0/3104086681 wait complete. 2024-09-21T10:48:55.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.998+0000 7f31eda08640 1 Processor -- start 2024-09-21T10:48:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.998+0000 7f31eda08640 1 -- start start 2024-09-21T10:48:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eda08640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31e80ffb80 0x7f31e81955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eda08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 0x7f31e8195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eda08640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8196100 con 0x7f31e8100d80 2024-09-21T10:48:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eda08640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8196270 con 0x7f31e80ffb80 2024-09-21T10:48:55.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 0x7f31e8195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 0x7f31e8195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50156/0 (socket says 172.21.15.60:50156) 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31e80ffb80 0x7f31e81955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 -- 172.21.15.60:0/4284033867 learned_addr learned my addr 172.21.15.60:0/4284033867 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 -- 172.21.15.60:0/4284033867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31e80ffb80 msgr2=0x7f31e81955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31e80ffb80 0x7f31e81955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 -- 172.21.15.60:0/4284033867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009900 con 0x7f31e8100d80 2024-09-21T10:48:55.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31e67fc640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 0x7f31e8195b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e9a0 tx=0x7f31d000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:55.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d000cd50 con 0x7f31e8100d80 2024-09-21T10:48:55.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e819ad10 con 0x7f31e8100d80 2024-09-21T10:48:55.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31d000ceb0 con 0x7f31e8100d80 2024-09-21T10:48:55.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:54.999+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d0010660 con 0x7f31e8100d80 2024-09-21T10:48:55.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.000+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e819b2e0 con 0x7f31e8100d80 2024-09-21T10:48:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.000+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e8108790 con 0x7f31e8100d80 2024-09-21T10:48:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.001+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f31d00048a0 con 0x7f31e8100d80 2024-09-21T10:48:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.002+0000 7f31eca06640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f31d407b270 0x7f31d407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.002+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f31d0014070 con 0x7f31e8100d80 2024-09-21T10:48:55.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.002+0000 7f31e6ffd640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f31d407b270 0x7f31d407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.002+0000 7f31e6ffd640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f31d407b270 0x7f31d407d730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31d8000f80 tx=0x7f31d803d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:55.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.006+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f31d0061810 con 0x7f31e8100d80 2024-09-21T10:48:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.200+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e81056d0 con 0x7f31d407b270 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.210+0000 7f31eca06640 1 -- 172.21.15.60:0/4284033867 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f31e81056d0 con 0x7f31d407b270 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (14m) 55s ago 16m 25.0M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 starting - - - - 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (7m) 13s ago 16m 8921k - 18.2.4-871-g6a1bdf85 0adab276c97e cf2d03aabfd0 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (5m) 55s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (5m) 13s ago 15m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:48:55.212 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (14m) 55s ago 16m 87.4M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (60s) 55s ago 10m 11.0M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 db77ea321515 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (84s) 55s ago 10m 14.0M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (17s) 13s ago 10m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 9b0567217371 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (38s) 13s ago 10m 16.2M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 75c0d10e7ca7 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (7m) 55s ago 18m 521M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (6m) 13s ago 15m 456M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (6m) 55s ago 18m 51.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (5m) 13s ago 15m 41.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (16m) 55s ago 16m 16.7M - 1.5.0 0da6a335fe13 b0b909eb6cfa 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (15m) 13s ago 15m 15.1M - 1.5.0 0da6a335fe13 567f4ba88638 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (4m) 55s ago 14m 111M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (4m) 55s ago 13m 116M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (3m) 55s ago 13m 98.6M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:48:55.213 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (2m) 13s ago 13m 123M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:48:55.214 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (2m) 13s ago 12m 115M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:48:55.214 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (100s) 13s ago 12m 98.6M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:48:55.214 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (6m) 55s ago 16m 63.8M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:48:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f31d407b270 msgr2=0x7f31d407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f31d407b270 0x7f31d407d730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31d8000f80 tx=0x7f31d803d040 comp rx=0 tx=0).stop 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 msgr2=0x7f31e8195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 0x7f31e8195b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e9a0 tx=0x7f31d000eda0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 shutdown_connections 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f31d407b270 0x7f31d407d730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31e8100d80 0x7f31e8195b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 --2- 172.21.15.60:0/4284033867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31e80ffb80 0x7f31e81955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 >> 172.21.15.60:0/4284033867 conn(0x7f31e80fb310 msgr2=0x7f31e8103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.212+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 shutdown_connections 2024-09-21T10:48:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.213+0000 7f31eda08640 1 -- 172.21.15.60:0/4284033867 wait complete. 2024-09-21T10:48:55.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 -- 172.21.15.60:0/2367220290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0fe420 msgr2=0x7f79ac100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2367220290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0fe420 0x7f79ac100830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009880 tx=0x7f79a802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 -- 172.21.15.60:0/2367220290 shutdown_connections 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2367220290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac100d70 0x7f79ac1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2367220290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0fe420 0x7f79ac100830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 -- 172.21.15.60:0/2367220290 >> 172.21.15.60:0/2367220290 conn(0x7f79ac0fa250 msgr2=0x7f79ac0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 -- 172.21.15.60:0/2367220290 shutdown_connections 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.295+0000 7f79b40d6640 1 -- 172.21.15.60:0/2367220290 wait complete. 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b40d6640 1 Processor -- start 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b40d6640 1 -- start start 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b40d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac0fe420 0x7f79ac19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b40d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 0x7f79ac19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b40d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac19c6f0 con 0x7f79ac100d70 2024-09-21T10:48:55.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b40d6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac19c860 con 0x7f79ac0fe420 2024-09-21T10:48:55.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b1671640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 0x7f79ac19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b1671640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 0x7f79ac19c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50182/0 (socket says 172.21.15.60:50182) 2024-09-21T10:48:55.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b1671640 1 -- 172.21.15.60:0/2954973519 learned_addr learned my addr 172.21.15.60:0/2954973519 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:55.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.296+0000 7f79b1e72640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac0fe420 0x7f79ac19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b1671640 1 -- 172.21.15.60:0/2954973519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac0fe420 msgr2=0x7f79ac19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b1671640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac0fe420 0x7f79ac19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b1671640 1 -- 172.21.15.60:0/2954973519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a8009560 con 0x7f79ac100d70 2024-09-21T10:48:55.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b1e72640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac0fe420 0x7f79ac19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:48:55.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b1671640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 0x7f79ac19c120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f799c00e9a0 tx=0x7f799c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:55.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f799c00cd50 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f799c00ceb0 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac1a1300 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f799c010660 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.297+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac1a18d0 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.298+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac10ed90 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.299+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f799c004ef0 con 0x7f79ac100d70 2024-09-21T10:48:55.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.300+0000 7f79a2ffd640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f799807b270 0x7f799807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.300+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f799c014070 con 0x7f79ac100d70 2024-09-21T10:48:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.300+0000 7f79b1e72640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f799807b270 0x7f799807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.300+0000 7f79b1e72640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f799807b270 0x7f799807d730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79a8000c00 tx=0x7f79a80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:55.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.304+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f799c064f60 con 0x7f79ac100d70 2024-09-21T10:48:55.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.607+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f79ac10ef70 con 0x7f79ac100d70 2024-09-21T10:48:55.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.609+0000 7f79a2ffd640 1 -- 172.21.15.60:0/2954973519 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f799c064900 con 0x7f79ac100d70 2024-09-21T10:48:55.611 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:48:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:48:55.611 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:48:55.612 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:48:55.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f799807b270 msgr2=0x7f799807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f799807b270 0x7f799807d730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79a8000c00 tx=0x7f79a80314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 msgr2=0x7f79ac19c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 0x7f79ac19c120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f799c00e9a0 tx=0x7f799c00eda0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 shutdown_connections 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f799807b270 0x7f799807d730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac100d70 0x7f79ac19c120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 --2- 172.21.15.60:0/2954973519 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79ac0fe420 0x7f79ac19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.611+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 >> 172.21.15.60:0/2954973519 conn(0x7f79ac0fa250 msgr2=0x7f79ac0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.612+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 shutdown_connections 2024-09-21T10:48:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.612+0000 7f79b40d6640 1 -- 172.21.15.60:0/2954973519 wait complete. 2024-09-21T10:48:55.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 -- 172.21.15.60:0/3868839323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54100740 msgr2=0x7f5d54102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 --2- 172.21.15.60:0/3868839323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54100740 0x7f5d54102b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009880 tx=0x7f5d4402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 -- 172.21.15.60:0/3868839323 shutdown_connections 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 --2- 172.21.15.60:0/3868839323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d54103070 0x7f5d54105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 --2- 172.21.15.60:0/3868839323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54100740 0x7f5d54102b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 -- 172.21.15.60:0/3868839323 >> 172.21.15.60:0/3868839323 conn(0x7f5d540fa280 msgr2=0x7f5d540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 -- 172.21.15.60:0/3868839323 shutdown_connections 2024-09-21T10:48:55.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.717+0000 7f5d591f2640 1 -- 172.21.15.60:0/3868839323 wait complete. 2024-09-21T10:48:55.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d591f2640 1 Processor -- start 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d591f2640 1 -- start start 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d591f2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d54100740 0x7f5d541956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d591f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 0x7f5d54195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d591f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541961d0 con 0x7f5d54103070 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d591f2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54196340 con 0x7f5d54100740 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d4bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 0x7f5d54195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d4bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 0x7f5d54195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50190/0 (socket says 172.21.15.60:50190) 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d4bfff640 1 -- 172.21.15.60:0/2429634326 learned_addr learned my addr 172.21.15.60:0/2429634326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.718+0000 7f5d52d9d640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d54100740 0x7f5d541956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d4bfff640 1 -- 172.21.15.60:0/2429634326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d54100740 msgr2=0x7f5d541956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d4bfff640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d54100740 0x7f5d541956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d4bfff640 1 -- 172.21.15.60:0/2429634326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009560 con 0x7f5d54103070 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d4bfff640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 0x7f5d54195c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c920 tx=0x7f5d3c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d3c007b80 con 0x7f5d54103070 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d3c0054e0 con 0x7f5d54103070 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d3c00f450 con 0x7f5d54103070 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5419ade0 con 0x7f5d54103070 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.719+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5419b300 con 0x7f5d54103070 2024-09-21T10:48:55.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.720+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d54100b20 con 0x7f5d54103070 2024-09-21T10:48:55.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.721+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5d3c0046c0 con 0x7f5d54103070 2024-09-21T10:48:55.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.722+0000 7f5d50d99640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5d4007b270 0x7f5d4007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:55.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.722+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f5d3c09e120 con 0x7f5d54103070 2024-09-21T10:48:55.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.722+0000 7f5d52d9d640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5d4007b270 0x7f5d4007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:55.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.723+0000 7f5d52d9d640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5d4007b270 0x7f5d4007d730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000c00 tx=0x7f5d440314a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:55.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.727+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f5d3c0610b0 con 0x7f5d54103070 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.958+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d54108810 con 0x7f5d54103070 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.958+0000 7f5d50d99640 1 -- 172.21.15.60:0/2429634326 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1974 (secure 0 0 0) 0x7f5d3c01d7d0 con 0x7f5d54103070 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T10:48:39:093091+0000 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:48:55.961 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 34 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:48:38.086780+0000 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:48:55.962 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 83 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34402} 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:48:55.963 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34402 members: 34402 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:55.964 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:44371} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/991928918,v1:172.21.15.112:6827/991928918] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.960+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5d4007b270 msgr2=0x7f5d4007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.960+0000 7f5d591f2640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5d4007b270 0x7f5d4007d730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000c00 tx=0x7f5d440314a0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.960+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 msgr2=0x7f5d54195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.960+0000 7f5d591f2640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 0x7f5d54195c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c920 tx=0x7f5d3c00cde0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 shutdown_connections 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5d4007b270 0x7f5d4007d730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d54103070 0x7f5d54195c00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 --2- 172.21.15.60:0/2429634326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d54100740 0x7f5d541956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 >> 172.21.15.60:0/2429634326 conn(0x7f5d540fa280 msgr2=0x7f5d540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 shutdown_connections 2024-09-21T10:48:55.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:55.961+0000 7f5d591f2640 1 -- 172.21.15.60:0/2429634326 wait complete. 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 -- 172.21.15.60:0/3212873865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0100630 msgr2=0x7f81c0102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3212873865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0100630 0x7f81c0102a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f81b00098b0 tx=0x7f81b002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 -- 172.21.15.60:0/3212873865 shutdown_connections 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3212873865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0102f60 0x7f81c0105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3212873865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0100630 0x7f81c0102a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 -- 172.21.15.60:0/3212873865 >> 172.21.15.60:0/3212873865 conn(0x7f81c00fa250 msgr2=0x7f81c00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 -- 172.21.15.60:0/3212873865 shutdown_connections 2024-09-21T10:48:56.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.048+0000 7f81c64ee640 1 -- 172.21.15.60:0/3212873865 wait complete. 2024-09-21T10:48:56.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.049+0000 7f81c64ee640 1 Processor -- start 2024-09-21T10:48:56.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.049+0000 7f81c64ee640 1 -- start start 2024-09-21T10:48:56.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.049+0000 7f81c64ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0100630 0x7f81c00fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:56.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.049+0000 7f81c64ee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 0x7f81c00fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:56.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.049+0000 7f81c64ee640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00feb20 con 0x7f81c0102f60 2024-09-21T10:48:56.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.049+0000 7f81c64ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00fec90 con 0x7f81c0100630 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 0x7f81c00fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 0x7f81c00fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50214/0 (socket says 172.21.15.60:50214) 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 -- 172.21.15.60:0/3583099496 learned_addr learned my addr 172.21.15.60:0/3583099496 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bffff640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0100630 0x7f81c00fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 -- 172.21.15.60:0/3583099496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0100630 msgr2=0x7f81c00fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0100630 0x7f81c00fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 -- 172.21.15.60:0/3583099496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009560 con 0x7f81c0102f60 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bf7fe640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 0x7f81c00fe5e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81b400d6f0 tx=0x7f81b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81b4009a30 con 0x7f81c0102f60 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81b4009b90 con 0x7f81c0102f60 2024-09-21T10:48:56.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00fef70 con 0x7f81c0102f60 2024-09-21T10:48:56.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81b400f680 con 0x7f81c0102f60 2024-09-21T10:48:56.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.050+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c019d6a0 con 0x7f81c0102f60 2024-09-21T10:48:56.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.051+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c01087c0 con 0x7f81c0102f60 2024-09-21T10:48:56.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.052+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f81b4009d00 con 0x7f81c0102f60 2024-09-21T10:48:56.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.052+0000 7f81bd7fa640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f81a807b270 0x7f81a807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:56.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.053+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f81b409e2e0 con 0x7f81c0102f60 2024-09-21T10:48:56.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.053+0000 7f81bffff640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f81a807b270 0x7f81a807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:56.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.053+0000 7f81bffff640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f81a807b270 0x7f81a807d730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f81b0006010 tx=0x7f81b00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:56.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.057+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f81b4061150 con 0x7f81c0102f60 2024-09-21T10:48:56.169 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: pgmap v216: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='client.44381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2954973519' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:56.170 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:55 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2429634326' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:48:56.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: pgmap v216: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='client.44377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='client.44381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2954973519' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:48:56.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:55 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2429634326' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:48:56.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.267+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81c0103980 con 0x7f81a807b270 2024-09-21T10:48:56.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.268+0000 7f81bd7fa640 1 -- 172.21.15.60:0/3583099496 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f81c0103980 con 0x7f81a807b270 2024-09-21T10:48:56.270 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "mds" 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:48:56.271 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.270+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f81a807b270 msgr2=0x7f81a807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.270+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f81a807b270 0x7f81a807d730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f81b0006010 tx=0x7f81b00314e0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 msgr2=0x7f81c00fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 0x7f81c00fe5e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81b400d6f0 tx=0x7f81b400dbb0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 shutdown_connections 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f81a807b270 0x7f81a807d730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c0102f60 0x7f81c00fe5e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 --2- 172.21.15.60:0/3583099496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c0100630 0x7f81c00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 >> 172.21.15.60:0/3583099496 conn(0x7f81c00fa250 msgr2=0x7f81c00fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 shutdown_connections 2024-09-21T10:48:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.271+0000 7f81c64ee640 1 -- 172.21.15.60:0/3583099496 wait complete. 2024-09-21T10:48:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.354+0000 7fa471057640 1 -- 172.21.15.60:0/135705986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 msgr2=0x7fa46c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.354+0000 7fa471057640 1 --2- 172.21.15.60:0/135705986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c1053a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa454009810 tx=0x7fa45402a410 comp rx=0 tx=0).stop 2024-09-21T10:48:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.354+0000 7fa471057640 1 -- 172.21.15.60:0/135705986 shutdown_connections 2024-09-21T10:48:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.354+0000 7fa471057640 1 --2- 172.21.15.60:0/135705986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c1053a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.354+0000 7fa471057640 1 --2- 172.21.15.60:0/135705986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 0x7fa46c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.354+0000 7fa471057640 1 -- 172.21.15.60:0/135705986 >> 172.21.15.60:0/135705986 conn(0x7fa46c0fa280 msgr2=0x7fa46c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:56.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.355+0000 7fa471057640 1 -- 172.21.15.60:0/135705986 shutdown_connections 2024-09-21T10:48:56.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.355+0000 7fa471057640 1 -- 172.21.15.60:0/135705986 wait complete. 2024-09-21T10:48:56.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.355+0000 7fa471057640 1 Processor -- start 2024-09-21T10:48:56.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.355+0000 7fa471057640 1 -- start start 2024-09-21T10:48:56.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa471057640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 0x7fa46c195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:56.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa471057640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:56.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa471057640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c196230 con 0x7fa46c102fb0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa471057640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1963a0 con 0x7fa46c100680 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50234/0 (socket says 172.21.15.60:50234) 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 -- 172.21.15.60:0/3643957968 learned_addr learned my addr 172.21.15.60:0/3643957968 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46ad9d640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 0x7fa46c195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 -- 172.21.15.60:0/3643957968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 msgr2=0x7fa46c195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 0x7fa46c195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 -- 172.21.15.60:0/3643957968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009490 con 0x7fa46c102fb0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46ad9d640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 0x7fa46c195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.356+0000 7fa46a59c640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c195c60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4540097e0 tx=0x7fa454030c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.357+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4540037c0 con 0x7fa46c102fb0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.357+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4540044f0 con 0x7fa46c102fb0 2024-09-21T10:48:56.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.357+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c19ade0 con 0x7fa46c102fb0 2024-09-21T10:48:56.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.357+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa454031c80 con 0x7fa46c102fb0 2024-09-21T10:48:56.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.357+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c19b2d0 con 0x7fa46c102fb0 2024-09-21T10:48:56.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.358+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c108800 con 0x7fa46c102fb0 2024-09-21T10:48:56.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.358+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa454003920 con 0x7fa46c102fb0 2024-09-21T10:48:56.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.359+0000 7fa463fff640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa45807b270 0x7fa45807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:48:56.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.359+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa4540bfa90 con 0x7fa46c102fb0 2024-09-21T10:48:56.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.359+0000 7fa46ad9d640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa45807b270 0x7fa45807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:48:56.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.359+0000 7fa46ad9d640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa45807b270 0x7fa45807d730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005fd0 tx=0x7fa45c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:48:56.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.363+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa454082a20 con 0x7fa46c102fb0 2024-09-21T10:48:56.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.639+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa46c108990 con 0x7fa46c102fb0 2024-09-21T10:48:56.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.640+0000 7fa463fff640 1 -- 172.21.15.60:0/3643957968 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa454085b40 con 0x7fa46c102fb0 2024-09-21T10:48:56.642 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa45807b270 msgr2=0x7fa45807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa45807b270 0x7fa45807d730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005fd0 tx=0x7fa45c009260 comp rx=0 tx=0).stop 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 msgr2=0x7fa46c195c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c195c60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4540097e0 tx=0x7fa454030c00 comp rx=0 tx=0).stop 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 shutdown_connections 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa45807b270 0x7fa45807d730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa46c102fb0 0x7fa46c195c60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 --2- 172.21.15.60:0/3643957968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa46c100680 0x7fa46c195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:48:56.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.642+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 >> 172.21.15.60:0/3643957968 conn(0x7fa46c0fa280 msgr2=0x7fa46c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:48:56.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.643+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 shutdown_connections 2024-09-21T10:48:56.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:48:56.643+0000 7fa471057640 1 -- 172.21.15.60:0/3643957968 wait complete. 2024-09-21T10:48:57.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:56 smithi060 ceph-mon[93270]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:57.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:56 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3643957968' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:48:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:56 smithi112 ceph-mon[78695]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:56 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3643957968' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:48:58.259 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:57 smithi060 ceph-mon[93270]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:58.259 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:57 smithi060 ceph-mon[93270]: pgmap v217: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-21T10:48:58.259 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:58.259 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:57 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:58.416 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:57 smithi112 ceph-mon[78695]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:48:58.416 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:57 smithi112 ceph-mon[78695]: pgmap v217: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-21T10:48:58.417 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:58.417 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:57 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:59.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:59.213 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:59.214 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:48:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:48:59.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:59.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:48:59.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:48:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:00.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:00 smithi060 ceph-mon[93270]: pgmap v218: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:00.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:00 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:00.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:00 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:00.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:00 smithi112 ceph-mon[78695]: pgmap v218: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:00.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:00 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:00.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:00 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:01 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:01.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:01 smithi060 ceph-mon[93270]: pgmap v219: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:01.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:01.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:01 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:01.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:01 smithi112 ceph-mon[78695]: pgmap v219: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:02.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:02 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:02.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:02 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:02 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:02.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:02 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:03.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:03 smithi060 ceph-mon[93270]: pgmap v220: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:03.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:03 smithi112 ceph-mon[78695]: pgmap v220: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:05.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.172 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.173 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi060"} : dispatch 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi060"}]': finished 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"} : dispatch 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"}]': finished 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all iscsi 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all nfs 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: Upgrade: Setting container_image for all nvmeof 2024-09-21T10:49:05.175 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:04 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi060"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi060"}]': finished 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi112"}]': finished 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all iscsi 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all nfs 2024-09-21T10:49:05.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:05.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:05.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: Upgrade: Setting container_image for all nvmeof 2024-09-21T10:49:05.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:04 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:05 smithi060 ceph-mon[93270]: pgmap v221: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:06.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:05 smithi112 ceph-mon[78695]: pgmap v221: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:07.128 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:06 smithi060 ceph-mon[93270]: Upgrade: Updating node-exporter.smithi060 (1/2) 2024-09-21T10:49:07.128 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:06 smithi060 ceph-mon[93270]: Deploying daemon node-exporter.smithi060 on smithi060 2024-09-21T10:49:07.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:06 smithi112 ceph-mon[78695]: Upgrade: Updating node-exporter.smithi060 (1/2) 2024-09-21T10:49:07.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:06 smithi112 ceph-mon[78695]: Deploying daemon node-exporter.smithi060 on smithi060 2024-09-21T10:49:08.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:07 smithi060 ceph-mon[93270]: pgmap v222: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:08.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:07 smithi112 ceph-mon[78695]: pgmap v222: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:10.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:09 smithi060 ceph-mon[93270]: pgmap v223: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:09 smithi112 ceph-mon[78695]: pgmap v223: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:11.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:10 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:11.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:10 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:10 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:11.280 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:10 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:12.345 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:11 smithi112 ceph-mon[78695]: pgmap v224: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:12.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:11 smithi060 ceph-mon[93270]: pgmap v224: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:13.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:12 smithi060 ceph-mon[93270]: Upgrade: Updating node-exporter.smithi112 (2/2) 2024-09-21T10:49:13.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:12 smithi060 ceph-mon[93270]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T10:49:13.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:12 smithi112 ceph-mon[78695]: Upgrade: Updating node-exporter.smithi112 (2/2) 2024-09-21T10:49:13.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:12 smithi112 ceph-mon[78695]: Deploying daemon node-exporter.smithi112 on smithi112 2024-09-21T10:49:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:13 smithi060 ceph-mon[93270]: pgmap v225: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:13 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:13 smithi112 ceph-mon[78695]: pgmap v225: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:13 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:15 smithi060 ceph-mon[93270]: pgmap v226: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:16.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:15 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:16.429 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:15 smithi112 ceph-mon[78695]: pgmap v226: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:16.429 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:16.429 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:16.429 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:15 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:18.354 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:17 smithi060 ceph-mon[93270]: pgmap v227: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:18.354 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:17 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:18.354 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:17 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:17 smithi112 ceph-mon[78695]: pgmap v227: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:17 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:17 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:19.815 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:19 smithi112 ceph-mon[78695]: pgmap v228: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:19.815 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:19.815 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:19 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:19.837 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:19 smithi060 ceph-mon[93270]: pgmap v228: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:19.838 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:19.838 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:19 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.565 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:21 smithi112 ceph-mon[78695]: pgmap v229: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:21.565 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.565 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.565 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.565 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:21 smithi060 ceph-mon[93270]: pgmap v229: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:21.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:21.661 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:22 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:22.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:22 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:22.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:22 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:22.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:22 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:23.947 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:23 smithi060 ceph-mon[93270]: pgmap v230: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:23.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:23 smithi112 ceph-mon[78695]: pgmap v230: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:25.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:25.686 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: pgmap v231: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.687 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.688 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:25 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: pgmap v231: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:25.700 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:25 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:26.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:26 smithi060 ceph-mon[93270]: Upgrade: Updating prometheus.smithi060 2024-09-21T10:49:26.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:26 smithi060 ceph-mon[93270]: Deploying daemon prometheus.smithi060 on smithi060 2024-09-21T10:49:26.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:26 smithi112 ceph-mon[78695]: Upgrade: Updating prometheus.smithi060 2024-09-21T10:49:26.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:26 smithi112 ceph-mon[78695]: Deploying daemon prometheus.smithi060 on smithi060 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 -- 172.21.15.60:0/127588947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc100dc0 msgr2=0x7fcecc101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 --2- 172.21.15.60:0/127588947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc100dc0 0x7fcecc101240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009880 tx=0x7fceb402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 -- 172.21.15.60:0/127588947 shutdown_connections 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 --2- 172.21.15.60:0/127588947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc100dc0 0x7fcecc101240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 --2- 172.21.15.60:0/127588947 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc0fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 -- 172.21.15.60:0/127588947 >> 172.21.15.60:0/127588947 conn(0x7fcecc0fb350 msgr2=0x7fcecc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 -- 172.21.15.60:0/127588947 shutdown_connections 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.733+0000 7fced2660640 1 -- 172.21.15.60:0/127588947 wait complete. 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fced2660640 1 Processor -- start 2024-09-21T10:49:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fced2660640 1 -- start start 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fced2660640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fced2660640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcecc100dc0 0x7fcecc0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fced2660640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc074790 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fced2660640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc072e10 con 0x7fcecc100dc0 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38032/0 (socket says 172.21.15.60:38032) 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcecbfff640 1 -- 172.21.15.60:0/3762355285 learned_addr learned my addr 172.21.15.60:0/3762355285 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcec3fff640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcecc100dc0 0x7fcecc0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:26.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcecbfff640 1 -- 172.21.15.60:0/3762355285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcecc100dc0 msgr2=0x7fcecc0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcecbfff640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcecc100dc0 0x7fcecc0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.734+0000 7fcecbfff640 1 -- 172.21.15.60:0/3762355285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009560 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.735+0000 7fcecbfff640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc074250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c8f0 tx=0x7fcebc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.735+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcebc0041f0 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.735+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcebc007e10 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.735+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc0730f0 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.735+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcebc00f450 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.735+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc073690 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.736+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc18f740 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.737+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fcebc007950 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.737+0000 7fcec9ffb640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fceb807b270 0x7fceb807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.737+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fcebc013070 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.737+0000 7fcec3fff640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fceb807b270 0x7fceb807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.738+0000 7fcec3fff640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fceb807b270 0x7fceb807d730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fceb4000c00 tx=0x7fceb40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.742+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fcebc0613b0 con 0x7fcecc0ffbc0 2024-09-21T10:49:26.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.956+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcecc02c480 con 0x7fceb807b270 2024-09-21T10:49:26.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.957+0000 7fcec9ffb640 1 -- 172.21.15.60:0/3762355285 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fcecc02c480 con 0x7fceb807b270 2024-09-21T10:49:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fceb807b270 msgr2=0x7fceb807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fceb807b270 0x7fceb807d730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fceb4000c00 tx=0x7fceb40314e0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 msgr2=0x7fcecc074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc074250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c8f0 tx=0x7fcebc00cdb0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 shutdown_connections 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fceb807b270 0x7fceb807d730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcecc100dc0 0x7fcecc0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 --2- 172.21.15.60:0/3762355285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcecc0ffbc0 0x7fcecc074250 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 >> 172.21.15.60:0/3762355285 conn(0x7fcecc0fb350 msgr2=0x7fcecc104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 shutdown_connections 2024-09-21T10:49:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:26.959+0000 7fced2660640 1 -- 172.21.15.60:0/3762355285 wait complete. 2024-09-21T10:49:26.970 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/618953282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 msgr2=0x7f3dc40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/618953282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc40feea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009880 tx=0x7f3dc002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/618953282 shutdown_connections 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/618953282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 0x7f3dc4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/618953282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc40feea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/618953282 >> 172.21.15.60:0/618953282 conn(0x7f3dc40fa250 msgr2=0x7f3dc40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/618953282 shutdown_connections 2024-09-21T10:49:27.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/618953282 wait complete. 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.045+0000 7f3dcbdc5640 1 Processor -- start 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dcbdc5640 1 -- start start 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dcbdc5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc4102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dcbdc5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 0x7f3dc4101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dcbdc5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4102f70 con 0x7f3dc40feaa0 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dcbdc5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc41015f0 con 0x7f3dc40ffca0 2024-09-21T10:49:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc4102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc4102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38036/0 (socket says 172.21.15.60:38036) 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 -- 172.21.15.60:0/2724803190 learned_addr learned my addr 172.21.15.60:0/2724803190 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9360640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 0x7f3dc4101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 -- 172.21.15.60:0/2724803190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 msgr2=0x7f3dc4101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 0x7f3dc4101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 -- 172.21.15.60:0/2724803190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0009560 con 0x7f3dc40feaa0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9360640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 0x7f3dc4101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.046+0000 7f3dc9b61640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc4102a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002a9c0 tx=0x7f3dc0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.047+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc0004b20 con 0x7f3dc40feaa0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.047+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dc0004c80 con 0x7f3dc40feaa0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.047+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc4101870 con 0x7f3dc40feaa0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.047+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc0003bc0 con 0x7f3dc40feaa0 2024-09-21T10:49:27.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.047+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc4101de0 con 0x7f3dc40feaa0 2024-09-21T10:49:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.048+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc40feea0 con 0x7f3dc40feaa0 2024-09-21T10:49:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.048+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3dc0031640 con 0x7f3dc40feaa0 2024-09-21T10:49:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.049+0000 7f3dbaffd640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3db007b270 0x7f3db007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.049+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3dc00bf840 con 0x7f3dc40feaa0 2024-09-21T10:49:27.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.049+0000 7f3dc9360640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3db007b270 0x7f3db007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.050+0000 7f3dc9360640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3db007b270 0x7f3db007d730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3dc41027b0 tx=0x7f3db4005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.053+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f3dc00826b0 con 0x7f3dc40feaa0 2024-09-21T10:49:27.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.264+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc4068c30 con 0x7f3db007b270 2024-09-21T10:49:27.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.265+0000 7f3dbaffd640 1 -- 172.21.15.60:0/2724803190 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f3dc4068c30 con 0x7f3db007b270 2024-09-21T10:49:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3db007b270 msgr2=0x7f3db007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3db007b270 0x7f3db007d730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3dc41027b0 tx=0x7f3db4005d90 comp rx=0 tx=0).stop 2024-09-21T10:49:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 msgr2=0x7f3dc4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc4102a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002a9c0 tx=0x7f3dc0005610 comp rx=0 tx=0).stop 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 shutdown_connections 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3db007b270 0x7f3db007d730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dc40ffca0 0x7f3dc4101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 --2- 172.21.15.60:0/2724803190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc40feaa0 0x7f3dc4102a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 >> 172.21.15.60:0/2724803190 conn(0x7f3dc40fa250 msgr2=0x7f3dc4068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 shutdown_connections 2024-09-21T10:49:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.268+0000 7f3dcbdc5640 1 -- 172.21.15.60:0/2724803190 wait complete. 2024-09-21T10:49:27.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 -- 172.21.15.60:0/2158889167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 msgr2=0x7f2824101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2158889167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824101210 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f280c009880 tx=0x7f280c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 -- 172.21.15.60:0/2158889167 shutdown_connections 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2158889167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824101210 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2158889167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28240ffb90 0x7f28240fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 -- 172.21.15.60:0/2158889167 >> 172.21.15.60:0/2158889167 conn(0x7f28240fb320 msgr2=0x7f28240fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 -- 172.21.15.60:0/2158889167 shutdown_connections 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.354+0000 7f2829f2b640 1 -- 172.21.15.60:0/2158889167 wait complete. 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f2829f2b640 1 Processor -- start 2024-09-21T10:49:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f2829f2b640 1 -- start start 2024-09-21T10:49:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f2829f2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28240ffb90 0x7f2824195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f2829f2b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f2829f2b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824196140 con 0x7f2824100d90 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f2829f2b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28241962b0 con 0x7f28240ffb90 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f281affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f281affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38052/0 (socket says 172.21.15.60:38052) 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f281affd640 1 -- 172.21.15.60:0/2224637125 learned_addr learned my addr 172.21.15.60:0/2224637125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f28237fe640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28240ffb90 0x7f2824195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f281affd640 1 -- 172.21.15.60:0/2224637125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28240ffb90 msgr2=0x7f2824195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f281affd640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28240ffb90 0x7f2824195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.355+0000 7f281affd640 1 -- 172.21.15.60:0/2224637125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c009560 con 0x7f2824100d90 2024-09-21T10:49:27.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.356+0000 7f281affd640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824195b70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f280c005520 tx=0x7f280c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:27.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.356+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c004aa0 con 0x7f2824100d90 2024-09-21T10:49:27.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.356+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282419acf0 con 0x7f2824100d90 2024-09-21T10:49:27.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.356+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f280c004c00 con 0x7f2824100d90 2024-09-21T10:49:27.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.356+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c003b10 con 0x7f2824100d90 2024-09-21T10:49:27.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.356+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282419b260 con 0x7f2824100d90 2024-09-21T10:49:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.357+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282418f730 con 0x7f2824100d90 2024-09-21T10:49:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.358+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f280c003d40 con 0x7f2824100d90 2024-09-21T10:49:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.358+0000 7f28217fa640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f281007b270 0x7f281007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.358+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f280c0bf660 con 0x7f2824100d90 2024-09-21T10:49:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.358+0000 7f28237fe640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f281007b270 0x7f281007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.359+0000 7f28237fe640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f281007b270 0x7f281007d730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2814005fd0 tx=0x7f2814005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:27.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.363+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f280c0825d0 con 0x7f2824100d90 2024-09-21T10:49:27.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.564+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f282402c450 con 0x7f281007b270 2024-09-21T10:49:27.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.573+0000 7f28217fa640 1 -- 172.21.15.60:0/2224637125 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f282402c450 con 0x7f281007b270 2024-09-21T10:49:27.575 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:49:27.575 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (15m) 7s ago 17m 25.1M - 0.25.0 c8568f914cd2 30654a8b7453 2024-09-21T10:49:27.575 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (37s) 7s ago 17m 8316k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 971a0f60ed38 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (32s) 9s ago 16m 8002k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f0303f9e56f2 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (5m) 7s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (5m) 9s ago 16m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (15m) 7s ago 17m 89.1M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (92s) 7s ago 11m 13.6M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 db77ea321515 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (116s) 7s ago 11m 82.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (49s) 9s ago 11m 15.4M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 9b0567217371 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (71s) 9s ago 11m 16.5M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 75c0d10e7ca7 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (7m) 7s ago 18m 523M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (6m) 9s ago 16m 456M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (6m) 7s ago 18m 56.5M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (6m) 9s ago 16m 44.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (18s) 7s ago 17m 8002k - 1.7.0 72c9c2088986 fc626a3cd8af 2024-09-21T10:49:27.576 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (12s) 9s ago 16m 3431k - 1.7.0 72c9c2088986 e51afe36f4cf 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (5m) 7s ago 14m 113M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (4m) 7s ago 14m 119M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (3m) 7s ago 13m 102M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (3m) 9s ago 13m 123M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (2m) 9s ago 13m 116M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (2m) 9s ago 12m 99.5M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:49:27.577 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (7m) 7s ago 16m 65.8M - 2.43.0 a07b618ecd1d d10b6b1cfc2b 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f281007b270 msgr2=0x7f281007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f281007b270 0x7f281007d730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2814005fd0 tx=0x7f2814005850 comp rx=0 tx=0).stop 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 msgr2=0x7f2824195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824195b70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f280c005520 tx=0x7f280c005550 comp rx=0 tx=0).stop 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 shutdown_connections 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f281007b270 0x7f281007d730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2824100d90 0x7f2824195b70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 --2- 172.21.15.60:0/2224637125 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28240ffb90 0x7f2824195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 >> 172.21.15.60:0/2224637125 conn(0x7f28240fb320 msgr2=0x7f2824104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 shutdown_connections 2024-09-21T10:49:27.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.575+0000 7f2829f2b640 1 -- 172.21.15.60:0/2224637125 wait complete. 2024-09-21T10:49:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 -- 172.21.15.60:0/2386839384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fe400 msgr2=0x7f198c0fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 --2- 172.21.15.60:0/2386839384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fe400 0x7f198c0fe800 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f197c009880 tx=0x7f197c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 -- 172.21.15.60:0/2386839384 shutdown_connections 2024-09-21T10:49:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 --2- 172.21.15.60:0/2386839384 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f198c0fed40 0x7f198c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 --2- 172.21.15.60:0/2386839384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fe400 0x7f198c0fe800 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 -- 172.21.15.60:0/2386839384 >> 172.21.15.60:0/2386839384 conn(0x7f198c0fa230 msgr2=0x7f198c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:27.660 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:27 smithi060 ceph-mon[93270]: pgmap v232: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:27.660 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:27 smithi060 ceph-mon[93270]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 -- 172.21.15.60:0/2386839384 shutdown_connections 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.657+0000 7f1992976640 1 -- 172.21.15.60:0/2386839384 wait complete. 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.658+0000 7f1992976640 1 Processor -- start 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.658+0000 7f1992976640 1 -- start start 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.658+0000 7f1992976640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f198c0fe400 0x7f198c1977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f1992976640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 0x7f198c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f1992976640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1982e0 con 0x7f198c0fed40 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f1992976640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c198450 con 0x7f198c0fe400 2024-09-21T10:49:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 0x7f198c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 0x7f198c197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38078/0 (socket says 172.21.15.60:38078) 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 -- 172.21.15.60:0/1091563086 learned_addr learned my addr 172.21.15.60:0/1091563086 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198bfff640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f198c0fe400 0x7f198c1977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 -- 172.21.15.60:0/1091563086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f198c0fe400 msgr2=0x7f198c1977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f198c0fe400 0x7f198c1977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 -- 172.21.15.60:0/1091563086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009560 con 0x7f198c0fed40 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f198b7fe640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 0x7f198c197d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f198000e9a0 tx=0x7f198000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198000cd50 con 0x7f198c0fed40 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c19cef0 con 0x7f198c0fed40 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f198000ceb0 con 0x7f198c0fed40 2024-09-21T10:49:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.659+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1980010660 con 0x7f198c0fed40 2024-09-21T10:49:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.660+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c19d490 con 0x7f198c0fed40 2024-09-21T10:49:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.661+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c10a970 con 0x7f198c0fed40 2024-09-21T10:49:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.661+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f19800048a0 con 0x7f198c0fed40 2024-09-21T10:49:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.662+0000 7f19897fa640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f197407b270 0x7f197407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.662+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1980014070 con 0x7f198c0fed40 2024-09-21T10:49:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.662+0000 7f198bfff640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f197407b270 0x7f197407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.663+0000 7f198bfff640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f197407b270 0x7f197407d730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f197c000c00 tx=0x7f197c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.667+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1980064ff0 con 0x7f198c0fed40 2024-09-21T10:49:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:27 smithi112 ceph-mon[78695]: pgmap v232: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:27.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:27 smithi112 ceph-mon[78695]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.932+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f198c10ab50 con 0x7f198c0fed40 2024-09-21T10:49:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.933+0000 7f19897fa640 1 -- 172.21.15.60:0/1091563086 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1980064990 con 0x7f198c0fed40 2024-09-21T10:49:27.935 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:49:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:49:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:49:27.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:49:27.936 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.935+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f197407b270 msgr2=0x7f197407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.935+0000 7f1992976640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f197407b270 0x7f197407d730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f197c000c00 tx=0x7f197c0314e0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.935+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 msgr2=0x7f198c197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.935+0000 7f1992976640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 0x7f198c197d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f198000e9a0 tx=0x7f198000eda0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 shutdown_connections 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f197407b270 0x7f197407d730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f198c0fed40 0x7f198c197d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 --2- 172.21.15.60:0/1091563086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f198c0fe400 0x7f198c1977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 >> 172.21.15.60:0/1091563086 conn(0x7f198c0fa230 msgr2=0x7f198c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 shutdown_connections 2024-09-21T10:49:27.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:27.936+0000 7f1992976640 1 -- 172.21.15.60:0/1091563086 wait complete. 2024-09-21T10:49:28.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 -- 172.21.15.60:0/3153946180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0ffc00 msgr2=0x7fdd9c100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 --2- 172.21.15.60:0/3153946180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009880 tx=0x7fdd9002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 -- 172.21.15.60:0/3153946180 shutdown_connections 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 --2- 172.21.15.60:0/3153946180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 --2- 172.21.15.60:0/3153946180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c0fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 -- 172.21.15.60:0/3153946180 >> 172.21.15.60:0/3153946180 conn(0x7fdd9c0fa190 msgr2=0x7fdd9c0fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 -- 172.21.15.60:0/3153946180 shutdown_connections 2024-09-21T10:49:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.019+0000 7fdda0c82640 1 -- 172.21.15.60:0/3153946180 wait complete. 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdda0c82640 1 Processor -- start 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdda0c82640 1 -- start start 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdda0c82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdda0c82640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdda0c82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c101520 con 0x7fdd9c0fea00 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdda0c82640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c101690 con 0x7fdd9c0ffc00 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdd9a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdd9a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c102990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38096/0 (socket says 172.21.15.60:38096) 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.020+0000 7fdd9a59c640 1 -- 172.21.15.60:0/2176439497 learned_addr learned my addr 172.21.15.60:0/2176439497 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd99d9b640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd9a59c640 1 -- 172.21.15.60:0/2176439497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0ffc00 msgr2=0x7fdd9c100fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd9a59c640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd9a59c640 1 -- 172.21.15.60:0/2176439497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90009560 con 0x7fdd9c0fea00 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd99d9b640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd9a59c640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c102990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00d8d0 tx=0x7fdd8c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8c009a30 con 0x7fdd9c0fea00 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd8c009b90 con 0x7fdd9c0fea00 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c101970 con 0x7fdd9c0fea00 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8c00f680 con 0x7fdd9c0fea00 2024-09-21T10:49:28.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.021+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c19d650 con 0x7fdd9c0fea00 2024-09-21T10:49:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.022+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c0fee00 con 0x7fdd9c0fea00 2024-09-21T10:49:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.023+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fdd8c009d00 con 0x7fdd9c0fea00 2024-09-21T10:49:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.023+0000 7fdd8b7fe640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd8407b270 0x7fdd8407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.024+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fdd8c09e240 con 0x7fdd9c0fea00 2024-09-21T10:49:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.024+0000 7fdd99d9b640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd8407b270 0x7fdd8407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.024+0000 7fdd99d9b640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd8407b270 0x7fdd8407d730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd90000c00 tx=0x7fdd900314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:28.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.028+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdd8c061130 con 0x7fdd9c0fea00 2024-09-21T10:49:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.254+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd9c107610 con 0x7fdd9c0fea00 2024-09-21T10:49:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.254+0000 7fdd8b7fe640 1 -- 172.21.15.60:0/2176439497 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1974 (secure 0 0 0) 0x7fdd8c064250 con 0x7fdd9c0fea00 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T10:48:39:093091+0000 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 34 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:48:38.086780+0000 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:49:28.257 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 83 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34402} 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:49:28.258 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34402 members: 34402 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:49:28.259 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:49:28.260 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:49:28.260 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:44371} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/991928918,v1:172.21.15.112:6827/991928918] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:49:28.260 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-09-21T10:49:28.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd8407b270 msgr2=0x7fdd8407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd8407b270 0x7fdd8407d730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd90000c00 tx=0x7fdd900314e0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 msgr2=0x7fdd9c102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c102990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00d8d0 tx=0x7fdd8c00dd90 comp rx=0 tx=0).stop 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 shutdown_connections 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd8407b270 0x7fdd8407d730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd9c0ffc00 0x7fdd9c100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 --2- 172.21.15.60:0/2176439497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd9c0fea00 0x7fdd9c102990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 >> 172.21.15.60:0/2176439497 conn(0x7fdd9c0fa190 msgr2=0x7fdd9c067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 shutdown_connections 2024-09-21T10:49:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.256+0000 7fdda0c82640 1 -- 172.21.15.60:0/2176439497 wait complete. 2024-09-21T10:49:28.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 -- 172.21.15.60:0/3860365999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 msgr2=0x7fbb38102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 --2- 172.21.15.60:0/3860365999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38102a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb280098b0 tx=0x7fbb2802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 -- 172.21.15.60:0/3860365999 shutdown_connections 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 --2- 172.21.15.60:0/3860365999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102f60 0x7fbb38105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 --2- 172.21.15.60:0/3860365999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38102a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 -- 172.21.15.60:0/3860365999 >> 172.21.15.60:0/3860365999 conn(0x7fbb380fa250 msgr2=0x7fbb380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 -- 172.21.15.60:0/3860365999 shutdown_connections 2024-09-21T10:49:28.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.341+0000 7fbb3d805640 1 -- 172.21.15.60:0/3860365999 wait complete. 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb3d805640 1 Processor -- start 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb3d805640 1 -- start start 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb3d805640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb3d805640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102f60 0x7fbb38197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb3d805640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb381983a0 con 0x7fbb38100630 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb3d805640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38198510 con 0x7fbb38102f60 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38114/0 (socket says 172.21.15.60:38114) 2024-09-21T10:49:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.342+0000 7fbb36ffd640 1 -- 172.21.15.60:0/806296708 learned_addr learned my addr 172.21.15.60:0/806296708 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb367fc640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102f60 0x7fbb38197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb36ffd640 1 -- 172.21.15.60:0/806296708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102f60 msgr2=0x7fbb38197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb36ffd640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102f60 0x7fbb38197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb36ffd640 1 -- 172.21.15.60:0/806296708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28009560 con 0x7fbb38100630 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb36ffd640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38197890 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbb28004650 tx=0x7fbb280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb28004aa0 con 0x7fbb38100630 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb28005d50 con 0x7fbb38100630 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3819cf00 con 0x7fbb38100630 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb280039f0 con 0x7fbb38100630 2024-09-21T10:49:28.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.343+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3819d3f0 con 0x7fbb38100630 2024-09-21T10:49:28.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.344+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb380fbd40 con 0x7fbb38100630 2024-09-21T10:49:28.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.345+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fbb28031c00 con 0x7fbb38100630 2024-09-21T10:49:28.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.346+0000 7fbb3c803640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbb2007b270 0x7fbb2007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.346+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbb280bf3a0 con 0x7fbb38100630 2024-09-21T10:49:28.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.346+0000 7fbb367fc640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbb2007b270 0x7fbb2007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.346+0000 7fbb367fc640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbb2007b270 0x7fbb2007d730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb38198d60 tx=0x7fbb2c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:28.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.350+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fbb280823e0 con 0x7fbb38100630 2024-09-21T10:49:28.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.560+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb3802c550 con 0x7fbb2007b270 2024-09-21T10:49:28.563 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:28 smithi060 ceph-mon[93270]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:28.563 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:28 smithi060 ceph-mon[93270]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:28.563 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:28 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1091563086' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:28.563 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:28 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2176439497' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.562+0000 7fbb3c803640 1 -- 172.21.15.60:0/806296708 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7fbb3802c550 con 0x7fbb2007b270 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph-exporter", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:49:28.564 INFO:teuthology.orchestra.run.smithi060.stdout: "mds" 2024-09-21T10:49:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:49:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "18/23 daemons upgraded", 2024-09-21T10:49:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-21T10:49:28.565 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:49:28.565 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:49:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbb2007b270 msgr2=0x7fbb2007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbb2007b270 0x7fbb2007d730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb38198d60 tx=0x7fbb2c005f90 comp rx=0 tx=0).stop 2024-09-21T10:49:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 msgr2=0x7fbb38197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38197890 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbb28004650 tx=0x7fbb280055a0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 shutdown_connections 2024-09-21T10:49:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbb2007b270 0x7fbb2007d730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb38102f60 0x7fbb38197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 --2- 172.21.15.60:0/806296708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb38100630 0x7fbb38197890 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 >> 172.21.15.60:0/806296708 conn(0x7fbb380fa250 msgr2=0x7fbb380fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 shutdown_connections 2024-09-21T10:49:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.564+0000 7fbb3d805640 1 -- 172.21.15.60:0/806296708 wait complete. 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 -- 172.21.15.60:0/3220997043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 msgr2=0x7f927c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 --2- 172.21.15.60:0/3220997043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c101210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9270009880 tx=0x7f927002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 -- 172.21.15.60:0/3220997043 shutdown_connections 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 --2- 172.21.15.60:0/3220997043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c101210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 --2- 172.21.15.60:0/3220997043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 0x7f927c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 -- 172.21.15.60:0/3220997043 >> 172.21.15.60:0/3220997043 conn(0x7f927c0fb320 msgr2=0x7f927c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 -- 172.21.15.60:0/3220997043 shutdown_connections 2024-09-21T10:49:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.647+0000 7f9280b3d640 1 -- 172.21.15.60:0/3220997043 wait complete. 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9280b3d640 1 Processor -- start 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9280b3d640 1 -- start start 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9280b3d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 0x7f927c1955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9280b3d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9280b3d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c196060 con 0x7f927c100d90 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9280b3d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c1961d0 con 0x7f927c0ffb90 2024-09-21T10:49:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9279d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9279d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38132/0 (socket says 172.21.15.60:38132) 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.648+0000 7f9279d9b640 1 -- 172.21.15.60:0/426164547 learned_addr learned my addr 172.21.15.60:0/426164547 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f9279d9b640 1 -- 172.21.15.60:0/426164547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 msgr2=0x7f927c1955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f927a59c640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 0x7f927c1955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f9279d9b640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 0x7f927c1955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f9279d9b640 1 -- 172.21.15.60:0/426164547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009560 con 0x7f927c100d90 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f927a59c640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 0x7f927c1955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f9279d9b640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c195b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9270005610 tx=0x7f9270005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9270004ba0 con 0x7f927c100d90 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9270004d00 con 0x7f927c100d90 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c19ac50 con 0x7f927c100d90 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9270003bd0 con 0x7f927c100d90 2024-09-21T10:49:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.649+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c19b170 con 0x7f927c100d90 2024-09-21T10:49:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.650+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c108780 con 0x7f927c100d90 2024-09-21T10:49:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.651+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f9270031640 con 0x7f927c100d90 2024-09-21T10:49:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.652+0000 7f926b7fe640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f926407b270 0x7f926407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.652+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f92700bf820 con 0x7f927c100d90 2024-09-21T10:49:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.652+0000 7f927a59c640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f926407b270 0x7f926407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:28.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.652+0000 7f927a59c640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f926407b270 0x7f926407d730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f927c100bf0 tx=0x7f926c005db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:28.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.656+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f9270082730 con 0x7f927c100d90 2024-09-21T10:49:28.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:28 smithi112 ceph-mon[78695]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:28.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:28 smithi112 ceph-mon[78695]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:28.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:28 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1091563086' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:28.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:28 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2176439497' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:49:28.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.923+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f927c19b360 con 0x7f927c100d90 2024-09-21T10:49:28.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.924+0000 7f926b7fe640 1 -- 172.21.15.60:0/426164547 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9270085850 con 0x7f927c100d90 2024-09-21T10:49:28.926 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:49:28.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f926407b270 msgr2=0x7f926407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f926407b270 0x7f926407d730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f927c100bf0 tx=0x7f926c005db0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 msgr2=0x7f927c195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c195b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9270005610 tx=0x7f9270005640 comp rx=0 tx=0).stop 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 shutdown_connections 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f926407b270 0x7f926407d730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c100d90 0x7f927c195b20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 --2- 172.21.15.60:0/426164547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f927c0ffb90 0x7f927c1955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.926+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 >> 172.21.15.60:0/426164547 conn(0x7f927c0fb320 msgr2=0x7f927c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.927+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 shutdown_connections 2024-09-21T10:49:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:28.927+0000 7f9280b3d640 1 -- 172.21.15.60:0/426164547 wait complete. 2024-09-21T10:49:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:29 smithi060 ceph-mon[93270]: pgmap v233: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:29 smithi060 ceph-mon[93270]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:29 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/426164547' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:49:29.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:29 smithi112 ceph-mon[78695]: pgmap v233: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:29.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:29 smithi112 ceph-mon[78695]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:49:29.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:29.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:29 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/426164547' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:49:31.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:31 smithi060 ceph-mon[93270]: pgmap v234: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:31.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:31 smithi112 ceph-mon[78695]: pgmap v234: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:33.689 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:33 smithi060 ceph-mon[93270]: pgmap v235: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:33.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:33 smithi112 ceph-mon[78695]: pgmap v235: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:35.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:35 smithi060 ceph-mon[93270]: pgmap v236: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:35.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:35 smithi112 ceph-mon[78695]: pgmap v236: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:37.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:37 smithi060 ceph-mon[93270]: pgmap v237: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:37 smithi112 ceph-mon[78695]: pgmap v237: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:39.535 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:39 smithi060 ceph-mon[93270]: pgmap v238: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:39 smithi112 ceph-mon[78695]: pgmap v238: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:41.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:41.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:40 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:41.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:41.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:41.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:40 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:42.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:41 smithi060 ceph-mon[93270]: pgmap v239: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:41 smithi112 ceph-mon[78695]: pgmap v239: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:44.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:43 smithi060 ceph-mon[93270]: pgmap v240: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:44.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:43 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:44.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:43 smithi112 ceph-mon[78695]: pgmap v240: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:44.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:43 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:45 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:45 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:45 smithi060 ceph-mon[93270]: pgmap v241: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:45 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:45 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:45 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:45 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:45 smithi112 ceph-mon[78695]: pgmap v241: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:45 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:45.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:45 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:47.641 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:47 smithi060 ceph-mon[93270]: pgmap v242: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:47.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:47 smithi112 ceph-mon[78695]: pgmap v242: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:49:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:49:49.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:49 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:49.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.452 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:49.453 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:49 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:49:50.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:50 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:49:50.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:50 smithi060 ceph-mon[93270]: pgmap v243: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:50.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:50 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T10:49:50.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:50 smithi112 ceph-mon[78695]: pgmap v243: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:51.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:51 smithi060 ceph-mon[93270]: Upgrade: Updating alertmanager.smithi060 2024-09-21T10:49:51.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:51 smithi060 ceph-mon[93270]: Deploying daemon alertmanager.smithi060 on smithi060 2024-09-21T10:49:51.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:51 smithi112 ceph-mon[78695]: Upgrade: Updating alertmanager.smithi060 2024-09-21T10:49:51.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:51 smithi112 ceph-mon[78695]: Deploying daemon alertmanager.smithi060 on smithi060 2024-09-21T10:49:52.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:52 smithi060 ceph-mon[93270]: pgmap v244: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:52 smithi112 ceph-mon[78695]: pgmap v244: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:54 smithi060 ceph-mon[93270]: pgmap v245: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:54 smithi112 ceph-mon[78695]: pgmap v245: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:56.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:56 smithi060 ceph-mon[93270]: pgmap v246: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:56.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:56 smithi112 ceph-mon[78695]: pgmap v246: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:57.407 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:57 smithi060 ceph-mon[93270]: pgmap v247: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:57 smithi112 ceph-mon[78695]: pgmap v247: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:59.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 -- 172.21.15.60:0/2672441296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 msgr2=0x7fdd180feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/2672441296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd180feea0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009880 tx=0x7fdd0802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 -- 172.21.15.60:0/2672441296 shutdown_connections 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/2672441296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffca0 0x7fdd18100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/2672441296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd180feea0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 -- 172.21.15.60:0/2672441296 >> 172.21.15.60:0/2672441296 conn(0x7fdd180fa250 msgr2=0x7fdd180fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 -- 172.21.15.60:0/2672441296 shutdown_connections 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.015+0000 7fdd1deb0640 1 -- 172.21.15.60:0/2672441296 wait complete. 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd1deb0640 1 Processor -- start 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd1deb0640 1 -- start start 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd1deb0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd18068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd1deb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffca0 0x7fdd1819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd1deb0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1819a960 con 0x7fdd180feaa0 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd1deb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1819aad0 con 0x7fdd180ffca0 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd177fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd18068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd177fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd18068ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58060/0 (socket says 172.21.15.60:58060) 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd177fe640 1 -- 172.21.15.60:0/380775334 learned_addr learned my addr 172.21.15.60:0/380775334 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.016+0000 7fdd0effd640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffca0 0x7fdd1819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd177fe640 1 -- 172.21.15.60:0/380775334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffca0 msgr2=0x7fdd1819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd177fe640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffca0 0x7fdd1819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd177fe640 1 -- 172.21.15.60:0/380775334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009560 con 0x7fdd180feaa0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd177fe640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd18068ff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd08006010 tx=0x7fdd080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd08004aa0 con 0x7fdd180feaa0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd08004c00 con 0x7fdd180feaa0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1819ad50 con 0x7fdd180feaa0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd080039e0 con 0x7fdd180feaa0 2024-09-21T10:49:59.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.017+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1819b260 con 0x7fdd180feaa0 2024-09-21T10:49:59.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.018+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1818e640 con 0x7fdd180feaa0 2024-09-21T10:49:59.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.019+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fdd08031c00 con 0x7fdd180feaa0 2024-09-21T10:49:59.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.019+0000 7fdd157fa640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0407b270 0x7fdd0407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.019+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fdd080bf420 con 0x7fdd180feaa0 2024-09-21T10:49:59.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.019+0000 7fdd0effd640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0407b270 0x7fdd0407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.020+0000 7fdd0effd640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0407b270 0x7fdd0407d730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd18068d70 tx=0x7fdd0000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.024+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fdd08082460 con 0x7fdd180feaa0 2024-09-21T10:49:59.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.234+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd1802c4f0 con 0x7fdd0407b270 2024-09-21T10:49:59.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.235+0000 7fdd157fa640 1 -- 172.21.15.60:0/380775334 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fdd1802c4f0 con 0x7fdd0407b270 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.237+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0407b270 msgr2=0x7fdd0407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.237+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0407b270 0x7fdd0407d730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd18068d70 tx=0x7fdd0000b390 comp rx=0 tx=0).stop 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.237+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 msgr2=0x7fdd18068ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.237+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd18068ff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd08006010 tx=0x7fdd080055a0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 shutdown_connections 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fdd0407b270 0x7fdd0407d730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd180ffca0 0x7fdd1819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 --2- 172.21.15.60:0/380775334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd180feaa0 0x7fdd18068ff0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 >> 172.21.15.60:0/380775334 conn(0x7fdd180fa250 msgr2=0x7fdd18103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 shutdown_connections 2024-09-21T10:49:59.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.238+0000 7fdd1deb0640 1 -- 172.21.15.60:0/380775334 wait complete. 2024-09-21T10:49:59.248 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:49:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 -- 172.21.15.60:0/2016691353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 msgr2=0x7f35e4105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/2016691353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4105350 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f35d40098b0 tx=0x7f35d402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 -- 172.21.15.60:0/2016691353 shutdown_connections 2024-09-21T10:49:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/2016691353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4105350 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/2016691353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e4100630 0x7f35e4102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 -- 172.21.15.60:0/2016691353 >> 172.21.15.60:0/2016691353 conn(0x7f35e40fa250 msgr2=0x7f35e40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 -- 172.21.15.60:0/2016691353 shutdown_connections 2024-09-21T10:49:59.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 -- 172.21.15.60:0/2016691353 wait complete. 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.323+0000 7f35ebaf9640 1 Processor -- start 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.324+0000 7f35ebaf9640 1 -- start start 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.324+0000 7f35ebaf9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e4100630 0x7f35e4195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.324+0000 7f35ebaf9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35ebaf9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e41960d0 con 0x7f35e4102f60 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9094640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35ebaf9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4196240 con 0x7f35e4100630 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9094640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58066/0 (socket says 172.21.15.60:58066) 2024-09-21T10:49:59.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9094640 1 -- 172.21.15.60:0/4285194684 learned_addr learned my addr 172.21.15.60:0/4285194684 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:59.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9094640 1 -- 172.21.15.60:0/4285194684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e4100630 msgr2=0x7f35e4195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9895640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e4100630 0x7f35e4195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9094640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e4100630 0x7f35e4195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.325+0000 7f35e9094640 1 -- 172.21.15.60:0/4285194684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009560 con 0x7f35e4102f60 2024-09-21T10:49:59.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.326+0000 7f35e9094640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4195b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f35d402a9f0 tx=0x7f35d4004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.327+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d4004cb0 con 0x7f35e4102f60 2024-09-21T10:49:59.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.327+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e419acc0 con 0x7f35e4102f60 2024-09-21T10:49:59.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.327+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35d4004e10 con 0x7f35e4102f60 2024-09-21T10:49:59.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.327+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d4003bd0 con 0x7f35e4102f60 2024-09-21T10:49:59.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.327+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e419b1e0 con 0x7f35e4102f60 2024-09-21T10:49:59.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.328+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e4108790 con 0x7f35e4102f60 2024-09-21T10:49:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.329+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f35d4003d30 con 0x7f35e4102f60 2024-09-21T10:49:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.329+0000 7f35daffd640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f35d007b270 0x7f35d007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.329+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f35d40bf950 con 0x7f35e4102f60 2024-09-21T10:49:59.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.330+0000 7f35e9895640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f35d007b270 0x7f35d007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.330+0000 7f35e9895640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f35d007b270 0x7f35d007d730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35e000ba40 tx=0x7f35e0005cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.334+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f35d40828e0 con 0x7f35e4102f60 2024-09-21T10:49:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.546+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35e41039c0 con 0x7f35d007b270 2024-09-21T10:49:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.547+0000 7f35daffd640 1 -- 172.21.15.60:0/4285194684 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f35e41039c0 con 0x7f35d007b270 2024-09-21T10:49:59.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f35d007b270 msgr2=0x7f35d007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f35d007b270 0x7f35d007d730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35e000ba40 tx=0x7f35e0005cc0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 msgr2=0x7f35e4195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4195b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f35d402a9f0 tx=0x7f35d4004940 comp rx=0 tx=0).stop 2024-09-21T10:49:59.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 shutdown_connections 2024-09-21T10:49:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f35d007b270 0x7f35d007d730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35e4102f60 0x7f35e4195b90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 --2- 172.21.15.60:0/4285194684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35e4100630 0x7f35e4195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 >> 172.21.15.60:0/4285194684 conn(0x7f35e40fa250 msgr2=0x7f35e40fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 shutdown_connections 2024-09-21T10:49:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.550+0000 7f35ebaf9640 1 -- 172.21.15.60:0/4285194684 wait complete. 2024-09-21T10:49:59.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 -- 172.21.15.60:0/1080065728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900ffb90 msgr2=0x7fa6900fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 --2- 172.21.15.60:0/1080065728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900ffb90 0x7fa6900fff90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa680009880 tx=0x7fa68002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 -- 172.21.15.60:0/1080065728 shutdown_connections 2024-09-21T10:49:59.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 --2- 172.21.15.60:0/1080065728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa690100d90 0x7fa690101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 --2- 172.21.15.60:0/1080065728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900ffb90 0x7fa6900fff90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 -- 172.21.15.60:0/1080065728 >> 172.21.15.60:0/1080065728 conn(0x7fa6900fb360 msgr2=0x7fa6900fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:59 smithi060 ceph-mon[93270]: pgmap v248: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:59.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:59.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:59.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:59.648 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:49:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:59.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 -- 172.21.15.60:0/1080065728 shutdown_connections 2024-09-21T10:49:59.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.645+0000 7fa695b76640 1 -- 172.21.15.60:0/1080065728 wait complete. 2024-09-21T10:49:59.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa695b76640 1 Processor -- start 2024-09-21T10:49:59.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa695b76640 1 -- start start 2024-09-21T10:49:59.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa695b76640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6900ffb90 0x7fa690074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa695b76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 0x7fa6900728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa695b76640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690072de0 con 0x7fa690100d90 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa695b76640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690072f50 con 0x7fa6900ffb90 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa68effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 0x7fa6900728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa68effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 0x7fa6900728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58070/0 (socket says 172.21.15.60:58070) 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa68effd640 1 -- 172.21.15.60:0/1902761739 learned_addr learned my addr 172.21.15.60:0/1902761739 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.646+0000 7fa68f7fe640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6900ffb90 0x7fa690074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68effd640 1 -- 172.21.15.60:0/1902761739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6900ffb90 msgr2=0x7fa690074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68effd640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6900ffb90 0x7fa690074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68effd640 1 -- 172.21.15.60:0/1902761739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009560 con 0x7fa690100d90 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68effd640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 0x7fa6900728a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa68400d8d0 tx=0x7fa68400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa68400bea0 con 0x7fa690100d90 2024-09-21T10:49:59.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa684009c00 con 0x7fa690100d90 2024-09-21T10:49:59.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa690073230 con 0x7fa690100d90 2024-09-21T10:49:59.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa68400f710 con 0x7fa690100d90 2024-09-21T10:49:59.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.647+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69019d640 con 0x7fa690100d90 2024-09-21T10:49:59.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.649+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa690108780 con 0x7fa690100d90 2024-09-21T10:49:59.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.649+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa684010460 con 0x7fa690100d90 2024-09-21T10:49:59.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.650+0000 7fa68cff9640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa67807b270 0x7fa67807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.650+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa68409e0b0 con 0x7fa690100d90 2024-09-21T10:49:59.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.650+0000 7fa68f7fe640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa67807b270 0x7fa67807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.651+0000 7fa68f7fe640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa67807b270 0x7fa67807d730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa680009230 tx=0x7fa6800314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.656+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa684061090 con 0x7fa690100d90 2024-09-21T10:49:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:59 smithi112 ceph-mon[78695]: pgmap v248: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:49:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:49:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:49:59.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:49:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:49:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.859+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6901056e0 con 0x7fa67807b270 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.869+0000 7fa68cff9640 1 -- 172.21.15.60:0/1902761739 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa6901056e0 con 0x7fa67807b270 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 starting - - - - 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (69s) 15s ago 18m 8346k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 971a0f60ed38 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (65s) 41s ago 17m 8002k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f0303f9e56f2 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (6m) 15s ago 18m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (6m) 41s ago 17m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:49:59.871 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (15m) 15s ago 17m 89.1M - 9.4.7 954c08fa6188 8dfb7a785e54 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (2m) 15s ago 11m 13.8M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 db77ea321515 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (2m) 15s ago 11m 82.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (81s) 41s ago 11m 15.4M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 9b0567217371 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (103s) 41s ago 11m 16.5M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 75c0d10e7ca7 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (8m) 15s ago 19m 526M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (7m) 41s ago 16m 456M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (7m) 15s ago 19m 57.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (6m) 41s ago 16m 44.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (50s) 15s ago 17m 8116k - 1.7.0 72c9c2088986 fc626a3cd8af 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (44s) 41s ago 16m 3431k - 1.7.0 72c9c2088986 e51afe36f4cf 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (5m) 15s ago 15m 112M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 15s ago 14m 119M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (4m) 15s ago 14m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:49:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (3m) 41s ago 14m 123M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:49:59.873 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (3m) 41s ago 13m 116M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:49:59.873 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (2m) 41s ago 13m 99.5M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:49:59.873 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (20s) 15s ago 17m 39.5M - 2.51.0 1d3b7f56885b d84bf501c6c0 2024-09-21T10:49:59.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.871+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa67807b270 msgr2=0x7fa67807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.871+0000 7fa695b76640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa67807b270 0x7fa67807d730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa680009230 tx=0x7fa6800314e0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.871+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 msgr2=0x7fa6900728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.871+0000 7fa695b76640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 0x7fa6900728a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa68400d8d0 tx=0x7fa68400dd90 comp rx=0 tx=0).stop 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 shutdown_connections 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa67807b270 0x7fa67807d730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa690100d90 0x7fa6900728a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 --2- 172.21.15.60:0/1902761739 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6900ffb90 0x7fa690074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 >> 172.21.15.60:0/1902761739 conn(0x7fa6900fb360 msgr2=0x7fa690103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 shutdown_connections 2024-09-21T10:49:59.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.872+0000 7fa695b76640 1 -- 172.21.15.60:0/1902761739 wait complete. 2024-09-21T10:49:59.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 -- 172.21.15.60:0/662938746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 msgr2=0x7fb4e01053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 --2- 172.21.15.60:0/662938746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e01053a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00098b0 tx=0x7fb4d002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 -- 172.21.15.60:0/662938746 shutdown_connections 2024-09-21T10:49:59.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 --2- 172.21.15.60:0/662938746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e01053a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 --2- 172.21.15.60:0/662938746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0100680 0x7fb4e0102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 -- 172.21.15.60:0/662938746 >> 172.21.15.60:0/662938746 conn(0x7fb4e00fa280 msgr2=0x7fb4e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:49:59.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 -- 172.21.15.60:0/662938746 shutdown_connections 2024-09-21T10:49:59.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.955+0000 7fb4e843c640 1 -- 172.21.15.60:0/662938746 wait complete. 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e843c640 1 Processor -- start 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e843c640 1 -- start start 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e843c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0100680 0x7fb4e00fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e843c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e00fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e843c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e00feb70 con 0x7fb4e0102fb0 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e843c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e00fece0 con 0x7fb4e0100680 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e59d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e00fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e59d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e00fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58084/0 (socket says 172.21.15.60:58084) 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e59d7640 1 -- 172.21.15.60:0/2123592224 learned_addr learned my addr 172.21.15.60:0/2123592224 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e61d8640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0100680 0x7fb4e00fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e59d7640 1 -- 172.21.15.60:0/2123592224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0100680 msgr2=0x7fb4e00fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e59d7640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0100680 0x7fb4e00fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.956+0000 7fb4e59d7640 1 -- 172.21.15.60:0/2123592224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d0009560 con 0x7fb4e0102fb0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.957+0000 7fb4e59d7640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e00fe630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002a9f0 tx=0x7fb4d00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.957+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4d0004aa0 con 0x7fb4e0102fb0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.957+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e00fef60 con 0x7fb4e0102fb0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.957+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4d0005d50 con 0x7fb4e0102fb0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.957+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4d00039b0 con 0x7fb4e0102fb0 2024-09-21T10:49:59.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.957+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e00ff450 con 0x7fb4e0102fb0 2024-09-21T10:49:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.958+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e0108800 con 0x7fb4e0102fb0 2024-09-21T10:49:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.959+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fb4d0031c00 con 0x7fb4e0102fb0 2024-09-21T10:49:59.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.959+0000 7fb4d77fe640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb4cc07b270 0x7fb4cc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:49:59.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.960+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb4d00bf500 con 0x7fb4e0102fb0 2024-09-21T10:49:59.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.960+0000 7fb4e61d8640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb4cc07b270 0x7fb4cc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:49:59.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.961+0000 7fb4e61d8640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb4cc07b270 0x7fb4cc07d730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009bd0 tx=0x7fb4dc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:49:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:49:59.965+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fb4d00824c0 con 0x7fb4e0102fb0 2024-09-21T10:50:00.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.241+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4e0108990 con 0x7fb4e0102fb0 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.242+0000 7fb4d77fe640 1 -- 172.21.15.60:0/2123592224 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fb4d00855e0 con 0x7fb4e0102fb0 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:50:00.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:50:00.245 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb4cc07b270 msgr2=0x7fb4cc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb4cc07b270 0x7fb4cc07d730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009bd0 tx=0x7fb4dc005f90 comp rx=0 tx=0).stop 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 msgr2=0x7fb4e00fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e00fe630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002a9f0 tx=0x7fb4d00055a0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 shutdown_connections 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb4cc07b270 0x7fb4cc07d730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4e0102fb0 0x7fb4e00fe630 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 --2- 172.21.15.60:0/2123592224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4e0100680 0x7fb4e00fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 >> 172.21.15.60:0/2123592224 conn(0x7fb4e00fa280 msgr2=0x7fb4e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:00.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 shutdown_connections 2024-09-21T10:50:00.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.244+0000 7fb4e843c640 1 -- 172.21.15.60:0/2123592224 wait complete. 2024-09-21T10:50:00.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 -- 172.21.15.60:0/3681224855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e581011b0 msgr2=0x7f8e581015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/3681224855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e581011b0 0x7f8e581015b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009880 tx=0x7f8e5402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 -- 172.21.15.60:0/3681224855 shutdown_connections 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/3681224855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e58101b80 0x7f8e580fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/3681224855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e581011b0 0x7f8e581015b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 -- 172.21.15.60:0/3681224855 >> 172.21.15.60:0/3681224855 conn(0x7f8e580f99c0 msgr2=0x7f8e580fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.328+0000 7f8e5fe05640 1 -- 172.21.15.60:0/3681224855 shutdown_connections 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 -- 172.21.15.60:0/3681224855 wait complete. 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 Processor -- start 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 -- start start 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e581011b0 0x7f8e581956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 0x7f8e58195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e581961b0 con 0x7f8e58101b80 2024-09-21T10:50:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5fe05640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58196320 con 0x7f8e581011b0 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5d3a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 0x7f8e58195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5d3a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 0x7f8e58195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58108/0 (socket says 172.21.15.60:58108) 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5d3a0640 1 -- 172.21.15.60:0/2412545045 learned_addr learned my addr 172.21.15.60:0/2412545045 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.329+0000 7f8e5dba1640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e581011b0 0x7f8e581956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e5d3a0640 1 -- 172.21.15.60:0/2412545045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e581011b0 msgr2=0x7f8e581956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e5d3a0640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e581011b0 0x7f8e581956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e5d3a0640 1 -- 172.21.15.60:0/2412545045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54009560 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e5d3a0640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 0x7f8e58195be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e970 tx=0x7f8e4800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e480096e0 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e480044f0 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e48010430 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5819ad70 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.330+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5819b340 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.331+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5818f730 con 0x7f8e58101b80 2024-09-21T10:50:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.332+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8e4800cc90 con 0x7f8e58101b80 2024-09-21T10:50:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.332+0000 7f8e4effd640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e4407b270 0x7f8e4407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.333+0000 7f8e5dba1640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e4407b270 0x7f8e4407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.333+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8e48014070 con 0x7f8e58101b80 2024-09-21T10:50:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.333+0000 7f8e5dba1640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e4407b270 0x7f8e4407d730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009230 tx=0x7f8e540314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.337+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f8e480617d0 con 0x7f8e58101b80 2024-09-21T10:50:00.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:00 smithi060 ceph-mon[93270]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:00.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:00 smithi060 ceph-mon[93270]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:00.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:00 smithi060 ceph-mon[93270]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:00.586 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:00 smithi060 ceph-mon[93270]: overall HEALTH_OK 2024-09-21T10:50:00.587 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:00 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2123592224' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:00.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.583+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e581087a0 con 0x7f8e58101b80 2024-09-21T10:50:00.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.584+0000 7f8e4effd640 1 -- 172.21.15.60:0/2412545045 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1974 (secure 0 0 0) 0x7f8e480648f0 con 0x7f8e58101b80 2024-09-21T10:50:00.587 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-09-21T10:50:00.587 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T10:48:39:093091+0000 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 34 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:48:38.086780+0000 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:50:00.588 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 83 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34402} 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:50:00.589 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34402 members: 34402 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:50:00.590 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:50:00.591 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:44371} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/991928918,v1:172.21.15.112:6827/991928918] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:50:00.591 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-09-21T10:50:00.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.586+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e4407b270 msgr2=0x7f8e4407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.586+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e4407b270 0x7f8e4407d730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009230 tx=0x7f8e540314e0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.586+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 msgr2=0x7f8e58195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.586+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 0x7f8e58195be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e970 tx=0x7f8e4800ee30 comp rx=0 tx=0).stop 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 shutdown_connections 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8e4407b270 0x7f8e4407d730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e58101b80 0x7f8e58195be0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 --2- 172.21.15.60:0/2412545045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e581011b0 0x7f8e581956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 >> 172.21.15.60:0/2412545045 conn(0x7f8e580f99c0 msgr2=0x7f8e58104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 shutdown_connections 2024-09-21T10:50:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.587+0000 7f8e5fe05640 1 -- 172.21.15.60:0/2412545045 wait complete. 2024-09-21T10:50:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/3744481671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b40ffb90 msgr2=0x7fe8b40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/3744481671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b40ffb90 0x7fe8b40fff90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009880 tx=0x7fe8b002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/3744481671 shutdown_connections 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/3744481671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b4100d90 0x7fe8b4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/3744481671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b40ffb90 0x7fe8b40fff90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/3744481671 >> 172.21.15.60:0/3744481671 conn(0x7fe8b40fb320 msgr2=0x7fe8b40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/3744481671 shutdown_connections 2024-09-21T10:50:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.671+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/3744481671 wait complete. 2024-09-21T10:50:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8bc4ee640 1 Processor -- start 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8bc4ee640 1 -- start start 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8bc4ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b40ffb90 0x7fe8b4074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8bc4ee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 0x7fe8b40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8bc4ee640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4072de0 con 0x7fe8b4100d90 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8bc4ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4072f50 con 0x7fe8b40ffb90 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8b9a89640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 0x7fe8b40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8b9a89640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 0x7fe8b40728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58122/0 (socket says 172.21.15.60:58122) 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8b9a89640 1 -- 172.21.15.60:0/290493494 learned_addr learned my addr 172.21.15.60:0/290493494 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8ba28a640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b40ffb90 0x7fe8b4074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8b9a89640 1 -- 172.21.15.60:0/290493494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b40ffb90 msgr2=0x7fe8b4074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8b9a89640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b40ffb90 0x7fe8b4074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.672+0000 7fe8b9a89640 1 -- 172.21.15.60:0/290493494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009560 con 0x7fe8b4100d90 2024-09-21T10:50:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8ba28a640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b40ffb90 0x7fe8b4074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:50:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8b9a89640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 0x7fe8b40728a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400d6f0 tx=0x7fe8a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a4009a30 con 0x7fe8b4100d90 2024-09-21T10:50:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8a40054e0 con 0x7fe8b4100d90 2024-09-21T10:50:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a4010460 con 0x7fe8b4100d90 2024-09-21T10:50:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b4073230 con 0x7fe8b4100d90 2024-09-21T10:50:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.673+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b419d6f0 con 0x7fe8b4100d90 2024-09-21T10:50:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.674+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b418f730 con 0x7fe8b4100d90 2024-09-21T10:50:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.675+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fe8a4009b90 con 0x7fe8b4100d90 2024-09-21T10:50:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.675+0000 7fe8ab7fe640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe8a007b270 0x7fe8a007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.676+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe8a409dfb0 con 0x7fe8b4100d90 2024-09-21T10:50:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.676+0000 7fe8ba28a640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe8a007b270 0x7fe8a007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.676+0000 7fe8ba28a640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe8a007b270 0x7fe8a007d730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0031540 tx=0x7fe8b0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:00.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.680+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fe8a4060ec0 con 0x7fe8b4100d90 2024-09-21T10:50:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:00 smithi112 ceph-mon[78695]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:00 smithi112 ceph-mon[78695]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:00 smithi112 ceph-mon[78695]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:00.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:00 smithi112 ceph-mon[78695]: overall HEALTH_OK 2024-09-21T10:50:00.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:00 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2123592224' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.893+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8b40608f0 con 0x7fe8a007b270 2024-09-21T10:50:00.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.894+0000 7fe8ab7fe640 1 -- 172.21.15.60:0/290493494 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fe8b40608f0 con 0x7fe8a007b270 2024-09-21T10:50:00.896 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:50:00.896 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": true, 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [ 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "osd", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "mon", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph-exporter", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "mds" 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": "18/23 daemons upgraded", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-21T10:50:00.897 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:50:00.898 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe8a007b270 msgr2=0x7fe8a007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe8a007b270 0x7fe8a007d730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0031540 tx=0x7fe8b0000bc0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 msgr2=0x7fe8b40728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 0x7fe8b40728a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400d6f0 tx=0x7fe8a400dbb0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 shutdown_connections 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fe8a007b270 0x7fe8a007d730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b4100d90 0x7fe8b40728a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 --2- 172.21.15.60:0/290493494 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8b40ffb90 0x7fe8b4074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 >> 172.21.15.60:0/290493494 conn(0x7fe8b40fb320 msgr2=0x7fe8b41044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:00.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 shutdown_connections 2024-09-21T10:50:00.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.897+0000 7fe8bc4ee640 1 -- 172.21.15.60:0/290493494 wait complete. 2024-09-21T10:50:00.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 -- 172.21.15.60:0/1331799918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac4100d90 msgr2=0x7f0ac4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1331799918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac4100d90 0x7f0ac4101210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009880 tx=0x7f0aac02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 -- 172.21.15.60:0/1331799918 shutdown_connections 2024-09-21T10:50:00.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1331799918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac4100d90 0x7f0ac4101210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1331799918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ac40ffb90 0x7f0ac40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 -- 172.21.15.60:0/1331799918 >> 172.21.15.60:0/1331799918 conn(0x7f0ac40fb320 msgr2=0x7f0ac40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:00.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 -- 172.21.15.60:0/1331799918 shutdown_connections 2024-09-21T10:50:00.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 -- 172.21.15.60:0/1331799918 wait complete. 2024-09-21T10:50:00.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.981+0000 7f0ac9898640 1 Processor -- start 2024-09-21T10:50:00.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac9898640 1 -- start start 2024-09-21T10:50:00.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac9898640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 0x7f0ac4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac9898640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ac4100d90 0x7f0ac40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac9898640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4072de0 con 0x7f0ac40ffb90 2024-09-21T10:50:00.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac9898640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4072f50 con 0x7f0ac4100d90 2024-09-21T10:50:00.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 0x7f0ac4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 0x7f0ac4074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58128/0 (socket says 172.21.15.60:58128) 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 -- 172.21.15.60:0/1349689587 learned_addr learned my addr 172.21.15.60:0/1349689587 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac27fc640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ac4100d90 0x7f0ac40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 -- 172.21.15.60:0/1349689587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ac4100d90 msgr2=0x7f0ac40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ac4100d90 0x7f0ac40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 -- 172.21.15.60:0/1349689587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac009560 con 0x7f0ac40ffb90 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.982+0000 7f0ac2ffd640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 0x7f0ac4074250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400d6f0 tx=0x7f0ab400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.983+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab4009a30 con 0x7f0ac40ffb90 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.983+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ab4009b90 con 0x7f0ac40ffb90 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.983+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac4073230 con 0x7f0ac40ffb90 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.983+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab4003e70 con 0x7f0ac40ffb90 2024-09-21T10:50:00.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.983+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac419d640 con 0x7f0ac40ffb90 2024-09-21T10:50:00.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.984+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4109150 con 0x7f0ac40ffb90 2024-09-21T10:50:00.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.984+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f0ab4009d00 con 0x7f0ac40ffb90 2024-09-21T10:50:00.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.985+0000 7f0ac8896640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ab007b220 0x7f0ab007d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:00.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.985+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f0ab409de20 con 0x7f0ac40ffb90 2024-09-21T10:50:00.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.985+0000 7f0ac27fc640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ab007b220 0x7f0ab007d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:00.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.985+0000 7f0ac27fc640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ab007b220 0x7f0ab007d6e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:00.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:00.990+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f0ac4109150 con 0x7f0ac40ffb90 2024-09-21T10:50:01.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.263+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0ac4100000 con 0x7f0ac40ffb90 2024-09-21T10:50:01.266 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:50:01.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.263+0000 7f0ac8896640 1 -- 172.21.15.60:0/1349689587 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0ac4100000 con 0x7f0ac40ffb90 2024-09-21T10:50:01.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ab007b220 msgr2=0x7f0ab007d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:01.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ab007b220 0x7f0ab007d6e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac0314e0 comp rx=0 tx=0).stop 2024-09-21T10:50:01.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 msgr2=0x7f0ac4074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:01.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 0x7f0ac4074250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400d6f0 tx=0x7f0ab400dbb0 comp rx=0 tx=0).stop 2024-09-21T10:50:01.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 shutdown_connections 2024-09-21T10:50:01.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f0ab007b220 0x7f0ab007d6e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:01.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ac4100d90 0x7f0ac40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:01.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 --2- 172.21.15.60:0/1349689587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ac40ffb90 0x7f0ac4074250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:01.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 >> 172.21.15.60:0/1349689587 conn(0x7f0ac40fb320 msgr2=0x7f0ac40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:01.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 shutdown_connections 2024-09-21T10:50:01.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:01.266+0000 7f0ac9898640 1 -- 172.21.15.60:0/1349689587 wait complete. 2024-09-21T10:50:01.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:01 smithi060 ceph-mon[93270]: pgmap v249: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:01.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:01 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2412545045' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:50:01.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:01 smithi060 ceph-mon[93270]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:01.673 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:01 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1349689587' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:50:01.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:01 smithi112 ceph-mon[78695]: pgmap v249: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:01.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:01 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2412545045' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:50:01.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:01 smithi112 ceph-mon[78695]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:01.701 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:01 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1349689587' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:50:04.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:03 smithi060 ceph-mon[93270]: pgmap v250: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:04.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.174 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:03 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:03 smithi112 ceph-mon[78695]: pgmap v250: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:04.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:04.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:03 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:06.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:05 smithi060 ceph-mon[93270]: pgmap v251: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:06.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:05 smithi112 ceph-mon[78695]: pgmap v251: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: pgmap v252: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T10:50:08.043 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.044 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.045 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:07 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: pgmap v252: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:08.201 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.202 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:08.203 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:07 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:08 smithi060 ceph-mon[93270]: Upgrade: Updating grafana.smithi060 2024-09-21T10:50:09.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:08 smithi060 ceph-mon[93270]: Deploying daemon grafana.smithi060 on smithi060 2024-09-21T10:50:09.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:08 smithi112 ceph-mon[78695]: Upgrade: Updating grafana.smithi060 2024-09-21T10:50:09.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:08 smithi112 ceph-mon[78695]: Deploying daemon grafana.smithi060 on smithi060 2024-09-21T10:50:09.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:09 smithi060 ceph-mon[93270]: pgmap v253: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:10.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:09 smithi112 ceph-mon[78695]: pgmap v253: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:12.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:11 smithi060 ceph-mon[93270]: pgmap v254: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:12.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:11 smithi112 ceph-mon[78695]: pgmap v254: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:14.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:13 smithi060 ceph-mon[93270]: pgmap v255: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:14.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:13 smithi112 ceph-mon[78695]: pgmap v255: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:15.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:15.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:15.897 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:15 smithi060 ceph-mon[93270]: pgmap v256: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:16.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:15 smithi112 ceph-mon[78695]: pgmap v256: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:17.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:17 smithi060 ceph-mon[93270]: pgmap v257: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:18.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:17 smithi112 ceph-mon[78695]: pgmap v257: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:20.002 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:19 smithi112 ceph-mon[78695]: pgmap v258: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:20.067 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:19 smithi060 ceph-mon[93270]: pgmap v258: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:21.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:21.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:21.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:21 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:21.386 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:21.386 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:21.386 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:21 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:22.250 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:22 smithi060 ceph-mon[93270]: pgmap v259: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:22.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:22 smithi112 ceph-mon[78695]: pgmap v259: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:24.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:24 smithi060 ceph-mon[93270]: pgmap v260: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:24.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:24 smithi112 ceph-mon[78695]: pgmap v260: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:26.416 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:26 smithi060 ceph-mon[93270]: pgmap v261: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:26.416 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.416 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.416 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.416 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:26 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:26 smithi112 ceph-mon[78695]: pgmap v261: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:26 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:28.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:28 smithi060 ceph-mon[93270]: pgmap v262: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:28.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:28 smithi112 ceph-mon[78695]: pgmap v262: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:29.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T10:50:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:29.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-21T10:50:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: pgmap v263: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.451 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T10:50:30.452 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.453 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:30.454 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: pgmap v263: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.455 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.456 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T10:50:30.457 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.458 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:50:30.459 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:50:30.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:50:30.460 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:31.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 -- 172.21.15.60:0/2223209405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 msgr2=0x7fc6200feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:31.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 --2- 172.21.15.60:0/2223209405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc6200feea0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc610009880 tx=0x7fc61002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 -- 172.21.15.60:0/2223209405 shutdown_connections 2024-09-21T10:50:31.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 --2- 172.21.15.60:0/2223209405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6200ffca0 0x7fc620100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 --2- 172.21.15.60:0/2223209405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc6200feea0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 -- 172.21.15.60:0/2223209405 >> 172.21.15.60:0/2223209405 conn(0x7fc6200fa250 msgr2=0x7fc6200fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:31.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 -- 172.21.15.60:0/2223209405 shutdown_connections 2024-09-21T10:50:31.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.367+0000 7fc624d81640 1 -- 172.21.15.60:0/2223209405 wait complete. 2024-09-21T10:50:31.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc624d81640 1 Processor -- start 2024-09-21T10:50:31.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc624d81640 1 -- start start 2024-09-21T10:50:31.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc624d81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc620068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc624d81640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6200ffca0 0x7fc62019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc624d81640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62019a950 con 0x7fc6200feaa0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc624d81640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62019aa90 con 0x7fc6200ffca0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc61e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc620068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc61e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc620068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45744/0 (socket says 172.21.15.60:45744) 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc61e59c640 1 -- 172.21.15.60:0/988689814 learned_addr learned my addr 172.21.15.60:0/988689814 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.368+0000 7fc61dd9b640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6200ffca0 0x7fc62019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc61e59c640 1 -- 172.21.15.60:0/988689814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6200ffca0 msgr2=0x7fc62019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc61e59c640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6200ffca0 0x7fc62019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc61e59c640 1 -- 172.21.15.60:0/988689814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610009560 con 0x7fc6200feaa0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc61e59c640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc620068fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc61002a9c0 tx=0x7fc6100054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc610004aa0 con 0x7fc6200feaa0 2024-09-21T10:50:31.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc610004c00 con 0x7fc6200feaa0 2024-09-21T10:50:31.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62019ace0 con 0x7fc6200feaa0 2024-09-21T10:50:31.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc610003a80 con 0x7fc6200feaa0 2024-09-21T10:50:31.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.369+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62019b250 con 0x7fc6200feaa0 2024-09-21T10:50:31.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.370+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62018e620 con 0x7fc6200feaa0 2024-09-21T10:50:31.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.371+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc610003d40 con 0x7fc6200feaa0 2024-09-21T10:50:31.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.371+0000 7fc6177fe640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc60c07b270 0x7fc60c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:31.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.372+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc6100bf5c0 con 0x7fc6200feaa0 2024-09-21T10:50:31.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.372+0000 7fc61dd9b640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc60c07b270 0x7fc60c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:31.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.372+0000 7fc61dd9b640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc60c07b270 0x7fc60c07d730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc620069530 tx=0x7fc60800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:31.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.376+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fc610082580 con 0x7fc6200feaa0 2024-09-21T10:50:31.447 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:31 smithi112 ceph-mon[78695]: Upgrade: Finalizing container_image settings 2024-09-21T10:50:31.448 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:31 smithi112 ceph-mon[78695]: Upgrade: Complete! 2024-09-21T10:50:31.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:31 smithi060 ceph-mon[93270]: Upgrade: Finalizing container_image settings 2024-09-21T10:50:31.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:31 smithi060 ceph-mon[93270]: Upgrade: Complete! 2024-09-21T10:50:31.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.583+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc62002c550 con 0x7fc60c07b270 2024-09-21T10:50:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.584+0000 7fc6177fe640 1 -- 172.21.15.60:0/988689814 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc62002c550 con 0x7fc60c07b270 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc60c07b270 msgr2=0x7fc60c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc60c07b270 0x7fc60c07d730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc620069530 tx=0x7fc60800b390 comp rx=0 tx=0).stop 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 msgr2=0x7fc620068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc620068fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc61002a9c0 tx=0x7fc6100054f0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 shutdown_connections 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc60c07b270 0x7fc60c07d730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6200ffca0 0x7fc62019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 --2- 172.21.15.60:0/988689814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6200feaa0 0x7fc620068fb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 >> 172.21.15.60:0/988689814 conn(0x7fc6200fa250 msgr2=0x7fc620103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 shutdown_connections 2024-09-21T10:50:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:31.586+0000 7fc624d81640 1 -- 172.21.15.60:0/988689814 wait complete. 2024-09-21T10:50:32.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:32 smithi060 ceph-mon[93270]: pgmap v264: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:32.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T10:50:32.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:32 smithi112 ceph-mon[78695]: pgmap v264: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:50:33.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:33 smithi060 ceph-mon[93270]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:33.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:33 smithi112 ceph-mon[78695]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:34.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 -- 172.21.15.60:0/2545312086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488101610 msgr2=0x7fa488109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:34.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2545312086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488101610 0x7fa488109b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa4700098b0 tx=0x7fa47002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 -- 172.21.15.60:0/2545312086 shutdown_connections 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2545312086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488101610 0x7fa488109b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2545312086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa488100c60 0x7fa488101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 -- 172.21.15.60:0/2545312086 >> 172.21.15.60:0/2545312086 conn(0x7fa4880fa730 msgr2=0x7fa4880fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 -- 172.21.15.60:0/2545312086 shutdown_connections 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.133+0000 7fa48cb33640 1 -- 172.21.15.60:0/2545312086 wait complete. 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48cb33640 1 Processor -- start 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48cb33640 1 -- start start 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48cb33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 0x7fa48819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48cb33640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa488101610 0x7fa48819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48cb33640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48819c4c0 con 0x7fa488100c60 2024-09-21T10:50:34.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48cb33640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488195a50 con 0x7fa488101610 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 0x7fa48819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 0x7fa48819b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39886/0 (socket says 172.21.15.60:39886) 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa48659c640 1 -- 172.21.15.60:0/2733508109 learned_addr learned my addr 172.21.15.60:0/2733508109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.134+0000 7fa47ffff640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa488101610 0x7fa48819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa48659c640 1 -- 172.21.15.60:0/2733508109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa488101610 msgr2=0x7fa48819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa48659c640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa488101610 0x7fa48819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa48659c640 1 -- 172.21.15.60:0/2733508109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470009560 con 0x7fa488100c60 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa48659c640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 0x7fa48819b960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b420 tx=0x7fa47800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa478011800 con 0x7fa488100c60 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa488195d30 con 0x7fa488100c60 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa478011e20 con 0x7fa488100c60 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47800f2e0 con 0x7fa488100c60 2024-09-21T10:50:34.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.135+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa488196250 con 0x7fa488100c60 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.136+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa488068d30 con 0x7fa488100c60 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.137+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa478010380 con 0x7fa488100c60 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.137+0000 7fa47f7fe640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa47407b270 0x7fa47407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.137+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa47809dc80 con 0x7fa488100c60 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.137+0000 7fa47ffff640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa47407b270 0x7fa47407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.138+0000 7fa47ffff640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa47407b270 0x7fa47407d730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa470009880 tx=0x7fa4700058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.142+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa478060af0 con 0x7fa488100c60 2024-09-21T10:50:34.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:34 smithi060 ceph-mon[93270]: pgmap v265: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:34.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:34 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.339+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4881044d0 con 0x7fa47407b270 2024-09-21T10:50:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.348+0000 7fa47f7fe640 1 -- 172.21.15.60:0/2733508109 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa4881044d0 con 0x7fa47407b270 2024-09-21T10:50:34.350 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (36s) 9s ago 18m 17.5M - 0.27.0 11f11916f8cd 6e8eb4bc0a4e 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (104s) 9s ago 18m 8409k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 971a0f60ed38 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (99s) 76s ago 17m 8002k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f0303f9e56f2 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (6m) 9s ago 18m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (6m) 76s ago 17m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (14s) 9s ago 18m 46.5M - 10.4.8 5aad1d7cf004 08683bdfbe09 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (2m) 9s ago 12m 14.1M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 db77ea321515 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (3m) 9s ago 12m 82.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (116s) 76s ago 12m 15.4M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 9b0567217371 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (2m) 76s ago 12m 16.5M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 75c0d10e7ca7 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (9m) 9s ago 19m 533M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:50:34.351 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (8m) 76s ago 17m 456M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (7m) 9s ago 20m 57.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (7m) 76s ago 17m 44.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (84s) 9s ago 18m 10.1M - 1.7.0 72c9c2088986 fc626a3cd8af 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (78s) 76s ago 17m 3431k - 1.7.0 72c9c2088986 e51afe36f4cf 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 9s ago 15m 113M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (5m) 9s ago 15m 119M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (5m) 9s ago 15m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (4m) 76s ago 14m 123M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (3m) 76s ago 14m 116M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (3m) 76s ago 13m 99.5M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:50:34.352 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (54s) 9s ago 18m 44.1M - 2.51.0 1d3b7f56885b d84bf501c6c0 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.350+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa47407b270 msgr2=0x7fa47407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.350+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa47407b270 0x7fa47407d730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa470009880 tx=0x7fa4700058d0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.350+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 msgr2=0x7fa48819b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.350+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 0x7fa48819b960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b420 tx=0x7fa47800b8e0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 shutdown_connections 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa47407b270 0x7fa47407d730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa488101610 0x7fa48819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 --2- 172.21.15.60:0/2733508109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa488100c60 0x7fa48819b960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 >> 172.21.15.60:0/2733508109 conn(0x7fa4880fa730 msgr2=0x7fa488101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 shutdown_connections 2024-09-21T10:50:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:34.351+0000 7fa48cb33640 1 -- 172.21.15.60:0/2733508109 wait complete. 2024-09-21T10:50:34.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:34 smithi112 ceph-mon[78695]: pgmap v265: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:34.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:34 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:50:35.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade status' 2024-09-21T10:50:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:50:35.356 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:35 smithi060 ceph-mon[93270]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:35.357 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:35 smithi060 ceph-mon[93270]: pgmap v266: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:35 smithi112 ceph-mon[78695]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:35.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:35 smithi112 ceph-mon[78695]: pgmap v266: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 -- 172.21.15.60:0/2717531220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894072850 msgr2=0x7fc894072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 --2- 172.21.15.60:0/2717531220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894072850 0x7fc894072c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc890009880 tx=0x7fc89002a530 comp rx=0 tx=0).stop 2024-09-21T10:50:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 -- 172.21.15.60:0/2717531220 shutdown_connections 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 --2- 172.21.15.60:0/2717531220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894073170 0x7fc8941105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 --2- 172.21.15.60:0/2717531220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894072850 0x7fc894072c30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 -- 172.21.15.60:0/2717531220 >> 172.21.15.60:0/2717531220 conn(0x7fc8940fb810 msgr2=0x7fc8940fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 -- 172.21.15.60:0/2717531220 shutdown_connections 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 -- 172.21.15.60:0/2717531220 wait complete. 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 Processor -- start 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.911+0000 7fc89bc17640 1 -- start start 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc89bc17640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894072850 0x7fc89419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc89bc17640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 0x7fc89419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc89bc17640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89419ccb0 con 0x7fc894073170 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc89bc17640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941a0a20 con 0x7fc894072850 2024-09-21T10:50:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 0x7fc89419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 0x7fc89419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39902/0 (socket says 172.21.15.60:39902) 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 -- 172.21.15.60:0/3188341526 learned_addr learned my addr 172.21.15.60:0/3188341526 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8999b3640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894072850 0x7fc89419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 -- 172.21.15.60:0/3188341526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894072850 msgr2=0x7fc89419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894072850 0x7fc89419c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 -- 172.21.15.60:0/3188341526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc890009560 con 0x7fc894073170 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8999b3640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894072850 0x7fc89419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc8991b2640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 0x7fc89419c620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc88400d6f0 tx=0x7fc88400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc884009a30 con 0x7fc894073170 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8941a0d00 con 0x7fc894073170 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8840054e0 con 0x7fc894073170 2024-09-21T10:50:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.912+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc884010460 con 0x7fc894073170 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.913+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8941a1250 con 0x7fc894073170 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.913+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc894073f90 con 0x7fc894073170 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.914+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc884009b90 con 0x7fc894073170 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.915+0000 7fc88affd640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc88007b270 0x7fc88007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.915+0000 7fc8999b3640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc88007b270 0x7fc88007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.915+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc88409dfb0 con 0x7fc894073170 2024-09-21T10:50:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.915+0000 7fc8999b3640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc88007b270 0x7fc88007d730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc890031440 tx=0x7fc890005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:36.919+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fc884060ec0 con 0x7fc894073170 2024-09-21T10:50:37.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.128+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc894113370 con 0x7fc88007b270 2024-09-21T10:50:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.129+0000 7fc88affd640 1 -- 172.21.15.60:0/3188341526 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc894113370 con 0x7fc88007b270 2024-09-21T10:50:37.131 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:50:37.131 INFO:teuthology.orchestra.run.smithi060.stdout: "target_image": null, 2024-09-21T10:50:37.131 INFO:teuthology.orchestra.run.smithi060.stdout: "in_progress": false, 2024-09-21T10:50:37.131 INFO:teuthology.orchestra.run.smithi060.stdout: "which": "", 2024-09-21T10:50:37.132 INFO:teuthology.orchestra.run.smithi060.stdout: "services_complete": [], 2024-09-21T10:50:37.132 INFO:teuthology.orchestra.run.smithi060.stdout: "progress": null, 2024-09-21T10:50:37.132 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "", 2024-09-21T10:50:37.132 INFO:teuthology.orchestra.run.smithi060.stdout: "is_paused": false 2024-09-21T10:50:37.132 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc88007b270 msgr2=0x7fc88007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc88007b270 0x7fc88007d730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc890031440 tx=0x7fc890005a20 comp rx=0 tx=0).stop 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 msgr2=0x7fc89419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 0x7fc89419c620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc88400d6f0 tx=0x7fc88400dbb0 comp rx=0 tx=0).stop 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 shutdown_connections 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc88007b270 0x7fc88007d730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc894073170 0x7fc89419c620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 --2- 172.21.15.60:0/3188341526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc894072850 0x7fc89419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 >> 172.21.15.60:0/3188341526 conn(0x7fc8940fb810 msgr2=0x7fc894103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 shutdown_connections 2024-09-21T10:50:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:37.133+0000 7fc89bc17640 1 -- 172.21.15.60:0/3188341526 wait complete. 2024-09-21T10:50:37.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:37 smithi060 ceph-mon[93270]: pgmap v267: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:37.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:37 smithi060 ceph-mon[93270]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:37 smithi112 ceph-mon[78695]: pgmap v267: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:37.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:37 smithi112 ceph-mon[78695]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:50:37.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph health detail' 2024-09-21T10:50:38.088 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:50:39.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 -- 172.21.15.60:0/3197064574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 msgr2=0x7fefb0101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 --2- 172.21.15.60:0/3197064574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb0101090 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fefac009880 tx=0x7fefac02a530 comp rx=0 tx=0).stop 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 -- 172.21.15.60:0/3197064574 shutdown_connections 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 --2- 172.21.15.60:0/3197064574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01015d0 0x7fefb0109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 --2- 172.21.15.60:0/3197064574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb0101090 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 -- 172.21.15.60:0/3197064574 >> 172.21.15.60:0/3197064574 conn(0x7fefb00758a0 msgr2=0x7fefb00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 -- 172.21.15.60:0/3197064574 shutdown_connections 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.622+0000 7fefb7e35640 1 -- 172.21.15.60:0/3197064574 wait complete. 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb7e35640 1 Processor -- start 2024-09-21T10:50:39.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb7e35640 1 -- start start 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb7e35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb7e35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01015d0 0x7fefb019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb7e35640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb019c410 con 0x7fefb0100cb0 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb7e35640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb01959a0 con 0x7fefb01015d0 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb5bd1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb5bd1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb019b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39916/0 (socket says 172.21.15.60:39916) 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb5bd1640 1 -- 172.21.15.60:0/2537288048 learned_addr learned my addr 172.21.15.60:0/2537288048 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:39.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb53d0640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01015d0 0x7fefb019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb5bd1640 1 -- 172.21.15.60:0/2537288048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01015d0 msgr2=0x7fefb019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.623+0000 7fefb5bd1640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01015d0 0x7fefb019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefb5bd1640 1 -- 172.21.15.60:0/2537288048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac009560 con 0x7fefb0100cb0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefb5bd1640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb019b8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefac006010 tx=0x7fefac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefac004aa0 con 0x7fefb0100cb0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefac031470 con 0x7fefb0100cb0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb0195c20 con 0x7fefb0100cb0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb0196110 con 0x7fefb0100cb0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.624+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefac003940 con 0x7fefb0100cb0 2024-09-21T10:50:39.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.625+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb0068510 con 0x7fefb0100cb0 2024-09-21T10:50:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.626+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fefac02ad50 con 0x7fefb0100cb0 2024-09-21T10:50:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.626+0000 7fefa6ffd640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef9c07b270 0x7fef9c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.626+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fefac0bf110 con 0x7fefb0100cb0 2024-09-21T10:50:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.627+0000 7fefb53d0640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef9c07b270 0x7fef9c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:39.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.627+0000 7fefb53d0640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef9c07b270 0x7fef9c07d730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fefb0196e10 tx=0x7fefa000b2e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.631+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fefac082150 con 0x7fefb0100cb0 2024-09-21T10:50:39.685 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:39 smithi060 ceph-mon[93270]: pgmap v268: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:39.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:39 smithi112 ceph-mon[78695]: pgmap v268: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.897+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fefb0104340 con 0x7fefb0100cb0 2024-09-21T10:50:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.897+0000 7fefa6ffd640 1 -- 172.21.15.60:0/2537288048 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fefac085270 con 0x7fefb0100cb0 2024-09-21T10:50:39.900 INFO:teuthology.orchestra.run.smithi060.stdout:HEALTH_OK 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef9c07b270 msgr2=0x7fef9c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef9c07b270 0x7fef9c07d730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fefb0196e10 tx=0x7fefa000b2e0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 msgr2=0x7fefb019b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb019b8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fefac006010 tx=0x7fefac0055a0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 shutdown_connections 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fef9c07b270 0x7fef9c07d730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fefb01015d0 0x7fefb019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 --2- 172.21.15.60:0/2537288048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0100cb0 0x7fefb019b8b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.899+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 >> 172.21.15.60:0/2537288048 conn(0x7fefb00758a0 msgr2=0x7fefb0101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.900+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 shutdown_connections 2024-09-21T10:50:39.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:39.900+0000 7fefb7e35640 1 -- 172.21.15.60:0/2537288048 wait complete. 2024-09-21T10:50:40.594 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:40 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2537288048' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:50:40.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions' 2024-09-21T10:50:40.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:40 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2537288048' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T10:50:40.825 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:50:42.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:42 smithi112 ceph-mon[78695]: pgmap v269: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:42.307 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:42 smithi060 ceph-mon[93270]: pgmap v269: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:42.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 -- 172.21.15.60:0/2502087958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 msgr2=0x7fafa8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2502087958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8104dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009880 tx=0x7fafa402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 -- 172.21.15.60:0/2502087958 shutdown_connections 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2502087958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafa80fe9f0 0x7fafa80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2502087958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8104dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 -- 172.21.15.60:0/2502087958 >> 172.21.15.60:0/2502087958 conn(0x7fafa80758a0 msgr2=0x7fafa80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 -- 172.21.15.60:0/2502087958 shutdown_connections 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.505+0000 7fafafbe5640 1 -- 172.21.15.60:0/2502087958 wait complete. 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafafbe5640 1 Processor -- start 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafafbe5640 1 -- start start 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafafbe5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafa80fe9f0 0x7fafa8194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafafbe5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafafbe5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8195630 con 0x7fafa81049f0 2024-09-21T10:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafafbe5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8199380 con 0x7fafa80fe9f0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafad180640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.506+0000 7fafad180640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39944/0 (socket says 172.21.15.60:39944) 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafad180640 1 -- 172.21.15.60:0/2857920488 learned_addr learned my addr 172.21.15.60:0/2857920488 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafad981640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafa80fe9f0 0x7fafa8194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafad180640 1 -- 172.21.15.60:0/2857920488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafa80fe9f0 msgr2=0x7fafa8194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafad180640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafa80fe9f0 0x7fafa8194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafad180640 1 -- 172.21.15.60:0/2857920488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009560 con 0x7fafa81049f0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafad180640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8194f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf9800e970 tx=0x7faf9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf9800cc90 con 0x7fafa81049f0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf9800cdf0 con 0x7fafa81049f0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa8199660 con 0x7fafa81049f0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf98010430 con 0x7fafa81049f0 2024-09-21T10:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.507+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa8199bb0 con 0x7fafa81049f0 2024-09-21T10:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.508+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa8103fc0 con 0x7fafa81049f0 2024-09-21T10:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.509+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7faf980046c0 con 0x7fafa81049f0 2024-09-21T10:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.509+0000 7faf9effd640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7faf9407b270 0x7faf9407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.510+0000 7fafad981640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7faf9407b270 0x7faf9407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.510+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7faf98014070 con 0x7fafa81049f0 2024-09-21T10:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.510+0000 7fafad981640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7faf9407b270 0x7faf9407d730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa4005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:50:42.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.517+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7faf98061910 con 0x7fafa81049f0 2024-09-21T10:50:42.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.781+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafa8100130 con 0x7fafa81049f0 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.782+0000 7faf9effd640 1 -- 172.21.15.60:0/2857920488 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7faf98064a30 con 0x7fafa81049f0 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:50:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:50:42.785 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:50:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7faf9407b270 msgr2=0x7faf9407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7faf9407b270 0x7faf9407d730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa4005e30 comp rx=0 tx=0).stop 2024-09-21T10:50:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 msgr2=0x7fafa8194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:50:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8194f50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf9800e970 tx=0x7faf9800ed70 comp rx=0 tx=0).stop 2024-09-21T10:50:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 shutdown_connections 2024-09-21T10:50:42.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7faf9407b270 0x7faf9407d730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa81049f0 0x7fafa8194f50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 --2- 172.21.15.60:0/2857920488 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafa80fe9f0 0x7fafa8194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:50:42.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 >> 172.21.15.60:0/2857920488 conn(0x7fafa80758a0 msgr2=0x7fafa80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:50:42.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 shutdown_connections 2024-09-21T10:50:42.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:50:42.784+0000 7fafafbe5640 1 -- 172.21.15.60:0/2857920488 wait complete. 2024-09-21T10:50:43.375 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:43 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2857920488' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:43.399 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-21T10:50:43.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:43 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2857920488' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:50:43.610 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:50:44.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:44 smithi060 ceph-mon[93270]: pgmap v270: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:44.334 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:44 smithi112 ceph-mon[78695]: pgmap v270: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:45.119 INFO:teuthology.orchestra.run.smithi060.stdout:wait for servicemap items w/ changing names to refresh 2024-09-21T10:50:46.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:46 smithi060 ceph-mon[93270]: pgmap v271: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:46 smithi112 ceph-mon[78695]: pgmap v271: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:48.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:48 smithi060 ceph-mon[93270]: pgmap v272: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:48.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:48 smithi112 ceph-mon[78695]: pgmap v272: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:49.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'sleep 60' 2024-09-21T10:50:49.339 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:50:50.347 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:50 smithi060 ceph-mon[93270]: pgmap v273: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:50.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:50 smithi112 ceph-mon[78695]: pgmap v273: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:52.237 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:52 smithi060 ceph-mon[93270]: pgmap v274: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:52 smithi112 ceph-mon[78695]: pgmap v274: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:54.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:54 smithi060 ceph-mon[93270]: pgmap v275: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:54.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:54 smithi112 ceph-mon[78695]: pgmap v275: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:56.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:56 smithi060 ceph-mon[93270]: pgmap v276: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:56.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:56 smithi112 ceph-mon[78695]: pgmap v276: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:58.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:58 smithi060 ceph-mon[93270]: pgmap v277: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:58 smithi112 ceph-mon[78695]: pgmap v277: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:50:59.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:50:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:50:59.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:50:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:00.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:00 smithi060 ceph-mon[93270]: pgmap v278: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:00.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:00 smithi112 ceph-mon[78695]: pgmap v278: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:02.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:02 smithi060 ceph-mon[93270]: pgmap v279: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:02.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:02 smithi112 ceph-mon[78695]: pgmap v279: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:04.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:04 smithi060 ceph-mon[93270]: pgmap v280: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:04.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:04 smithi112 ceph-mon[78695]: pgmap v280: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:06.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:06 smithi060 ceph-mon[93270]: pgmap v281: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:06.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:06 smithi112 ceph-mon[78695]: pgmap v281: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:08.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:08 smithi060 ceph-mon[93270]: pgmap v282: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:08.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:08 smithi112 ceph-mon[78695]: pgmap v282: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:10.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:10 smithi060 ceph-mon[93270]: pgmap v283: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:10.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:10 smithi112 ceph-mon[78695]: pgmap v283: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:12.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:12 smithi060 ceph-mon[93270]: pgmap v284: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:12.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:12 smithi112 ceph-mon[78695]: pgmap v284: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:14 smithi060 ceph-mon[93270]: pgmap v285: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:14.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:14 smithi112 ceph-mon[78695]: pgmap v285: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:14.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:16.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:16 smithi060 ceph-mon[93270]: pgmap v286: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:16.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:16 smithi112 ceph-mon[78695]: pgmap v286: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:18.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:18 smithi060 ceph-mon[93270]: pgmap v287: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:18.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:18 smithi112 ceph-mon[78695]: pgmap v287: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:20.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:20 smithi060 ceph-mon[93270]: pgmap v288: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:20.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:20 smithi112 ceph-mon[78695]: pgmap v288: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:22.443 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:22 smithi112 ceph-mon[78695]: pgmap v289: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:22.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:22 smithi060 ceph-mon[93270]: pgmap v289: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:24.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:24 smithi060 ceph-mon[93270]: pgmap v290: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:24.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:24 smithi112 ceph-mon[78695]: pgmap v290: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:26.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:26 smithi060 ceph-mon[93270]: pgmap v291: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:26.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:26 smithi112 ceph-mon[78695]: pgmap v291: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:28.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:28 smithi060 ceph-mon[93270]: pgmap v292: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:28.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:28 smithi112 ceph-mon[78695]: pgmap v292: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:29.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:29 smithi060 ceph-mon[93270]: pgmap v293: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:29.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:29 smithi112 ceph-mon[78695]: pgmap v293: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:29.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:51:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:51:30.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:51:30.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:51:30.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:51:31.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:31 smithi060 ceph-mon[93270]: pgmap v294: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:31.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:31 smithi112 ceph-mon[78695]: pgmap v294: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:33.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:33 smithi060 ceph-mon[93270]: pgmap v295: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:33.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:33 smithi112 ceph-mon[78695]: pgmap v295: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:35.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:35 smithi112 ceph-mon[78695]: pgmap v296: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:35.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:35 smithi060 ceph-mon[93270]: pgmap v296: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:37.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:37 smithi060 ceph-mon[93270]: pgmap v297: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:37.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:37 smithi112 ceph-mon[78695]: pgmap v297: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:39.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:39 smithi060 ceph-mon[93270]: pgmap v298: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:39.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:39 smithi112 ceph-mon[78695]: pgmap v298: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:41.952 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:41 smithi112 ceph-mon[78695]: pgmap v299: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:41.952 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:41 smithi060 ceph-mon[93270]: pgmap v299: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:43.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:43 smithi060 ceph-mon[93270]: pgmap v300: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:43.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:43 smithi112 ceph-mon[78695]: pgmap v300: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:44.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:44.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:45.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:45 smithi060 ceph-mon[93270]: pgmap v301: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:45.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:45 smithi112 ceph-mon[78695]: pgmap v301: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:47.826 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:47 smithi112 ceph-mon[78695]: pgmap v302: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:47.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:47 smithi060 ceph-mon[93270]: pgmap v302: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:49.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:49 smithi060 ceph-mon[93270]: pgmap v303: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:49.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:49 smithi112 ceph-mon[78695]: pgmap v303: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:51.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T10:51:51.694 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:51:51.753 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:51 smithi112 ceph-mon[78695]: pgmap v304: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:51.816 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:51 smithi060 ceph-mon[93270]: pgmap v304: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.328+0000 7fead7348640 1 -- 172.21.15.60:0/1023627001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 msgr2=0x7fead0104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.328+0000 7fead7348640 1 --2- 172.21.15.60:0/1023627001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead0104dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feacc009880 tx=0x7feacc02a4b0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.328+0000 7fead7348640 1 -- 172.21.15.60:0/1023627001 shutdown_connections 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.328+0000 7fead7348640 1 --2- 172.21.15.60:0/1023627001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 0x7fead00fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.328+0000 7fead7348640 1 --2- 172.21.15.60:0/1023627001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead0104dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.328+0000 7fead7348640 1 -- 172.21.15.60:0/1023627001 >> 172.21.15.60:0/1023627001 conn(0x7fead00758a0 msgr2=0x7fead00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.329+0000 7fead7348640 1 -- 172.21.15.60:0/1023627001 shutdown_connections 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.329+0000 7fead7348640 1 -- 172.21.15.60:0/1023627001 wait complete. 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.329+0000 7fead7348640 1 Processor -- start 2024-09-21T10:51:53.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.329+0000 7fead7348640 1 -- start start 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead7348640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 0x7fead019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead7348640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead7348640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead019b350 con 0x7fead01049f0 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead7348640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead01948e0 con 0x7fead00fe9f0 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead019ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46974/0 (socket says 172.21.15.60:46974) 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 -- 172.21.15.60:0/3001622309 learned_addr learned my addr 172.21.15.60:0/3001622309 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead50e4640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 0x7fead019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 -- 172.21.15.60:0/3001622309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 msgr2=0x7fead019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 0x7fead019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 -- 172.21.15.60:0/3001622309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009560 con 0x7fead01049f0 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead50e4640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 0x7fead019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:51:53.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.330+0000 7fead48e3640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead019ad30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feac000b420 tx=0x7feac000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:51:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.331+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac0011800 con 0x7fead01049f0 2024-09-21T10:51:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.331+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feac0011e20 con 0x7fead01049f0 2024-09-21T10:51:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.331+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead0194bc0 con 0x7fead01049f0 2024-09-21T10:51:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.331+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac000f2e0 con 0x7fead01049f0 2024-09-21T10:51:53.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.331+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead0195110 con 0x7fead01049f0 2024-09-21T10:51:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.332+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0100130 con 0x7fead01049f0 2024-09-21T10:51:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.332+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7feac0010380 con 0x7fead01049f0 2024-09-21T10:51:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.333+0000 7feac67fc640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7feabc07b270 0x7feabc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.333+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7feac009dbe0 con 0x7fead01049f0 2024-09-21T10:51:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.333+0000 7fead50e4640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7feabc07b270 0x7feabc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:53.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.333+0000 7fead50e4640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7feabc07b270 0x7feabc07d730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feacc000c00 tx=0x7feacc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:51:53.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.337+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7feac0060b70 con 0x7fead01049f0 2024-09-21T10:51:53.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.534+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 --> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fead010bce0 con 0x7feabc07b270 2024-09-21T10:51:53.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.544+0000 7feac67fc640 1 -- 172.21.15.60:0/3001622309 <== mgr.34104 v2:172.21.15.60:6800/588982991 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fead010bce0 con 0x7feabc07b270 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:alertmanager.smithi060 smithi060 *:9093,9094 running (115s) 88s ago 19m 17.5M - 0.27.0 11f11916f8cd 6e8eb4bc0a4e 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi060 smithi060 running (3m) 88s ago 20m 8409k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 971a0f60ed38 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-exporter.smithi112 smithi112 running (2m) 2m ago 18m 8002k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 f0303f9e56f2 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi060 smithi060 running (8m) 88s ago 19m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 564c6d57cc16 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:crash.smithi112 smithi112 running (8m) 2m ago 18m 6903k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 d63327f34dc1 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:grafana.smithi060 smithi060 *:3000 running (93s) 88s ago 19m 46.5M - 10.4.8 5aad1d7cf004 08683bdfbe09 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.lljnqu smithi060 running (3m) 88s ago 13m 14.1M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 db77ea321515 2024-09-21T10:51:53.547 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi060.xjabvh smithi060 running (4m) 88s ago 13m 82.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 356b6f6e599a 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.urlyzu smithi112 running (3m) 2m ago 13m 15.4M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 9b0567217371 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:mds.cephfs.smithi112.worwat smithi112 running (3m) 2m ago 13m 16.5M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 75c0d10e7ca7 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi060.mulzpr smithi060 *:8443,9283,8765 running (10m) 88s ago 21m 533M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0e7eda156c95 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.smithi112.gkunly smithi112 *:8443,9283,8765 running (9m) 2m ago 18m 456M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 933ec72b1f1c 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi060 smithi060 running (9m) 88s ago 21m 57.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 94cb96b350ae 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:mon.smithi112 smithi112 running (8m) 2m ago 18m 44.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 9d9e84bb6909 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi060 smithi060 *:9100 running (2m) 88s ago 19m 10.1M - 1.7.0 72c9c2088986 fc626a3cd8af 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:node-exporter.smithi112 smithi112 *:9100 running (2m) 2m ago 18m 3431k - 1.7.0 72c9c2088986 e51afe36f4cf 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (7m) 88s ago 17m 113M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 45dffb9af19a 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi060 running (7m) 88s ago 16m 119M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 2a6c2dd790d3 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi060 running (6m) 88s ago 16m 101M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 49baa994e878 2024-09-21T10:51:53.548 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi112 running (5m) 2m ago 15m 123M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 07df4ec59ea3 2024-09-21T10:51:53.549 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi112 running (5m) 2m ago 15m 116M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 fbcf09adc156 2024-09-21T10:51:53.549 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi112 running (4m) 2m ago 15m 99.5M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 deb9d465dea3 2024-09-21T10:51:53.549 INFO:teuthology.orchestra.run.smithi060.stdout:prometheus.smithi060 smithi060 *:9095 running (2m) 88s ago 19m 44.1M - 2.51.0 1d3b7f56885b d84bf501c6c0 2024-09-21T10:51:53.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7feabc07b270 msgr2=0x7feabc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7feabc07b270 0x7feabc07d730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feacc000c00 tx=0x7feacc005a20 comp rx=0 tx=0).stop 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 msgr2=0x7fead019ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead019ad30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feac000b420 tx=0x7feac000b8e0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 shutdown_connections 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7feabc07b270 0x7feabc07d730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead01049f0 0x7fead019ad30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 --2- 172.21.15.60:0/3001622309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fead00fe9f0 0x7fead019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 >> 172.21.15.60:0/3001622309 conn(0x7fead00758a0 msgr2=0x7fead00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 shutdown_connections 2024-09-21T10:51:53.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:53.546+0000 7fead7348640 1 -- 172.21.15.60:0/3001622309 wait complete. 2024-09-21T10:51:53.875 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:53 smithi060 ceph-mon[93270]: pgmap v305: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:53.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:53 smithi112 ceph-mon[78695]: pgmap v305: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:54.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions' 2024-09-21T10:51:54.429 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:51:54.795 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:54 smithi060 ceph-mon[93270]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:51:54.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:54 smithi112 ceph-mon[78695]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T10:51:55.820 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:55 smithi060 ceph-mon[93270]: pgmap v306: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:55.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:55 smithi112 ceph-mon[78695]: pgmap v306: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:56.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 -- 172.21.15.60:0/3796220994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 msgr2=0x7f174c0fe410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:56.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 --2- 172.21.15.60:0/3796220994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fe410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f173c009880 tx=0x7f173c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 -- 172.21.15.60:0/3796220994 shutdown_connections 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 --2- 172.21.15.60:0/3796220994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 0x7f174c0fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 --2- 172.21.15.60:0/3796220994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fe410 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 -- 172.21.15.60:0/3796220994 >> 172.21.15.60:0/3796220994 conn(0x7f174c0f9e70 msgr2=0x7f174c0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 -- 172.21.15.60:0/3796220994 shutdown_connections 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.148+0000 7f1750d96640 1 -- 172.21.15.60:0/3796220994 wait complete. 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f1750d96640 1 Processor -- start 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f1750d96640 1 -- start start 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f1750d96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f1750d96640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 0x7f174c0fac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f1750d96640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0fb1c0 con 0x7f174c067bc0 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f1750d96640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0fb330 con 0x7f174c068030 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f174a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:56.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f174a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47502/0 (socket says 172.21.15.60:47502) 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.149+0000 7f174a59c640 1 -- 172.21.15.60:0/12202098 learned_addr learned my addr 172.21.15.60:0/12202098 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1741d9b640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 0x7f174c0fac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f174a59c640 1 -- 172.21.15.60:0/12202098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 msgr2=0x7f174c0fac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f174a59c640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 0x7f174c0fac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f174a59c640 1 -- 172.21.15.60:0/12202098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009560 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1741d9b640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 0x7f174c0fac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f174a59c640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fa740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f173c006010 tx=0x7f173c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173c004aa0 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f173c031470 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c0fb5b0 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173c003940 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.150+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c1a1f30 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.151+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c0ff8f0 con 0x7f174c067bc0 2024-09-21T10:51:56.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.152+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f173c031b90 con 0x7f174c067bc0 2024-09-21T10:51:56.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.152+0000 7f1743fff640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f173807b270 0x7f173807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:56.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.152+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f173c0bf3e0 con 0x7f174c067bc0 2024-09-21T10:51:56.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.152+0000 7f1741d9b640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f173807b270 0x7f173807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:56.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.153+0000 7f1741d9b640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f173807b270 0x7f173807d730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f174c0fbec0 tx=0x7f1734005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:51:56.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.157+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f173c0822f0 con 0x7f174c067bc0 2024-09-21T10:51:56.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.422+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f174c0fb580 con 0x7f174c067bc0 2024-09-21T10:51:56.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.422+0000 7f1743fff640 1 -- 172.21.15.60:0/12202098 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f173c085410 con 0x7f174c067bc0 2024-09-21T10:51:56.425 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": { 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": { 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": { 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T10:51:56.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T10:51:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T10:51:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "overall": { 2024-09-21T10:51:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T10:51:56.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T10:51:56.427 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T10:51:56.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f173807b270 msgr2=0x7f173807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:56.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f173807b270 0x7f173807d730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f174c0fbec0 tx=0x7f1734005e50 comp rx=0 tx=0).stop 2024-09-21T10:51:56.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 msgr2=0x7f174c0fa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fa740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f173c006010 tx=0x7f173c0055a0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 shutdown_connections 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f173807b270 0x7f173807d730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f174c068030 0x7f174c0fac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 --2- 172.21.15.60:0/12202098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c067bc0 0x7f174c0fa740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.424+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 >> 172.21.15.60:0/12202098 conn(0x7f174c0f9e70 msgr2=0x7f174c100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.425+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 shutdown_connections 2024-09-21T10:51:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:56.425+0000 7f1750d96640 1 -- 172.21.15.60:0/12202098 wait complete. 2024-09-21T10:51:56.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:56 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/12202098' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:51:56.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:56 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/12202098' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:51:57.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-21T10:51:57.225 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:51:57.659 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:57 smithi060 ceph-mon[93270]: pgmap v307: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:57.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:57 smithi112 ceph-mon[78695]: pgmap v307: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:58.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 -- 172.21.15.60:0/3645175505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c8105bf0 msgr2=0x7f19c8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:58.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 --2- 172.21.15.60:0/3645175505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c8105bf0 0x7f19c8105fd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009880 tx=0x7f19c402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:51:58.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 -- 172.21.15.60:0/3645175505 shutdown_connections 2024-09-21T10:51:58.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 --2- 172.21.15.60:0/3645175505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c80ffb40 0x7f19c80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:58.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 --2- 172.21.15.60:0/3645175505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c8105bf0 0x7f19c8105fd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:58.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 -- 172.21.15.60:0/3645175505 >> 172.21.15.60:0/3645175505 conn(0x7f19c80fb860 msgr2=0x7f19c80fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 -- 172.21.15.60:0/3645175505 shutdown_connections 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.808+0000 7f19cffda640 1 -- 172.21.15.60:0/3645175505 wait complete. 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cffda640 1 Processor -- start 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cffda640 1 -- start start 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cffda640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 0x7f19c819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cffda640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c8105bf0 0x7f19c819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cffda640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c819c320 con 0x7f19c80ffb40 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cffda640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c81958b0 con 0x7f19c8105bf0 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cdd76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 0x7f19c819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cdd76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 0x7f19c819b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47510/0 (socket says 172.21.15.60:47510) 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cdd76640 1 -- 172.21.15.60:0/1481442185 learned_addr learned my addr 172.21.15.60:0/1481442185 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.809+0000 7f19cd575640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c8105bf0 0x7f19c819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cdd76640 1 -- 172.21.15.60:0/1481442185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c8105bf0 msgr2=0x7f19c819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:58.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cdd76640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c8105bf0 0x7f19c819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cdd76640 1 -- 172.21.15.60:0/1481442185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4009560 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cd575640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c8105bf0 0x7f19c819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cdd76640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 0x7f19c819b7c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f19c402a9c0 tx=0x7f19c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c40048d0 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19c4031640 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c8195b30 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c40038d0 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.810+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c81960a0 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.812+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c81011f0 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.812+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f19c4003b90 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.813+0000 7f19beffd640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f19b407b270 0x7f19b407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.813+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f19c40bf530 con 0x7f19c80ffb40 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.813+0000 7f19cd575640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f19b407b270 0x7f19b407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.814+0000 7f19cd575640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f19b407b270 0x7f19b407d730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f19c8196d20 tx=0x7f19b8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:51:58.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:58.818+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f19c40823a0 con 0x7f19c80ffb40 2024-09-21T10:51:59.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.089+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19c8108010 con 0x7f19c80ffb40 2024-09-21T10:51:59.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.089+0000 7f19beffd640 1 -- 172.21.15.60:0/1481442185 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f19c40854c0 con 0x7f19c80ffb40 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f19b407b270 msgr2=0x7f19b407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f19b407b270 0x7f19b407d730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f19c8196d20 tx=0x7f19b8005f90 comp rx=0 tx=0).stop 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 msgr2=0x7f19c819b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 0x7f19c819b7c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f19c402a9c0 tx=0x7f19c40055a0 comp rx=0 tx=0).stop 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 shutdown_connections 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f19b407b270 0x7f19b407d730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19c8105bf0 0x7f19c819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 --2- 172.21.15.60:0/1481442185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19c80ffb40 0x7f19c819b7c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.091+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 >> 172.21.15.60:0/1481442185 conn(0x7f19c80fb860 msgr2=0x7f19c80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.092+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 shutdown_connections 2024-09-21T10:51:59.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:51:59.092+0000 7f19cffda640 1 -- 172.21.15.60:0/1481442185 wait complete. 2024-09-21T10:51:59.103 INFO:teuthology.orchestra.run.smithi060.stdout:true 2024-09-21T10:51:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:59 smithi060 ceph-mon[93270]: pgmap v308: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:59.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:51:59 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1481442185' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:51:59.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-21T10:51:59.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:59 smithi112 ceph-mon[78695]: pgmap v308: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:51:59.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:51:59.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:51:59 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1481442185' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:51:59.958 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:01.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.625+0000 7f6078ae3640 1 -- 172.21.15.60:0/1537811225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60740ffda0 msgr2=0x7f6074100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:01.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.625+0000 7f6078ae3640 1 --2- 172.21.15.60:0/1537811225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60740ffda0 0x7f6074100180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6064009880 tx=0x7f606402a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 -- 172.21.15.60:0/1537811225 shutdown_connections 2024-09-21T10:52:01.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 --2- 172.21.15.60:0/1537811225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6074100750 0x7f60741047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 --2- 172.21.15.60:0/1537811225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60740ffda0 0x7f6074100180 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 -- 172.21.15.60:0/1537811225 >> 172.21.15.60:0/1537811225 conn(0x7f60740fb840 msgr2=0x7f60740fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:01.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 -- 172.21.15.60:0/1537811225 shutdown_connections 2024-09-21T10:52:01.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 -- 172.21.15.60:0/1537811225 wait complete. 2024-09-21T10:52:01.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 Processor -- start 2024-09-21T10:52:01.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.626+0000 7f6078ae3640 1 -- start start 2024-09-21T10:52:01.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6078ae3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60740ffda0 0x7f60740727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:01.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6078ae3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 0x7f6074072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:01.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6078ae3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074073230 con 0x7f6074100750 2024-09-21T10:52:01.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6078ae3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740733a0 con 0x7f60740ffda0 2024-09-21T10:52:01.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 0x7f6074072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:01.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 0x7f6074072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47536/0 (socket says 172.21.15.60:47536) 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 -- 172.21.15.60:0/3404213663 learned_addr learned my addr 172.21.15.60:0/3404213663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f607259c640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60740ffda0 0x7f60740727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 -- 172.21.15.60:0/3404213663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60740ffda0 msgr2=0x7f60740727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60740ffda0 0x7f60740727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 -- 172.21.15.60:0/3404213663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6064009560 con 0x7f6074100750 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f6071d9b640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 0x7f6074072cf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f606800d8d0 tx=0x7f606800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.627+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606800bea0 con 0x7f6074100750 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.628+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60741a1c70 con 0x7f6074100750 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.628+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6068009c00 con 0x7f6074100750 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.628+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606800f710 con 0x7f6074100750 2024-09-21T10:52:01.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.628+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60741a1fd0 con 0x7f6074100750 2024-09-21T10:52:01.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.629+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6074101280 con 0x7f6074100750 2024-09-21T10:52:01.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.629+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f606800f990 con 0x7f6074100750 2024-09-21T10:52:01.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.630+0000 7f60637fe640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f605c07b270 0x7f605c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:01.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.630+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f606809e190 con 0x7f6074100750 2024-09-21T10:52:01.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.630+0000 7f607259c640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f605c07b270 0x7f605c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:01.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.630+0000 7f607259c640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f605c07b270 0x7f605c07d730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6064000c00 tx=0x7f6064005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:01.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.634+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f60680610a0 con 0x7f6074100750 2024-09-21T10:52:01.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:01 smithi060 ceph-mon[93270]: pgmap v309: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:01.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.897+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f60741080e0 con 0x7f6074100750 2024-09-21T10:52:01.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.897+0000 7f60637fe640 1 -- 172.21.15.60:0/3404213663 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f60680641c0 con 0x7f6074100750 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f605c07b270 msgr2=0x7f605c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f605c07b270 0x7f605c07d730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6064000c00 tx=0x7f6064005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 msgr2=0x7f6074072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 0x7f6074072cf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f606800d8d0 tx=0x7f606800dd90 comp rx=0 tx=0).stop 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 shutdown_connections 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f605c07b270 0x7f605c07d730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6074100750 0x7f6074072cf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 --2- 172.21.15.60:0/3404213663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60740ffda0 0x7f60740727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.899+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 >> 172.21.15.60:0/3404213663 conn(0x7f60740fb840 msgr2=0x7f60740fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.900+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 shutdown_connections 2024-09-21T10:52:01.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:01.900+0000 7f6078ae3640 1 -- 172.21.15.60:0/3404213663 wait complete. 2024-09-21T10:52:01.911 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)" 2024-09-21T10:52:01.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:01 smithi112 ceph-mon[78695]: pgmap v309: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:02.552 DEBUG:teuthology.parallel:result is None 2024-09-21T10:52:02.552 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T10:52:02.563 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:52:02.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T10:52:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:02.895 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:02 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3404213663' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:52:02.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:02 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3404213663' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T10:52:03.869 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:03 smithi060 ceph-mon[93270]: pgmap v310: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:03.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:03 smithi112 ceph-mon[78695]: pgmap v310: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 -- 172.21.15.60:0/3567127918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 msgr2=0x7fb63c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 --2- 172.21.15.60:0/3567127918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c0fff90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb630009880 tx=0x7fb63002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 -- 172.21.15.60:0/3567127918 shutdown_connections 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 --2- 172.21.15.60:0/3567127918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c0fff90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 --2- 172.21.15.60:0/3567127918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c105be0 0x7fb63c105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 -- 172.21.15.60:0/3567127918 >> 172.21.15.60:0/3567127918 conn(0x7fb63c0fb810 msgr2=0x7fb63c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 -- 172.21.15.60:0/3567127918 shutdown_connections 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.436+0000 7fb641154640 1 -- 172.21.15.60:0/3567127918 wait complete. 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.437+0000 7fb641154640 1 Processor -- start 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.437+0000 7fb641154640 1 -- start start 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.437+0000 7fb641154640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.437+0000 7fb641154640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c105be0 0x7fb63c19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.437+0000 7fb641154640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c19c450 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.437+0000 7fb641154640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1959e0 con 0x7fb63c105be0 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c19b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59958/0 (socket says 172.21.15.60:59958) 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 -- 172.21.15.60:0/2748945331 learned_addr learned my addr 172.21.15.60:0/2748945331 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63a59c640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c105be0 0x7fb63c19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 -- 172.21.15.60:0/2748945331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c105be0 msgr2=0x7fb63c19be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c105be0 0x7fb63c19be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 -- 172.21.15.60:0/2748945331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009560 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb63ad9d640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c19b8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00b420 tx=0x7fb62c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62c011800 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c195cc0 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c196260 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb62c011e20 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.438+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62c0105b0 con 0x7fb63c0ffb30 2024-09-21T10:52:04.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.439+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb628005250 con 0x7fb63c0ffb30 2024-09-21T10:52:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.441+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fb62c011960 con 0x7fb63c0ffb30 2024-09-21T10:52:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.441+0000 7fb623fff640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb62407b270 0x7fb62407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.441+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb62c09db70 con 0x7fb63c0ffb30 2024-09-21T10:52:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.441+0000 7fb63a59c640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb62407b270 0x7fb62407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.442+0000 7fb63a59c640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb62407b270 0x7fb62407d730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb630000c00 tx=0x7fb630005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.446+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fb62c064200 con 0x7fb63c0ffb30 2024-09-21T10:52:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.674+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb628005d10 con 0x7fb63c0ffb30 2024-09-21T10:52:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.674+0000 7fb623fff640 1 -- 172.21.15.60:0/2748945331 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1974 (secure 0 0 0) 0x7fb62c063ba0 con 0x7fb63c0ffb30 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:e35 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T10:48:39:093091+0000 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 34 2024-09-21T10:52:04.678 INFO:teuthology.orchestra.run.smithi060.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T10:38:10.995498+0000 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T10:48:38.086780+0000 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 60 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 83 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T10:52:04.679 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 1 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:in 0 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=34402} 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 1 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 34402 members: 34402 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.xjabvh{0:34402} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.60:6826/684433833,v1:172.21.15.60:6827/684433833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:52:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:04.681 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T10:52:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:04.681 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi060.lljnqu{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.60:6828/3518934014,v1:172.21.15.60:6829/3518934014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:52:04.681 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.worwat{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6824/1825608898,v1:172.21.15.112:6825/1825608898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:52:04.681 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.cephfs.smithi112.urlyzu{-1:44371} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.112:6826/991928918,v1:172.21.15.112:6827/991928918] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T10:52:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-09-21T10:52:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb62407b270 msgr2=0x7fb62407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb62407b270 0x7fb62407d730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb630000c00 tx=0x7fb630005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 msgr2=0x7fb63c19b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c19b8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00b420 tx=0x7fb62c00b8e0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 shutdown_connections 2024-09-21T10:52:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fb62407b270 0x7fb62407d730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb63c105be0 0x7fb63c19be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 --2- 172.21.15.60:0/2748945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb63c0ffb30 0x7fb63c19b8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.676+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 >> 172.21.15.60:0/2748945331 conn(0x7fb63c0fb810 msgr2=0x7fb63c0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.677+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 shutdown_connections 2024-09-21T10:52:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:04.677+0000 7fb641154640 1 -- 172.21.15.60:0/2748945331 wait complete. 2024-09-21T10:52:05.332 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-21T10:52:05.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T10:52:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:05.584 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:05 smithi060 ceph-mon[93270]: pgmap v311: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:05.585 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:05 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2748945331' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:52:05.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:05 smithi112 ceph-mon[78695]: pgmap v311: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:05.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:05 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2748945331' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 -- 172.21.15.60:0/327874029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 msgr2=0x7f8d60104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 --2- 172.21.15.60:0/327874029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d60104dd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009c20 tx=0x7f8d5002a970 comp rx=0 tx=0).stop 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 -- 172.21.15.60:0/327874029 shutdown_connections 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 --2- 172.21.15.60:0/327874029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d600fe9f0 0x7f8d600fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 --2- 172.21.15.60:0/327874029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d60104dd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 -- 172.21.15.60:0/327874029 >> 172.21.15.60:0/327874029 conn(0x7f8d600758a0 msgr2=0x7f8d600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 -- 172.21.15.60:0/327874029 shutdown_connections 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 -- 172.21.15.60:0/327874029 wait complete. 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.153+0000 7f8d65777640 1 Processor -- start 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d65777640 1 -- start start 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d65777640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d600fe9f0 0x7f8d6019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d65777640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d6019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d65777640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60195900 con 0x7f8d601049f0 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d65777640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60195a40 con 0x7f8d600fe9f0 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d6019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d6019bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59970/0 (socket says 172.21.15.60:59970) 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5e7fc640 1 -- 172.21.15.60:0/4268872873 learned_addr learned my addr 172.21.15.60:0/4268872873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5effd640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d600fe9f0 0x7f8d6019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5e7fc640 1 -- 172.21.15.60:0/4268872873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d600fe9f0 msgr2=0x7f8d6019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5e7fc640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d600fe9f0 0x7f8d6019b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.154+0000 7f8d5e7fc640 1 -- 172.21.15.60:0/4268872873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50009900 con 0x7f8d601049f0 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.155+0000 7f8d5e7fc640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d6019bde0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400d6f0 tx=0x7f8d5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.155+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d54009a30 con 0x7f8d601049f0 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.155+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d540054e0 con 0x7f8d601049f0 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.155+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d60195d20 con 0x7f8d601049f0 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.155+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d54010460 con 0x7f8d601049f0 2024-09-21T10:52:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.155+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d60196270 con 0x7f8d601049f0 2024-09-21T10:52:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.156+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d60100130 con 0x7f8d601049f0 2024-09-21T10:52:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.157+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8d54009b90 con 0x7f8d601049f0 2024-09-21T10:52:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.157+0000 7f8d47fff640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8d4807b270 0x7f8d4807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.157+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8d5409de50 con 0x7f8d601049f0 2024-09-21T10:52:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.157+0000 7f8d5effd640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8d4807b270 0x7f8d4807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.158+0000 7f8d5effd640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8d4807b270 0x7f8d4807d730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8d50000f80 tx=0x7f8d5003d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:07.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.162+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f8d54060e90 con 0x7f8d601049f0 2024-09-21T10:52:07.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.386+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d6010bc80 con 0x7f8d601049f0 2024-09-21T10:52:07.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.387+0000 7f8d47fff640 1 -- 172.21.15.60:0/4268872873 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5249 (secure 0 0 0) 0x7f8d54063fb0 con 0x7f8d601049f0 2024-09-21T10:52:07.389 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"btime":"2024-09-21T10:48:39:093091+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44343,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1825608898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1825608898},{"type":"v1","addr":"172.21.15.112:6825","nonce":1825608898}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44371,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6827/991928918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":991928918},{"type":"v1","addr":"172.21.15.112:6827","nonce":991928918}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:38.086780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":0,"incarnation":31,"state":"up:active","state_seq":20,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34402,"qdb_cluster":[34402]},"id":1}]} 2024-09-21T10:52:07.390 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2024-09-21T10:52:07.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8d4807b270 msgr2=0x7f8d4807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:07.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8d4807b270 0x7f8d4807d730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8d50000f80 tx=0x7f8d5003d040 comp rx=0 tx=0).stop 2024-09-21T10:52:07.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 msgr2=0x7f8d6019bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d6019bde0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400d6f0 tx=0x7f8d5400dbb0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 shutdown_connections 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8d4807b270 0x7f8d4807d730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d601049f0 0x7f8d6019bde0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 --2- 172.21.15.60:0/4268872873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d600fe9f0 0x7f8d6019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 >> 172.21.15.60:0/4268872873 conn(0x7f8d600758a0 msgr2=0x7f8d600fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 shutdown_connections 2024-09-21T10:52:07.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:07.389+0000 7f8d65777640 1 -- 172.21.15.60:0/4268872873 wait complete. 2024-09-21T10:52:07.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:07 smithi060 ceph-mon[93270]: pgmap v312: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:07.691 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:07 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/4268872873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T10:52:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:07 smithi112 ceph-mon[78695]: pgmap v312: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:07.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:07 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/4268872873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T10:52:08.055 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 18} 2024-09-21T10:52:08.055 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 16 2024-09-21T10:52:08.263 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:09.633 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:09 smithi060 ceph-mon[93270]: pgmap v313: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 -- 172.21.15.60:0/1632412935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 msgr2=0x7fda30105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 --2- 172.21.15.60:0/1632412935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30105fd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda20009880 tx=0x7fda2002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 -- 172.21.15.60:0/1632412935 shutdown_connections 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 --2- 172.21.15.60:0/1632412935 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda300ffb40 0x7fda300fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 --2- 172.21.15.60:0/1632412935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30105fd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 -- 172.21.15.60:0/1632412935 >> 172.21.15.60:0/1632412935 conn(0x7fda300fb860 msgr2=0x7fda300fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 -- 172.21.15.60:0/1632412935 shutdown_connections 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.851+0000 7fda3596d640 1 -- 172.21.15.60:0/1632412935 wait complete. 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda3596d640 1 Processor -- start 2024-09-21T10:52:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda3596d640 1 -- start start 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda3596d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda300ffb40 0x7fda300727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda3596d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda3596d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda30073230 con 0x7fda30105bf0 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda3596d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300733a0 con 0x7fda300ffb40 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda2e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda2e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59990/0 (socket says 172.21.15.60:59990) 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda2e7fc640 1 -- 172.21.15.60:0/895023041 learned_addr learned my addr 172.21.15.60:0/895023041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.852+0000 7fda2effd640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda300ffb40 0x7fda300727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda2e7fc640 1 -- 172.21.15.60:0/895023041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda300ffb40 msgr2=0x7fda300727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda2e7fc640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda300ffb40 0x7fda300727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda2e7fc640 1 -- 172.21.15.60:0/895023041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009560 con 0x7fda30105bf0 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda2e7fc640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30072cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda2400b420 tx=0x7fda2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda24011800 con 0x7fda30105bf0 2024-09-21T10:52:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda301a1cf0 con 0x7fda30105bf0 2024-09-21T10:52:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda24011e20 con 0x7fda30105bf0 2024-09-21T10:52:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2400f2e0 con 0x7fda30105bf0 2024-09-21T10:52:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.853+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda301a20d0 con 0x7fda30105bf0 2024-09-21T10:52:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.854+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda301011f0 con 0x7fda30105bf0 2024-09-21T10:52:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.855+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fda24010380 con 0x7fda30105bf0 2024-09-21T10:52:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.856+0000 7fda3496b640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fda1807b270 0x7fda1807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.856+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fda2409dbe0 con 0x7fda30105bf0 2024-09-21T10:52:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.856+0000 7fda2effd640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fda1807b270 0x7fda1807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.857+0000 7fda2effd640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fda1807b270 0x7fda1807d730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda20009230 tx=0x7fda20005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:09.861+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fda24060af0 con 0x7fda30105bf0 2024-09-21T10:52:09.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:09 smithi112 ceph-mon[78695]: pgmap v313: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.088+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fda301080b0 con 0x7fda30105bf0 2024-09-21T10:52:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.088+0000 7fda3496b640 1 -- 172.21.15.60:0/895023041 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4123 (secure 0 0 0) 0x7fda24063c10 con 0x7fda30105bf0 2024-09-21T10:52:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:10.091 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"btime":"2024-09-21T10:47:27:211224+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:38:28.451343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi060.lljnqu","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6829/4161459268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4161459268},{"type":"v1","addr":"172.21.15.60:6829","nonce":4161459268}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2024-09-21T10:52:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fda1807b270 msgr2=0x7fda1807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fda1807b270 0x7fda1807d730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda20009230 tx=0x7fda20005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 msgr2=0x7fda30072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30072cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda2400b420 tx=0x7fda2400b8e0 comp rx=0 tx=0).stop 2024-09-21T10:52:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 shutdown_connections 2024-09-21T10:52:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fda1807b270 0x7fda1807d730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda30105bf0 0x7fda30072cf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 --2- 172.21.15.60:0/895023041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda300ffb40 0x7fda300727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 >> 172.21.15.60:0/895023041 conn(0x7fda300fb860 msgr2=0x7fda300fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 shutdown_connections 2024-09-21T10:52:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:10.091+0000 7fda3596d640 1 -- 172.21.15.60:0/895023041 wait complete. 2024-09-21T10:52:10.688 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:10 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/895023041' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-21T10:52:10.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 17 2024-09-21T10:52:10.929 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:10.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:10 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/895023041' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-21T10:52:11.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:11 smithi060 ceph-mon[93270]: pgmap v314: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:11.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:11 smithi112 ceph-mon[78695]: pgmap v314: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.532+0000 7ff9dadc0640 1 -- 172.21.15.60:0/2077559555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d4104a30 msgr2=0x7ff9d4104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.532+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/2077559555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d4104a30 0x7ff9d4104e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009880 tx=0x7ff9c802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.532+0000 7ff9dadc0640 1 -- 172.21.15.60:0/2077559555 shutdown_connections 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.532+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/2077559555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9d40fea30 0x7ff9d40fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.532+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/2077559555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d4104a30 0x7ff9d4104e10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.532+0000 7ff9dadc0640 1 -- 172.21.15.60:0/2077559555 >> 172.21.15.60:0/2077559555 conn(0x7ff9d40fa730 msgr2=0x7ff9d40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 -- 172.21.15.60:0/2077559555 shutdown_connections 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 -- 172.21.15.60:0/2077559555 wait complete. 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 Processor -- start 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 -- start start 2024-09-21T10:52:12.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 0x7ff9d4194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9d4104a30 0x7ff9d4194d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41952b0 con 0x7ff9d40fea30 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9dadc0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4195420 con 0x7ff9d4104a30 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.533+0000 7ff9d8b5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 0x7ff9d4194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d8b5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 0x7ff9d4194830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60002/0 (socket says 172.21.15.60:60002) 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d8b5c640 1 -- 172.21.15.60:0/862242434 learned_addr learned my addr 172.21.15.60:0/862242434 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d3fff640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9d4104a30 0x7ff9d4194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d8b5c640 1 -- 172.21.15.60:0/862242434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9d4104a30 msgr2=0x7ff9d4194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d8b5c640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9d4104a30 0x7ff9d4194d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d8b5c640 1 -- 172.21.15.60:0/862242434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009560 con 0x7ff9d40fea30 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d8b5c640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 0x7ff9d4194830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9c802a9c0 tx=0x7ff9c80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9c8004aa0 con 0x7ff9d40fea30 2024-09-21T10:52:12.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9c8004c00 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9c8003ab0 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.534+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d41956a0 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.535+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d41a20c0 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.536+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d4100170 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.536+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff9c8003c10 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.537+0000 7ff9d1ffb640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff9c407b270 0x7ff9c407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.537+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ff9c80bf350 con 0x7ff9d40fea30 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.537+0000 7ff9d3fff640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff9c407b270 0x7ff9c407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.538+0000 7ff9d3fff640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff9c407b270 0x7ff9c407d730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4068d40 tx=0x7ff9c0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:12.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.542+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ff9c8082240 con 0x7ff9d40fea30 2024-09-21T10:52:12.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.764+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7ff9d41956a0 con 0x7ff9d40fea30 2024-09-21T10:52:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.765+0000 7ff9d1ffb640 1 -- 172.21.15.60:0/862242434 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4967 (secure 0 0 0) 0x7ff9d41956a0 con 0x7ff9d40fea30 2024-09-21T10:52:12.767 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:12.767 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"btime":"2024-09-21T10:47:31:861755+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:38:28.451343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"cephfs.smithi060.lljnqu","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.60:6829/4161459268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":4161459268},{"type":"v1","addr":"172.21.15.60:6829","nonce":4161459268}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:12.767 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 17 2024-09-21T10:52:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff9c407b270 msgr2=0x7ff9c407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff9c407b270 0x7ff9c407d730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4068d40 tx=0x7ff9c0008040 comp rx=0 tx=0).stop 2024-09-21T10:52:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 msgr2=0x7ff9d4194830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 0x7ff9d4194830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9c802a9c0 tx=0x7ff9c80055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 shutdown_connections 2024-09-21T10:52:12.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff9c407b270 0x7ff9c407d730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff9d4104a30 0x7ff9d4194d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 --2- 172.21.15.60:0/862242434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9d40fea30 0x7ff9d4194830 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 >> 172.21.15.60:0/862242434 conn(0x7ff9d40fa730 msgr2=0x7ff9d40fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 shutdown_connections 2024-09-21T10:52:12.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:12.767+0000 7ff9dadc0640 1 -- 172.21.15.60:0/862242434 wait complete. 2024-09-21T10:52:13.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 18 2024-09-21T10:52:13.650 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:13.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:13 smithi060 ceph-mon[93270]: pgmap v315: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:13.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:13 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/862242434' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T10:52:13.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:13 smithi112 ceph-mon[78695]: pgmap v315: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:13.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:13 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/862242434' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T10:52:14.668 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:14 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:14.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:14 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:15.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 -- 172.21.15.60:0/552086859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1100728e0 msgr2=0x7fd110072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 --2- 172.21.15.60:0/552086859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1100728e0 0x7fd110072cc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009880 tx=0x7fd10c02a530 comp rx=0 tx=0).stop 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 -- 172.21.15.60:0/552086859 shutdown_connections 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 --2- 172.21.15.60:0/552086859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd110073200 0x7fd11010bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 --2- 172.21.15.60:0/552086859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1100728e0 0x7fd110072cc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 -- 172.21.15.60:0/552086859 >> 172.21.15.60:0/552086859 conn(0x7fd1100fb900 msgr2=0x7fd1100fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 -- 172.21.15.60:0/552086859 shutdown_connections 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.186+0000 7fd11845e640 1 -- 172.21.15.60:0/552086859 wait complete. 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd11845e640 1 Processor -- start 2024-09-21T10:52:15.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd11845e640 1 -- start start 2024-09-21T10:52:15.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd11845e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1100728e0 0x7fd110197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd11845e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 0x7fd1101982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd11845e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd110198960 con 0x7fd110073200 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd11845e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11019c6d0 con 0x7fd1100728e0 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 0x7fd1101982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 0x7fd1101982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42524/0 (socket says 172.21.15.60:42524) 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 -- 172.21.15.60:0/421577397 learned_addr learned my addr 172.21.15.60:0/421577397 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1161fa640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1100728e0 0x7fd110197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 -- 172.21.15.60:0/421577397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1100728e0 msgr2=0x7fd110197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1100728e0 0x7fd110197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 -- 172.21.15.60:0/421577397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009560 con 0x7fd110073200 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1161fa640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1100728e0 0x7fd110197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:15.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.187+0000 7fd1159f9640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 0x7fd1101982d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c8f0 tx=0x7fd10000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:15.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.188+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd100007b80 con 0x7fd110073200 2024-09-21T10:52:15.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.188+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1000054e0 con 0x7fd110073200 2024-09-21T10:52:15.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.188+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10000f450 con 0x7fd110073200 2024-09-21T10:52:15.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.188+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11019c9b0 con 0x7fd110073200 2024-09-21T10:52:15.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.188+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11019cf00 con 0x7fd110073200 2024-09-21T10:52:15.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.189+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd110073f90 con 0x7fd110073200 2024-09-21T10:52:15.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.189+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fd100004f60 con 0x7fd110073200 2024-09-21T10:52:15.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.190+0000 7fd1077fe640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd0fc07b270 0x7fd0fc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:15.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.190+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd10009e180 con 0x7fd110073200 2024-09-21T10:52:15.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.190+0000 7fd1161fa640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd0fc07b270 0x7fd0fc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:15.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.190+0000 7fd1161fa640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd0fc07b270 0x7fd0fc07d730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd10c000c00 tx=0x7fd10c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:15.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.194+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fd100061110 con 0x7fd110073200 2024-09-21T10:52:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.418+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fd110072cc0 con 0x7fd110073200 2024-09-21T10:52:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.418+0000 7fd1077fe640 1 -- 172.21.15.60:0/421577397 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4177 (secure 0 0 0) 0x7fd100064230 con 0x7fd110073200 2024-09-21T10:52:15.421 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:15.421 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"btime":"2024-09-21T10:47:43:475207+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24329,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:47:43.474998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd0fc07b270 msgr2=0x7fd0fc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd0fc07b270 0x7fd0fc07d730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd10c000c00 tx=0x7fd10c005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 msgr2=0x7fd1101982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 0x7fd1101982d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c8f0 tx=0x7fd10000cdb0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 shutdown_connections 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fd0fc07b270 0x7fd0fc07d730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd110073200 0x7fd1101982d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 --2- 172.21.15.60:0/421577397 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd1100728e0 0x7fd110197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 >> 172.21.15.60:0/421577397 conn(0x7fd1100fb900 msgr2=0x7fd1101043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 shutdown_connections 2024-09-21T10:52:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:15.421+0000 7fd11845e640 1 -- 172.21.15.60:0/421577397 wait complete. 2024-09-21T10:52:15.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:15 smithi060 ceph-mon[93270]: pgmap v316: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:15.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:15 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/421577397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T10:52:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:15 smithi112 ceph-mon[78695]: pgmap v316: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:15.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:15 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/421577397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T10:52:16.008 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 19 2024-09-21T10:52:16.216 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.725+0000 7f648f45d640 1 -- 172.21.15.60:0/1273668284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64881007d0 msgr2=0x7f6488104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 --2- 172.21.15.60:0/1273668284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64881007d0 0x7f6488104820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6478009880 tx=0x7f647802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 -- 172.21.15.60:0/1273668284 shutdown_connections 2024-09-21T10:52:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 --2- 172.21.15.60:0/1273668284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64881007d0 0x7f6488104820 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 --2- 172.21.15.60:0/1273668284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64880ffe20 0x7f6488100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 -- 172.21.15.60:0/1273668284 >> 172.21.15.60:0/1273668284 conn(0x7f64880fb900 msgr2=0x7f64880fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 -- 172.21.15.60:0/1273668284 shutdown_connections 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 -- 172.21.15.60:0/1273668284 wait complete. 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 Processor -- start 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.726+0000 7f648f45d640 1 -- start start 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648f45d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 0x7f648819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648f45d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64881007d0 0x7f648819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648f45d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648819c480 con 0x7f64880ffe20 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648f45d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6488195a10 con 0x7f64881007d0 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 0x7f648819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 0x7f648819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42548/0 (socket says 172.21.15.60:42548) 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 -- 172.21.15.60:0/3971931536 learned_addr learned my addr 172.21.15.60:0/3971931536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648c9f8640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64881007d0 0x7f648819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 -- 172.21.15.60:0/3971931536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64881007d0 msgr2=0x7f648819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64881007d0 0x7f648819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 -- 172.21.15.60:0/3971931536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009560 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648c9f8640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64881007d0 0x7f648819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648d1f9640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 0x7f648819b920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f648400c810 tx=0x7f648400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64840041f0 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6484007e70 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488195cf0 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64840049d0 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.727+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488196210 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.728+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6488101300 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.729+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f64840079b0 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.730+0000 7f647e7fc640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f647407b270 0x7f647407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.730+0000 7f648c9f8640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f647407b270 0x7f647407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.730+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f648409e1c0 con 0x7f64880ffe20 2024-09-21T10:52:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.730+0000 7f648c9f8640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f647407b270 0x7f647407d730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6478000c00 tx=0x7f6478005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.734+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f6484061150 con 0x7f64880ffe20 2024-09-21T10:52:17.948 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:17 smithi060 ceph-mon[93270]: pgmap v317: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:17.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:17 smithi112 ceph-mon[78695]: pgmap v317: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.957+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f6488100200 con 0x7f64880ffe20 2024-09-21T10:52:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.958+0000 7f647e7fc640 1 -- 172.21.15.60:0/3971931536 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4188 (secure 0 0 0) 0x7f6484064270 con 0x7f64880ffe20 2024-09-21T10:52:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:17.960 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":19,"btime":"2024-09-21T10:47:43:480082+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:47:43.480072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24329":{"gid":24329,"name":"cephfs.smithi112.worwat","rank":0,"incarnation":19,"state":"up:replay","state_seq":3,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 19 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f647407b270 msgr2=0x7f647407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f647407b270 0x7f647407d730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6478000c00 tx=0x7f6478005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 msgr2=0x7f648819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 0x7f648819b920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f648400c810 tx=0x7f648400ccd0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 shutdown_connections 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f647407b270 0x7f647407d730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64881007d0 0x7f648819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 --2- 172.21.15.60:0/3971931536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64880ffe20 0x7f648819b920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 >> 172.21.15.60:0/3971931536 conn(0x7f64880fb900 msgr2=0x7f64880fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 shutdown_connections 2024-09-21T10:52:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:17.960+0000 7f648f45d640 1 -- 172.21.15.60:0/3971931536 wait complete. 2024-09-21T10:52:18.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 20 2024-09-21T10:52:18.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:18 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3971931536' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T10:52:18.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:18 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3971931536' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T10:52:18.813 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:19.854 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:19 smithi060 ceph-mon[93270]: pgmap v318: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:19.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:19 smithi112 ceph-mon[78695]: pgmap v318: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.422+0000 7f2752b3a640 1 -- 172.21.15.60:0/4204380789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 msgr2=0x7f274c104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4204380789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c104e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f273c009880 tx=0x7f273c02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 -- 172.21.15.60:0/4204380789 shutdown_connections 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4204380789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f274c0fea40 0x7f274c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4204380789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c104e20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 -- 172.21.15.60:0/4204380789 >> 172.21.15.60:0/4204380789 conn(0x7f274c0fa700 msgr2=0x7f274c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 -- 172.21.15.60:0/4204380789 shutdown_connections 2024-09-21T10:52:20.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 -- 172.21.15.60:0/4204380789 wait complete. 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 Processor -- start 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.423+0000 7f2752b3a640 1 -- start start 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f2752b3a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f274c0fea40 0x7f274c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f2752b3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f2752b3a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1989f0 con 0x7f274c104a40 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f2752b3a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c19c760 con 0x7f274c0fea40 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42566/0 (socket says 172.21.15.60:42566) 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 -- 172.21.15.60:0/4279543611 learned_addr learned my addr 172.21.15.60:0/4279543611 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:20.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f27508d6640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f274c0fea40 0x7f274c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:20.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 -- 172.21.15.60:0/4279543611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f274c0fea40 msgr2=0x7f274c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:20.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f274c0fea40 0x7f274c197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 -- 172.21.15.60:0/4279543611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c009560 con 0x7f274c104a40 2024-09-21T10:52:20.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.424+0000 7f274bfff640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c198360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f274000b420 tx=0x7f274000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:20.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.425+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2740011800 con 0x7f274c104a40 2024-09-21T10:52:20.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.425+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2740011e20 con 0x7f274c104a40 2024-09-21T10:52:20.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.425+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c19ca40 con 0x7f274c104a40 2024-09-21T10:52:20.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.425+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274000f2e0 con 0x7f274c104a40 2024-09-21T10:52:20.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.425+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c19cf90 con 0x7f274c104a40 2024-09-21T10:52:20.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.426+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c100180 con 0x7f274c104a40 2024-09-21T10:52:20.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.427+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2740010380 con 0x7f274c104a40 2024-09-21T10:52:20.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.427+0000 7f2749ffb640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f273407b270 0x7f273407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:20.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.427+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f274009dbe0 con 0x7f274c104a40 2024-09-21T10:52:20.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.427+0000 7f27508d6640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f273407b270 0x7f273407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:20.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.428+0000 7f27508d6640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f273407b270 0x7f273407d730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f273c009230 tx=0x7f273c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:20.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.432+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2740060af0 con 0x7f274c104a40 2024-09-21T10:52:20.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.658+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f274c0fef20 con 0x7f274c104a40 2024-09-21T10:52:20.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.659+0000 7f2749ffb640 1 -- 172.21.15.60:0/4279543611 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4193 (secure 0 0 0) 0x7f2740063c10 con 0x7f274c104a40 2024-09-21T10:52:20.661 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:20.661 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"btime":"2024-09-21T10:47:51:088035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:47:50.493066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24329":{"gid":24329,"name":"cephfs.smithi112.worwat","rank":0,"incarnation":19,"state":"up:reconnect","state_seq":145,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:20.662 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 20 2024-09-21T10:52:20.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.661+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f273407b270 msgr2=0x7f273407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.661+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f273407b270 0x7f273407d730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f273c009230 tx=0x7f273c0058d0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.661+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 msgr2=0x7f274c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.661+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c198360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f274000b420 tx=0x7f274000b8e0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.661+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 shutdown_connections 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.661+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f273407b270 0x7f273407d730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.662+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f274c104a40 0x7f274c198360 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.662+0000 7f2752b3a640 1 --2- 172.21.15.60:0/4279543611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f274c0fea40 0x7f274c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.662+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 >> 172.21.15.60:0/4279543611 conn(0x7f274c0fa700 msgr2=0x7f274c0fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.662+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 shutdown_connections 2024-09-21T10:52:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:20.662+0000 7f2752b3a640 1 -- 172.21.15.60:0/4279543611 wait complete. 2024-09-21T10:52:21.351 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 21 2024-09-21T10:52:21.559 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:21.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:21 smithi060 ceph-mon[93270]: pgmap v319: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:21.681 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:21 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/4279543611' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T10:52:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:21 smithi112 ceph-mon[78695]: pgmap v319: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:21.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:21 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/4279543611' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T10:52:23.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 -- 172.21.15.60:0/3788781323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec100cb0 msgr2=0x7f3dec101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:23.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 --2- 172.21.15.60:0/3788781323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec100cb0 0x7f3dec101090 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009c20 tx=0x7f3ddc02aa00 comp rx=0 tx=0).stop 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 -- 172.21.15.60:0/3788781323 shutdown_connections 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 --2- 172.21.15.60:0/3788781323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dec1015d0 0x7f3dec109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 --2- 172.21.15.60:0/3788781323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec100cb0 0x7f3dec101090 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 -- 172.21.15.60:0/3788781323 >> 172.21.15.60:0/3788781323 conn(0x7f3dec0758a0 msgr2=0x7f3dec0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 -- 172.21.15.60:0/3788781323 shutdown_connections 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.144+0000 7f3df1631640 1 -- 172.21.15.60:0/3788781323 wait complete. 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3df1631640 1 Processor -- start 2024-09-21T10:52:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3df1631640 1 -- start start 2024-09-21T10:52:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3df1631640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dec100cb0 0x7f3dec0fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3df1631640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 0x7f3dec0fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3df1631640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0ff390 con 0x7f3dec1015d0 2024-09-21T10:52:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3df1631640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0ff500 con 0x7f3dec100cb0 2024-09-21T10:52:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3dea7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 0x7f3dec0fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3dea7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 0x7f3dec0fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42586/0 (socket says 172.21.15.60:42586) 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.145+0000 7f3dea7fc640 1 -- 172.21.15.60:0/2629970377 learned_addr learned my addr 172.21.15.60:0/2629970377 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3deaffd640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dec100cb0 0x7f3dec0fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dea7fc640 1 -- 172.21.15.60:0/2629970377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dec100cb0 msgr2=0x7f3dec0fe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dea7fc640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dec100cb0 0x7f3dec0fe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dea7fc640 1 -- 172.21.15.60:0/2629970377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009900 con 0x7f3dec1015d0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dea7fc640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 0x7f3dec0fee50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009db0 tx=0x7f3de0007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de0005020 con 0x7f3dec1015d0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3de0005640 con 0x7f3dec1015d0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0ff780 con 0x7f3dec1015d0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de0013660 con 0x7f3dec1015d0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.146+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec195bd0 con 0x7f3dec1015d0 2024-09-21T10:52:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.147+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec068510 con 0x7f3dec1015d0 2024-09-21T10:52:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.148+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f3de000e460 con 0x7f3dec1015d0 2024-09-21T10:52:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.149+0000 7f3dd3fff640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3dd407b270 0x7f3dd407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.149+0000 7f3deaffd640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3dd407b270 0x7f3dd407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.149+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3de009dd50 con 0x7f3dec1015d0 2024-09-21T10:52:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.149+0000 7f3deaffd640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3dd407b270 0x7f3dd407d730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc000f80 tx=0x7f3ddc009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.153+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f3de0060ce0 con 0x7f3dec1015d0 2024-09-21T10:52:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.379+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f3dec0ffe40 con 0x7f3dec1015d0 2024-09-21T10:52:23.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.380+0000 7f3dd3fff640 1 -- 172.21.15.60:0/2629970377 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4190 (secure 0 0 0) 0x7f3de0063e00 con 0x7f3dec1015d0 2024-09-21T10:52:23.383 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:23.383 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-21T10:47:52:092477+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:47:51.095407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24329":{"gid":24329,"name":"cephfs.smithi112.worwat","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":146,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:23.383 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-21T10:52:23.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.382+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3dd407b270 msgr2=0x7f3dd407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.382+0000 7f3df1631640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3dd407b270 0x7f3dd407d730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc000f80 tx=0x7f3ddc009360 comp rx=0 tx=0).stop 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.382+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 msgr2=0x7f3dec0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.382+0000 7f3df1631640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 0x7f3dec0fee50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009db0 tx=0x7f3de0007590 comp rx=0 tx=0).stop 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 shutdown_connections 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f3dd407b270 0x7f3dd407d730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dec1015d0 0x7f3dec0fee50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 --2- 172.21.15.60:0/2629970377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dec100cb0 0x7f3dec0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 >> 172.21.15.60:0/2629970377 conn(0x7f3dec0758a0 msgr2=0x7f3dec101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 shutdown_connections 2024-09-21T10:52:23.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:23.383+0000 7f3df1631640 1 -- 172.21.15.60:0/2629970377 wait complete. 2024-09-21T10:52:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:23 smithi112 ceph-mon[78695]: pgmap v320: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:23.700 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:23 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2629970377' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T10:52:23.831 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:23 smithi060 ceph-mon[93270]: pgmap v320: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:23.831 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:23 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2629970377' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T10:52:24.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 22 2024-09-21T10:52:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:25.949 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:25 smithi060 ceph-mon[93270]: pgmap v321: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:25.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:25 smithi112 ceph-mon[78695]: pgmap v321: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:26.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 -- 172.21.15.60:0/1155927684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928100c60 msgr2=0x7f1928101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:26.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 --2- 172.21.15.60:0/1155927684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928100c60 0x7f1928101040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19240098b0 tx=0x7f192402a4d0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 -- 172.21.15.60:0/1155927684 shutdown_connections 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 --2- 172.21.15.60:0/1155927684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928101610 0x7f1928109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 --2- 172.21.15.60:0/1155927684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928100c60 0x7f1928101040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 -- 172.21.15.60:0/1155927684 >> 172.21.15.60:0/1155927684 conn(0x7f19280fa730 msgr2=0x7f19280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 -- 172.21.15.60:0/1155927684 shutdown_connections 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.172+0000 7f193077f640 1 -- 172.21.15.60:0/1155927684 wait complete. 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f193077f640 1 Processor -- start 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f193077f640 1 -- start start 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f193077f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928100c60 0x7f19280fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f193077f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 0x7f19280fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f193077f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280ff3d0 con 0x7f1928101610 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f193077f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280ff540 con 0x7f1928100c60 2024-09-21T10:52:26.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f192dd1a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 0x7f19280fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f192dd1a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 0x7f19280fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35248/0 (socket says 172.21.15.60:35248) 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f192dd1a640 1 -- 172.21.15.60:0/2131350268 learned_addr learned my addr 172.21.15.60:0/2131350268 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.173+0000 7f192e51b640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928100c60 0x7f19280fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f192dd1a640 1 -- 172.21.15.60:0/2131350268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928100c60 msgr2=0x7f19280fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f192dd1a640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928100c60 0x7f19280fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f192dd1a640 1 -- 172.21.15.60:0/2131350268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009560 con 0x7f1928101610 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f192e51b640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928100c60 0x7f19280fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f192dd1a640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 0x7f19280fee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f191800b420 tx=0x7f191800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1918011800 con 0x7f1928101610 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19281a1db0 con 0x7f1928101610 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1918011e20 con 0x7f1928101610 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191800f2e0 con 0x7f1928101610 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.174+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19281a2110 con 0x7f1928101610 2024-09-21T10:52:26.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.175+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928068d30 con 0x7f1928101610 2024-09-21T10:52:26.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.176+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1918010380 con 0x7f1928101610 2024-09-21T10:52:26.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.176+0000 7f191f7fe640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f191407b270 0x7f191407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:26.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.176+0000 7f192e51b640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f191407b270 0x7f191407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:26.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.176+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f191809dc70 con 0x7f1928101610 2024-09-21T10:52:26.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.177+0000 7f192e51b640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f191407b270 0x7f191407d730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1924009230 tx=0x7f1924005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:26.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.181+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1918060c30 con 0x7f1928101610 2024-09-21T10:52:26.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.405+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f19280ff700 con 0x7f1928101610 2024-09-21T10:52:26.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.406+0000 7f191f7fe640 1 -- 172.21.15.60:0/2131350268 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4199 (secure 0 0 0) 0x7f19280ff700 con 0x7f1928101610 2024-09-21T10:52:26.408 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:26.408 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"btime":"2024-09-21T10:47:53:097782+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:47:53.097778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24329":{"gid":24329,"name":"cephfs.smithi112.worwat","rank":0,"incarnation":19,"state":"up:active","state_seq":147,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24329,"qdb_cluster":[24329]},"id":1}]} 2024-09-21T10:52:26.408 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 22 2024-09-21T10:52:26.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f191407b270 msgr2=0x7f191407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f191407b270 0x7f191407d730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1924009230 tx=0x7f1924005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 msgr2=0x7f19280fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 0x7f19280fee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f191800b420 tx=0x7f191800b8e0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 shutdown_connections 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f191407b270 0x7f191407d730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1928101610 0x7f19280fee90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 --2- 172.21.15.60:0/2131350268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1928100c60 0x7f19280fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 >> 172.21.15.60:0/2131350268 conn(0x7f19280fa730 msgr2=0x7f1928101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.408+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 shutdown_connections 2024-09-21T10:52:26.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:26.409+0000 7f193077f640 1 -- 172.21.15.60:0/2131350268 wait complete. 2024-09-21T10:52:26.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:26 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2131350268' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T10:52:26.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:26 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2131350268' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T10:52:26.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 23 2024-09-21T10:52:27.191 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:27.636 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:27 smithi060 ceph-mon[93270]: pgmap v322: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:27.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:27 smithi112 ceph-mon[78695]: pgmap v322: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 -- 172.21.15.60:0/2545955666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a20100750 msgr2=0x7f7a201047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 --2- 172.21.15.60:0/2545955666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a20100750 0x7f7a201047a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009880 tx=0x7f7a0802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 -- 172.21.15.60:0/2545955666 shutdown_connections 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 --2- 172.21.15.60:0/2545955666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a20100750 0x7f7a201047a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 --2- 172.21.15.60:0/2545955666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a200ffda0 0x7f7a20100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 -- 172.21.15.60:0/2545955666 >> 172.21.15.60:0/2545955666 conn(0x7f7a200fb840 msgr2=0x7f7a200fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 -- 172.21.15.60:0/2545955666 shutdown_connections 2024-09-21T10:52:28.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.766+0000 7f7a25728640 1 -- 172.21.15.60:0/2545955666 wait complete. 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a25728640 1 Processor -- start 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a25728640 1 -- start start 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a25728640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 0x7f7a2019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a25728640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a20100750 0x7f7a2019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a25728640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a20197b60 con 0x7f7a200ffda0 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a25728640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a20197ca0 con 0x7f7a20100750 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a1effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 0x7f7a2019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a1effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 0x7f7a2019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35268/0 (socket says 172.21.15.60:35268) 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.767+0000 7f7a1effd640 1 -- 172.21.15.60:0/322933640 learned_addr learned my addr 172.21.15.60:0/322933640 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a167fc640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a20100750 0x7f7a2019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1effd640 1 -- 172.21.15.60:0/322933640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a20100750 msgr2=0x7f7a2019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1effd640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a20100750 0x7f7a2019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:28.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1effd640 1 -- 172.21.15.60:0/322933640 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009560 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a167fc640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a20100750 0x7f7a2019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1effd640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 0x7f7a2019dab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000e970 tx=0x7f7a1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a1000cc90 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a20197f80 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a1000cdf0 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a10010430 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.768+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a201984a0 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.769+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a20101280 con 0x7f7a200ffda0 2024-09-21T10:52:28.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.770+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f7a100046c0 con 0x7f7a200ffda0 2024-09-21T10:52:28.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.770+0000 7f7a1cff9640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7a0c07b270 0x7f7a0c07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:28.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.770+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f7a10014070 con 0x7f7a200ffda0 2024-09-21T10:52:28.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.770+0000 7f7a167fc640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7a0c07b270 0x7f7a0c07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:28.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.771+0000 7f7a167fc640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7a0c07b270 0x7f7a0c07d730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a08000c00 tx=0x7f7a08005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:28.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:28.775+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f7a10061960 con 0x7f7a200ffda0 2024-09-21T10:52:29.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.003+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f7a20198fd0 con 0x7f7a200ffda0 2024-09-21T10:52:29.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.004+0000 7f7a1cff9640 1 -- 172.21.15.60:0/322933640 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+5046 (secure 0 0 0) 0x7f7a10064a80 con 0x7f7a200ffda0 2024-09-21T10:52:29.006 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:29.006 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"btime":"2024-09-21T10:47:56:106371+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:47:53.097778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24329":{"gid":24329,"name":"cephfs.smithi112.worwat","rank":0,"incarnation":19,"state":"up:active","state_seq":147,"addr":"172.21.15.112:6825/603063981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":603063981},{"type":"v1","addr":"172.21.15.112:6825","nonce":603063981}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24329,"qdb_cluster":[24329]},"id":1}]} 2024-09-21T10:52:29.006 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2024-09-21T10:52:29.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7a0c07b270 msgr2=0x7f7a0c07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:29.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7a0c07b270 0x7f7a0c07d730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a08000c00 tx=0x7f7a08005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 msgr2=0x7f7a2019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 0x7f7a2019dab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000e970 tx=0x7f7a1000ed70 comp rx=0 tx=0).stop 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 shutdown_connections 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f7a0c07b270 0x7f7a0c07d730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a20100750 0x7f7a2019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 --2- 172.21.15.60:0/322933640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a200ffda0 0x7f7a2019dab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 >> 172.21.15.60:0/322933640 conn(0x7f7a200fb840 msgr2=0x7f7a200fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 shutdown_connections 2024-09-21T10:52:29.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:29.006+0000 7f7a25728640 1 -- 172.21.15.60:0/322933640 wait complete. 2024-09-21T10:52:29.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:29 smithi060 ceph-mon[93270]: pgmap v323: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:29 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:29.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:29 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/322933640' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T10:52:29.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 24 2024-09-21T10:52:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:29 smithi112 ceph-mon[78695]: pgmap v323: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:29 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:29.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:29 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/322933640' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T10:52:30.035 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:30.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:30 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:52:30.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:30 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T10:52:31.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 -- 172.21.15.60:0/3374979103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd00fea30 msgr2=0x7f8bd00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 --2- 172.21.15.60:0/3374979103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd00fea30 0x7f8bd00fee90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009880 tx=0x7f8bc002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 -- 172.21.15.60:0/3374979103 shutdown_connections 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 --2- 172.21.15.60:0/3374979103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd00fea30 0x7f8bd00fee90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 --2- 172.21.15.60:0/3374979103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd0104a30 0x7f8bd0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 -- 172.21.15.60:0/3374979103 >> 172.21.15.60:0/3374979103 conn(0x7f8bd00fa730 msgr2=0x7f8bd00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 -- 172.21.15.60:0/3374979103 shutdown_connections 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.581+0000 7f8bd8482640 1 -- 172.21.15.60:0/3374979103 wait complete. 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd8482640 1 Processor -- start 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd8482640 1 -- start start 2024-09-21T10:52:31.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd8482640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd00fea30 0x7f8bd019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd8482640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 0x7f8bd019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd8482640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd019c370 con 0x7f8bd0104a30 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd8482640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0195900 con 0x7f8bd00fea30 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd5a1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 0x7f8bd019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd5a1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 0x7f8bd019bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35290/0 (socket says 172.21.15.60:35290) 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.582+0000 7f8bd5a1d640 1 -- 172.21.15.60:0/2126411043 learned_addr learned my addr 172.21.15.60:0/2126411043 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd621e640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd00fea30 0x7f8bd019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd5a1d640 1 -- 172.21.15.60:0/2126411043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd00fea30 msgr2=0x7f8bd019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd5a1d640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd00fea30 0x7f8bd019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd5a1d640 1 -- 172.21.15.60:0/2126411043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009560 con 0x7f8bd0104a30 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd621e640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd00fea30 0x7f8bd019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:52:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd5a1d640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 0x7f8bd019bd50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8bc002a9c0 tx=0x7f8bc00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc0004aa0 con 0x7f8bd0104a30 2024-09-21T10:52:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd0195b80 con 0x7f8bd0104a30 2024-09-21T10:52:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bc0004c00 con 0x7f8bd0104a30 2024-09-21T10:52:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc0003980 con 0x7f8bd0104a30 2024-09-21T10:52:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.583+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd0196070 con 0x7f8bd0104a30 2024-09-21T10:52:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.584+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0100170 con 0x7f8bd0104a30 2024-09-21T10:52:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.585+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f8bc0003bf0 con 0x7f8bd0104a30 2024-09-21T10:52:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.585+0000 7f8bc77fe640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8bbc07b270 0x7f8bbc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.586+0000 7f8bd621e640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8bbc07b270 0x7f8bbc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.586+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8bc00bf580 con 0x7f8bd0104a30 2024-09-21T10:52:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.586+0000 7f8bd621e640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8bbc07b270 0x7f8bbc07d730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009b40 tx=0x7f8bcc005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:31.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.590+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f8bc00823f0 con 0x7f8bd0104a30 2024-09-21T10:52:31.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:31 smithi060 ceph-mon[93270]: pgmap v324: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:31.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:52:31.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:52:31.699 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:31 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:52:31.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.816+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f8bd010bcc0 con 0x7f8bd0104a30 2024-09-21T10:52:31.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.817+0000 7f8bc77fe640 1 -- 172.21.15.60:0/2126411043 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4245 (secure 0 0 0) 0x7f8bc0085510 con 0x7f8bd0104a30 2024-09-21T10:52:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:31.819 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T10:48:07:117680+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:07.117677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:31.819 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T10:52:31.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8bbc07b270 msgr2=0x7f8bbc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8bbc07b270 0x7f8bbc07d730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009b40 tx=0x7f8bcc005e50 comp rx=0 tx=0).stop 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 msgr2=0x7f8bd019bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 0x7f8bd019bd50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8bc002a9c0 tx=0x7f8bc00055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 shutdown_connections 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f8bbc07b270 0x7f8bbc07d730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bd0104a30 0x7f8bd019bd50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 --2- 172.21.15.60:0/2126411043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bd00fea30 0x7f8bd019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 >> 172.21.15.60:0/2126411043 conn(0x7f8bd00fa730 msgr2=0x7f8bd00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 shutdown_connections 2024-09-21T10:52:31.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:31.819+0000 7f8bd8482640 1 -- 172.21.15.60:0/2126411043 wait complete. 2024-09-21T10:52:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:31 smithi112 ceph-mon[78695]: pgmap v324: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:31.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T10:52:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T10:52:31.951 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:31 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' 2024-09-21T10:52:32.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 25 2024-09-21T10:52:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:32.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:32 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2126411043' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T10:52:32.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:32 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2126411043' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T10:52:33.745 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:33 smithi060 ceph-mon[93270]: pgmap v325: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:33.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:33 smithi112 ceph-mon[78695]: pgmap v325: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 -- 172.21.15.60:0/2524369276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 msgr2=0x7f1df0109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 --2- 172.21.15.60:0/2524369276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df0109b80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80098b0 tx=0x7f1dd802a4d0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 -- 172.21.15.60:0/2524369276 shutdown_connections 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 --2- 172.21.15.60:0/2524369276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df0109b80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 --2- 172.21.15.60:0/2524369276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1df0100d70 0x7f1df0101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 -- 172.21.15.60:0/2524369276 >> 172.21.15.60:0/2524369276 conn(0x7f1df00fa730 msgr2=0x7f1df00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 -- 172.21.15.60:0/2524369276 shutdown_connections 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 -- 172.21.15.60:0/2524369276 wait complete. 2024-09-21T10:52:34.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.230+0000 7f1df5d25640 1 Processor -- start 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1df5d25640 1 -- start start 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1df5d25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1df0100d70 0x7f1df019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1df5d25640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1df5d25640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df019c3c0 con 0x7f1df0101690 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1df5d25640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0195950 con 0x7f1df0100d70 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44910/0 (socket says 172.21.15.60:44910) 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 -- 172.21.15.60:0/1856299460 learned_addr learned my addr 172.21.15.60:0/1856299460 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1def7fe640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1df0100d70 0x7f1df019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 -- 172.21.15.60:0/1856299460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1df0100d70 msgr2=0x7f1df019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1df0100d70 0x7f1df019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 -- 172.21.15.60:0/1856299460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009560 con 0x7f1df0101690 2024-09-21T10:52:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.231+0000 7f1de7fff640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df019bda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8006010 tx=0x7f1dd80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.232+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd8004aa0 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.232+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1dd8004c00 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.232+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df0195bd0 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.232+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd8003a20 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.232+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df01960c0 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.233+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df0068cb0 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.233+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f1dd8003ba0 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.234+0000 7f1ded7fa640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1ddc07b270 0x7f1ddc07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.234+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1dd80bf4b0 con 0x7f1df0101690 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.234+0000 7f1def7fe640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1ddc07b270 0x7f1ddc07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.234+0000 7f1def7fe640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1ddc07b270 0x7f1ddc07d730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1de00058c0 tx=0x7f1de000a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.238+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1dd80824f0 con 0x7f1df0101690 2024-09-21T10:52:34.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.471+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f1df01043c0 con 0x7f1df0101690 2024-09-21T10:52:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.471+0000 7f1ded7fa640 1 -- 172.21.15.60:0/1856299460 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+4256 (secure 0 0 0) 0x7f1dd8085610 con 0x7f1df0101690 2024-09-21T10:52:34.474 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:34.474 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"btime":"2024-09-21T10:48:07:123113+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:07.123099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24343":{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 25 2024-09-21T10:52:34.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1ddc07b270 msgr2=0x7f1ddc07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:34.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1ddc07b270 0x7f1ddc07d730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1de00058c0 tx=0x7f1de000a2d0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 msgr2=0x7f1df019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:34.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df019bda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8006010 tx=0x7f1dd80055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 shutdown_connections 2024-09-21T10:52:34.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f1ddc07b270 0x7f1ddc07d730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1df0101690 0x7f1df019bda0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 --2- 172.21.15.60:0/1856299460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1df0100d70 0x7f1df019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:34.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 >> 172.21.15.60:0/1856299460 conn(0x7f1df00fa730 msgr2=0x7f1df0101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:34.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 shutdown_connections 2024-09-21T10:52:34.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:34.474+0000 7f1df5d25640 1 -- 172.21.15.60:0/1856299460 wait complete. 2024-09-21T10:52:34.698 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:34 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1856299460' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T10:52:34.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:34 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1856299460' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T10:52:35.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 26 2024-09-21T10:52:35.328 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:36.410 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:36 smithi060 ceph-mon[93270]: pgmap v326: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:36.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:36 smithi112 ceph-mon[78695]: pgmap v326: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.937+0000 7fa51382d640 1 -- 172.21.15.60:0/2320284883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 msgr2=0x7fa50c0fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.937+0000 7fa51382d640 1 --2- 172.21.15.60:0/2320284883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c0fec60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa508009880 tx=0x7fa50802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 -- 172.21.15.60:0/2320284883 shutdown_connections 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 --2- 172.21.15.60:0/2320284883 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0ff230 0x7fa50c10bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 --2- 172.21.15.60:0/2320284883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c0fec60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 -- 172.21.15.60:0/2320284883 >> 172.21.15.60:0/2320284883 conn(0x7fa50c0fa730 msgr2=0x7fa50c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 -- 172.21.15.60:0/2320284883 shutdown_connections 2024-09-21T10:52:36.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 -- 172.21.15.60:0/2320284883 wait complete. 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 Processor -- start 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.938+0000 7fa51382d640 1 -- start start 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa51382d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa51382d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0ff230 0x7fa50c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa51382d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1988c0 con 0x7fa50c0fe880 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa51382d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c19b530 con 0x7fa50c0ff230 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44934/0 (socket says 172.21.15.60:44934) 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 -- 172.21.15.60:0/578532406 learned_addr learned my addr 172.21.15.60:0/578532406 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa510dc8640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0ff230 0x7fa50c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:36.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 -- 172.21.15.60:0/578532406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0ff230 msgr2=0x7fa50c1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0ff230 0x7fa50c1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 -- 172.21.15.60:0/578532406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508009560 con 0x7fa50c0fe880 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5115c9640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c197ca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa50802a9c0 tx=0x7fa5080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa508004aa0 con 0x7fa50c0fe880 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa508004c00 con 0x7fa50c0fe880 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.939+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c19b810 con 0x7fa50c0fe880 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.940+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa508003980 con 0x7fa50c0fe880 2024-09-21T10:52:36.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.940+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c19bd60 con 0x7fa50c0fe880 2024-09-21T10:52:36.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.941+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c068d30 con 0x7fa50c0fe880 2024-09-21T10:52:36.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.941+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fa508003bf0 con 0x7fa50c0fe880 2024-09-21T10:52:36.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.942+0000 7fa5027fc640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa4f807b270 0x7fa4f807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:36.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.942+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa5080bf460 con 0x7fa50c0fe880 2024-09-21T10:52:36.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.942+0000 7fa510dc8640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa4f807b270 0x7fa4f807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:36.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.942+0000 7fa510dc8640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa4f807b270 0x7fa4f807d730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005fd0 tx=0x7fa4fc005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:36.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:36.946+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fa508082370 con 0x7fa50c0fe880 2024-09-21T10:52:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.171+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fa50c198fc0 con 0x7fa50c0fe880 2024-09-21T10:52:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.172+0000 7fa5027fc640 1 -- 172.21.15.60:0/578532406 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4261 (secure 0 0 0) 0x7fa508085490 con 0x7fa50c0fe880 2024-09-21T10:52:37.174 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:37.174 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"btime":"2024-09-21T10:48:14:809204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:14.259690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24343":{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":149,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 26 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.174+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa4f807b270 msgr2=0x7fa4f807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.174+0000 7fa51382d640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa4f807b270 0x7fa4f807d730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005fd0 tx=0x7fa4fc005850 comp rx=0 tx=0).stop 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.174+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 msgr2=0x7fa50c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.174+0000 7fa51382d640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c197ca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa50802a9c0 tx=0x7fa5080055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 shutdown_connections 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fa4f807b270 0x7fa4f807d730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0ff230 0x7fa50c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 --2- 172.21.15.60:0/578532406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa50c0fe880 0x7fa50c197ca0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 >> 172.21.15.60:0/578532406 conn(0x7fa50c0fa730 msgr2=0x7fa50c0fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 shutdown_connections 2024-09-21T10:52:37.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:37.175+0000 7fa51382d640 1 -- 172.21.15.60:0/578532406 wait complete. 2024-09-21T10:52:37.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 27 2024-09-21T10:52:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:38.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:38 smithi060 ceph-mon[93270]: pgmap v327: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:38.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:38 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/578532406' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T10:52:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:38 smithi112 ceph-mon[78695]: pgmap v327: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:38.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:38 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/578532406' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 -- 172.21.15.60:0/4187047095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 msgr2=0x7ff0bc104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/4187047095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc104dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009880 tx=0x7ff0b802a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 -- 172.21.15.60:0/4187047095 shutdown_connections 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/4187047095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0bc0fe9f0 0x7ff0bc0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/4187047095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc104dd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 -- 172.21.15.60:0/4187047095 >> 172.21.15.60:0/4187047095 conn(0x7ff0bc0758a0 msgr2=0x7ff0bc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:39.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 -- 172.21.15.60:0/4187047095 shutdown_connections 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.856+0000 7ff0c40b8640 1 -- 172.21.15.60:0/4187047095 wait complete. 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c40b8640 1 Processor -- start 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c40b8640 1 -- start start 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c40b8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0bc0fe9f0 0x7ff0bc105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c40b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c40b8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1063a0 con 0x7ff0bc1049f0 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c40b8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1064e0 con 0x7ff0bc0fe9f0 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c1653640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c1653640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44956/0 (socket says 172.21.15.60:44956) 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c1653640 1 -- 172.21.15.60:0/3666183391 learned_addr learned my addr 172.21.15.60:0/3666183391 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.857+0000 7ff0c1e54640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0bc0fe9f0 0x7ff0bc105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0c1653640 1 -- 172.21.15.60:0/3666183391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0bc0fe9f0 msgr2=0x7ff0bc105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0c1653640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0bc0fe9f0 0x7ff0bc105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0c1653640 1 -- 172.21.15.60:0/3666183391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8009560 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0c1653640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc105e60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00d8d0 tx=0x7ff0ac00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ac00bea0 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc1a1c30 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0ac009c00 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ac00f710 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.858+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc1a2040 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.859+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc100130 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.861+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7ff0ac00f990 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.861+0000 7ff0b2ffd640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff0a807b270 0x7ff0a807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.861+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ff0ac09e150 con 0x7ff0bc1049f0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.861+0000 7ff0c1e54640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff0a807b270 0x7ff0a807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.862+0000 7ff0c1e54640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff0a807b270 0x7ff0a807d730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8000c00 tx=0x7ff0b8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:39.864+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7ff0ac061180 con 0x7ff0bc1049f0 2024-09-21T10:52:40.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.095+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7ff0bc0fee50 con 0x7ff0bc1049f0 2024-09-21T10:52:40.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.095+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3666183391 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+4258 (secure 0 0 0) 0x7ff0ac065e60 con 0x7ff0bc1049f0 2024-09-21T10:52:40.098 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:40.098 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"btime":"2024-09-21T10:48:15:814059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:14.817484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24343":{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":150,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 27 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff0a807b270 msgr2=0x7ff0a807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff0a807b270 0x7ff0a807d730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8000c00 tx=0x7ff0b8005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 msgr2=0x7ff0bc105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc105e60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00d8d0 tx=0x7ff0ac00dd90 comp rx=0 tx=0).stop 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 shutdown_connections 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7ff0a807b270 0x7ff0a807d730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0bc1049f0 0x7ff0bc105e60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 --2- 172.21.15.60:0/3666183391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff0bc0fe9f0 0x7ff0bc105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 >> 172.21.15.60:0/3666183391 conn(0x7ff0bc0758a0 msgr2=0x7ff0bc067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 shutdown_connections 2024-09-21T10:52:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:40.098+0000 7ff0c40b8640 1 -- 172.21.15.60:0/3666183391 wait complete. 2024-09-21T10:52:40.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:40 smithi060 ceph-mon[93270]: pgmap v328: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:40.198 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:40 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3666183391' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T10:52:40.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:40 smithi112 ceph-mon[78695]: pgmap v328: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:40.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:40 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3666183391' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T10:52:40.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 28 2024-09-21T10:52:40.988 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:42.425 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:42 smithi060 ceph-mon[93270]: pgmap v329: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:42.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:42 smithi112 ceph-mon[78695]: pgmap v329: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 -- 172.21.15.60:0/499872274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 msgr2=0x7fca8c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 --2- 172.21.15.60:0/499872274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c1047a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fca80009880 tx=0x7fca8002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 -- 172.21.15.60:0/499872274 shutdown_connections 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 --2- 172.21.15.60:0/499872274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c1047a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 --2- 172.21.15.60:0/499872274 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 0x7fca8c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 -- 172.21.15.60:0/499872274 >> 172.21.15.60:0/499872274 conn(0x7fca8c0fb840 msgr2=0x7fca8c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 -- 172.21.15.60:0/499872274 shutdown_connections 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 -- 172.21.15.60:0/499872274 wait complete. 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 Processor -- start 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.619+0000 7fca93ec9640 1 -- start start 2024-09-21T10:52:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca93ec9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 0x7fca8c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca93ec9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca93ec9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c19c2f0 con 0x7fca8c100750 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca93ec9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c195910 con 0x7fca8c0ffda0 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44980/0 (socket says 172.21.15.60:44980) 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 -- 172.21.15.60:0/4072764181 learned_addr learned my addr 172.21.15.60:0/4072764181 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91c65640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 0x7fca8c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 -- 172.21.15.60:0/4072764181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 msgr2=0x7fca8c19b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 0x7fca8c19b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 -- 172.21.15.60:0/4072764181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80009560 con 0x7fca8c100750 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91c65640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 0x7fca8c19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca91464640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c19bd60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca8002a9c0 tx=0x7fca800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca80004aa0 con 0x7fca8c100750 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca80004c00 con 0x7fca8c100750 2024-09-21T10:52:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c195b90 con 0x7fca8c100750 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.620+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca80003ab0 con 0x7fca8c100750 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.621+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c196080 con 0x7fca8c100750 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.621+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c101280 con 0x7fca8c100750 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.622+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fca80003c10 con 0x7fca8c100750 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.623+0000 7fca8affd640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fca7407b270 0x7fca7407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.623+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fca800bf4b0 con 0x7fca8c100750 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.623+0000 7fca91c65640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fca7407b270 0x7fca7407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.623+0000 7fca91c65640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fca7407b270 0x7fca7407d730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca7c007e70 tx=0x7fca7c007850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:42.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.627+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fca80082440 con 0x7fca8c100750 2024-09-21T10:52:42.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.859+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fca8c196e80 con 0x7fca8c100750 2024-09-21T10:52:42.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.860+0000 7fca8affd640 1 -- 172.21.15.60:0/4072764181 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4267 (secure 0 0 0) 0x7fca80085560 con 0x7fca8c100750 2024-09-21T10:52:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:42.862 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-21T10:48:16:819694+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:16.819689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24343":{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":0,"incarnation":25,"state":"up:active","state_seq":151,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24343,"qdb_cluster":[24343]},"id":1}]} 2024-09-21T10:52:42.862 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-21T10:52:42.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fca7407b270 msgr2=0x7fca7407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:42.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fca7407b270 0x7fca7407d730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca7c007e70 tx=0x7fca7c007850 comp rx=0 tx=0).stop 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 msgr2=0x7fca8c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c19bd60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca8002a9c0 tx=0x7fca800055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 shutdown_connections 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fca7407b270 0x7fca7407d730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca8c100750 0x7fca8c19bd60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 --2- 172.21.15.60:0/4072764181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca8c0ffda0 0x7fca8c19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.862+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 >> 172.21.15.60:0/4072764181 conn(0x7fca8c0fb840 msgr2=0x7fca8c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.863+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 shutdown_connections 2024-09-21T10:52:42.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:42.863+0000 7fca93ec9640 1 -- 172.21.15.60:0/4072764181 wait complete. 2024-09-21T10:52:43.181 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:43 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/4072764181' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T10:52:43.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:43 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/4072764181' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T10:52:43.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 29 2024-09-21T10:52:43.805 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:44.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:44 smithi060 ceph-mon[93270]: pgmap v330: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:44.199 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:44 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:44 smithi112 ceph-mon[78695]: pgmap v330: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:44.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:44 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 -- 172.21.15.60:0/3065782483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44100d30 msgr2=0x7f5b44101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/3065782483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44100d30 0x7f5b44101110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009880 tx=0x7f5b4002a530 comp rx=0 tx=0).stop 2024-09-21T10:52:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 -- 172.21.15.60:0/3065782483 shutdown_connections 2024-09-21T10:52:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/3065782483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44101650 0x7f5b44109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/3065782483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44100d30 0x7f5b44101110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 -- 172.21.15.60:0/3065782483 >> 172.21.15.60:0/3065782483 conn(0x7f5b440758a0 msgr2=0x7f5b440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 -- 172.21.15.60:0/3065782483 shutdown_connections 2024-09-21T10:52:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 -- 172.21.15.60:0/3065782483 wait complete. 2024-09-21T10:52:45.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 Processor -- start 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.449+0000 7f5b4c66e640 1 -- start start 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b4c66e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44100d30 0x7f5b4419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b4c66e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 0x7f5b4419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b4c66e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4419c4f0 con 0x7f5b44101650 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b4c66e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44195a80 con 0x7f5b44100d30 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 0x7f5b4419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 0x7f5b4419bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60588/0 (socket says 172.21.15.60:60588) 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 -- 172.21.15.60:0/2610781994 learned_addr learned my addr 172.21.15.60:0/2610781994 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b4a40a640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44100d30 0x7f5b4419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 -- 172.21.15.60:0/2610781994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44100d30 msgr2=0x7f5b4419b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:45.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44100d30 0x7f5b4419b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 -- 172.21.15.60:0/2610781994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009560 con 0x7f5b44101650 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b4a40a640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44100d30 0x7f5b4419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b49c09640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 0x7f5b4419bed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400b420 tx=0x7f5b3400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.450+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b34011800 con 0x7f5b44101650 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.451+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b34011e20 con 0x7f5b44101650 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.451+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3400f2e0 con 0x7f5b44101650 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.451+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b44195d60 con 0x7f5b44101650 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.451+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b441962b0 con 0x7f5b44101650 2024-09-21T10:52:45.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.452+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b44068490 con 0x7f5b44101650 2024-09-21T10:52:45.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.452+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5b34010380 con 0x7f5b44101650 2024-09-21T10:52:45.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.453+0000 7f5b3b7fe640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5b3007b270 0x7f5b3007d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:45.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.453+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f5b3409dbd0 con 0x7f5b44101650 2024-09-21T10:52:45.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.453+0000 7f5b4a40a640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5b3007b270 0x7f5b3007d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:45.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.453+0000 7f5b4a40a640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5b3007b270 0x7f5b3007d730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000c00 tx=0x7f5b40031400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:45.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.457+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f5b34060b60 con 0x7f5b44101650 2024-09-21T10:52:45.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.683+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f5b44101190 con 0x7f5b44101650 2024-09-21T10:52:45.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.684+0000 7f5b3b7fe640 1 -- 172.21.15.60:0/2610781994 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+5117 (secure 0 0 0) 0x7f5b34063c80 con 0x7f5b44101650 2024-09-21T10:52:45.686 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:45.687 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-21T10:48:18:826331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44343,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1825608898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1825608898},{"type":"v1","addr":"172.21.15.112:6825","nonce":1825608898}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:16.819689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24343":{"gid":24343,"name":"cephfs.smithi112.urlyzu","rank":0,"incarnation":25,"state":"up:active","state_seq":151,"addr":"172.21.15.112:6827/3978606848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3978606848},{"type":"v1","addr":"172.21.15.112:6827","nonce":3978606848}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24343,"qdb_cluster":[24343]},"id":1}]} 2024-09-21T10:52:45.687 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-21T10:52:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5b3007b270 msgr2=0x7f5b3007d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5b3007b270 0x7f5b3007d730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000c00 tx=0x7f5b40031400 comp rx=0 tx=0).stop 2024-09-21T10:52:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 msgr2=0x7f5b4419bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:45.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 0x7f5b4419bed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400b420 tx=0x7f5b3400b8e0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 shutdown_connections 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f5b3007b270 0x7f5b3007d730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b44101650 0x7f5b4419bed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 --2- 172.21.15.60:0/2610781994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b44100d30 0x7f5b4419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 >> 172.21.15.60:0/2610781994 conn(0x7f5b440758a0 msgr2=0x7f5b44101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 shutdown_connections 2024-09-21T10:52:45.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:45.687+0000 7f5b4c66e640 1 -- 172.21.15.60:0/2610781994 wait complete. 2024-09-21T10:52:46.338 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:46 smithi060 ceph-mon[93270]: pgmap v331: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:46.338 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:46 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2610781994' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T10:52:46.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 30 2024-09-21T10:52:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:46 smithi112 ceph-mon[78695]: pgmap v331: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:46.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:46 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2610781994' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T10:52:46.574 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:48.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 -- 172.21.15.60:0/3349534803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c100da0 msgr2=0x7f291c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:48.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 --2- 172.21.15.60:0/3349534803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c100da0 0x7f291c101180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f290c009880 tx=0x7f290c02a530 comp rx=0 tx=0).stop 2024-09-21T10:52:48.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 -- 172.21.15.60:0/3349534803 shutdown_connections 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 --2- 172.21.15.60:0/3349534803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c1016c0 0x7f291c109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 --2- 172.21.15.60:0/3349534803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c100da0 0x7f291c101180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 -- 172.21.15.60:0/3349534803 >> 172.21.15.60:0/3349534803 conn(0x7f291c0fa700 msgr2=0x7f291c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 -- 172.21.15.60:0/3349534803 shutdown_connections 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 -- 172.21.15.60:0/3349534803 wait complete. 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.189+0000 7f29213cb640 1 Processor -- start 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f29213cb640 1 -- start start 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f29213cb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c100da0 0x7f291c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f29213cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 0x7f291c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f29213cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c19c3e0 con 0x7f291c1016c0 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f29213cb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c195970 con 0x7f291c100da0 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 0x7f291c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:48.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 0x7f291c19bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60608/0 (socket says 172.21.15.60:60608) 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 -- 172.21.15.60:0/1578518364 learned_addr learned my addr 172.21.15.60:0/1578518364 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291affd640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c100da0 0x7f291c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 -- 172.21.15.60:0/1578518364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c100da0 msgr2=0x7f291c19b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c100da0 0x7f291c19b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 -- 172.21.15.60:0/1578518364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c009560 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.190+0000 7f291a7fc640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 0x7f291c19bdc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f291000d6f0 tx=0x7f291000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.191+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2910009a30 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.191+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29100054e0 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.191+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c195c50 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.191+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2910010460 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.191+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c1961a0 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.192+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c068c90 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.192+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2910009b90 con 0x7f291c1016c0 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.193+0000 7f2903fff640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f290407b270 0x7f290407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.193+0000 7f291affd640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f290407b270 0x7f290407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:48.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.193+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f291009df00 con 0x7f291c1016c0 2024-09-21T10:52:48.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.194+0000 7f291affd640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f290407b270 0x7f290407d730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f290c031440 tx=0x7f290c005b70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:48.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.198+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2910060e90 con 0x7f291c1016c0 2024-09-21T10:52:48.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.423+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f291c1043c0 con 0x7f291c1016c0 2024-09-21T10:52:48.425 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:48 smithi060 ceph-mon[93270]: pgmap v332: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:48.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.423+0000 7f2903fff640 1 -- 172.21.15.60:0/1578518364 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+4313 (secure 0 0 0) 0x7f2910063fb0 con 0x7f291c1016c0 2024-09-21T10:52:48.426 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:48.426 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-21T10:48:28:710068+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44343,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1825608898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1825608898},{"type":"v1","addr":"172.21.15.112:6825","nonce":1825608898}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:28.710065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:48.426 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f290407b270 msgr2=0x7f290407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f290407b270 0x7f290407d730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f290c031440 tx=0x7f290c005b70 comp rx=0 tx=0).stop 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 msgr2=0x7f291c19bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 0x7f291c19bdc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f291000d6f0 tx=0x7f291000dbb0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 shutdown_connections 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f290407b270 0x7f290407d730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f291c1016c0 0x7f291c19bdc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 --2- 172.21.15.60:0/1578518364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f291c100da0 0x7f291c19b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:48.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 >> 172.21.15.60:0/1578518364 conn(0x7f291c0fa700 msgr2=0x7f291c102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:48.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 shutdown_connections 2024-09-21T10:52:48.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:48.426+0000 7f29213cb640 1 -- 172.21.15.60:0/1578518364 wait complete. 2024-09-21T10:52:48.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:48 smithi112 ceph-mon[78695]: pgmap v332: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:49.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 31 2024-09-21T10:52:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:49.422 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:49 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/1578518364' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T10:52:49.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:49 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/1578518364' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T10:52:50.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:50 smithi060 ceph-mon[93270]: pgmap v333: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:50.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:50 smithi112 ceph-mon[78695]: pgmap v333: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 -- 172.21.15.60:0/1359157279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffda0 msgr2=0x7f2b3c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/1359157279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c100180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009c20 tx=0x7f2b2c02a970 comp rx=0 tx=0).stop 2024-09-21T10:52:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 -- 172.21.15.60:0/1359157279 shutdown_connections 2024-09-21T10:52:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/1359157279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c100750 0x7f2b3c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/1359157279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c100180 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 -- 172.21.15.60:0/1359157279 >> 172.21.15.60:0/1359157279 conn(0x7f2b3c0fb840 msgr2=0x7f2b3c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 -- 172.21.15.60:0/1359157279 shutdown_connections 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.915+0000 7f2b40bfa640 1 -- 172.21.15.60:0/1359157279 wait complete. 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b40bfa640 1 Processor -- start 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b40bfa640 1 -- start start 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b40bfa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b40bfa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 0x7f2b3c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b40bfa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c195a10 con 0x7f2b3c100750 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b40bfa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c195b50 con 0x7f2b3c0ffda0 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b39d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 0x7f2b3c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b39d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 0x7f2b3c19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60622/0 (socket says 172.21.15.60:60622) 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.916+0000 7f2b39d9b640 1 -- 172.21.15.60:0/3758015551 learned_addr learned my addr 172.21.15.60:0/3758015551 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b3a59c640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b39d9b640 1 -- 172.21.15.60:0/3758015551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffda0 msgr2=0x7f2b3c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b39d9b640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b39d9b640 1 -- 172.21.15.60:0/3758015551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009900 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b3a59c640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b39d9b640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 0x7f2b3c19bef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c8f0 tx=0x7f2b2400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b24007b80 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c195e30 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b240054e0 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2400f450 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.917+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c196380 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.918+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c101280 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.919+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f2b24004f60 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.919+0000 7f2b337fe640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.919+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f2b2409e290 con 0x7f2b3c100750 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.919+0000 7f2b3a59c640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.920+0000 7f2b3a59c640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0098d0 tx=0x7f2b2c009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:50.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:50.924+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f2b240611a0 con 0x7f2b3c100750 2024-09-21T10:52:51.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.149+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f2b3c196fa0 con 0x7f2b3c100750 2024-09-21T10:52:51.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.149+0000 7f2b337fe640 1 -- 172.21.15.60:0/3758015551 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+4392 (secure 0 0 0) 0x7f2b240642c0 con 0x7f2b3c100750 2024-09-21T10:52:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:51.152 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"btime":"2024-09-21T10:48:28:715570+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44343,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1825608898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1825608898},{"type":"v1","addr":"172.21.15.112:6825","nonce":1825608898}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:28.715554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:51.152 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-09-21T10:52:51.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 msgr2=0x7f2b2807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:51.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0098d0 tx=0x7f2b2c009360 comp rx=0 tx=0).stop 2024-09-21T10:52:51.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 msgr2=0x7f2b3c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:51.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 0x7f2b3c19bef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c8f0 tx=0x7f2b2400cdb0 comp rx=0 tx=0).stop 2024-09-21T10:52:51.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 shutdown_connections 2024-09-21T10:52:51.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f2b2807b270 0x7f2b2807d730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:51.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b3c100750 0x7f2b3c19bef0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:51.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 --2- 172.21.15.60:0/3758015551 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b3c0ffda0 0x7f2b3c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:51.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 >> 172.21.15.60:0/3758015551 conn(0x7f2b3c0fb840 msgr2=0x7f2b3c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:51.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 shutdown_connections 2024-09-21T10:52:51.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:51.152+0000 7f2b40bfa640 1 -- 172.21.15.60:0/3758015551 wait complete. 2024-09-21T10:52:51.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 32 2024-09-21T10:52:52.001 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:52.396 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:52 smithi060 ceph-mon[93270]: pgmap v334: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:52.396 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:52 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3758015551' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T10:52:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:52 smithi112 ceph-mon[78695]: pgmap v334: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:52.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:52 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3758015551' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T10:52:53.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 -- 172.21.15.60:0/3786432498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc00ffda0 msgr2=0x7fbfc0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:53.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 --2- 172.21.15.60:0/3786432498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc00ffda0 0x7fbfc0100180 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009880 tx=0x7fbfbc02a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:53.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 -- 172.21.15.60:0/3786432498 shutdown_connections 2024-09-21T10:52:53.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 --2- 172.21.15.60:0/3786432498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfc0100750 0x7fbfc01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:53.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 --2- 172.21.15.60:0/3786432498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc00ffda0 0x7fbfc0100180 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 -- 172.21.15.60:0/3786432498 >> 172.21.15.60:0/3786432498 conn(0x7fbfc00fb840 msgr2=0x7fbfc00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 -- 172.21.15.60:0/3786432498 shutdown_connections 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.896+0000 7fbfc7301640 1 -- 172.21.15.60:0/3786432498 wait complete. 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc7301640 1 Processor -- start 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc7301640 1 -- start start 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc7301640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfc00ffda0 0x7fbfc00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:53.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc7301640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 0x7fbfc0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc7301640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0073230 con 0x7fbfc0100750 2024-09-21T10:52:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc7301640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc0073370 con 0x7fbfc00ffda0 2024-09-21T10:52:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc489c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 0x7fbfc0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc489c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 0x7fbfc0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60648/0 (socket says 172.21.15.60:60648) 2024-09-21T10:52:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc489c640 1 -- 172.21.15.60:0/2888324831 learned_addr learned my addr 172.21.15.60:0/2888324831 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.897+0000 7fbfc509d640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfc00ffda0 0x7fbfc00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfc489c640 1 -- 172.21.15.60:0/2888324831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfc00ffda0 msgr2=0x7fbfc00727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfc489c640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfc00ffda0 0x7fbfc00727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfc489c640 1 -- 172.21.15.60:0/2888324831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc009560 con 0x7fbfc0100750 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfc489c640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 0x7fbfc0072cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400e970 tx=0x7fbfb400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfb400cc90 con 0x7fbfc0100750 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfb400cdf0 con 0x7fbfc0100750 2024-09-21T10:52:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc01a1db0 con 0x7fbfc0100750 2024-09-21T10:52:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfb4010430 con 0x7fbfc0100750 2024-09-21T10:52:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.898+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc01a21c0 con 0x7fbfc0100750 2024-09-21T10:52:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.899+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc0101280 con 0x7fbfc0100750 2024-09-21T10:52:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.900+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fbfb40046c0 con 0x7fbfc0100750 2024-09-21T10:52:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.900+0000 7fbfb27fc640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbfac07b270 0x7fbfac07d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.900+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbfb4014070 con 0x7fbfc0100750 2024-09-21T10:52:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.901+0000 7fbfc509d640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbfac07b270 0x7fbfac07d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.901+0000 7fbfc509d640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbfac07b270 0x7fbfac07d730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009230 tx=0x7fbfbc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:53.905+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fbfb4061900 con 0x7fbfc0100750 2024-09-21T10:52:54.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.137+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fbfc0100180 con 0x7fbfc0100750 2024-09-21T10:52:54.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.137+0000 7fbfb27fc640 1 -- 172.21.15.60:0/2888324831 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+4396 (secure 0 0 0) 0x7fbfb4064a20 con 0x7fbfc0100750 2024-09-21T10:52:54.141 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:54.141 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"btime":"2024-09-21T10:48:36:075955+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44343,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1825608898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1825608898},{"type":"v1","addr":"172.21.15.112:6825","nonce":1825608898}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:35.607527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:54.141 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 32 2024-09-21T10:52:54.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbfac07b270 msgr2=0x7fbfac07d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:54.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbfac07b270 0x7fbfac07d730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009230 tx=0x7fbfbc005a20 comp rx=0 tx=0).stop 2024-09-21T10:52:54.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 msgr2=0x7fbfc0072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 0x7fbfc0072cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400e970 tx=0x7fbfb400ed70 comp rx=0 tx=0).stop 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 shutdown_connections 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fbfac07b270 0x7fbfac07d730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfc0100750 0x7fbfc0072cf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 --2- 172.21.15.60:0/2888324831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfc00ffda0 0x7fbfc00727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 >> 172.21.15.60:0/2888324831 conn(0x7fbfc00fb840 msgr2=0x7fbfc00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 shutdown_connections 2024-09-21T10:52:54.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:54.140+0000 7fbfc7301640 1 -- 172.21.15.60:0/2888324831 wait complete. 2024-09-21T10:52:54.431 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:54 smithi060 ceph-mon[93270]: pgmap v335: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:54.451 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:54 smithi112 ceph-mon[78695]: pgmap v335: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:54.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 33 2024-09-21T10:52:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:55.386 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:55 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/2888324831' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T10:52:55.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:55 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/2888324831' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T10:52:56.412 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:56 smithi060 ceph-mon[93270]: pgmap v336: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:56.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:56 smithi112 ceph-mon[78695]: pgmap v336: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:56.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 -- 172.21.15.60:0/252770742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 msgr2=0x7f501c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 --2- 172.21.15.60:0/252770742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c1047a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5010009880 tx=0x7f501002a4a0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 -- 172.21.15.60:0/252770742 shutdown_connections 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 --2- 172.21.15.60:0/252770742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c1047a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 --2- 172.21.15.60:0/252770742 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 0x7f501c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 -- 172.21.15.60:0/252770742 >> 172.21.15.60:0/252770742 conn(0x7f501c0fb840 msgr2=0x7f501c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 -- 172.21.15.60:0/252770742 shutdown_connections 2024-09-21T10:52:56.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.703+0000 7f50228b9640 1 -- 172.21.15.60:0/252770742 wait complete. 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.704+0000 7f50228b9640 1 Processor -- start 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.704+0000 7f50228b9640 1 -- start start 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.704+0000 7f50228b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 0x7f501c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.704+0000 7f50228b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.704+0000 7f50228b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c19c380 con 0x7f501c100750 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f50228b9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c195910 con 0x7f501c0ffda0 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33328/0 (socket says 172.21.15.60:33328) 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 -- 172.21.15.60:0/3688004128 learned_addr learned my addr 172.21.15.60:0/3688004128 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501bfff640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 0x7f501c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 -- 172.21.15.60:0/3688004128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 msgr2=0x7f501c19b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:56.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 0x7f501c19b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 -- 172.21.15.60:0/3688004128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010009560 con 0x7f501c100750 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501bfff640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 0x7f501c19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f501b7fe640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c19bd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f501002a9c0 tx=0x7f50100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5010004aa0 con 0x7f501c100750 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5010004c00 con 0x7f501c100750 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.705+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c195b90 con 0x7f501c100750 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.706+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5010003980 con 0x7f501c100750 2024-09-21T10:52:56.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.706+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c196080 con 0x7f501c100750 2024-09-21T10:52:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.707+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c101280 con 0x7f501c100750 2024-09-21T10:52:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.707+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f5010003bf0 con 0x7f501c100750 2024-09-21T10:52:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.708+0000 7f50197fa640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f500407b270 0x7f500407d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.708+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f50100bf4e0 con 0x7f501c100750 2024-09-21T10:52:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.708+0000 7f501bfff640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f500407b270 0x7f500407d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:56.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.708+0000 7f501bfff640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f500407b270 0x7f500407d730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f500c005fd0 tx=0x7f500c00b5f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:56.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.712+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f50100823f0 con 0x7f501c100750 2024-09-21T10:52:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.936+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f501c1080b0 con 0x7f501c100750 2024-09-21T10:52:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.937+0000 7f50197fa640 1 -- 172.21.15.60:0/3688004128 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+4393 (secure 0 0 0) 0x7f5010085510 con 0x7f501c100750 2024-09-21T10:52:56.939 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T10:52:56.939 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":33,"btime":"2024-09-21T10:48:37:081507+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi060.lljnqu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6829/3518934014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3518934014},{"type":"v1","addr":"172.21.15.60:6829","nonce":3518934014}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44343,"name":"cephfs.smithi112.worwat","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6825/1825608898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":1825608898},{"type":"v1","addr":"172.21.15.112:6825","nonce":1825608898}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T10:38:10.995498+0000","modified":"2024-09-21T10:48:36.083275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34402},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34402":{"gid":34402,"name":"cephfs.smithi060.xjabvh","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.60:6827/684433833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":684433833},{"type":"v1","addr":"172.21.15.60:6827","nonce":684433833}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T10:52:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 33 2024-09-21T10:52:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f500407b270 msgr2=0x7f500407d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f500407b270 0x7f500407d730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f500c005fd0 tx=0x7f500c00b5f0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 msgr2=0x7f501c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c19bd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f501002a9c0 tx=0x7f50100055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 shutdown_connections 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f500407b270 0x7f500407d730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f501c100750 0x7f501c19bd60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 --2- 172.21.15.60:0/3688004128 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f501c0ffda0 0x7f501c19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 >> 172.21.15.60:0/3688004128 conn(0x7f501c0fb840 msgr2=0x7f501c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 shutdown_connections 2024-09-21T10:52:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:56.939+0000 7f50228b9640 1 -- 172.21.15.60:0/3688004128 wait complete. 2024-09-21T10:52:57.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:57 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/3688004128' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T10:52:57.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:57 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/3688004128' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T10:52:57.610 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T10:52:57.621 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T10:52:57.621 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:52:57.621 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T10:52:57.641 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T10:52:57.641 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T10:52:57.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T10:52:57.949 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:52:58.395 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:58 smithi060 ceph-mon[93270]: pgmap v337: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:58.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:58 smithi112 ceph-mon[78695]: pgmap v337: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:52:59.200 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:52:59 smithi112 ceph-mon[78695]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:59.385 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:52:59 smithi060 ceph-mon[93270]: from='mgr.34104 172.21.15.60:0/1391117865' entity='mgr.smithi060.mulzpr' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 -- 172.21.15.60:0/3403069872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 msgr2=0x7f108c101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 --2- 172.21.15.60:0/3403069872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c101090 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1084009880 tx=0x7f108402a530 comp rx=0 tx=0).stop 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 -- 172.21.15.60:0/3403069872 shutdown_connections 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 --2- 172.21.15.60:0/3403069872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f108c1015d0 0x7f108c109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 --2- 172.21.15.60:0/3403069872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c101090 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 -- 172.21.15.60:0/3403069872 >> 172.21.15.60:0/3403069872 conn(0x7f108c0758a0 msgr2=0x7f108c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 -- 172.21.15.60:0/3403069872 shutdown_connections 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 -- 172.21.15.60:0/3403069872 wait complete. 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.603+0000 7f10913a4640 1 Processor -- start 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f10913a4640 1 -- start start 2024-09-21T10:52:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f10913a4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c0fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f10913a4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f108c1015d0 0x7f108c0fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f10913a4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0ff390 con 0x7f108c100cb0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f10913a4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0ff500 con 0x7f108c1015d0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c0fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c0fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33350/0 (socket says 172.21.15.60:33350) 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 -- 172.21.15.60:0/37595183 learned_addr learned my addr 172.21.15.60:0/37595183 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 -- 172.21.15.60:0/37595183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f108c1015d0 msgr2=0x7f108c0fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108a7fc640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f108c1015d0 0x7f108c0fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f108c1015d0 0x7f108c0fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 -- 172.21.15.60:0/37595183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009560 con 0x7f108c100cb0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.604+0000 7f108affd640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c0fe910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1084006010 tx=0x7f10840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.605+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10840048d0 con 0x7f108c100cb0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.605+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1084031640 con 0x7f108c100cb0 2024-09-21T10:52:59.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.605+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c0ff780 con 0x7f108c100cb0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.605+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1084003820 con 0x7f108c100cb0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.605+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c1a1f60 con 0x7f108c100cb0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.606+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c068510 con 0x7f108c100cb0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.606+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7f108402ad50 con 0x7f108c100cb0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.607+0000 7f1083fff640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f107807b270 0x7f107807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.607+0000 7f108a7fc640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f107807b270 0x7f107807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.607+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f10840bf000 con 0x7f108c100cb0 2024-09-21T10:52:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.608+0000 7f108a7fc640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f107807b270 0x7f107807d730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f108c100090 tx=0x7f1074005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:52:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.612+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7f1084081f10 con 0x7f108c100cb0 2024-09-21T10:52:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.828+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f108c0ff780 con 0x7f108c100cb0 2024-09-21T10:52:59.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.828+0000 7f1083fff640 1 -- 172.21.15.60:0/37595183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 45 entries v83) v1 ==== 81+0+2675 (secure 0 0 0) 0x7f108c0ff780 con 0x7f108c100cb0 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6826/3978606848 2024-09-22T10:48:28.709780+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6824/603063981 2024-09-22T10:48:07.117371+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6825/603063981 2024-09-22T10:48:07.117371+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6828/4161459268 2024-09-22T10:47:43.474986+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2022102524 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1955530480 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1665555180 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/73049205 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2595991099 2024-09-22T10:40:32.330846+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3622691260 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1074459672 2024-09-22T10:31:36.919711+0000 2024-09-21T10:52:59.831 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/4032399424 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/1402296828 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/2655853111 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1375438723 2024-09-22T10:32:37.452284+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3334685987 2024-09-22T10:31:36.919711+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6827/1450096155 2024-09-22T10:38:25.437478+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6829/2321701771 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6827/3978606848 2024-09-22T10:48:28.709780+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1365116952 2024-09-22T10:40:32.330846+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1846043547 2024-09-22T10:40:32.330846+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/194909203 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1994264567 2024-09-22T10:40:32.330846+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1631962843 2024-09-22T10:32:37.452284+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3364675318 2024-09-22T10:32:37.452284+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6829/4161459268 2024-09-22T10:47:43.474986+0000 2024-09-21T10:52:59.832 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6826/1450096155 2024-09-22T10:38:25.437478+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/3202839814 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1410574713 2024-09-22T10:31:05.936397+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2185187485 2024-09-22T10:31:36.919711+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3064083016 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2957889149 2024-09-22T10:31:05.936397+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1665555180 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3611925388 2024-09-22T10:31:05.936397+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6828/2321701771 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1365116952 2024-09-22T10:40:32.330846+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2300592546 2024-09-22T10:32:37.452284+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1152707410 2024-09-22T10:31:36.919711+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4213874648 2024-09-22T10:31:05.936397+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1152707410 2024-09-22T10:31:36.919711+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4213874648 2024-09-22T10:31:05.936397+0000 2024-09-21T10:52:59.833 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3248589549 2024-09-22T10:40:32.330846+0000 2024-09-21T10:52:59.834 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1631962843 2024-09-22T10:32:37.452284+0000 2024-09-21T10:52:59.834 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1181833058 2024-09-22T10:42:58.255610+0000 2024-09-21T10:52:59.834 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/60563177 2024-09-22T10:41:56.262613+0000 2024-09-21T10:52:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:listed 45 entries 2024-09-21T10:52:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f107807b270 msgr2=0x7f107807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f107807b270 0x7f107807d730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f108c100090 tx=0x7f1074005f90 comp rx=0 tx=0).stop 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 msgr2=0x7f108c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c0fe910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1084006010 tx=0x7f10840055a0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 shutdown_connections 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7f107807b270 0x7f107807d730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f108c1015d0 0x7f108c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 --2- 172.21.15.60:0/37595183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f108c100cb0 0x7f108c0fe910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 >> 172.21.15.60:0/37595183 conn(0x7f108c0758a0 msgr2=0x7f108c101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 shutdown_connections 2024-09-21T10:52:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:52:59.831+0000 7f10913a4640 1 -- 172.21.15.60:0/37595183 wait complete. 2024-09-21T10:53:00.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:00 smithi060 ceph-mon[93270]: pgmap v338: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:53:00.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:00 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/37595183' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T10:53:00.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:00 smithi112 ceph-mon[78695]: pgmap v338: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:53:00.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:00 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/37595183' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T10:53:00.471 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T10:53:00.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:00.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T10:53:00.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:53:00.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:00.502 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T10:53:00.568 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:53:00.569 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T10:53:00.589 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-21T10:53:00.589 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T10:53:00.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 6621b92e-7804-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T10:53:00.857 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/mon.smithi060/config 2024-09-21T10:53:02.368 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:02 smithi060 ceph-mon[93270]: pgmap v339: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:53:02.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:02 smithi112 ceph-mon[78695]: pgmap v339: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-21T10:53:02.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/2556990197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0100c50 msgr2=0x7fc2f0101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:53:02.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/2556990197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0100c50 0x7fc2f0101030 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00098b0 tx=0x7fc2e002a4d0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/2556990197 shutdown_connections 2024-09-21T10:53:02.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/2556990197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0101600 0x7fc2f0109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/2556990197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0100c50 0x7fc2f0101030 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/2556990197 >> 172.21.15.60:0/2556990197 conn(0x7fc2f00fa700 msgr2=0x7fc2f00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/2556990197 shutdown_connections 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.600+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/2556990197 wait complete. 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2f5fe9640 1 Processor -- start 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2f5fe9640 1 -- start start 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2f5fe9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0100c50 0x7fc2f00fe940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2f5fe9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 0x7fc2f00fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2f5fe9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00ff3c0 con 0x7fc2f0101600 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2f5fe9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00ff530 con 0x7fc2f0100c50 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2eeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 0x7fc2f00fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2eeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 0x7fc2f00fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33364/0 (socket says 172.21.15.60:33364) 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2eeffd640 1 -- 172.21.15.60:0/209751735 learned_addr learned my addr 172.21.15.60:0/209751735 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T10:53:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.601+0000 7fc2ef7fe640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0100c50 0x7fc2f00fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2eeffd640 1 -- 172.21.15.60:0/209751735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0100c50 msgr2=0x7fc2f00fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2eeffd640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0100c50 0x7fc2f00fe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2eeffd640 1 -- 172.21.15.60:0/209751735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009560 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2ef7fe640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0100c50 0x7fc2f00fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2eeffd640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 0x7fc2f00fee80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400b420 tx=0x7fc2e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e4011800 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2e4011e20 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f01a1dc0 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e400f2e0 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.602+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f01a2120 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.603+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f0068d30 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.604+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 38) v1 ==== 103320+0+0 (secure 0 0 0) 0x7fc2e4010380 con 0x7fc2f0101600 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.604+0000 7fc2ecff9640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc2d807b270 0x7fc2d807d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T10:53:02.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.604+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc2e409dbd0 con 0x7fc2f0101600 2024-09-21T10:53:02.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.604+0000 7fc2ef7fe640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc2d807b270 0x7fc2d807d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T10:53:02.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.605+0000 7fc2ef7fe640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc2d807b270 0x7fc2d807d730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0006010 tx=0x7fc2e0005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T10:53:02.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.609+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+198400 (secure 0 0 0) 0x7fc2e4060b60 con 0x7fc2f0101600 2024-09-21T10:53:02.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.819+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2f00ff6f0 con 0x7fc2f0101600 2024-09-21T10:53:02.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.819+0000 7fc2ecff9640 1 -- 172.21.15.60:0/209751735 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 45 entries v83) v1 ==== 81+0+2675 (secure 0 0 0) 0x7fc2e4063c80 con 0x7fc2f0101600 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6826/3978606848 2024-09-22T10:48:28.709780+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6824/603063981 2024-09-22T10:48:07.117371+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6825/603063981 2024-09-22T10:48:07.117371+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6828/4161459268 2024-09-22T10:47:43.474986+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2022102524 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1955530480 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1665555180 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/73049205 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2595991099 2024-09-22T10:40:32.330846+0000 2024-09-21T10:53:02.822 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3622691260 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1074459672 2024-09-22T10:31:36.919711+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/4032399424 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/1402296828 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/2655853111 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1375438723 2024-09-22T10:32:37.452284+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3334685987 2024-09-22T10:31:36.919711+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6827/1450096155 2024-09-22T10:38:25.437478+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6829/2321701771 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6827/3978606848 2024-09-22T10:48:28.709780+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1365116952 2024-09-22T10:40:32.330846+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1846043547 2024-09-22T10:40:32.330846+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/194909203 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1994264567 2024-09-22T10:40:32.330846+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1631962843 2024-09-22T10:32:37.452284+0000 2024-09-21T10:53:02.823 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3364675318 2024-09-22T10:32:37.452284+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6829/4161459268 2024-09-22T10:47:43.474986+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6826/1450096155 2024-09-22T10:38:25.437478+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/3202839814 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1410574713 2024-09-22T10:31:05.936397+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2185187485 2024-09-22T10:31:36.919711+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3064083016 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2957889149 2024-09-22T10:31:05.936397+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1665555180 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3611925388 2024-09-22T10:31:05.936397+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:6828/2321701771 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.824 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1365116952 2024-09-22T10:40:32.330846+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2300592546 2024-09-22T10:32:37.452284+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1152707410 2024-09-22T10:31:36.919711+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/4213874648 2024-09-22T10:31:05.936397+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1152707410 2024-09-22T10:31:36.919711+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/4213874648 2024-09-22T10:31:05.936397+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3248589549 2024-09-22T10:40:32.330846+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1631962843 2024-09-22T10:32:37.452284+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1181833058 2024-09-22T10:42:58.255610+0000 2024-09-21T10:53:02.825 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.112:0/60563177 2024-09-22T10:41:56.262613+0000 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:listed 45 entries 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc2d807b270 msgr2=0x7fc2d807d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc2d807b270 0x7fc2d807d730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0006010 tx=0x7fc2e0005e60 comp rx=0 tx=0).stop 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 msgr2=0x7fc2f00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 0x7fc2f00fee80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400b420 tx=0x7fc2e400b8e0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 shutdown_connections 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:6800/588982991,v1:172.21.15.60:6801/588982991] conn(0x7fc2d807b270 0x7fc2d807d730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0101600 0x7fc2f00fee80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 --2- 172.21.15.60:0/209751735 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2f0100c50 0x7fc2f00fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T10:53:02.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.822+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 >> 172.21.15.60:0/209751735 conn(0x7fc2f00fa700 msgr2=0x7fc2f0101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T10:53:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.823+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 shutdown_connections 2024-09-21T10:53:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T10:53:02.823+0000 7fc2f5fe9640 1 -- 172.21.15.60:0/209751735 wait complete. 2024-09-21T10:53:03.448 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:03 smithi060 ceph-mon[93270]: from='client.? 172.21.15.60:0/209751735' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T10:53:03.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:03 smithi112 ceph-mon[78695]: from='client.? 172.21.15.60:0/209751735' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T10:53:03.676 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T10:53:03.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.677 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T10:53:03.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T10:53:03.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.711 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T10:53:03.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.782 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-21T10:53:03.802 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T10:53:03.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T10:53:03.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-21T10:53:03.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.977 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-21T10:53:03.994 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T10:53:03.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:03.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T10:53:04.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T10:53:04.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-21T10:53:04.156 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T10:53:04.167 INFO:tasks.cephadm:Teardown begin 2024-09-21T10:53:04.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:53:04.194 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:04 smithi060 ceph-mon[93270]: pgmap v340: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:53:04.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:53:04.224 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T10:53:04.225 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T10:53:04.256 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T10:53:04.280 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T10:53:04.280 INFO:tasks.cephadm.mon.smithi060:Stopping mon.smithi060... 2024-09-21T10:53:04.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060 2024-09-21T10:53:04.449 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:04 smithi060 systemd[1]: Stopping Ceph mon.smithi060 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:04.450 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:04 smithi112 ceph-mon[78695]: pgmap v340: 65 pgs: 65 active+clean; 195 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-21T10:53:04.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:04 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[93266]: 2024-09-21T10:53:04.617+0000 7fc0695a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi060 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:04.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:04 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060[93266]: 2024-09-21T10:53:04.617+0000 7fc0695a6640 -1 mon.smithi060@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T10:53:04.885 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:04 smithi060 podman[152333]: 2024-09-21 10:53:04.823018228 +0000 UTC m=+0.320421279 container died 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T10:53:05.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:05 smithi060 podman[152333]: 2024-09-21 10:53:05.243592549 +0000 UTC m=+0.740995592 container cleanup 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T10:53:05.537 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:05 smithi060 bash[152333]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060 2024-09-21T10:53:05.538 INFO:journalctl@ceph.mon.smithi060.smithi060.stdout:Sep 21 10:53:05 smithi060 podman[152346]: 2024-09-21 10:53:05.461801042 +0000 UTC m=+0.629005870 container remove 94cb96b350ae64d7e059aeea9337daf47fd1f764b2c616b9dd5fc97dc1d6a2e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi060, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T10:53:05.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi060.service' 2024-09-21T10:53:05.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:05.767 INFO:tasks.cephadm.mon.smithi060:Stopped mon.smithi060 2024-09-21T10:53:05.767 INFO:tasks.cephadm.mon.smithi112:Stopping mon.smithi112... 2024-09-21T10:53:05.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112 2024-09-21T10:53:06.064 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:05 smithi112 systemd[1]: Stopping Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:06.319 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:06 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112[78691]: 2024-09-21T10:53:06.062+0000 7fb253af1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi112 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:06.319 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:06 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112[78691]: 2024-09-21T10:53:06.062+0000 7fb253af1640 -1 mon.smithi112@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T10:53:06.615 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:06 smithi112 podman[117556]: 2024-09-21 10:53:06.317809092 +0000 UTC m=+0.358274381 container died 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T10:53:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:06 smithi112 podman[117556]: 2024-09-21 10:53:06.787916151 +0000 UTC m=+0.828381443 container cleanup 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:06.950 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:06 smithi112 bash[117556]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112 2024-09-21T10:53:07.213 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112.service' 2024-09-21T10:53:07.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:06 smithi112 podman[117569]: 2024-09-21 10:53:06.972741139 +0000 UTC m=+0.650860165 container remove 9d9e84bb6909950ea89dfb2757a29a093c46a2ba45d7120d9f07dc1f15e5bf71 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-mon-smithi112, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T10:53:07.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:07 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112.service: Deactivated successfully. 2024-09-21T10:53:07.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:07 smithi112 systemd[1]: Stopped Ceph mon.smithi112 for 6621b92e-7804-11ef-baf6-efdc52797490. 2024-09-21T10:53:07.235 INFO:journalctl@ceph.mon.smithi112.smithi112.stdout:Sep 21 10:53:07 smithi112 systemd[1]: ceph-6621b92e-7804-11ef-baf6-efdc52797490@mon.smithi112.service: Consumed 5.735s CPU time. 2024-09-21T10:53:07.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:07.272 INFO:tasks.cephadm.mon.smithi112:Stopped mon.smithi112 2024-09-21T10:53:07.272 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T10:53:07.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.0 2024-09-21T10:53:07.583 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:07 smithi060 systemd[1]: Stopping Ceph osd.0 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:07.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:07 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[101041]: 2024-09-21T10:53:07.581+0000 7f442b76b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:07.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:07 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[101041]: 2024-09-21T10:53:07.581+0000 7f442b76b640 -1 osd.0 83 *** Got signal Terminated *** 2024-09-21T10:53:07.949 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:07 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0[101041]: 2024-09-21T10:53:07.581+0000 7f442b76b640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:53:13.244 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:12 smithi060 podman[152464]: 2024-09-21 10:53:12.969017155 +0000 UTC m=+5.496116928 container died 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T10:53:13.560 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:13 smithi060 podman[152464]: 2024-09-21 10:53:13.314995561 +0000 UTC m=+5.842095332 container cleanup 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T10:53:13.560 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:13 smithi060 bash[152464]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0 2024-09-21T10:53:13.948 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:13 smithi060 podman[152492]: 2024-09-21 10:53:13.558540652 +0000 UTC m=+0.586863524 container remove 45dffb9af19ad18459d9ec4fc40d82e46b218932d059dc287f490c5cc6b9c33d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T10:53:14.263 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:14 smithi060 podman[152582]: 2024-09-21 10:53:14.001141544 +0000 UTC m=+0.113441590 container create 276b1bfb1029c77de954400722aa3906b50e0022874b582b1c3b5f0a4393a11c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:14.263 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:14 smithi060 podman[152582]: 2024-09-21 10:53:13.904725029 +0000 UTC m=+0.017025088 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:53:14.263 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:14 smithi060 podman[152582]: 2024-09-21 10:53:14.262112304 +0000 UTC m=+0.374412363 container init 276b1bfb1029c77de954400722aa3906b50e0022874b582b1c3b5f0a4393a11c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T10:53:14.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:14 smithi060 podman[152582]: 2024-09-21 10:53:14.266072459 +0000 UTC m=+0.378372514 container start 276b1bfb1029c77de954400722aa3906b50e0022874b582b1c3b5f0a4393a11c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T10:53:14.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:14 smithi060 podman[152582]: 2024-09-21 10:53:14.345395448 +0000 UTC m=+0.457695512 container attach 276b1bfb1029c77de954400722aa3906b50e0022874b582b1c3b5f0a4393a11c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:14.699 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 10:53:14 smithi060 podman[152582]: 2024-09-21 10:53:14.461359414 +0000 UTC m=+0.573659478 container died 276b1bfb1029c77de954400722aa3906b50e0022874b582b1c3b5f0a4393a11c (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:15.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T10:53:15.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:15.125 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T10:53:15.125 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T10:53:15.125 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.1 2024-09-21T10:53:15.446 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:15 smithi060 systemd[1]: Stopping Ceph osd.1 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:15.698 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:15 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[106453]: 2024-09-21T10:53:15.444+0000 7fd24a37f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:15.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:15 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[106453]: 2024-09-21T10:53:15.444+0000 7fd24a37f640 -1 osd.1 83 *** Got signal Terminated *** 2024-09-21T10:53:15.699 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:15 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1[106453]: 2024-09-21T10:53:15.444+0000 7fd24a37f640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:53:21.056 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:20 smithi060 podman[152686]: 2024-09-21 10:53:20.7952166 +0000 UTC m=+5.447599089 container died 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:21.422 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:21 smithi060 podman[152686]: 2024-09-21 10:53:21.152673254 +0000 UTC m=+5.805055731 container cleanup 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T10:53:21.422 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:21 smithi060 bash[152686]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1 2024-09-21T10:53:21.698 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:21 smithi060 podman[152701]: 2024-09-21 10:53:21.420707651 +0000 UTC m=+0.619963799 container remove 2a6c2dd790d362ec468ea7e09b3e947395186897168504f4795eb7cb9d148a32 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T10:53:22.092 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:21 smithi060 podman[152789]: 2024-09-21 10:53:21.682809209 +0000 UTC m=+0.016680020 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:53:22.093 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:21 smithi060 podman[152789]: 2024-09-21 10:53:21.805231636 +0000 UTC m=+0.139102448 container create 36b0d4125055892ca83525bad4452eb4b592bfa9c2dbe65f761e787914543b41 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T10:53:22.093 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:22 smithi060 podman[152789]: 2024-09-21 10:53:22.016632278 +0000 UTC m=+0.350503096 container init 36b0d4125055892ca83525bad4452eb4b592bfa9c2dbe65f761e787914543b41 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T10:53:22.093 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:22 smithi060 podman[152789]: 2024-09-21 10:53:22.020594945 +0000 UTC m=+0.354465762 container start 36b0d4125055892ca83525bad4452eb4b592bfa9c2dbe65f761e787914543b41 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:22.093 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:22 smithi060 podman[152789]: 2024-09-21 10:53:22.091276622 +0000 UTC m=+0.425147444 container attach 36b0d4125055892ca83525bad4452eb4b592bfa9c2dbe65f761e787914543b41 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:22.449 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 10:53:22 smithi060 podman[152812]: 2024-09-21 10:53:22.244367628 +0000 UTC m=+0.017247817 container died 36b0d4125055892ca83525bad4452eb4b592bfa9c2dbe65f761e787914543b41 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T10:53:22.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T10:53:22.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:22.862 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T10:53:22.862 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T10:53:22.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.2 2024-09-21T10:53:23.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:22 smithi060 systemd[1]: Stopping Ceph osd.2 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:23.698 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:23 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[111961]: 2024-09-21T10:53:23.222+0000 7fe1f4017640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:23.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:23 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[111961]: 2024-09-21T10:53:23.222+0000 7fe1f4017640 -1 osd.2 83 *** Got signal Terminated *** 2024-09-21T10:53:23.699 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:23 smithi060 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2[111961]: 2024-09-21T10:53:23.222+0000 7fe1f4017640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:53:28.867 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:28 smithi060 podman[152893]: 2024-09-21 10:53:28.614388425 +0000 UTC m=+5.515895279 container died 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:29.126 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:28 smithi060 podman[152893]: 2024-09-21 10:53:28.939523534 +0000 UTC m=+5.841030388 container cleanup 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T10:53:29.126 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:28 smithi060 bash[152893]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2 2024-09-21T10:53:29.448 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:29 smithi060 podman[152907]: 2024-09-21 10:53:29.124266957 +0000 UTC m=+0.506173433 container remove 49baa994e878f2c724628cb4d4d98fb2d381ba68c50f2088ee4150c3f308c613 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:29.837 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:29 smithi060 podman[152996]: 2024-09-21 10:53:29.47494953 +0000 UTC m=+0.017323297 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:53:29.837 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:29 smithi060 podman[152996]: 2024-09-21 10:53:29.591902733 +0000 UTC m=+0.134276530 container create bcfdedad75ab0fba65faca316bd5ddb892e55cbe57605c7b1815ed970b44a1d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:29.837 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:29 smithi060 podman[152996]: 2024-09-21 10:53:29.836206477 +0000 UTC m=+0.378580239 container init bcfdedad75ab0fba65faca316bd5ddb892e55cbe57605c7b1815ed970b44a1d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T10:53:30.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:29 smithi060 podman[152996]: 2024-09-21 10:53:29.839791317 +0000 UTC m=+0.382165070 container start bcfdedad75ab0fba65faca316bd5ddb892e55cbe57605c7b1815ed970b44a1d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T10:53:30.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:29 smithi060 podman[152996]: 2024-09-21 10:53:29.961141215 +0000 UTC m=+0.503514971 container attach bcfdedad75ab0fba65faca316bd5ddb892e55cbe57605c7b1815ed970b44a1d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T10:53:30.199 INFO:journalctl@ceph.osd.2.smithi060.stdout:Sep 21 10:53:30 smithi060 podman[153019]: 2024-09-21 10:53:30.059157787 +0000 UTC m=+0.017538140 container died bcfdedad75ab0fba65faca316bd5ddb892e55cbe57605c7b1815ed970b44a1d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:30.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T10:53:30.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:30.700 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T10:53:30.700 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T10:53:30.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.3 2024-09-21T10:53:31.061 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:30 smithi112 systemd[1]: Stopping Ceph osd.3 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:31.450 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:31 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:53:31.058+0000 7f2ef6279640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:31.450 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:31 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:53:31.058+0000 7f2ef6279640 -1 osd.3 83 *** Got signal Terminated *** 2024-09-21T10:53:31.450 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:31 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:53:31.058+0000 7f2ef6279640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:53:34.700 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:34 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:53:34.573+0000 7f2eee886640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:08.912661+0000 front 2024-09-21T10:53:08.912600+0000 (oldest deadline 2024-09-21T10:53:33.612458+0000) 2024-09-21T10:53:35.436 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:35 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:35.096+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:35.700 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:35 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3[87865]: 2024-09-21T10:53:35.530+0000 7f2eee886640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:08.912661+0000 front 2024-09-21T10:53:08.912600+0000 (oldest deadline 2024-09-21T10:53:33.612458+0000) 2024-09-21T10:53:35.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:35 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:35.449+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:36.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:36 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:36.119+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:36.762 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:36 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:36.463+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:36.762 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:36 smithi112 podman[117699]: 2024-09-21 10:53:36.500366016 +0000 UTC m=+5.600243647 container died 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:37.122 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:36 smithi112 podman[117699]: 2024-09-21 10:53:36.934381463 +0000 UTC m=+6.034259090 container cleanup 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:37.122 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:36 smithi112 bash[117699]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3 2024-09-21T10:53:37.443 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117718]: 2024-09-21 10:53:37.152526571 +0000 UTC m=+0.645814640 container remove 07df4ec59ea3c1f0c3f6bb5740919bd658ead28dff585cb8b50532f38d3cb036 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:37.443 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:37 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:37.120+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:37.711 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:37 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:37.440+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:37.711 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117809]: 2024-09-21 10:53:37.454974737 +0000 UTC m=+0.016720364 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:53:37.711 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117809]: 2024-09-21 10:53:37.561790961 +0000 UTC m=+0.123536573 container create dba17dcf2679c41ffc48f09eb39cb1177d807b19b569c2a6d9da03f09b5a50fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T10:53:37.977 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117809]: 2024-09-21 10:53:37.789322217 +0000 UTC m=+0.351067840 container init dba17dcf2679c41ffc48f09eb39cb1177d807b19b569c2a6d9da03f09b5a50fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T10:53:37.978 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117809]: 2024-09-21 10:53:37.792592549 +0000 UTC m=+0.354338170 container start dba17dcf2679c41ffc48f09eb39cb1177d807b19b569c2a6d9da03f09b5a50fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T10:53:37.978 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117809]: 2024-09-21 10:53:37.872581372 +0000 UTC m=+0.434326997 container attach dba17dcf2679c41ffc48f09eb39cb1177d807b19b569c2a6d9da03f09b5a50fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T10:53:38.321 INFO:journalctl@ceph.osd.3.smithi112.stdout:Sep 21 10:53:37 smithi112 podman[117809]: 2024-09-21 10:53:37.97612488 +0000 UTC m=+0.537870505 container died dba17dcf2679c41ffc48f09eb39cb1177d807b19b569c2a6d9da03f09b5a50fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:38.321 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:38 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:38.158+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:38.622 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:38 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:38.439+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:38.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T10:53:38.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:38.682 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T10:53:38.683 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T10:53:38.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.4 2024-09-21T10:53:38.911 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:38 smithi112 systemd[1]: Stopping Ceph osd.4 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:39.200 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:39.056+0000 7f74f4477640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:39.200 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:39.056+0000 7f74f4477640 -1 osd.4 83 *** Got signal Terminated *** 2024-09-21T10:53:39.200 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:39.056+0000 7f74f4477640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:53:39.200 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:39.143+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:39.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:39 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:39.392+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:40.451 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:40 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:40.143+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:40.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:40 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:40.343+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:41.451 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:41 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:41.150+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:41.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:41 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:41.358+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:42.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:42 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:42.155+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:42.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:42 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:42.351+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:43.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:43 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:43.107+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:10.012032+0000 front 2024-09-21T10:53:10.012042+0000 (oldest deadline 2024-09-21T10:53:34.711888+0000) 2024-09-21T10:53:43.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:43 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4[92773]: 2024-09-21T10:53:43.107+0000 7f74eca84640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:14.712338+0000 front 2024-09-21T10:53:14.712397+0000 (oldest deadline 2024-09-21T10:53:42.312603+0000) 2024-09-21T10:53:43.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:43 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:43.346+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:43.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:43 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:43.346+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:44.700 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:44 smithi112 podman[117914]: 2024-09-21 10:53:44.536667221 +0000 UTC m=+5.597926039 container died fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T10:53:44.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:44 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:44.333+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:44.701 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:44 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:44.333+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:45.160 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:44 smithi112 podman[117914]: 2024-09-21 10:53:44.974293019 +0000 UTC m=+6.035551836 container cleanup fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:45.161 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:44 smithi112 bash[117914]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4 2024-09-21T10:53:45.450 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[117941]: 2024-09-21 10:53:45.159215577 +0000 UTC m=+0.621496502 container remove fbcf09adc156929aa702ce457766e97284063e0a19bf91f866b386426dcf61da (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T10:53:45.450 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:45 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:45.284+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:45.451 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:45 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:45.284+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:45.892 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[118032]: 2024-09-21 10:53:45.560006188 +0000 UTC m=+0.108433109 container create 10be9a46408f7b39128a9f97f30ced1c7d74915632b04e5f2138b6978b8e99fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T10:53:45.892 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[118032]: 2024-09-21 10:53:45.467137715 +0000 UTC m=+0.015564651 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:53:45.892 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[118032]: 2024-09-21 10:53:45.779000344 +0000 UTC m=+0.327427281 container init 10be9a46408f7b39128a9f97f30ced1c7d74915632b04e5f2138b6978b8e99fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T10:53:45.892 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[118032]: 2024-09-21 10:53:45.78214628 +0000 UTC m=+0.330573202 container start 10be9a46408f7b39128a9f97f30ced1c7d74915632b04e5f2138b6978b8e99fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:45.892 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[118032]: 2024-09-21 10:53:45.889640785 +0000 UTC m=+0.438067710 container attach 10be9a46408f7b39128a9f97f30ced1c7d74915632b04e5f2138b6978b8e99fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T10:53:46.200 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 21 10:53:45 smithi112 podman[118032]: 2024-09-21 10:53:45.977103973 +0000 UTC m=+0.525530902 container died 10be9a46408f7b39128a9f97f30ced1c7d74915632b04e5f2138b6978b8e99fd (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T10:53:46.534 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:46 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:46.274+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:46.534 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:46 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:46.274+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:46.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T10:53:46.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:46.587 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T10:53:46.587 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T10:53:46.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.5 2024-09-21T10:53:46.929 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:46 smithi112 systemd[1]: Stopping Ceph osd.5 for 6621b92e-7804-11ef-baf6-efdc52797490... 2024-09-21T10:53:47.200 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:46 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:46.927+0000 7ff1f39b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T10:53:47.200 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:46 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:46.927+0000 7ff1f39b9640 -1 osd.5 83 *** Got signal Terminated *** 2024-09-21T10:53:47.200 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:46 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:46.927+0000 7ff1f39b9640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T10:53:47.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:47 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:47.301+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:47.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:47 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:47.301+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:48.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:48 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:48.276+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:48.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:48 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:48.276+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:49.552 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:49 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:49.293+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:49.553 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:49 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:49.293+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:50.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:50 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:50.312+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:50.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:50 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:50.312+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:50.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:50 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:50.312+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-09-21T10:53:25.207534+0000 front 2024-09-21T10:53:25.207540+0000 (oldest deadline 2024-09-21T10:53:49.907569+0000) 2024-09-21T10:53:51.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:51 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:51.272+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T10:53:12.406493+0000 front 2024-09-21T10:53:12.406589+0000 (oldest deadline 2024-09-21T10:53:34.706268+0000) 2024-09-21T10:53:51.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:51 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:51.272+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6814 osd.1 since back 2024-09-21T10:53:20.007161+0000 front 2024-09-21T10:53:20.007129+0000 (oldest deadline 2024-09-21T10:53:42.906836+0000) 2024-09-21T10:53:51.700 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:51 smithi112 ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5[97947]: 2024-09-21T10:53:51.272+0000 7ff1effce640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.60:6822 osd.2 since back 2024-09-21T10:53:25.207534+0000 front 2024-09-21T10:53:25.207540+0000 (oldest deadline 2024-09-21T10:53:49.907569+0000) 2024-09-21T10:53:52.671 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:52 smithi112 podman[118136]: 2024-09-21 10:53:52.403323484 +0000 UTC m=+5.596773196 container died deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:52.950 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:52 smithi112 podman[118136]: 2024-09-21 10:53:52.835699599 +0000 UTC m=+6.029149312 container cleanup deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T10:53:52.950 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:52 smithi112 bash[118136]: ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5 2024-09-21T10:53:53.450 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118153]: 2024-09-21 10:53:53.045451715 +0000 UTC m=+0.635896251 container remove deb9d465dea3767902dc85e038807a2d4b92c7ade7cb86f7b1cd7a757b44ea22 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T10:53:53.703 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118241]: 2024-09-21 10:53:53.354407187 +0000 UTC m=+0.015518896 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T10:53:53.703 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118241]: 2024-09-21 10:53:53.463039729 +0000 UTC m=+0.124151429 container create 1b3b1b98f6f6a622cd2bcbaf4024bb59d51cba3065166a188e817bc825aea1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2) 2024-09-21T10:53:53.703 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118241]: 2024-09-21 10:53:53.698725874 +0000 UTC m=+0.359837575 container init 1b3b1b98f6f6a622cd2bcbaf4024bb59d51cba3065166a188e817bc825aea1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T10:53:53.703 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118241]: 2024-09-21 10:53:53.70204676 +0000 UTC m=+0.363158460 container start 1b3b1b98f6f6a622cd2bcbaf4024bb59d51cba3065166a188e817bc825aea1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T10:53:54.200 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118241]: 2024-09-21 10:53:53.815772784 +0000 UTC m=+0.476884496 container attach 1b3b1b98f6f6a622cd2bcbaf4024bb59d51cba3065166a188e817bc825aea1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T10:53:54.200 INFO:journalctl@ceph.osd.5.smithi112.stdout:Sep 21 10:53:53 smithi112 podman[118241]: 2024-09-21 10:53:53.889323441 +0000 UTC m=+0.550435158 container died 1b3b1b98f6f6a622cd2bcbaf4024bb59d51cba3065166a188e817bc825aea1fe (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-6621b92e-7804-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T10:53:54.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6621b92e-7804-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T10:53:54.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T10:53:54.613 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T10:53:54.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6621b92e-7804-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T10:53:54.775 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:54:20.090 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6621b92e-7804-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T10:54:20.261 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:54:35.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:54:35.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T10:54:35.971 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T10:54:35.974 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803/remote/smithi060/crash 2024-09-21T10:54:35.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/crash -- . 2024-09-21T10:54:36.012 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T10:54:36.012 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-09-21T10:54:36.014 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803/remote/smithi112/crash 2024-09-21T10:54:36.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/crash -- . 2024-09-21T10:54:36.039 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/6621b92e-7804-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T10:54:36.039 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-09-21T10:54:36.040 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T10:54:36.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T10:54:36.095 INFO:tasks.cephadm:Compressing logs... 2024-09-21T10:54:36.095 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T10:54:36.137 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T10:54:36.161 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T10:54:36.162 INFO:teuthology.orchestra.run.smithi112.stderr:: No such file or directory 2024-09-21T10:54:36.162 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-volume.log: /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mgr.smithi112.gkunly.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi112.worwat.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mgr.smithi112.gkunly.log: /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi112.worwat.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.5.log: 85.9% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi112.log 2024-09-21T10:54:36.165 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi112.urlyzu.log 2024-09-21T10:54:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T10:54:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T10:54:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mgr.smithi060.mulzpr.log 2024-09-21T10:54:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi060.log 2024-09-21T10:54:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.0.log: /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mgr.smithi060.mulzpr.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T10:54:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi060.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T10:54:36.172 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi112.log: 91.7% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T10:54:36.172 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% 88.3% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T10:54:36.172 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi112.log.gzgzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T10:54:36.172 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-21T10:54:36.172 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi112.urlyzu.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mon.smithi112.log 2024-09-21T10:54:36.172 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.1.log: /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi060.lljnqu.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi060.xjabvh.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi060.lljnqu.log: 93.9%gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi060.log.gz 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi060.xjabvh.log: /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.cephadm.log: 86.9% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log 2024-09-21T10:54:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.2.log: 91.5% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T10:54:36.177 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mon.smithi060.log 2024-09-21T10:54:36.180 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log: 88.3% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T10:54:36.182 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mon.smithi112.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T10:54:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T10:54:36.187 INFO:teuthology.orchestra.run.smithi060.stderr: 91.4%/var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mon.smithi060.log: -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T10:54:36.188 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T10:54:36.208 INFO:teuthology.orchestra.run.smithi112.stderr: 89.0% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mgr.smithi112.gkunly.log.gz 2024-09-21T10:54:36.212 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/cephadm.log: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T10:54:36.564 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mgr.smithi060.mulzpr.log.gz 2024-09-21T10:54:36.570 INFO:teuthology.orchestra.run.smithi112.stderr: 92.5% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mon.smithi112.log.gz 2024-09-21T10:54:36.966 INFO:teuthology.orchestra.run.smithi060.stderr: 90.5% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mon.smithi060.log.gz 2024-09-21T10:54:40.564 INFO:teuthology.orchestra.run.smithi112.stderr: 93.5% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T10:54:41.660 INFO:teuthology.orchestra.run.smithi112.stderr: 94.9% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi112.urlyzu.log.gz 2024-09-21T10:54:41.823 INFO:teuthology.orchestra.run.smithi060.stderr: 93.5% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T10:54:42.169 INFO:teuthology.orchestra.run.smithi112.stderr: 93.6% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T10:54:42.312 INFO:teuthology.orchestra.run.smithi060.stderr: 93.6% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T10:54:42.768 INFO:teuthology.orchestra.run.smithi060.stderr: 93.7% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T10:54:42.797 INFO:teuthology.orchestra.run.smithi112.stderr: 94.9% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi112.worwat.log.gz 2024-09-21T10:54:43.392 INFO:teuthology.orchestra.run.smithi060.stderr: 94.8% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi060.xjabvh.log.gz 2024-09-21T10:54:43.681 INFO:teuthology.orchestra.run.smithi112.stderr: 93.6% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T10:54:43.683 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-21T10:54:43.683 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m7.531s 2024-09-21T10:54:43.683 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m29.462s 2024-09-21T10:54:43.683 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m1.035s 2024-09-21T10:56:10.239 INFO:teuthology.orchestra.run.smithi060.stderr: 92.5% -- replaced with /var/log/ceph/6621b92e-7804-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi060.lljnqu.log.gz 2024-09-21T10:56:10.240 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-21T10:56:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:real 1m34.089s 2024-09-21T10:56:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:user 1m57.434s 2024-09-21T10:56:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m3.281s 2024-09-21T10:56:10.241 INFO:tasks.cephadm:Archiving logs... 2024-09-21T10:56:10.241 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803/remote/smithi060/log 2024-09-21T10:56:10.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T10:56:26.448 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803/remote/smithi112/log 2024-09-21T10:56:26.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T10:56:30.011 INFO:tasks.cephadm:Removing cluster... 2024-09-21T10:56:30.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6621b92e-7804-11ef-baf6-efdc52797490 --force 2024-09-21T10:56:30.173 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:56:30.597 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6621b92e-7804-11ef-baf6-efdc52797490 --force 2024-09-21T10:56:30.739 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: 6621b92e-7804-11ef-baf6-efdc52797490 2024-09-21T10:56:31.038 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T10:56:31.038 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T10:56:31.055 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T10:56:31.070 INFO:tasks.cephadm:Teardown complete 2024-09-21T10:56:31.070 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T10:56:31.080 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T10:56:31.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T10:56:31.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T10:56:31.180 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T10:56:31.190 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T10:56:31.190 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T10:56:31.193 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T10:56:31.206 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-21T10:56:31.207 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-21T10:56:31.210 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T10:56:31.210 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-21T10:56:31.210 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -196us[ -192us] +/- 52ms 2024-09-21T10:56:31.210 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 +228us[ +232us] +/- 62ms 2024-09-21T10:56:31.211 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +16us[ +21us] +/- 63ms 2024-09-21T10:56:31.211 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:56:31.212 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T10:56:31.212 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-21T10:56:31.212 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 -196us[ -192us] +/- 52ms 2024-09-21T10:56:31.212 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 +244us[ +248us] +/- 62ms 2024-09-21T10:56:31.212 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -1642ns[-1642ns] +/- 63ms 2024-09-21T10:56:31.212 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T10:56:31.212 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T10:56:31.223 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T10:56:31.223 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T10:56:31.237 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T10:56:31.335 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T10:56:31.407 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T10:56:31.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:56:31.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T10:56:31.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:56:31.465 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T10:56:31.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T10:56:31.485 INFO:teuthology.task.internal:Duration was 1971.025406 seconds 2024-09-21T10:56:31.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T10:56:31.495 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T10:56:31.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T10:56:31.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T10:56:31.536 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T10:56:31.543 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T10:56:31.992 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T10:56:31.992 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T10:56:31.992 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T10:56:32.014 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-21T10:56:32.014 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T10:56:32.059 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T10:56:32.059 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T10:56:32.062 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T10:56:32.126 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T10:56:32.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T10:56:32.130 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T10:56:32.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T10:56:32.825 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T10:56:32.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T10:56:32.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T10:56:32.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T10:56:32.888 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T10:56:32.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T10:56:32.914 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-21T10:56:32.940 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-21T10:56:32.953 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T10:56:32.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:56:32.983 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T10:56:33.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T10:56:33.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T10:56:33.024 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T10:56:33.025 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803/remote/smithi060 2024-09-21T10:56:33.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T10:56:33.073 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913803/remote/smithi112 2024-09-21T10:56:33.073 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T10:56:33.110 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T10:56:33.110 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T10:56:33.113 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T10:56:33.159 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T10:56:33.171 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T10:56:33.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T10:56:33.225 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T10:56:33.225 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T10:56:33.227 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T10:56:33.240 INFO:teuthology.orchestra.run.smithi060.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 10:56 /home/ubuntu/cephtest 2024-09-21T10:56:33.242 INFO:teuthology.orchestra.run.smithi112.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 10:56 /home/ubuntu/cephtest 2024-09-21T10:56:33.243 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T10:56:33.255 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T10:56:33.281 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1971.0254063606262 flavor: default owner: scheduled_gabrioux@teuthology success: true 2024-09-21T10:56:33.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T10:56:33.366 INFO:teuthology.run:pass